Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure

Orbiter Check History

Showing 50 of 117413 reports (Page 1596 of 2349)
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)
antiblip:
1 out of 15 is failed (threshold=6) [............X..]
duration:
108.101937ms
remote:
"tcp:18.211.166.153:443"
response headers:
Date=Wed, 20 Aug 2025 16:45:37 GMT
Content-Type=text/html
Content-Length=164
X-Cluster-Name=us-east-1-prod-hosting-red
target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-20 16:46:40 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 108.182849ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
2 out of 60 is failed (threshold=3) [.....X..........X...........................................]
duration:
1.694720836s
FAIL (2025-08-20 16:46:10 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 20 16:12:54.720936118 (286h46m35.452203779s) [upload=298240]: Starting upload
Aug 20 16:12:54.721001581 (286h46m35.452269231s) [upload=298240]: Done starting upload
Aug 20 16:12:54.721062465 (286h46m35.452330126s) [upload=298240]: Uploading segments...
Aug 20 16:12:54.721102501 (286h46m35.452370151s) [upload=298240]: Got next segment. Inline: true
Aug 20 16:12:54.721107880 (286h46m35.452375531s) [upload=298240]: Waiting for error group managing segments...
Aug 20 16:12:54.721153737 (286h46m35.452421387s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 16:12:54.721159748 (286h46m35.452427398s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 20 16:12:54.721163615 (286h46m35.452431276s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 16:12:54.723615261 (286h46m35.454882912s) [upload=298240]: Done uploading segments...
Aug 20 16:12:54.723626853 (286h46m35.454894503s) [upload=298240]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.694744741s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)
antiblip:
1 out of 15 is failed (threshold=6) [.............X.]
duration:
115.340331ms
remote:
"tcp:18.211.166.153:443"
response headers:
Date=Wed, 20 Aug 2025 16:45:37 GMT
Content-Type=text/html
Content-Length=164
X-Cluster-Name=us-east-1-prod-hosting-red
target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-20 16:45:52 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 115.358515ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
2 out of 60 is failed (threshold=3) [......X..........X..........................................]
duration:
161.066707ms
FAIL (2025-08-20 16:45:48 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 20 16:12:54.720936118 (286h46m35.452203779s) [upload=298240]: Starting upload
Aug 20 16:12:54.721001581 (286h46m35.452269231s) [upload=298240]: Done starting upload
Aug 20 16:12:54.721062465 (286h46m35.452330126s) [upload=298240]: Uploading segments...
Aug 20 16:12:54.721102501 (286h46m35.452370151s) [upload=298240]: Got next segment. Inline: true
Aug 20 16:12:54.721107880 (286h46m35.452375531s) [upload=298240]: Waiting for error group managing segments...
Aug 20 16:12:54.721153737 (286h46m35.452421387s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 16:12:54.721159748 (286h46m35.452427398s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 20 16:12:54.721163615 (286h46m35.452431276s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 16:12:54.723615261 (286h46m35.454882912s) [upload=298240]: Done uploading segments...
Aug 20 16:12:54.723626853 (286h46m35.454894503s) [upload=298240]: Upload finished. err: metaclient: Too Many Requests
Duration: 161.083019ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip:
3 out of 15 is failed (threshold=6) [....XX.......X.]
duration:
82.863782ms
remote:
"tcp:18.211.166.153:443"
response headers:
Content-Length=164
X-Cluster-Name=us-east-1-prod-hosting-red
Date=Wed, 20 Aug 2025 16:44:58 GMT
Content-Type=text/html
target:
https://www.storj.io/
FAIL (2025-08-20 16:45:44 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 82.884842ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
2 out of 60 is failed (threshold=3) [....................................X....X..................]
duration:
1.236400823s
FAIL (2025-08-20 16:45:42 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 20 16:32:05.324046131 (287h5m46.055313751s) [upload=298561]: Starting upload
Aug 20 16:32:05.324087819 (287h5m46.055355449s) [upload=298561]: Done starting upload
Aug 20 16:32:05.324385969 (287h5m46.0556536s) [upload=298561]: Uploading segments...
Aug 20 16:32:05.324417028 (287h5m46.055684658s) [upload=298561]: Got next segment. Inline: false
Aug 20 16:32:05.324441945 (287h5m46.055709564s) [upload=298561]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 16:32:05.324445723 (287h5m46.055713343s) [upload=298561]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 16:32:05.327260850 (287h5m46.05852848s) [upload=298561]: Next segment err: metaclient: Too Many Requests
Aug 20 16:32:05.327271079 (287h5m46.058538709s) [upload=298561]: Done uploading segments...
Aug 20 16:32:05.327279075 (287h5m46.058546705s) [upload=298561]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.23643142s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)
antiblip:
1 out of 15 is failed (threshold=6) [..............X]
duration:
1.043412062s
remote:
"tcp:18.211.166.153:443"
response headers:
Date=Wed, 20 Aug 2025 16:45:37 GMT
Content-Type=text/html
Content-Length=164
X-Cluster-Name=us-east-1-prod-hosting-red
target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-20 16:45:37 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 1.043429214s core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
2 out of 60 is failed (threshold=3) [.....................................X....X.................]
duration:
875.961631ms
FAIL (2025-08-20 16:45:07 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 20 16:32:05.324046131 (287h5m46.055313751s) [upload=298561]: Starting upload
Aug 20 16:32:05.324087819 (287h5m46.055355449s) [upload=298561]: Done starting upload
Aug 20 16:32:05.324385969 (287h5m46.0556536s) [upload=298561]: Uploading segments...
Aug 20 16:32:05.324417028 (287h5m46.055684658s) [upload=298561]: Got next segment. Inline: false
Aug 20 16:32:05.324441945 (287h5m46.055709564s) [upload=298561]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 16:32:05.324445723 (287h5m46.055713343s) [upload=298561]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 16:32:05.327260850 (287h5m46.05852848s) [upload=298561]: Next segment err: metaclient: Too Many Requests
Aug 20 16:32:05.327271079 (287h5m46.058538709s) [upload=298561]: Done uploading segments...
Aug 20 16:32:05.327279075 (287h5m46.058546705s) [upload=298561]: Upload finished. err: metaclient: Too Many Requests
Duration: 875.977721ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip:
3 out of 15 is failed (threshold=6) [.....XX.......X]
duration:
3.04084299s
remote:
"tcp:18.211.166.153:443"
response headers:
Content-Length=164
X-Cluster-Name=us-east-1-prod-hosting-red
Date=Wed, 20 Aug 2025 16:44:58 GMT
Content-Type=text/html
target:
https://www.storj.io/
FAIL (2025-08-20 16:44:58 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 3.040863348s core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
3 out of 60 is failed (threshold=3) [X......X..........X.........................................]
duration:
476.241499ms
FAIL (2025-08-20 16:44:36 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 20 16:12:54.720936118 (286h46m35.452203779s) [upload=298240]: Starting upload
Aug 20 16:12:54.721001581 (286h46m35.452269231s) [upload=298240]: Done starting upload
Aug 20 16:12:54.721062465 (286h46m35.452330126s) [upload=298240]: Uploading segments...
Aug 20 16:12:54.721102501 (286h46m35.452370151s) [upload=298240]: Got next segment. Inline: true
Aug 20 16:12:54.721107880 (286h46m35.452375531s) [upload=298240]: Waiting for error group managing segments...
Aug 20 16:12:54.721153737 (286h46m35.452421387s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 16:12:54.721159748 (286h46m35.452427398s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 20 16:12:54.721163615 (286h46m35.452431276s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 16:12:54.723615261 (286h46m35.454882912s) [upload=298240]: Done uploading segments...
Aug 20 16:12:54.723626853 (286h46m35.454894503s) [upload=298240]: Upload finished. err: metaclient: Too Many Requests
Duration: 476.2692ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
2 out of 60 is failed (threshold=3) [......................................X....X................]
duration:
673.038245ms
FAIL (2025-08-20 16:44:26 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 20 16:32:05.324046131 (287h5m46.055313751s) [upload=298561]: Starting upload
Aug 20 16:32:05.324087819 (287h5m46.055355449s) [upload=298561]: Done starting upload
Aug 20 16:32:05.324385969 (287h5m46.0556536s) [upload=298561]: Uploading segments...
Aug 20 16:32:05.324417028 (287h5m46.055684658s) [upload=298561]: Got next segment. Inline: false
Aug 20 16:32:05.324441945 (287h5m46.055709564s) [upload=298561]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 16:32:05.324445723 (287h5m46.055713343s) [upload=298561]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 16:32:05.327260850 (287h5m46.05852848s) [upload=298561]: Next segment err: metaclient: Too Many Requests
Aug 20 16:32:05.327271079 (287h5m46.058538709s) [upload=298561]: Done uploading segments...
Aug 20 16:32:05.327279075 (287h5m46.058546705s) [upload=298561]: Upload finished. err: metaclient: Too Many Requests
Duration: 673.058153ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip:
2 out of 15 is failed (threshold=6) [......XX.......]
duration:
62.855902ms
remote:
"tcp:54.243.86.28:443"
response headers:
Content-Type=text/html
Content-Length=164
X-Cluster-Name=us-east-1-prod-hosting-red
Date=Wed, 20 Aug 2025 16:39:10 GMT
target:
https://www.storj.io/
FAIL (2025-08-20 16:44:20 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 62.882963ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
3 out of 60 is failed (threshold=3) [.X......X..........X........................................]
duration:
132.689194ms
FAIL (2025-08-20 16:43:33 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 20 16:12:54.720936118 (286h46m35.452203779s) [upload=298240]: Starting upload
Aug 20 16:12:54.721001581 (286h46m35.452269231s) [upload=298240]: Done starting upload
Aug 20 16:12:54.721062465 (286h46m35.452330126s) [upload=298240]: Uploading segments...
Aug 20 16:12:54.721102501 (286h46m35.452370151s) [upload=298240]: Got next segment. Inline: true
Aug 20 16:12:54.721107880 (286h46m35.452375531s) [upload=298240]: Waiting for error group managing segments...
Aug 20 16:12:54.721153737 (286h46m35.452421387s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 16:12:54.721159748 (286h46m35.452427398s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 20 16:12:54.721163615 (286h46m35.452431276s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 16:12:54.723615261 (286h46m35.454882912s) [upload=298240]: Done uploading segments...
Aug 20 16:12:54.723626853 (286h46m35.454894503s) [upload=298240]: Upload finished. err: metaclient: Too Many Requests
Duration: 132.707507ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip:
2 out of 15 is failed (threshold=6) [.......XX......]
duration:
249.299688ms
remote:
"tcp:54.243.86.28:443"
response headers:
Content-Type=text/html
Content-Length=164
X-Cluster-Name=us-east-1-prod-hosting-red
Date=Wed, 20 Aug 2025 16:39:10 GMT
target:
https://www.storj.io/
FAIL (2025-08-20 16:43:20 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 249.323021ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
2 out of 60 is failed (threshold=3) [.......................................X....X...............]
duration:
451.365344ms
FAIL (2025-08-20 16:43:14 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 20 16:32:05.324046131 (287h5m46.055313751s) [upload=298561]: Starting upload
Aug 20 16:32:05.324087819 (287h5m46.055355449s) [upload=298561]: Done starting upload
Aug 20 16:32:05.324385969 (287h5m46.0556536s) [upload=298561]: Uploading segments...
Aug 20 16:32:05.324417028 (287h5m46.055684658s) [upload=298561]: Got next segment. Inline: false
Aug 20 16:32:05.324441945 (287h5m46.055709564s) [upload=298561]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 16:32:05.324445723 (287h5m46.055713343s) [upload=298561]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 16:32:05.327260850 (287h5m46.05852848s) [upload=298561]: Next segment err: metaclient: Too Many Requests
Aug 20 16:32:05.327271079 (287h5m46.058538709s) [upload=298561]: Done uploading segments...
Aug 20 16:32:05.327279075 (287h5m46.058546705s) [upload=298561]: Upload finished. err: metaclient: Too Many Requests
Duration: 451.390903ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)
antiblip:
1 out of 15 is failed (threshold=6) [X..............]
duration:
105.053901ms
remote:
"tcp:18.211.166.153:443"
response headers:
X-Cluster-Name=us-east-1-prod-hosting-red
Date=Wed, 20 Aug 2025 16:32:35 GMT
Content-Type=text/html
Content-Length=164
target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-20 16:43:01 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 105.134272ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
3 out of 60 is failed (threshold=3) [..X......X..........X.......................................]
duration:
593.60064ms
FAIL (2025-08-20 16:42:44 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 20 16:12:54.720936118 (286h46m35.452203779s) [upload=298240]: Starting upload
Aug 20 16:12:54.721001581 (286h46m35.452269231s) [upload=298240]: Done starting upload
Aug 20 16:12:54.721062465 (286h46m35.452330126s) [upload=298240]: Uploading segments...
Aug 20 16:12:54.721102501 (286h46m35.452370151s) [upload=298240]: Got next segment. Inline: true
Aug 20 16:12:54.721107880 (286h46m35.452375531s) [upload=298240]: Waiting for error group managing segments...
Aug 20 16:12:54.721153737 (286h46m35.452421387s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 16:12:54.721159748 (286h46m35.452427398s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 20 16:12:54.721163615 (286h46m35.452431276s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 16:12:54.723615261 (286h46m35.454882912s) [upload=298240]: Done uploading segments...
Aug 20 16:12:54.723626853 (286h46m35.454894503s) [upload=298240]: Upload finished. err: metaclient: Too Many Requests
Duration: 593.622762ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
3 out of 60 is failed (threshold=3) [...X......X..........X......................................]
duration:
1.45707403s
FAIL (2025-08-20 16:42:25 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 20 16:12:54.720936118 (286h46m35.452203779s) [upload=298240]: Starting upload
Aug 20 16:12:54.721001581 (286h46m35.452269231s) [upload=298240]: Done starting upload
Aug 20 16:12:54.721062465 (286h46m35.452330126s) [upload=298240]: Uploading segments...
Aug 20 16:12:54.721102501 (286h46m35.452370151s) [upload=298240]: Got next segment. Inline: true
Aug 20 16:12:54.721107880 (286h46m35.452375531s) [upload=298240]: Waiting for error group managing segments...
Aug 20 16:12:54.721153737 (286h46m35.452421387s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 16:12:54.721159748 (286h46m35.452427398s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 20 16:12:54.721163615 (286h46m35.452431276s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 16:12:54.723615261 (286h46m35.454882912s) [upload=298240]: Done uploading segments...
Aug 20 16:12:54.723626853 (286h46m35.454894503s) [upload=298240]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.457096765s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
2 out of 60 is failed (threshold=3) [........................................X....X..............]
duration:
3.521430224s
FAIL (2025-08-20 16:42:17 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 20 16:32:05.324046131 (287h5m46.055313751s) [upload=298561]: Starting upload
Aug 20 16:32:05.324087819 (287h5m46.055355449s) [upload=298561]: Done starting upload
Aug 20 16:32:05.324385969 (287h5m46.0556536s) [upload=298561]: Uploading segments...
Aug 20 16:32:05.324417028 (287h5m46.055684658s) [upload=298561]: Got next segment. Inline: false
Aug 20 16:32:05.324441945 (287h5m46.055709564s) [upload=298561]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 16:32:05.324445723 (287h5m46.055713343s) [upload=298561]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 16:32:05.327260850 (287h5m46.05852848s) [upload=298561]: Next segment err: metaclient: Too Many Requests
Aug 20 16:32:05.327271079 (287h5m46.058538709s) [upload=298561]: Done uploading segments...
Aug 20 16:32:05.327279075 (287h5m46.058546705s) [upload=298561]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.521452356s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip:
3 out of 15 is failed (threshold=6) [X.......XX.....]
duration:
74.024863ms
remote:
"tcp:54.243.86.28:443"
response headers:
Content-Type=text/html
Content-Length=164
X-Cluster-Name=us-east-1-prod-hosting-red
Date=Wed, 20 Aug 2025 16:39:10 GMT
target:
https://www.storj.io/
FAIL (2025-08-20 16:42:05 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 74.054921ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)
antiblip:
2 out of 15 is failed (threshold=6) [XX.............]
duration:
136.322911ms
remote:
"tcp:18.211.166.153:443"
response headers:
X-Cluster-Name=us-east-1-prod-hosting-red
Date=Wed, 20 Aug 2025 16:32:35 GMT
Content-Type=text/html
Content-Length=164
target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-20 16:41:51 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 136.346195ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip:
3 out of 15 is failed (threshold=6) [.X.......XX....]
duration:
79.23305ms
remote:
"tcp:54.243.86.28:443"
response headers:
Content-Type=text/html
Content-Length=164
X-Cluster-Name=us-east-1-prod-hosting-red
Date=Wed, 20 Aug 2025 16:39:10 GMT
target:
https://www.storj.io/
FAIL (2025-08-20 16:41:49 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 79.256954ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
2 out of 60 is failed (threshold=3) [.........................................X....X.............]
duration:
1.456443417s
FAIL (2025-08-20 16:41:42 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 20 16:32:05.324046131 (287h5m46.055313751s) [upload=298561]: Starting upload
Aug 20 16:32:05.324087819 (287h5m46.055355449s) [upload=298561]: Done starting upload
Aug 20 16:32:05.324385969 (287h5m46.0556536s) [upload=298561]: Uploading segments...
Aug 20 16:32:05.324417028 (287h5m46.055684658s) [upload=298561]: Got next segment. Inline: false
Aug 20 16:32:05.324441945 (287h5m46.055709564s) [upload=298561]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 16:32:05.324445723 (287h5m46.055713343s) [upload=298561]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 16:32:05.327260850 (287h5m46.05852848s) [upload=298561]: Next segment err: metaclient: Too Many Requests
Aug 20 16:32:05.327271079 (287h5m46.058538709s) [upload=298561]: Done uploading segments...
Aug 20 16:32:05.327279075 (287h5m46.058546705s) [upload=298561]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.456469756s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)
antiblip:
2 out of 15 is failed (threshold=6) [.XX............]
duration:
65.226858ms
remote:
"tcp:18.211.166.153:443"
response headers:
X-Cluster-Name=us-east-1-prod-hosting-red
Date=Wed, 20 Aug 2025 16:32:35 GMT
Content-Type=text/html
Content-Length=164
target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-20 16:41:16 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 65.263217ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
3 out of 60 is failed (threshold=3) [....X......X..........X.....................................]
duration:
243.404495ms
FAIL (2025-08-20 16:41:10 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 20 16:12:54.720936118 (286h46m35.452203779s) [upload=298240]: Starting upload
Aug 20 16:12:54.721001581 (286h46m35.452269231s) [upload=298240]: Done starting upload
Aug 20 16:12:54.721062465 (286h46m35.452330126s) [upload=298240]: Uploading segments...
Aug 20 16:12:54.721102501 (286h46m35.452370151s) [upload=298240]: Got next segment. Inline: true
Aug 20 16:12:54.721107880 (286h46m35.452375531s) [upload=298240]: Waiting for error group managing segments...
Aug 20 16:12:54.721153737 (286h46m35.452421387s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 16:12:54.721159748 (286h46m35.452427398s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 20 16:12:54.721163615 (286h46m35.452431276s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 16:12:54.723615261 (286h46m35.454882912s) [upload=298240]: Done uploading segments...
Aug 20 16:12:54.723626853 (286h46m35.454894503s) [upload=298240]: Upload finished. err: metaclient: Too Many Requests
Duration: 243.429151ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip:
3 out of 15 is failed (threshold=6) [..X.......XX...]
duration:
65.869937ms
remote:
"tcp:54.243.86.28:443"
response headers:
Content-Type=text/html
Content-Length=164
X-Cluster-Name=us-east-1-prod-hosting-red
Date=Wed, 20 Aug 2025 16:39:10 GMT
target:
https://www.storj.io/
FAIL (2025-08-20 16:41:04 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 65.889704ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)
antiblip:
2 out of 15 is failed (threshold=6) [..XX...........]
duration:
76.718625ms
remote:
"tcp:18.211.166.153:443"
response headers:
X-Cluster-Name=us-east-1-prod-hosting-red
Date=Wed, 20 Aug 2025 16:32:35 GMT
Content-Type=text/html
Content-Length=164
target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-20 16:40:49 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 76.866894ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip:
3 out of 15 is failed (threshold=6) [...X.......XX..]
duration:
126.07915ms
remote:
"tcp:54.243.86.28:443"
response headers:
Content-Type=text/html
Content-Length=164
X-Cluster-Name=us-east-1-prod-hosting-red
Date=Wed, 20 Aug 2025 16:39:10 GMT
target:
https://www.storj.io/
FAIL (2025-08-20 16:40:35 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 126.098096ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
2 out of 60 is failed (threshold=3) [..........................................X....X............]
duration:
1.686087806s
FAIL (2025-08-20 16:40:31 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 20 16:32:05.324046131 (287h5m46.055313751s) [upload=298561]: Starting upload
Aug 20 16:32:05.324087819 (287h5m46.055355449s) [upload=298561]: Done starting upload
Aug 20 16:32:05.324385969 (287h5m46.0556536s) [upload=298561]: Uploading segments...
Aug 20 16:32:05.324417028 (287h5m46.055684658s) [upload=298561]: Got next segment. Inline: false
Aug 20 16:32:05.324441945 (287h5m46.055709564s) [upload=298561]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 16:32:05.324445723 (287h5m46.055713343s) [upload=298561]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 16:32:05.327260850 (287h5m46.05852848s) [upload=298561]: Next segment err: metaclient: Too Many Requests
Aug 20 16:32:05.327271079 (287h5m46.058538709s) [upload=298561]: Done uploading segments...
Aug 20 16:32:05.327279075 (287h5m46.058546705s) [upload=298561]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.68611066s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)
antiblip:
2 out of 15 is failed (threshold=6) [...XX..........]
duration:
94.84661ms
remote:
"tcp:18.211.166.153:443"
response headers:
X-Cluster-Name=us-east-1-prod-hosting-red
Date=Wed, 20 Aug 2025 16:32:35 GMT
Content-Type=text/html
Content-Length=164
target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-20 16:40:30 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 94.859895ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
3 out of 60 is failed (threshold=3) [.....X......X..........X....................................]
duration:
145.739491ms
FAIL (2025-08-20 16:40:13 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 20 16:12:54.720936118 (286h46m35.452203779s) [upload=298240]: Starting upload
Aug 20 16:12:54.721001581 (286h46m35.452269231s) [upload=298240]: Done starting upload
Aug 20 16:12:54.721062465 (286h46m35.452330126s) [upload=298240]: Uploading segments...
Aug 20 16:12:54.721102501 (286h46m35.452370151s) [upload=298240]: Got next segment. Inline: true
Aug 20 16:12:54.721107880 (286h46m35.452375531s) [upload=298240]: Waiting for error group managing segments...
Aug 20 16:12:54.721153737 (286h46m35.452421387s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 16:12:54.721159748 (286h46m35.452427398s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 20 16:12:54.721163615 (286h46m35.452431276s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 16:12:54.723615261 (286h46m35.454882912s) [upload=298240]: Done uploading segments...
Aug 20 16:12:54.723626853 (286h46m35.454894503s) [upload=298240]: Upload finished. err: metaclient: Too Many Requests
Duration: 145.762093ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
3 out of 60 is failed (threshold=3) [......X......X..........X...................................]
duration:
165.804553ms
FAIL (2025-08-20 16:39:52 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 20 16:12:54.720936118 (286h46m35.452203779s) [upload=298240]: Starting upload
Aug 20 16:12:54.721001581 (286h46m35.452269231s) [upload=298240]: Done starting upload
Aug 20 16:12:54.721062465 (286h46m35.452330126s) [upload=298240]: Uploading segments...
Aug 20 16:12:54.721102501 (286h46m35.452370151s) [upload=298240]: Got next segment. Inline: true
Aug 20 16:12:54.721107880 (286h46m35.452375531s) [upload=298240]: Waiting for error group managing segments...
Aug 20 16:12:54.721153737 (286h46m35.452421387s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 16:12:54.721159748 (286h46m35.452427398s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 20 16:12:54.721163615 (286h46m35.452431276s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 16:12:54.723615261 (286h46m35.454882912s) [upload=298240]: Done uploading segments...
Aug 20 16:12:54.723626853 (286h46m35.454894503s) [upload=298240]: Upload finished. err: metaclient: Too Many Requests
Duration: 165.829501ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)
antiblip:
2 out of 15 is failed (threshold=6) [....XX.........]
duration:
68.159006ms
remote:
"tcp:18.211.166.153:443"
response headers:
X-Cluster-Name=us-east-1-prod-hosting-red
Date=Wed, 20 Aug 2025 16:32:35 GMT
Content-Type=text/html
Content-Length=164
target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-20 16:39:36 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 68.175026ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip:
3 out of 15 is failed (threshold=6) [....X.......XX.]
duration:
62.733985ms
remote:
"tcp:54.243.86.28:443"
response headers:
Content-Type=text/html
Content-Length=164
X-Cluster-Name=us-east-1-prod-hosting-red
Date=Wed, 20 Aug 2025 16:39:10 GMT
target:
https://www.storj.io/
FAIL (2025-08-20 16:39:25 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 62.760695ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
2 out of 60 is failed (threshold=3) [...........................................X....X...........]
duration:
428.705031ms
FAIL (2025-08-20 16:39:24 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 20 16:32:05.324046131 (287h5m46.055313751s) [upload=298561]: Starting upload
Aug 20 16:32:05.324087819 (287h5m46.055355449s) [upload=298561]: Done starting upload
Aug 20 16:32:05.324385969 (287h5m46.0556536s) [upload=298561]: Uploading segments...
Aug 20 16:32:05.324417028 (287h5m46.055684658s) [upload=298561]: Got next segment. Inline: false
Aug 20 16:32:05.324441945 (287h5m46.055709564s) [upload=298561]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 16:32:05.324445723 (287h5m46.055713343s) [upload=298561]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 16:32:05.327260850 (287h5m46.05852848s) [upload=298561]: Next segment err: metaclient: Too Many Requests
Aug 20 16:32:05.327271079 (287h5m46.058538709s) [upload=298561]: Done uploading segments...
Aug 20 16:32:05.327279075 (287h5m46.058546705s) [upload=298561]: Upload finished. err: metaclient: Too Many Requests
Duration: 428.725901ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
3 out of 60 is failed (threshold=3) [.......X......X..........X..................................]
duration:
246.524426ms
FAIL (2025-08-20 16:39:23 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 20 16:12:54.720936118 (286h46m35.452203779s) [upload=298240]: Starting upload
Aug 20 16:12:54.721001581 (286h46m35.452269231s) [upload=298240]: Done starting upload
Aug 20 16:12:54.721062465 (286h46m35.452330126s) [upload=298240]: Uploading segments...
Aug 20 16:12:54.721102501 (286h46m35.452370151s) [upload=298240]: Got next segment. Inline: true
Aug 20 16:12:54.721107880 (286h46m35.452375531s) [upload=298240]: Waiting for error group managing segments...
Aug 20 16:12:54.721153737 (286h46m35.452421387s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 16:12:54.721159748 (286h46m35.452427398s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 20 16:12:54.721163615 (286h46m35.452431276s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 16:12:54.723615261 (286h46m35.454882912s) [upload=298240]: Done uploading segments...
Aug 20 16:12:54.723626853 (286h46m35.454894503s) [upload=298240]: Upload finished. err: metaclient: Too Many Requests
Duration: 246.54775ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip:
3 out of 15 is failed (threshold=6) [.....X.......XX]
duration:
1.014314321s
remote:
"tcp:54.243.86.28:443"
response headers:
Content-Type=text/html
Content-Length=164
X-Cluster-Name=us-east-1-prod-hosting-red
Date=Wed, 20 Aug 2025 16:39:10 GMT
target:
https://www.storj.io/
FAIL (2025-08-20 16:39:10 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 1.014331333s core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)
antiblip:
2 out of 15 is failed (threshold=6) [.....XX........]
duration:
58.755893ms
remote:
"tcp:18.211.166.153:443"
response headers:
X-Cluster-Name=us-east-1-prod-hosting-red
Date=Wed, 20 Aug 2025 16:32:35 GMT
Content-Type=text/html
Content-Length=164
target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-20 16:38:57 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 58.777163ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
2 out of 60 is failed (threshold=3) [............................................X....X..........]
duration:
1.67251477s
FAIL (2025-08-20 16:38:53 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 20 16:32:05.324046131 (287h5m46.055313751s) [upload=298561]: Starting upload
Aug 20 16:32:05.324087819 (287h5m46.055355449s) [upload=298561]: Done starting upload
Aug 20 16:32:05.324385969 (287h5m46.0556536s) [upload=298561]: Uploading segments...
Aug 20 16:32:05.324417028 (287h5m46.055684658s) [upload=298561]: Got next segment. Inline: false
Aug 20 16:32:05.324441945 (287h5m46.055709564s) [upload=298561]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 16:32:05.324445723 (287h5m46.055713343s) [upload=298561]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 16:32:05.327260850 (287h5m46.05852848s) [upload=298561]: Next segment err: metaclient: Too Many Requests
Aug 20 16:32:05.327271079 (287h5m46.058538709s) [upload=298561]: Done uploading segments...
Aug 20 16:32:05.327279075 (287h5m46.058546705s) [upload=298561]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.672540869s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip:
2 out of 15 is failed (threshold=6) [......X.......X]
duration:
1.038553433s
remote:
"tcp:54.243.86.28:443"
response headers:
Date=Wed, 20 Aug 2025 16:38:34 GMT
Content-Type=text/html
Content-Length=164
X-Cluster-Name=us-east-1-prod-hosting-red
target:
https://www.storj.io/
FAIL (2025-08-20 16:38:34 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 1.038570035s core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
3 out of 60 is failed (threshold=3) [........X......X..........X.................................]
duration:
183.602107ms
FAIL (2025-08-20 16:38:31 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 20 16:12:54.720936118 (286h46m35.452203779s) [upload=298240]: Starting upload
Aug 20 16:12:54.721001581 (286h46m35.452269231s) [upload=298240]: Done starting upload
Aug 20 16:12:54.721062465 (286h46m35.452330126s) [upload=298240]: Uploading segments...
Aug 20 16:12:54.721102501 (286h46m35.452370151s) [upload=298240]: Got next segment. Inline: true
Aug 20 16:12:54.721107880 (286h46m35.452375531s) [upload=298240]: Waiting for error group managing segments...
Aug 20 16:12:54.721153737 (286h46m35.452421387s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 16:12:54.721159748 (286h46m35.452427398s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 20 16:12:54.721163615 (286h46m35.452431276s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 16:12:54.723615261 (286h46m35.454882912s) [upload=298240]: Done uploading segments...
Aug 20 16:12:54.723626853 (286h46m35.454894503s) [upload=298240]: Upload finished. err: metaclient: Too Many Requests
Duration: 183.62575ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
2 out of 60 is failed (threshold=3) [.............................................X....X.........]
duration:
1.360815561s
FAIL (2025-08-20 16:38:27 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 20 16:32:05.324046131 (287h5m46.055313751s) [upload=298561]: Starting upload
Aug 20 16:32:05.324087819 (287h5m46.055355449s) [upload=298561]: Done starting upload
Aug 20 16:32:05.324385969 (287h5m46.0556536s) [upload=298561]: Uploading segments...
Aug 20 16:32:05.324417028 (287h5m46.055684658s) [upload=298561]: Got next segment. Inline: false
Aug 20 16:32:05.324441945 (287h5m46.055709564s) [upload=298561]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 16:32:05.324445723 (287h5m46.055713343s) [upload=298561]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 16:32:05.327260850 (287h5m46.05852848s) [upload=298561]: Next segment err: metaclient: Too Many Requests
Aug 20 16:32:05.327271079 (287h5m46.058538709s) [upload=298561]: Done uploading segments...
Aug 20 16:32:05.327279075 (287h5m46.058546705s) [upload=298561]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.360840057s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip:
1 out of 15 is failed (threshold=6) [.......X.......]
duration:
80.240943ms
remote:
"tcp:54.243.86.28:443"
response headers:
X-Cluster-Name=us-east-1-prod-hosting-red
Date=Wed, 20 Aug 2025 16:32:58 GMT
Content-Type=text/html
Content-Length=164
target:
https://www.storj.io/
FAIL (2025-08-20 16:37:52 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 80.257954ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)
antiblip:
2 out of 15 is failed (threshold=6) [......XX.......]
duration:
71.489733ms
remote:
"tcp:18.211.166.153:443"
response headers:
X-Cluster-Name=us-east-1-prod-hosting-red
Date=Wed, 20 Aug 2025 16:32:35 GMT
Content-Type=text/html
Content-Length=164
target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-20 16:37:48 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 71.510352ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip:
1 out of 15 is failed (threshold=6) [........X......]
duration:
1.083031966s
remote:
"tcp:54.243.86.28:443"
response headers:
X-Cluster-Name=us-east-1-prod-hosting-red
Date=Wed, 20 Aug 2025 16:32:58 GMT
Content-Type=text/html
Content-Length=164
target:
https://www.storj.io/
FAIL (2025-08-20 16:37:33 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 1.083052905s core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
3 out of 60 is failed (threshold=3) [.........X......X..........X................................]
duration:
446.59482ms
FAIL (2025-08-20 16:37:26 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 20 16:12:54.720936118 (286h46m35.452203779s) [upload=298240]: Starting upload
Aug 20 16:12:54.721001581 (286h46m35.452269231s) [upload=298240]: Done starting upload
Aug 20 16:12:54.721062465 (286h46m35.452330126s) [upload=298240]: Uploading segments...
Aug 20 16:12:54.721102501 (286h46m35.452370151s) [upload=298240]: Got next segment. Inline: true
Aug 20 16:12:54.721107880 (286h46m35.452375531s) [upload=298240]: Waiting for error group managing segments...
Aug 20 16:12:54.721153737 (286h46m35.452421387s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 16:12:54.721159748 (286h46m35.452427398s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 20 16:12:54.721163615 (286h46m35.452431276s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 16:12:54.723615261 (286h46m35.454882912s) [upload=298240]: Done uploading segments...
Aug 20 16:12:54.723626853 (286h46m35.454894503s) [upload=298240]: Upload finished. err: metaclient: Too Many Requests
Duration: 446.614406ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
2 out of 60 is failed (threshold=3) [..............................................X....X........]
duration:
762.728478ms
FAIL (2025-08-20 16:37:22 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 20 16:32:05.324046131 (287h5m46.055313751s) [upload=298561]: Starting upload
Aug 20 16:32:05.324087819 (287h5m46.055355449s) [upload=298561]: Done starting upload
Aug 20 16:32:05.324385969 (287h5m46.0556536s) [upload=298561]: Uploading segments...
Aug 20 16:32:05.324417028 (287h5m46.055684658s) [upload=298561]: Got next segment. Inline: false
Aug 20 16:32:05.324441945 (287h5m46.055709564s) [upload=298561]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 16:32:05.324445723 (287h5m46.055713343s) [upload=298561]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 16:32:05.327260850 (287h5m46.05852848s) [upload=298561]: Next segment err: metaclient: Too Many Requests
Aug 20 16:32:05.327271079 (287h5m46.058538709s) [upload=298561]: Done uploading segments...
Aug 20 16:32:05.327279075 (287h5m46.058546705s) [upload=298561]: Upload finished. err: metaclient: Too Many Requests
Duration: 762.749435ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip:
2 out of 15 is failed (threshold=6) [X........X.....]
duration:
72.090272ms
remote:
"tcp:54.243.86.28:443"
response headers:
X-Cluster-Name=us-east-1-prod-hosting-red
Date=Wed, 20 Aug 2025 16:32:58 GMT
Content-Type=text/html
Content-Length=164
target:
https://www.storj.io/
FAIL (2025-08-20 16:37:02 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 72.111671ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
2 out of 60 is failed (threshold=3) [...............................................X....X.......]
duration:
729.080279ms
FAIL (2025-08-20 16:37:01 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 20 16:32:05.324046131 (287h5m46.055313751s) [upload=298561]: Starting upload
Aug 20 16:32:05.324087819 (287h5m46.055355449s) [upload=298561]: Done starting upload
Aug 20 16:32:05.324385969 (287h5m46.0556536s) [upload=298561]: Uploading segments...
Aug 20 16:32:05.324417028 (287h5m46.055684658s) [upload=298561]: Got next segment. Inline: false
Aug 20 16:32:05.324441945 (287h5m46.055709564s) [upload=298561]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 16:32:05.324445723 (287h5m46.055713343s) [upload=298561]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 16:32:05.327260850 (287h5m46.05852848s) [upload=298561]: Next segment err: metaclient: Too Many Requests
Aug 20 16:32:05.327271079 (287h5m46.058538709s) [upload=298561]: Done uploading segments...
Aug 20 16:32:05.327279075 (287h5m46.058546705s) [upload=298561]: Upload finished. err: metaclient: Too Many Requests
Duration: 729.13437ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)
antiblip:
2 out of 15 is failed (threshold=6) [.......XX......]
duration:
1.17875421s
remote:
"tcp:18.211.166.153:443"
response headers:
X-Cluster-Name=us-east-1-prod-hosting-red
Date=Wed, 20 Aug 2025 16:32:35 GMT
Content-Type=text/html
Content-Length=164
target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-20 16:37:01 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 1.178768636s core website