Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure

Orbiter Check History

Showing 50 of 117413 reports (Page 1595 of 2349)
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip: 
2 out of 60 is failed (threshold=3) [.......................X....X...............................]
duration: 
7.266036283s
FAIL (2025-08-20 16:56:56 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 20 16:32:05.324046131 (287h5m46.055313751s) [upload=298561]: Starting upload
Aug 20 16:32:05.324087819 (287h5m46.055355449s) [upload=298561]: Done starting upload
Aug 20 16:32:05.324385969 (287h5m46.0556536s) [upload=298561]: Uploading segments...
Aug 20 16:32:05.324417028 (287h5m46.055684658s) [upload=298561]: Got next segment. Inline: false
Aug 20 16:32:05.324441945 (287h5m46.055709564s) [upload=298561]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 16:32:05.324445723 (287h5m46.055713343s) [upload=298561]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 16:32:05.327260850 (287h5m46.05852848s) [upload=298561]: Next segment err: metaclient: Too Many Requests
Aug 20 16:32:05.327271079 (287h5m46.058538709s) [upload=298561]: Done uploading segments...
Aug 20 16:32:05.327279075 (287h5m46.058546705s) [upload=298561]: Upload finished. err: metaclient: Too Many Requests
Duration: 7.266056812s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)
antiblip: 
1 out of 15 is failed (threshold=6) [.X.............]
duration: 
66.982715ms
remote: 
"tcp:18.211.166.153:443"
response headers: 
Date=Wed, 20 Aug 2025 16:45:37 GMT
Content-Type=text/html
Content-Length=164
X-Cluster-Name=us-east-1-prod-hosting-red
target: 
https://www.storj.io/dcs-satellites
FAIL (2025-08-20 16:56:44 UTC) 
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 67.021068ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip: 
2 out of 60 is failed (threshold=3) [........................X....X..............................]
duration: 
31.902473737s
FAIL (2025-08-20 16:56:43 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 20 16:32:05.324046131 (287h5m46.055313751s) [upload=298561]: Starting upload
Aug 20 16:32:05.324087819 (287h5m46.055355449s) [upload=298561]: Done starting upload
Aug 20 16:32:05.324385969 (287h5m46.0556536s) [upload=298561]: Uploading segments...
Aug 20 16:32:05.324417028 (287h5m46.055684658s) [upload=298561]: Got next segment. Inline: false
Aug 20 16:32:05.324441945 (287h5m46.055709564s) [upload=298561]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 16:32:05.324445723 (287h5m46.055713343s) [upload=298561]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 16:32:05.327260850 (287h5m46.05852848s) [upload=298561]: Next segment err: metaclient: Too Many Requests
Aug 20 16:32:05.327271079 (287h5m46.058538709s) [upload=298561]: Done uploading segments...
Aug 20 16:32:05.327279075 (287h5m46.058546705s) [upload=298561]: Upload finished. err: metaclient: Too Many Requests
Duration: 31.90249129s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip: 
1 out of 60 is failed (threshold=3) [..X.........................................................]
duration: 
19.928514298s
FAIL (2025-08-20 16:56:27 UTC) 
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 20 16:12:54.720936118 (286h46m35.452203779s) [upload=298240]: Starting upload
Aug 20 16:12:54.721001581 (286h46m35.452269231s) [upload=298240]: Done starting upload
Aug 20 16:12:54.721062465 (286h46m35.452330126s) [upload=298240]: Uploading segments...
Aug 20 16:12:54.721102501 (286h46m35.452370151s) [upload=298240]: Got next segment. Inline: true
Aug 20 16:12:54.721107880 (286h46m35.452375531s) [upload=298240]: Waiting for error group managing segments...
Aug 20 16:12:54.721153737 (286h46m35.452421387s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 16:12:54.721159748 (286h46m35.452427398s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 20 16:12:54.721163615 (286h46m35.452431276s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 16:12:54.723615261 (286h46m35.454882912s) [upload=298240]: Done uploading segments...
Aug 20 16:12:54.723626853 (286h46m35.454894503s) [upload=298240]: Upload finished. err: metaclient: Too Many Requests
Duration: 19.928536028s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip: 
1 out of 15 is failed (threshold=6) [.X.............]
duration: 
58.708329ms
remote: 
"tcp:18.211.166.153:443"
response headers: 
Content-Length=164
X-Cluster-Name=us-east-1-prod-hosting-red
Date=Wed, 20 Aug 2025 16:44:58 GMT
Content-Type=text/html
target: 
https://www.storj.io/
FAIL (2025-08-20 16:56:26 UTC) 
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 58.756781ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip: 
1 out of 60 is failed (threshold=3) [...X........................................................]
duration: 
29.028791488s
FAIL (2025-08-20 16:56:07 UTC) 
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 20 16:12:54.720936118 (286h46m35.452203779s) [upload=298240]: Starting upload
Aug 20 16:12:54.721001581 (286h46m35.452269231s) [upload=298240]: Done starting upload
Aug 20 16:12:54.721062465 (286h46m35.452330126s) [upload=298240]: Uploading segments...
Aug 20 16:12:54.721102501 (286h46m35.452370151s) [upload=298240]: Got next segment. Inline: true
Aug 20 16:12:54.721107880 (286h46m35.452375531s) [upload=298240]: Waiting for error group managing segments...
Aug 20 16:12:54.721153737 (286h46m35.452421387s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 16:12:54.721159748 (286h46m35.452427398s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 20 16:12:54.721163615 (286h46m35.452431276s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 16:12:54.723615261 (286h46m35.454882912s) [upload=298240]: Done uploading segments...
Aug 20 16:12:54.723626853 (286h46m35.454894503s) [upload=298240]: Upload finished. err: metaclient: Too Many Requests
Duration: 29.028817458s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)
antiblip: 
1 out of 15 is failed (threshold=6) [..X............]
duration: 
92.580288ms
remote: 
"tcp:18.211.166.153:443"
response headers: 
Date=Wed, 20 Aug 2025 16:45:37 GMT
Content-Type=text/html
Content-Length=164
X-Cluster-Name=us-east-1-prod-hosting-red
target: 
https://www.storj.io/dcs-satellites
FAIL (2025-08-20 16:55:48 UTC) 
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 92.607689ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip: 
2 out of 60 is failed (threshold=3) [.........................X....X.............................]
duration: 
9.578937815s
FAIL (2025-08-20 16:55:33 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 20 16:32:05.324046131 (287h5m46.055313751s) [upload=298561]: Starting upload
Aug 20 16:32:05.324087819 (287h5m46.055355449s) [upload=298561]: Done starting upload
Aug 20 16:32:05.324385969 (287h5m46.0556536s) [upload=298561]: Uploading segments...
Aug 20 16:32:05.324417028 (287h5m46.055684658s) [upload=298561]: Got next segment. Inline: false
Aug 20 16:32:05.324441945 (287h5m46.055709564s) [upload=298561]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 16:32:05.324445723 (287h5m46.055713343s) [upload=298561]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 16:32:05.327260850 (287h5m46.05852848s) [upload=298561]: Next segment err: metaclient: Too Many Requests
Aug 20 16:32:05.327271079 (287h5m46.058538709s) [upload=298561]: Done uploading segments...
Aug 20 16:32:05.327279075 (287h5m46.058546705s) [upload=298561]: Upload finished. err: metaclient: Too Many Requests
Duration: 9.578969484s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip: 
1 out of 15 is failed (threshold=6) [..X............]
duration: 
78.952323ms
remote: 
"tcp:18.211.166.153:443"
response headers: 
Content-Length=164
X-Cluster-Name=us-east-1-prod-hosting-red
Date=Wed, 20 Aug 2025 16:44:58 GMT
Content-Type=text/html
target: 
https://www.storj.io/
FAIL (2025-08-20 16:55:31 UTC) 
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 78.983261ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip: 
1 out of 60 is failed (threshold=3) [....X.......................................................]
duration: 
184.536983ms
FAIL (2025-08-20 16:54:41 UTC) 
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 20 16:12:54.720936118 (286h46m35.452203779s) [upload=298240]: Starting upload
Aug 20 16:12:54.721001581 (286h46m35.452269231s) [upload=298240]: Done starting upload
Aug 20 16:12:54.721062465 (286h46m35.452330126s) [upload=298240]: Uploading segments...
Aug 20 16:12:54.721102501 (286h46m35.452370151s) [upload=298240]: Got next segment. Inline: true
Aug 20 16:12:54.721107880 (286h46m35.452375531s) [upload=298240]: Waiting for error group managing segments...
Aug 20 16:12:54.721153737 (286h46m35.452421387s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 16:12:54.721159748 (286h46m35.452427398s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 20 16:12:54.721163615 (286h46m35.452431276s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 16:12:54.723615261 (286h46m35.454882912s) [upload=298240]: Done uploading segments...
Aug 20 16:12:54.723626853 (286h46m35.454894503s) [upload=298240]: Upload finished. err: metaclient: Too Many Requests
Duration: 184.566238ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip: 
1 out of 15 is failed (threshold=6) [...X...........]
duration: 
83.882432ms
remote: 
"tcp:18.211.166.153:443"
response headers: 
Content-Length=164
X-Cluster-Name=us-east-1-prod-hosting-red
Date=Wed, 20 Aug 2025 16:44:58 GMT
Content-Type=text/html
target: 
https://www.storj.io/
FAIL (2025-08-20 16:54:35 UTC) 
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 83.908773ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)
antiblip: 
1 out of 15 is failed (threshold=6) [...X...........]
duration: 
94.48313ms
remote: 
"tcp:18.211.166.153:443"
response headers: 
Date=Wed, 20 Aug 2025 16:45:37 GMT
Content-Type=text/html
Content-Length=164
X-Cluster-Name=us-east-1-prod-hosting-red
target: 
https://www.storj.io/dcs-satellites
FAIL (2025-08-20 16:54:34 UTC) 
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 94.502697ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip: 
2 out of 60 is failed (threshold=3) [..........................X....X............................]
duration: 
5.25050547s
FAIL (2025-08-20 16:54:21 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 20 16:32:05.324046131 (287h5m46.055313751s) [upload=298561]: Starting upload
Aug 20 16:32:05.324087819 (287h5m46.055355449s) [upload=298561]: Done starting upload
Aug 20 16:32:05.324385969 (287h5m46.0556536s) [upload=298561]: Uploading segments...
Aug 20 16:32:05.324417028 (287h5m46.055684658s) [upload=298561]: Got next segment. Inline: false
Aug 20 16:32:05.324441945 (287h5m46.055709564s) [upload=298561]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 16:32:05.324445723 (287h5m46.055713343s) [upload=298561]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 16:32:05.327260850 (287h5m46.05852848s) [upload=298561]: Next segment err: metaclient: Too Many Requests
Aug 20 16:32:05.327271079 (287h5m46.058538709s) [upload=298561]: Done uploading segments...
Aug 20 16:32:05.327279075 (287h5m46.058546705s) [upload=298561]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.250530016s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip: 
1 out of 60 is failed (threshold=3) [.....X......................................................]
duration: 
134.704578ms
FAIL (2025-08-20 16:53:50 UTC) 
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 20 16:12:54.720936118 (286h46m35.452203779s) [upload=298240]: Starting upload
Aug 20 16:12:54.721001581 (286h46m35.452269231s) [upload=298240]: Done starting upload
Aug 20 16:12:54.721062465 (286h46m35.452330126s) [upload=298240]: Uploading segments...
Aug 20 16:12:54.721102501 (286h46m35.452370151s) [upload=298240]: Got next segment. Inline: true
Aug 20 16:12:54.721107880 (286h46m35.452375531s) [upload=298240]: Waiting for error group managing segments...
Aug 20 16:12:54.721153737 (286h46m35.452421387s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 16:12:54.721159748 (286h46m35.452427398s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 20 16:12:54.721163615 (286h46m35.452431276s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 16:12:54.723615261 (286h46m35.454882912s) [upload=298240]: Done uploading segments...
Aug 20 16:12:54.723626853 (286h46m35.454894503s) [upload=298240]: Upload finished. err: metaclient: Too Many Requests
Duration: 134.734574ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)
antiblip: 
1 out of 15 is failed (threshold=6) [....X..........]
duration: 
63.315237ms
remote: 
"tcp:18.211.166.153:443"
response headers: 
Date=Wed, 20 Aug 2025 16:45:37 GMT
Content-Type=text/html
Content-Length=164
X-Cluster-Name=us-east-1-prod-hosting-red
target: 
https://www.storj.io/dcs-satellites
FAIL (2025-08-20 16:53:46 UTC) 
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 63.338941ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip: 
1 out of 15 is failed (threshold=6) [....X..........]
duration: 
688.559725ms
remote: 
"tcp:18.211.166.153:443"
response headers: 
Content-Length=164
X-Cluster-Name=us-east-1-prod-hosting-red
Date=Wed, 20 Aug 2025 16:44:58 GMT
Content-Type=text/html
target: 
https://www.storj.io/
FAIL (2025-08-20 16:53:26 UTC) 
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 688.582328ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip: 
1 out of 60 is failed (threshold=3) [......X.....................................................]
duration: 
407.983759ms
FAIL (2025-08-20 16:53:20 UTC) 
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 20 16:12:54.720936118 (286h46m35.452203779s) [upload=298240]: Starting upload
Aug 20 16:12:54.721001581 (286h46m35.452269231s) [upload=298240]: Done starting upload
Aug 20 16:12:54.721062465 (286h46m35.452330126s) [upload=298240]: Uploading segments...
Aug 20 16:12:54.721102501 (286h46m35.452370151s) [upload=298240]: Got next segment. Inline: true
Aug 20 16:12:54.721107880 (286h46m35.452375531s) [upload=298240]: Waiting for error group managing segments...
Aug 20 16:12:54.721153737 (286h46m35.452421387s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 16:12:54.721159748 (286h46m35.452427398s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 20 16:12:54.721163615 (286h46m35.452431276s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 16:12:54.723615261 (286h46m35.454882912s) [upload=298240]: Done uploading segments...
Aug 20 16:12:54.723626853 (286h46m35.454894503s) [upload=298240]: Upload finished. err: metaclient: Too Many Requests
Duration: 408.007664ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip: 
2 out of 60 is failed (threshold=3) [...........................X....X...........................]
duration: 
1.957110183s
FAIL (2025-08-20 16:53:17 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 20 16:32:05.324046131 (287h5m46.055313751s) [upload=298561]: Starting upload
Aug 20 16:32:05.324087819 (287h5m46.055355449s) [upload=298561]: Done starting upload
Aug 20 16:32:05.324385969 (287h5m46.0556536s) [upload=298561]: Uploading segments...
Aug 20 16:32:05.324417028 (287h5m46.055684658s) [upload=298561]: Got next segment. Inline: false
Aug 20 16:32:05.324441945 (287h5m46.055709564s) [upload=298561]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 16:32:05.324445723 (287h5m46.055713343s) [upload=298561]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 16:32:05.327260850 (287h5m46.05852848s) [upload=298561]: Next segment err: metaclient: Too Many Requests
Aug 20 16:32:05.327271079 (287h5m46.058538709s) [upload=298561]: Done uploading segments...
Aug 20 16:32:05.327279075 (287h5m46.058546705s) [upload=298561]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.957135952s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip: 
1 out of 60 is failed (threshold=3) [.......X....................................................]
duration: 
184.656708ms
FAIL (2025-08-20 16:53:02 UTC) 
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 20 16:12:54.720936118 (286h46m35.452203779s) [upload=298240]: Starting upload
Aug 20 16:12:54.721001581 (286h46m35.452269231s) [upload=298240]: Done starting upload
Aug 20 16:12:54.721062465 (286h46m35.452330126s) [upload=298240]: Uploading segments...
Aug 20 16:12:54.721102501 (286h46m35.452370151s) [upload=298240]: Got next segment. Inline: true
Aug 20 16:12:54.721107880 (286h46m35.452375531s) [upload=298240]: Waiting for error group managing segments...
Aug 20 16:12:54.721153737 (286h46m35.452421387s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 16:12:54.721159748 (286h46m35.452427398s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 20 16:12:54.721163615 (286h46m35.452431276s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 16:12:54.723615261 (286h46m35.454882912s) [upload=298240]: Done uploading segments...
Aug 20 16:12:54.723626853 (286h46m35.454894503s) [upload=298240]: Upload finished. err: metaclient: Too Many Requests
Duration: 184.675012ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)
antiblip: 
1 out of 15 is failed (threshold=6) [.....X.........]
duration: 
923.337991ms
remote: 
"tcp:18.211.166.153:443"
response headers: 
Date=Wed, 20 Aug 2025 16:45:37 GMT
Content-Type=text/html
Content-Length=164
X-Cluster-Name=us-east-1-prod-hosting-red
target: 
https://www.storj.io/dcs-satellites
FAIL (2025-08-20 16:52:58 UTC) 
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 923.362738ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)
antiblip: 
1 out of 15 is failed (threshold=6) [......X........]
duration: 
1.134372474s
remote: 
"tcp:18.211.166.153:443"
response headers: 
Date=Wed, 20 Aug 2025 16:45:37 GMT
Content-Type=text/html
Content-Length=164
X-Cluster-Name=us-east-1-prod-hosting-red
target: 
https://www.storj.io/dcs-satellites
FAIL (2025-08-20 16:52:41 UTC) 
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 1.134390119s core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip: 
1 out of 15 is failed (threshold=6) [.....X.........]
duration: 
74.918876ms
remote: 
"tcp:18.211.166.153:443"
response headers: 
Content-Length=164
X-Cluster-Name=us-east-1-prod-hosting-red
Date=Wed, 20 Aug 2025 16:44:58 GMT
Content-Type=text/html
target: 
https://www.storj.io/
FAIL (2025-08-20 16:52:15 UTC) 
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 74.941257ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip: 
1 out of 60 is failed (threshold=3) [........X...................................................]
duration: 
251.628703ms
FAIL (2025-08-20 16:52:07 UTC) 
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 20 16:12:54.720936118 (286h46m35.452203779s) [upload=298240]: Starting upload
Aug 20 16:12:54.721001581 (286h46m35.452269231s) [upload=298240]: Done starting upload
Aug 20 16:12:54.721062465 (286h46m35.452330126s) [upload=298240]: Uploading segments...
Aug 20 16:12:54.721102501 (286h46m35.452370151s) [upload=298240]: Got next segment. Inline: true
Aug 20 16:12:54.721107880 (286h46m35.452375531s) [upload=298240]: Waiting for error group managing segments...
Aug 20 16:12:54.721153737 (286h46m35.452421387s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 16:12:54.721159748 (286h46m35.452427398s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 20 16:12:54.721163615 (286h46m35.452431276s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 16:12:54.723615261 (286h46m35.454882912s) [upload=298240]: Done uploading segments...
Aug 20 16:12:54.723626853 (286h46m35.454894503s) [upload=298240]: Upload finished. err: metaclient: Too Many Requests
Duration: 251.682033ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip: 
2 out of 60 is failed (threshold=3) [............................X....X..........................]
duration: 
1.167949181s
FAIL (2025-08-20 16:52:02 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 20 16:32:05.324046131 (287h5m46.055313751s) [upload=298561]: Starting upload
Aug 20 16:32:05.324087819 (287h5m46.055355449s) [upload=298561]: Done starting upload
Aug 20 16:32:05.324385969 (287h5m46.0556536s) [upload=298561]: Uploading segments...
Aug 20 16:32:05.324417028 (287h5m46.055684658s) [upload=298561]: Got next segment. Inline: false
Aug 20 16:32:05.324441945 (287h5m46.055709564s) [upload=298561]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 16:32:05.324445723 (287h5m46.055713343s) [upload=298561]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 16:32:05.327260850 (287h5m46.05852848s) [upload=298561]: Next segment err: metaclient: Too Many Requests
Aug 20 16:32:05.327271079 (287h5m46.058538709s) [upload=298561]: Done uploading segments...
Aug 20 16:32:05.327279075 (287h5m46.058546705s) [upload=298561]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.167966834s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip: 
1 out of 60 is failed (threshold=3) [.........X..................................................]
duration: 
1.383956408s
FAIL (2025-08-20 16:51:49 UTC) 
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 20 16:12:54.720936118 (286h46m35.452203779s) [upload=298240]: Starting upload
Aug 20 16:12:54.721001581 (286h46m35.452269231s) [upload=298240]: Done starting upload
Aug 20 16:12:54.721062465 (286h46m35.452330126s) [upload=298240]: Uploading segments...
Aug 20 16:12:54.721102501 (286h46m35.452370151s) [upload=298240]: Got next segment. Inline: true
Aug 20 16:12:54.721107880 (286h46m35.452375531s) [upload=298240]: Waiting for error group managing segments...
Aug 20 16:12:54.721153737 (286h46m35.452421387s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 16:12:54.721159748 (286h46m35.452427398s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 20 16:12:54.721163615 (286h46m35.452431276s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 16:12:54.723615261 (286h46m35.454882912s) [upload=298240]: Done uploading segments...
Aug 20 16:12:54.723626853 (286h46m35.454894503s) [upload=298240]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.383985233s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip: 
1 out of 15 is failed (threshold=6) [......X........]
duration: 
269.532469ms
remote: 
"tcp:18.211.166.153:443"
response headers: 
Content-Length=164
X-Cluster-Name=us-east-1-prod-hosting-red
Date=Wed, 20 Aug 2025 16:44:58 GMT
Content-Type=text/html
target: 
https://www.storj.io/
FAIL (2025-08-20 16:51:44 UTC) 
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 269.554851ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)
antiblip: 
1 out of 15 is failed (threshold=6) [.......X.......]
duration: 
78.436673ms
remote: 
"tcp:18.211.166.153:443"
response headers: 
Date=Wed, 20 Aug 2025 16:45:37 GMT
Content-Type=text/html
Content-Length=164
X-Cluster-Name=us-east-1-prod-hosting-red
target: 
https://www.storj.io/dcs-satellites
FAIL (2025-08-20 16:51:30 UTC) 
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 78.470527ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)
antiblip: 
1 out of 15 is failed (threshold=6) [........X......]
duration: 
888.912944ms
remote: 
"tcp:18.211.166.153:443"
response headers: 
Date=Wed, 20 Aug 2025 16:45:37 GMT
Content-Type=text/html
Content-Length=164
X-Cluster-Name=us-east-1-prod-hosting-red
target: 
https://www.storj.io/dcs-satellites
FAIL (2025-08-20 16:51:16 UTC) 
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 888.935136ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip: 
1 out of 60 is failed (threshold=3) [..........X.................................................]
duration: 
158.805617ms
FAIL (2025-08-20 16:50:51 UTC) 
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 20 16:12:54.720936118 (286h46m35.452203779s) [upload=298240]: Starting upload
Aug 20 16:12:54.721001581 (286h46m35.452269231s) [upload=298240]: Done starting upload
Aug 20 16:12:54.721062465 (286h46m35.452330126s) [upload=298240]: Uploading segments...
Aug 20 16:12:54.721102501 (286h46m35.452370151s) [upload=298240]: Got next segment. Inline: true
Aug 20 16:12:54.721107880 (286h46m35.452375531s) [upload=298240]: Waiting for error group managing segments...
Aug 20 16:12:54.721153737 (286h46m35.452421387s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 16:12:54.721159748 (286h46m35.452427398s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 20 16:12:54.721163615 (286h46m35.452431276s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 16:12:54.723615261 (286h46m35.454882912s) [upload=298240]: Done uploading segments...
Aug 20 16:12:54.723626853 (286h46m35.454894503s) [upload=298240]: Upload finished. err: metaclient: Too Many Requests
Duration: 158.835855ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip: 
2 out of 60 is failed (threshold=3) [.............................X....X.........................]
duration: 
1.46502669s
FAIL (2025-08-20 16:50:50 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 20 16:32:05.324046131 (287h5m46.055313751s) [upload=298561]: Starting upload
Aug 20 16:32:05.324087819 (287h5m46.055355449s) [upload=298561]: Done starting upload
Aug 20 16:32:05.324385969 (287h5m46.0556536s) [upload=298561]: Uploading segments...
Aug 20 16:32:05.324417028 (287h5m46.055684658s) [upload=298561]: Got next segment. Inline: false
Aug 20 16:32:05.324441945 (287h5m46.055709564s) [upload=298561]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 16:32:05.324445723 (287h5m46.055713343s) [upload=298561]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 16:32:05.327260850 (287h5m46.05852848s) [upload=298561]: Next segment err: metaclient: Too Many Requests
Aug 20 16:32:05.327271079 (287h5m46.058538709s) [upload=298561]: Done uploading segments...
Aug 20 16:32:05.327279075 (287h5m46.058546705s) [upload=298561]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.465051366s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip: 
1 out of 15 is failed (threshold=6) [.......X.......]
duration: 
193.974183ms
remote: 
"tcp:18.211.166.153:443"
response headers: 
Content-Length=164
X-Cluster-Name=us-east-1-prod-hosting-red
Date=Wed, 20 Aug 2025 16:44:58 GMT
Content-Type=text/html
target: 
https://www.storj.io/
FAIL (2025-08-20 16:50:43 UTC) 
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 193.999932ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip: 
2 out of 60 is failed (threshold=3) [..............................X....X........................]
duration: 
1.51003497s
FAIL (2025-08-20 16:50:32 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 20 16:32:05.324046131 (287h5m46.055313751s) [upload=298561]: Starting upload
Aug 20 16:32:05.324087819 (287h5m46.055355449s) [upload=298561]: Done starting upload
Aug 20 16:32:05.324385969 (287h5m46.0556536s) [upload=298561]: Uploading segments...
Aug 20 16:32:05.324417028 (287h5m46.055684658s) [upload=298561]: Got next segment. Inline: false
Aug 20 16:32:05.324441945 (287h5m46.055709564s) [upload=298561]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 16:32:05.324445723 (287h5m46.055713343s) [upload=298561]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 16:32:05.327260850 (287h5m46.05852848s) [upload=298561]: Next segment err: metaclient: Too Many Requests
Aug 20 16:32:05.327271079 (287h5m46.058538709s) [upload=298561]: Done uploading segments...
Aug 20 16:32:05.327279075 (287h5m46.058546705s) [upload=298561]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.510058113s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip: 
2 out of 15 is failed (threshold=6) [X.......X......]
duration: 
74.565212ms
remote: 
"tcp:18.211.166.153:443"
response headers: 
Content-Length=164
X-Cluster-Name=us-east-1-prod-hosting-red
Date=Wed, 20 Aug 2025 16:44:58 GMT
Content-Type=text/html
target: 
https://www.storj.io/
FAIL (2025-08-20 16:50:24 UTC) 
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 74.586462ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip: 
2 out of 60 is failed (threshold=3) [...............................X....X.......................]
duration: 
2.438140351s
FAIL (2025-08-20 16:50:11 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 20 16:32:05.324046131 (287h5m46.055313751s) [upload=298561]: Starting upload
Aug 20 16:32:05.324087819 (287h5m46.055355449s) [upload=298561]: Done starting upload
Aug 20 16:32:05.324385969 (287h5m46.0556536s) [upload=298561]: Uploading segments...
Aug 20 16:32:05.324417028 (287h5m46.055684658s) [upload=298561]: Got next segment. Inline: false
Aug 20 16:32:05.324441945 (287h5m46.055709564s) [upload=298561]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 16:32:05.324445723 (287h5m46.055713343s) [upload=298561]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 16:32:05.327260850 (287h5m46.05852848s) [upload=298561]: Next segment err: metaclient: Too Many Requests
Aug 20 16:32:05.327271079 (287h5m46.058538709s) [upload=298561]: Done uploading segments...
Aug 20 16:32:05.327279075 (287h5m46.058546705s) [upload=298561]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.438161841s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip: 
2 out of 60 is failed (threshold=3) [X..........X................................................]
duration: 
376.855627ms
FAIL (2025-08-20 16:50:10 UTC) 
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 20 16:12:54.720936118 (286h46m35.452203779s) [upload=298240]: Starting upload
Aug 20 16:12:54.721001581 (286h46m35.452269231s) [upload=298240]: Done starting upload
Aug 20 16:12:54.721062465 (286h46m35.452330126s) [upload=298240]: Uploading segments...
Aug 20 16:12:54.721102501 (286h46m35.452370151s) [upload=298240]: Got next segment. Inline: true
Aug 20 16:12:54.721107880 (286h46m35.452375531s) [upload=298240]: Waiting for error group managing segments...
Aug 20 16:12:54.721153737 (286h46m35.452421387s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 16:12:54.721159748 (286h46m35.452427398s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 20 16:12:54.721163615 (286h46m35.452431276s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 16:12:54.723615261 (286h46m35.454882912s) [upload=298240]: Done uploading segments...
Aug 20 16:12:54.723626853 (286h46m35.454894503s) [upload=298240]: Upload finished. err: metaclient: Too Many Requests
Duration: 376.871226ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)
antiblip: 
1 out of 15 is failed (threshold=6) [.........X.....]
duration: 
98.279095ms
remote: 
"tcp:18.211.166.153:443"
response headers: 
Date=Wed, 20 Aug 2025 16:45:37 GMT
Content-Type=text/html
Content-Length=164
X-Cluster-Name=us-east-1-prod-hosting-red
target: 
https://www.storj.io/dcs-satellites
FAIL (2025-08-20 16:50:09 UTC) 
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 98.391947ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip: 
3 out of 15 is failed (threshold=6) [XX.......X.....]
duration: 
80.655302ms
remote: 
"tcp:18.211.166.153:443"
response headers: 
Content-Length=164
X-Cluster-Name=us-east-1-prod-hosting-red
Date=Wed, 20 Aug 2025 16:44:58 GMT
Content-Type=text/html
target: 
https://www.storj.io/
FAIL (2025-08-20 16:49:36 UTC) 
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 80.671222ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip: 
2 out of 60 is failed (threshold=3) [................................X....X......................]
duration: 
6.660143409s
FAIL (2025-08-20 16:49:26 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 20 16:32:05.324046131 (287h5m46.055313751s) [upload=298561]: Starting upload
Aug 20 16:32:05.324087819 (287h5m46.055355449s) [upload=298561]: Done starting upload
Aug 20 16:32:05.324385969 (287h5m46.0556536s) [upload=298561]: Uploading segments...
Aug 20 16:32:05.324417028 (287h5m46.055684658s) [upload=298561]: Got next segment. Inline: false
Aug 20 16:32:05.324441945 (287h5m46.055709564s) [upload=298561]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 16:32:05.324445723 (287h5m46.055713343s) [upload=298561]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 16:32:05.327260850 (287h5m46.05852848s) [upload=298561]: Next segment err: metaclient: Too Many Requests
Aug 20 16:32:05.327271079 (287h5m46.058538709s) [upload=298561]: Done uploading segments...
Aug 20 16:32:05.327279075 (287h5m46.058546705s) [upload=298561]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.660169507s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip: 
2 out of 60 is failed (threshold=3) [.X..........X...............................................]
duration: 
182.508912ms
FAIL (2025-08-20 16:49:17 UTC) 
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 20 16:12:54.720936118 (286h46m35.452203779s) [upload=298240]: Starting upload
Aug 20 16:12:54.721001581 (286h46m35.452269231s) [upload=298240]: Done starting upload
Aug 20 16:12:54.721062465 (286h46m35.452330126s) [upload=298240]: Uploading segments...
Aug 20 16:12:54.721102501 (286h46m35.452370151s) [upload=298240]: Got next segment. Inline: true
Aug 20 16:12:54.721107880 (286h46m35.452375531s) [upload=298240]: Waiting for error group managing segments...
Aug 20 16:12:54.721153737 (286h46m35.452421387s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 16:12:54.721159748 (286h46m35.452427398s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 20 16:12:54.721163615 (286h46m35.452431276s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 16:12:54.723615261 (286h46m35.454882912s) [upload=298240]: Done uploading segments...
Aug 20 16:12:54.723626853 (286h46m35.454894503s) [upload=298240]: Upload finished. err: metaclient: Too Many Requests
Duration: 182.529883ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)
antiblip: 
1 out of 15 is failed (threshold=6) [..........X....]
duration: 
90.885153ms
remote: 
"tcp:18.211.166.153:443"
response headers: 
Date=Wed, 20 Aug 2025 16:45:37 GMT
Content-Type=text/html
Content-Length=164
X-Cluster-Name=us-east-1-prod-hosting-red
target: 
https://www.storj.io/dcs-satellites
FAIL (2025-08-20 16:48:56 UTC) 
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 90.920479ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip: 
2 out of 60 is failed (threshold=3) [.................................X....X.....................]
duration: 
664.719575ms
FAIL (2025-08-20 16:48:47 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 20 16:32:05.324046131 (287h5m46.055313751s) [upload=298561]: Starting upload
Aug 20 16:32:05.324087819 (287h5m46.055355449s) [upload=298561]: Done starting upload
Aug 20 16:32:05.324385969 (287h5m46.0556536s) [upload=298561]: Uploading segments...
Aug 20 16:32:05.324417028 (287h5m46.055684658s) [upload=298561]: Got next segment. Inline: false
Aug 20 16:32:05.324441945 (287h5m46.055709564s) [upload=298561]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 16:32:05.324445723 (287h5m46.055713343s) [upload=298561]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 16:32:05.327260850 (287h5m46.05852848s) [upload=298561]: Next segment err: metaclient: Too Many Requests
Aug 20 16:32:05.327271079 (287h5m46.058538709s) [upload=298561]: Done uploading segments...
Aug 20 16:32:05.327279075 (287h5m46.058546705s) [upload=298561]: Upload finished. err: metaclient: Too Many Requests
Duration: 664.751485ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip: 
3 out of 15 is failed (threshold=6) [.XX.......X....]
duration: 
76.590535ms
remote: 
"tcp:18.211.166.153:443"
response headers: 
Content-Length=164
X-Cluster-Name=us-east-1-prod-hosting-red
Date=Wed, 20 Aug 2025 16:44:58 GMT
Content-Type=text/html
target: 
https://www.storj.io/
FAIL (2025-08-20 16:48:47 UTC) 
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 76.610854ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip: 
2 out of 60 is failed (threshold=3) [..X..........X..............................................]
duration: 
158.304106ms
FAIL (2025-08-20 16:48:23 UTC) 
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 20 16:12:54.720936118 (286h46m35.452203779s) [upload=298240]: Starting upload
Aug 20 16:12:54.721001581 (286h46m35.452269231s) [upload=298240]: Done starting upload
Aug 20 16:12:54.721062465 (286h46m35.452330126s) [upload=298240]: Uploading segments...
Aug 20 16:12:54.721102501 (286h46m35.452370151s) [upload=298240]: Got next segment. Inline: true
Aug 20 16:12:54.721107880 (286h46m35.452375531s) [upload=298240]: Waiting for error group managing segments...
Aug 20 16:12:54.721153737 (286h46m35.452421387s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 16:12:54.721159748 (286h46m35.452427398s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 20 16:12:54.721163615 (286h46m35.452431276s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 16:12:54.723615261 (286h46m35.454882912s) [upload=298240]: Done uploading segments...
Aug 20 16:12:54.723626853 (286h46m35.454894503s) [upload=298240]: Upload finished. err: metaclient: Too Many Requests
Duration: 158.326206ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip: 
3 out of 15 is failed (threshold=6) [..XX.......X...]
duration: 
129.845602ms
remote: 
"tcp:18.211.166.153:443"
response headers: 
Content-Length=164
X-Cluster-Name=us-east-1-prod-hosting-red
Date=Wed, 20 Aug 2025 16:44:58 GMT
Content-Type=text/html
target: 
https://www.storj.io/
FAIL (2025-08-20 16:47:54 UTC) 
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 129.859748ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)
antiblip: 
1 out of 15 is failed (threshold=6) [...........X...]
duration: 
93.195083ms
remote: 
"tcp:18.211.166.153:443"
response headers: 
Date=Wed, 20 Aug 2025 16:45:37 GMT
Content-Type=text/html
Content-Length=164
X-Cluster-Name=us-east-1-prod-hosting-red
target: 
https://www.storj.io/dcs-satellites
FAIL (2025-08-20 16:47:48 UTC) 
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 93.217194ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip: 
2 out of 60 is failed (threshold=3) [...X..........X.............................................]
duration: 
152.045669ms
FAIL (2025-08-20 16:47:46 UTC) 
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 20 16:12:54.720936118 (286h46m35.452203779s) [upload=298240]: Starting upload
Aug 20 16:12:54.721001581 (286h46m35.452269231s) [upload=298240]: Done starting upload
Aug 20 16:12:54.721062465 (286h46m35.452330126s) [upload=298240]: Uploading segments...
Aug 20 16:12:54.721102501 (286h46m35.452370151s) [upload=298240]: Got next segment. Inline: true
Aug 20 16:12:54.721107880 (286h46m35.452375531s) [upload=298240]: Waiting for error group managing segments...
Aug 20 16:12:54.721153737 (286h46m35.452421387s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 16:12:54.721159748 (286h46m35.452427398s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 20 16:12:54.721163615 (286h46m35.452431276s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 16:12:54.723615261 (286h46m35.454882912s) [upload=298240]: Done uploading segments...
Aug 20 16:12:54.723626853 (286h46m35.454894503s) [upload=298240]: Upload finished. err: metaclient: Too Many Requests
Duration: 152.068142ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip: 
2 out of 60 is failed (threshold=3) [..................................X....X....................]
duration: 
482.858832ms
FAIL (2025-08-20 16:47:33 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 20 16:32:05.324046131 (287h5m46.055313751s) [upload=298561]: Starting upload
Aug 20 16:32:05.324087819 (287h5m46.055355449s) [upload=298561]: Done starting upload
Aug 20 16:32:05.324385969 (287h5m46.0556536s) [upload=298561]: Uploading segments...
Aug 20 16:32:05.324417028 (287h5m46.055684658s) [upload=298561]: Got next segment. Inline: false
Aug 20 16:32:05.324441945 (287h5m46.055709564s) [upload=298561]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 16:32:05.324445723 (287h5m46.055713343s) [upload=298561]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 16:32:05.327260850 (287h5m46.05852848s) [upload=298561]: Next segment err: metaclient: Too Many Requests
Aug 20 16:32:05.327271079 (287h5m46.058538709s) [upload=298561]: Done uploading segments...
Aug 20 16:32:05.327279075 (287h5m46.058546705s) [upload=298561]: Upload finished. err: metaclient: Too Many Requests
Duration: 482.885562ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip: 
2 out of 60 is failed (threshold=3) [....X..........X............................................]
duration: 
170.112744ms
FAIL (2025-08-20 16:47:13 UTC) 
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 20 16:12:54.720936118 (286h46m35.452203779s) [upload=298240]: Starting upload
Aug 20 16:12:54.721001581 (286h46m35.452269231s) [upload=298240]: Done starting upload
Aug 20 16:12:54.721062465 (286h46m35.452330126s) [upload=298240]: Uploading segments...
Aug 20 16:12:54.721102501 (286h46m35.452370151s) [upload=298240]: Got next segment. Inline: true
Aug 20 16:12:54.721107880 (286h46m35.452375531s) [upload=298240]: Waiting for error group managing segments...
Aug 20 16:12:54.721153737 (286h46m35.452421387s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 16:12:54.721159748 (286h46m35.452427398s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 20 16:12:54.721163615 (286h46m35.452431276s) [upload=298240]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 16:12:54.723615261 (286h46m35.454882912s) [upload=298240]: Done uploading segments...
Aug 20 16:12:54.723626853 (286h46m35.454894503s) [upload=298240]: Upload finished. err: metaclient: Too Many Requests
Duration: 170.134445ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip: 
2 out of 60 is failed (threshold=3) [...................................X....X...................]
duration: 
2.427531336s
FAIL (2025-08-20 16:46:51 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 20 16:32:05.324046131 (287h5m46.055313751s) [upload=298561]: Starting upload
Aug 20 16:32:05.324087819 (287h5m46.055355449s) [upload=298561]: Done starting upload
Aug 20 16:32:05.324385969 (287h5m46.0556536s) [upload=298561]: Uploading segments...
Aug 20 16:32:05.324417028 (287h5m46.055684658s) [upload=298561]: Got next segment. Inline: false
Aug 20 16:32:05.324441945 (287h5m46.055709564s) [upload=298561]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 16:32:05.324445723 (287h5m46.055713343s) [upload=298561]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 16:32:05.327260850 (287h5m46.05852848s) [upload=298561]: Next segment err: metaclient: Too Many Requests
Aug 20 16:32:05.327271079 (287h5m46.058538709s) [upload=298561]: Done uploading segments...
Aug 20 16:32:05.327279075 (287h5m46.058546705s) [upload=298561]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.427558276s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip: 
3 out of 15 is failed (threshold=6) [...XX.......X..]
duration: 
174.962896ms
remote: 
"tcp:18.211.166.153:443"
response headers: 
Content-Length=164
X-Cluster-Name=us-east-1-prod-hosting-red
Date=Wed, 20 Aug 2025 16:44:58 GMT
Content-Type=text/html
target: 
https://www.storj.io/
FAIL (2025-08-20 16:46:50 UTC) 
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 175.039029ms core website