Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure

Orbiter Check History

Showing 50 of 117669 reports (Page 1539 of 2354)
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [........................................X...................]
duration: 
508.237127ms
FAIL (2025-08-21 17:47:36 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 21 17:33:59.350385001 (312h7m40.081652621s) [upload=324499]: Starting upload
Aug 21 17:33:59.350415309 (312h7m40.08168294s) [upload=324499]: Done starting upload
Aug 21 17:33:59.350640743 (312h7m40.081908373s) [upload=324499]: Uploading segments...
Aug 21 17:33:59.351323566 (312h7m40.082591187s) [upload=324499]: Got next segment. Inline: false
Aug 21 17:33:59.351374332 (312h7m40.082641952s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 17:33:59.351378549 (312h7m40.08264617s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 17:33:59.354517922 (312h7m40.085785582s) [upload=324499]: Next segment err: metaclient: Too Many Requests
Aug 21 17:33:59.354532639 (312h7m40.085800269s) [upload=324499]: Done uploading segments...
Aug 21 17:33:59.354542808 (312h7m40.085810438s) [upload=324499]: Upload finished. err: metaclient: Too Many Requests
Duration: 508.255853ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip: 
2 out of 60 is failed (threshold=3) [...............................X.........................X..]
duration: 
173.385459ms
FAIL (2025-08-21 17:47:23 UTC) 
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 21 17:45:26.360745871 (312h19m7.092013491s) [upload=324704]: Starting upload
Aug 21 17:45:26.360824949 (312h19m7.092092579s) [upload=324704]: Done starting upload
Aug 21 17:45:26.360871646 (312h19m7.092139277s) [upload=324704]: Uploading segments...
Aug 21 17:45:26.360901273 (312h19m7.092168892s) [upload=324704]: Got next segment. Inline: true
Aug 21 17:45:26.360904679 (312h19m7.092172309s) [upload=324704]: Waiting for error group managing segments...
Aug 21 17:45:26.360957487 (312h19m7.092225118s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 17:45:26.360961525 (312h19m7.092229155s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 21 17:45:26.360963790 (312h19m7.092231409s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 17:45:26.363758492 (312h19m7.095026112s) [upload=324704]: Done uploading segments...
Aug 21 17:45:26.363766668 (312h19m7.095034299s) [upload=324704]: Upload finished. err: metaclient: Too Many Requests
Duration: 173.408553ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)
antiblip: 
4 out of 15 is failed (threshold=6) [...X...X..X.X..]
duration: 
134.37813ms
remote: 
"tcp:54.243.86.28:443"
response headers: 
X-Cluster-Name=us-east-1-prod-hosting-red
Date=Thu, 21 Aug 2025 17:46:23 GMT
Content-Type=text/html
Content-Length=164
target: 
https://www.storj.io/dcs-satellites
FAIL (2025-08-21 17:47:20 UTC) 
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 134.419458ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip: 
6 out of 15 is failed (threshold=6) [..X...X..XX.XX.]
duration: 
76.756041ms
remote: 
"tcp:18.211.166.153:443"
response headers: 
Date=Thu, 21 Aug 2025 17:46:20 GMT
Content-Type=text/html
Content-Length=164
X-Cluster-Name=us-east-1-prod-hosting-red
target: 
https://www.storj.io/
FAIL (2025-08-21 17:47:12 UTC) 
unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 76.774517ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)
antiblip: 
4 out of 15 is failed (threshold=6) [....X...X..X.X.]
duration: 
96.100322ms
remote: 
"tcp:54.243.86.28:443"
response headers: 
X-Cluster-Name=us-east-1-prod-hosting-red
Date=Thu, 21 Aug 2025 17:46:23 GMT
Content-Type=text/html
Content-Length=164
target: 
https://www.storj.io/dcs-satellites
FAIL (2025-08-21 17:46:58 UTC) 
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 96.120039ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [.........................................X..................]
duration: 
1.665872201s
FAIL (2025-08-21 17:46:53 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 21 17:33:59.350385001 (312h7m40.081652621s) [upload=324499]: Starting upload
Aug 21 17:33:59.350415309 (312h7m40.08168294s) [upload=324499]: Done starting upload
Aug 21 17:33:59.350640743 (312h7m40.081908373s) [upload=324499]: Uploading segments...
Aug 21 17:33:59.351323566 (312h7m40.082591187s) [upload=324499]: Got next segment. Inline: false
Aug 21 17:33:59.351374332 (312h7m40.082641952s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 17:33:59.351378549 (312h7m40.08264617s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 17:33:59.354517922 (312h7m40.085785582s) [upload=324499]: Next segment err: metaclient: Too Many Requests
Aug 21 17:33:59.354532639 (312h7m40.085800269s) [upload=324499]: Done uploading segments...
Aug 21 17:33:59.354542808 (312h7m40.085810438s) [upload=324499]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.665892459s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip: 
2 out of 60 is failed (threshold=3) [................................X.........................X.]
duration: 
180.273898ms
FAIL (2025-08-21 17:46:24 UTC) 
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 21 17:45:26.360745871 (312h19m7.092013491s) [upload=324704]: Starting upload
Aug 21 17:45:26.360824949 (312h19m7.092092579s) [upload=324704]: Done starting upload
Aug 21 17:45:26.360871646 (312h19m7.092139277s) [upload=324704]: Uploading segments...
Aug 21 17:45:26.360901273 (312h19m7.092168892s) [upload=324704]: Got next segment. Inline: true
Aug 21 17:45:26.360904679 (312h19m7.092172309s) [upload=324704]: Waiting for error group managing segments...
Aug 21 17:45:26.360957487 (312h19m7.092225118s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 17:45:26.360961525 (312h19m7.092229155s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 21 17:45:26.360963790 (312h19m7.092231409s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 17:45:26.363758492 (312h19m7.095026112s) [upload=324704]: Done uploading segments...
Aug 21 17:45:26.363766668 (312h19m7.095034299s) [upload=324704]: Upload finished. err: metaclient: Too Many Requests
Duration: 180.299756ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)
antiblip: 
5 out of 15 is failed (threshold=6) [X....X...X..X.X]
duration: 
1.016950671s
remote: 
"tcp:54.243.86.28:443"
response headers: 
X-Cluster-Name=us-east-1-prod-hosting-red
Date=Thu, 21 Aug 2025 17:46:23 GMT
Content-Type=text/html
Content-Length=164
target: 
https://www.storj.io/dcs-satellites
FAIL (2025-08-21 17:46:23 UTC) 
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 1.01696608s core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [..........................................X.................]
duration: 
1.226376668s
FAIL (2025-08-21 17:46:21 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 21 17:33:59.350385001 (312h7m40.081652621s) [upload=324499]: Starting upload
Aug 21 17:33:59.350415309 (312h7m40.08168294s) [upload=324499]: Done starting upload
Aug 21 17:33:59.350640743 (312h7m40.081908373s) [upload=324499]: Uploading segments...
Aug 21 17:33:59.351323566 (312h7m40.082591187s) [upload=324499]: Got next segment. Inline: false
Aug 21 17:33:59.351374332 (312h7m40.082641952s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 17:33:59.351378549 (312h7m40.08264617s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 17:33:59.354517922 (312h7m40.085785582s) [upload=324499]: Next segment err: metaclient: Too Many Requests
Aug 21 17:33:59.354532639 (312h7m40.085800269s) [upload=324499]: Done uploading segments...
Aug 21 17:33:59.354542808 (312h7m40.085810438s) [upload=324499]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.226396334s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip: 
7 out of 15 is failed (threshold=6) [X..X...X..XX.XX]
duration: 
1.044426329s
remote: 
"tcp:18.211.166.153:443"
response headers: 
Date=Thu, 21 Aug 2025 17:46:20 GMT
Content-Type=text/html
Content-Length=164
X-Cluster-Name=us-east-1-prod-hosting-red
target: 
https://www.storj.io/
FAIL (2025-08-21 17:46:20 UTC) 
unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 1.044436677s core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [...........................................X................]
duration: 
1.612969556s
FAIL (2025-08-21 17:45:54 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 21 17:33:59.350385001 (312h7m40.081652621s) [upload=324499]: Starting upload
Aug 21 17:33:59.350415309 (312h7m40.08168294s) [upload=324499]: Done starting upload
Aug 21 17:33:59.350640743 (312h7m40.081908373s) [upload=324499]: Uploading segments...
Aug 21 17:33:59.351323566 (312h7m40.082591187s) [upload=324499]: Got next segment. Inline: false
Aug 21 17:33:59.351374332 (312h7m40.082641952s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 17:33:59.351378549 (312h7m40.08264617s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 17:33:59.354517922 (312h7m40.085785582s) [upload=324499]: Next segment err: metaclient: Too Many Requests
Aug 21 17:33:59.354532639 (312h7m40.085800269s) [upload=324499]: Done uploading segments...
Aug 21 17:33:59.354542808 (312h7m40.085810438s) [upload=324499]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.612989483s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)
antiblip: 
5 out of 15 is failed (threshold=6) [XX....X...X..X.]
duration: 
308.162339ms
remote: 
"tcp:54.243.86.28:443"
response headers: 
Date=Thu, 21 Aug 2025 17:44:53 GMT
Content-Type=text/html
Content-Length=164
X-Cluster-Name=us-east-1-prod-hosting-red
target: 
https://www.storj.io/dcs-satellites
FAIL (2025-08-21 17:45:45 UTC) 
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 308.183389ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip: 
2 out of 60 is failed (threshold=3) [.................................X.........................X]
duration: 
21.78946ms
FAIL (2025-08-21 17:45:26 UTC) 
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 21 17:45:26.360745871 (312h19m7.092013491s) [upload=324704]: Starting upload
Aug 21 17:45:26.360824949 (312h19m7.092092579s) [upload=324704]: Done starting upload
Aug 21 17:45:26.360871646 (312h19m7.092139277s) [upload=324704]: Uploading segments...
Aug 21 17:45:26.360901273 (312h19m7.092168892s) [upload=324704]: Got next segment. Inline: true
Aug 21 17:45:26.360904679 (312h19m7.092172309s) [upload=324704]: Waiting for error group managing segments...
Aug 21 17:45:26.360957487 (312h19m7.092225118s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 17:45:26.360961525 (312h19m7.092229155s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 21 17:45:26.360963790 (312h19m7.092231409s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 17:45:26.363758492 (312h19m7.095026112s) [upload=324704]: Done uploading segments...
Aug 21 17:45:26.363766668 (312h19m7.095034299s) [upload=324704]: Upload finished. err: metaclient: Too Many Requests
Duration: 21.805029ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip: 
7 out of 15 is failed (threshold=6) [XX..X...X..XX.X]
duration: 
1.203352271s
remote: 
"tcp:34.202.203.47:443"
response headers: 
X-Cluster-Name=us-east-1-prod-hosting-red
Date=Thu, 21 Aug 2025 17:45:17 GMT
Content-Type=text/html
Content-Length=164
target: 
https://www.storj.io/
FAIL (2025-08-21 17:45:17 UTC) 
unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 1.203376036s core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [............................................X...............]
duration: 
620.958967ms
FAIL (2025-08-21 17:45:15 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 21 17:33:59.350385001 (312h7m40.081652621s) [upload=324499]: Starting upload
Aug 21 17:33:59.350415309 (312h7m40.08168294s) [upload=324499]: Done starting upload
Aug 21 17:33:59.350640743 (312h7m40.081908373s) [upload=324499]: Uploading segments...
Aug 21 17:33:59.351323566 (312h7m40.082591187s) [upload=324499]: Got next segment. Inline: false
Aug 21 17:33:59.351374332 (312h7m40.082641952s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 17:33:59.351378549 (312h7m40.08264617s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 17:33:59.354517922 (312h7m40.085785582s) [upload=324499]: Next segment err: metaclient: Too Many Requests
Aug 21 17:33:59.354532639 (312h7m40.085800269s) [upload=324499]: Done uploading segments...
Aug 21 17:33:59.354542808 (312h7m40.085810438s) [upload=324499]: Upload finished. err: metaclient: Too Many Requests
Duration: 620.988201ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)
antiblip: 
6 out of 15 is failed (threshold=6) [XXX....X...X..X]
duration: 
1.015566446s
remote: 
"tcp:54.243.86.28:443"
response headers: 
Date=Thu, 21 Aug 2025 17:44:53 GMT
Content-Type=text/html
Content-Length=164
X-Cluster-Name=us-east-1-prod-hosting-red
target: 
https://www.storj.io/dcs-satellites
FAIL (2025-08-21 17:44:53 UTC) 
unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 1.015598858s core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip: 
1 out of 60 is failed (threshold=3) [..................................X.........................]
duration: 
338.746686ms
FAIL (2025-08-21 17:44:39 UTC) 
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 21 17:25:11.548962484 (311h58m52.280230114s) [upload=324350]: Starting upload
Aug 21 17:25:11.549002850 (311h58m52.28027047s) [upload=324350]: Done starting upload
Aug 21 17:25:11.549054988 (311h58m52.280322608s) [upload=324350]: Uploading segments...
Aug 21 17:25:11.549092488 (311h58m52.280360118s) [upload=324350]: Got next segment. Inline: true
Aug 21 17:25:11.549096727 (311h58m52.280364357s) [upload=324350]: Waiting for error group managing segments...
Aug 21 17:25:11.549145848 (311h58m52.280413478s) [upload=324350]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 17:25:11.549150006 (311h58m52.280417626s) [upload=324350]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 21 17:25:11.549152240 (311h58m52.280419871s) [upload=324350]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 17:25:11.553018232 (311h58m52.284285862s) [upload=324350]: Done uploading segments...
Aug 21 17:25:11.553025245 (311h58m52.284292866s) [upload=324350]: Upload finished. err: metaclient: Too Many Requests
Duration: 338.766244ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip: 
2 out of 60 is failed (threshold=3) [X............................................X..............]
duration: 
1.445496595s
FAIL (2025-08-21 17:44:32 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 21 17:33:59.350385001 (312h7m40.081652621s) [upload=324499]: Starting upload
Aug 21 17:33:59.350415309 (312h7m40.08168294s) [upload=324499]: Done starting upload
Aug 21 17:33:59.350640743 (312h7m40.081908373s) [upload=324499]: Uploading segments...
Aug 21 17:33:59.351323566 (312h7m40.082591187s) [upload=324499]: Got next segment. Inline: false
Aug 21 17:33:59.351374332 (312h7m40.082641952s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 17:33:59.351378549 (312h7m40.08264617s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 17:33:59.354517922 (312h7m40.085785582s) [upload=324499]: Next segment err: metaclient: Too Many Requests
Aug 21 17:33:59.354532639 (312h7m40.085800269s) [upload=324499]: Done uploading segments...
Aug 21 17:33:59.354542808 (312h7m40.085810438s) [upload=324499]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.445513626s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip: 
7 out of 15 is failed (threshold=6) [XXX..X...X..XX.]
duration: 
473.585022ms
remote: 
"tcp:34.202.203.47:443"
response headers: 
Date=Thu, 21 Aug 2025 17:44:02 GMT
Content-Type=text/html
Content-Length=164
X-Cluster-Name=us-east-1-prod-hosting-red
target: 
https://www.storj.io/
FAIL (2025-08-21 17:44:18 UTC) 
unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 473.607454ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip: 
2 out of 60 is failed (threshold=3) [.X............................................X.............]
duration: 
1.443421196s
FAIL (2025-08-21 17:44:06 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 21 17:33:59.350385001 (312h7m40.081652621s) [upload=324499]: Starting upload
Aug 21 17:33:59.350415309 (312h7m40.08168294s) [upload=324499]: Done starting upload
Aug 21 17:33:59.350640743 (312h7m40.081908373s) [upload=324499]: Uploading segments...
Aug 21 17:33:59.351323566 (312h7m40.082591187s) [upload=324499]: Got next segment. Inline: false
Aug 21 17:33:59.351374332 (312h7m40.082641952s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 17:33:59.351378549 (312h7m40.08264617s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 17:33:59.354517922 (312h7m40.085785582s) [upload=324499]: Next segment err: metaclient: Too Many Requests
Aug 21 17:33:59.354532639 (312h7m40.085800269s) [upload=324499]: Done uploading segments...
Aug 21 17:33:59.354542808 (312h7m40.085810438s) [upload=324499]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.443443659s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)
antiblip: 
6 out of 15 is failed (threshold=6) [XXXX....X...X..]
duration: 
88.750677ms
remote: 
"tcp:34.202.203.47:443"
response headers: 
Date=Thu, 21 Aug 2025 17:42:16 GMT
Content-Type=text/html
Content-Length=164
X-Cluster-Name=us-east-1-prod-hosting-red
target: 
https://www.storj.io/dcs-satellites
FAIL (2025-08-21 17:44:06 UTC) 
unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 88.764803ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip: 
8 out of 15 is failed (threshold=6) [XXXX..X...X..XX]
duration: 
1.05231256s
remote: 
"tcp:34.202.203.47:443"
response headers: 
Date=Thu, 21 Aug 2025 17:44:02 GMT
Content-Type=text/html
Content-Length=164
X-Cluster-Name=us-east-1-prod-hosting-red
target: 
https://www.storj.io/
FAIL (2025-08-21 17:44:02 UTC) 
unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 1.052338429s core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip: 
1 out of 60 is failed (threshold=3) [...................................X........................]
duration: 
1.243791193s
FAIL (2025-08-21 17:43:33 UTC) 
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 21 17:25:11.548962484 (311h58m52.280230114s) [upload=324350]: Starting upload
Aug 21 17:25:11.549002850 (311h58m52.28027047s) [upload=324350]: Done starting upload
Aug 21 17:25:11.549054988 (311h58m52.280322608s) [upload=324350]: Uploading segments...
Aug 21 17:25:11.549092488 (311h58m52.280360118s) [upload=324350]: Got next segment. Inline: true
Aug 21 17:25:11.549096727 (311h58m52.280364357s) [upload=324350]: Waiting for error group managing segments...
Aug 21 17:25:11.549145848 (311h58m52.280413478s) [upload=324350]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 17:25:11.549150006 (311h58m52.280417626s) [upload=324350]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 21 17:25:11.549152240 (311h58m52.280419871s) [upload=324350]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 17:25:11.553018232 (311h58m52.284285862s) [upload=324350]: Done uploading segments...
Aug 21 17:25:11.553025245 (311h58m52.284292866s) [upload=324350]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.243823422s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip: 
2 out of 60 is failed (threshold=3) [..X............................................X............]
duration: 
1.356325023s
FAIL (2025-08-21 17:43:23 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 21 17:33:59.350385001 (312h7m40.081652621s) [upload=324499]: Starting upload
Aug 21 17:33:59.350415309 (312h7m40.08168294s) [upload=324499]: Done starting upload
Aug 21 17:33:59.350640743 (312h7m40.081908373s) [upload=324499]: Uploading segments...
Aug 21 17:33:59.351323566 (312h7m40.082591187s) [upload=324499]: Got next segment. Inline: false
Aug 21 17:33:59.351374332 (312h7m40.082641952s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 17:33:59.351378549 (312h7m40.08264617s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 17:33:59.354517922 (312h7m40.085785582s) [upload=324499]: Next segment err: metaclient: Too Many Requests
Aug 21 17:33:59.354532639 (312h7m40.085800269s) [upload=324499]: Done uploading segments...
Aug 21 17:33:59.354542808 (312h7m40.085810438s) [upload=324499]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.356345012s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)
antiblip: 
6 out of 15 is failed (threshold=6) [.XXXX....X...X.]
duration: 
1.165189606s
remote: 
"tcp:34.202.203.47:443"
response headers: 
Date=Thu, 21 Aug 2025 17:42:16 GMT
Content-Type=text/html
Content-Length=164
X-Cluster-Name=us-east-1-prod-hosting-red
target: 
https://www.storj.io/dcs-satellites
FAIL (2025-08-21 17:43:15 UTC) 
unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 1.165209865s core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip: 
2 out of 60 is failed (threshold=3) [...X............................................X...........]
duration: 
2.163316912s
FAIL (2025-08-21 17:42:59 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 21 17:33:59.350385001 (312h7m40.081652621s) [upload=324499]: Starting upload
Aug 21 17:33:59.350415309 (312h7m40.08168294s) [upload=324499]: Done starting upload
Aug 21 17:33:59.350640743 (312h7m40.081908373s) [upload=324499]: Uploading segments...
Aug 21 17:33:59.351323566 (312h7m40.082591187s) [upload=324499]: Got next segment. Inline: false
Aug 21 17:33:59.351374332 (312h7m40.082641952s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 17:33:59.351378549 (312h7m40.08264617s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 17:33:59.354517922 (312h7m40.085785582s) [upload=324499]: Next segment err: metaclient: Too Many Requests
Aug 21 17:33:59.354532639 (312h7m40.085800269s) [upload=324499]: Done uploading segments...
Aug 21 17:33:59.354542808 (312h7m40.085810438s) [upload=324499]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.163340899s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip: 
7 out of 15 is failed (threshold=6) [.XXXX..X...X..X]
duration: 
1.105151804s
remote: 
"tcp:54.243.86.28:443"
response headers: 
Content-Type=text/html
Content-Length=164
X-Cluster-Name=us-east-1-prod-hosting-red
Date=Thu, 21 Aug 2025 17:42:56 GMT
target: 
https://www.storj.io/
FAIL (2025-08-21 17:42:56 UTC) 
unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 1.105168556s core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip: 
1 out of 60 is failed (threshold=3) [....................................X.......................]
duration: 
499.589452ms
FAIL (2025-08-21 17:42:47 UTC) 
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 21 17:25:11.548962484 (311h58m52.280230114s) [upload=324350]: Starting upload
Aug 21 17:25:11.549002850 (311h58m52.28027047s) [upload=324350]: Done starting upload
Aug 21 17:25:11.549054988 (311h58m52.280322608s) [upload=324350]: Uploading segments...
Aug 21 17:25:11.549092488 (311h58m52.280360118s) [upload=324350]: Got next segment. Inline: true
Aug 21 17:25:11.549096727 (311h58m52.280364357s) [upload=324350]: Waiting for error group managing segments...
Aug 21 17:25:11.549145848 (311h58m52.280413478s) [upload=324350]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 17:25:11.549150006 (311h58m52.280417626s) [upload=324350]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 21 17:25:11.549152240 (311h58m52.280419871s) [upload=324350]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 17:25:11.553018232 (311h58m52.284285862s) [upload=324350]: Done uploading segments...
Aug 21 17:25:11.553025245 (311h58m52.284292866s) [upload=324350]: Upload finished. err: metaclient: Too Many Requests
Duration: 499.61536ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip: 
6 out of 15 is failed (threshold=6) [..XXXX..X...X..]
duration: 
90.087214ms
remote: 
"tcp:54.243.86.28:443"
response headers: 
Date=Thu, 21 Aug 2025 17:40:51 GMT
Content-Type=text/html
Content-Length=164
X-Cluster-Name=us-east-1-prod-hosting-red
target: 
https://www.storj.io/
FAIL (2025-08-21 17:42:34 UTC) 
unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 90.104515ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip: 
1 out of 60 is failed (threshold=3) [.....................................X......................]
duration: 
123.986605ms
FAIL (2025-08-21 17:42:17 UTC) 
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 21 17:25:11.548962484 (311h58m52.280230114s) [upload=324350]: Starting upload
Aug 21 17:25:11.549002850 (311h58m52.28027047s) [upload=324350]: Done starting upload
Aug 21 17:25:11.549054988 (311h58m52.280322608s) [upload=324350]: Uploading segments...
Aug 21 17:25:11.549092488 (311h58m52.280360118s) [upload=324350]: Got next segment. Inline: true
Aug 21 17:25:11.549096727 (311h58m52.280364357s) [upload=324350]: Waiting for error group managing segments...
Aug 21 17:25:11.549145848 (311h58m52.280413478s) [upload=324350]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 17:25:11.549150006 (311h58m52.280417626s) [upload=324350]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 21 17:25:11.549152240 (311h58m52.280419871s) [upload=324350]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 17:25:11.553018232 (311h58m52.284285862s) [upload=324350]: Done uploading segments...
Aug 21 17:25:11.553025245 (311h58m52.284292866s) [upload=324350]: Upload finished. err: metaclient: Too Many Requests
Duration: 124.00041ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)
antiblip: 
6 out of 15 is failed (threshold=6) [..XXXX....X...X]
duration: 
1.016270628s
remote: 
"tcp:34.202.203.47:443"
response headers: 
Date=Thu, 21 Aug 2025 17:42:16 GMT
Content-Type=text/html
Content-Length=164
X-Cluster-Name=us-east-1-prod-hosting-red
target: 
https://www.storj.io/dcs-satellites
FAIL (2025-08-21 17:42:16 UTC) 
unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 1.016291828s core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip: 
7 out of 15 is failed (threshold=6) [X..XXXX..X...X.]
duration: 
102.054845ms
remote: 
"tcp:54.243.86.28:443"
response headers: 
Date=Thu, 21 Aug 2025 17:40:51 GMT
Content-Type=text/html
Content-Length=164
X-Cluster-Name=us-east-1-prod-hosting-red
target: 
https://www.storj.io/
FAIL (2025-08-21 17:41:53 UTC) 
unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 102.078869ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip: 
2 out of 60 is failed (threshold=3) [....X............................................X..........]
duration: 
446.166157ms
FAIL (2025-08-21 17:41:52 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 21 17:33:59.350385001 (312h7m40.081652621s) [upload=324499]: Starting upload
Aug 21 17:33:59.350415309 (312h7m40.08168294s) [upload=324499]: Done starting upload
Aug 21 17:33:59.350640743 (312h7m40.081908373s) [upload=324499]: Uploading segments...
Aug 21 17:33:59.351323566 (312h7m40.082591187s) [upload=324499]: Got next segment. Inline: false
Aug 21 17:33:59.351374332 (312h7m40.082641952s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 17:33:59.351378549 (312h7m40.08264617s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 17:33:59.354517922 (312h7m40.085785582s) [upload=324499]: Next segment err: metaclient: Too Many Requests
Aug 21 17:33:59.354532639 (312h7m40.085800269s) [upload=324499]: Done uploading segments...
Aug 21 17:33:59.354542808 (312h7m40.085810438s) [upload=324499]: Upload finished. err: metaclient: Too Many Requests
Duration: 446.18884ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)
antiblip: 
5 out of 15 is failed (threshold=6) [...XXXX....X...]
duration: 
353.308955ms
remote: 
"tcp:18.211.166.153:443"
response headers: 
Content-Type=text/html
Content-Length=164
X-Cluster-Name=us-east-1-prod-hosting-red
Date=Thu, 21 Aug 2025 17:39:10 GMT
target: 
https://www.storj.io/dcs-satellites
FAIL (2025-08-21 17:41:19 UTC) 
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 353.334754ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip: 
1 out of 60 is failed (threshold=3) [......................................X.....................]
duration: 
146.660974ms
FAIL (2025-08-21 17:41:13 UTC) 
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 21 17:25:11.548962484 (311h58m52.280230114s) [upload=324350]: Starting upload
Aug 21 17:25:11.549002850 (311h58m52.28027047s) [upload=324350]: Done starting upload
Aug 21 17:25:11.549054988 (311h58m52.280322608s) [upload=324350]: Uploading segments...
Aug 21 17:25:11.549092488 (311h58m52.280360118s) [upload=324350]: Got next segment. Inline: true
Aug 21 17:25:11.549096727 (311h58m52.280364357s) [upload=324350]: Waiting for error group managing segments...
Aug 21 17:25:11.549145848 (311h58m52.280413478s) [upload=324350]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 17:25:11.549150006 (311h58m52.280417626s) [upload=324350]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 21 17:25:11.549152240 (311h58m52.280419871s) [upload=324350]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 17:25:11.553018232 (311h58m52.284285862s) [upload=324350]: Done uploading segments...
Aug 21 17:25:11.553025245 (311h58m52.284292866s) [upload=324350]: Upload finished. err: metaclient: Too Many Requests
Duration: 146.682604ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip: 
2 out of 60 is failed (threshold=3) [.....X............................................X.........]
duration: 
1.283092273s
FAIL (2025-08-21 17:40:53 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 21 17:33:59.350385001 (312h7m40.081652621s) [upload=324499]: Starting upload
Aug 21 17:33:59.350415309 (312h7m40.08168294s) [upload=324499]: Done starting upload
Aug 21 17:33:59.350640743 (312h7m40.081908373s) [upload=324499]: Uploading segments...
Aug 21 17:33:59.351323566 (312h7m40.082591187s) [upload=324499]: Got next segment. Inline: false
Aug 21 17:33:59.351374332 (312h7m40.082641952s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 17:33:59.351378549 (312h7m40.08264617s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 17:33:59.354517922 (312h7m40.085785582s) [upload=324499]: Next segment err: metaclient: Too Many Requests
Aug 21 17:33:59.354532639 (312h7m40.085800269s) [upload=324499]: Done uploading segments...
Aug 21 17:33:59.354542808 (312h7m40.085810438s) [upload=324499]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.283112832s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip: 
8 out of 15 is failed (threshold=6) [XX..XXXX..X...X]
duration: 
1.093765876s
remote: 
"tcp:54.243.86.28:443"
response headers: 
Date=Thu, 21 Aug 2025 17:40:51 GMT
Content-Type=text/html
Content-Length=164
X-Cluster-Name=us-east-1-prod-hosting-red
target: 
https://www.storj.io/
FAIL (2025-08-21 17:40:51 UTC) 
unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 1.09378353s core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)
antiblip: 
5 out of 15 is failed (threshold=6) [....XXXX....X..]
duration: 
331.251165ms
remote: 
"tcp:18.211.166.153:443"
response headers: 
Content-Type=text/html
Content-Length=164
X-Cluster-Name=us-east-1-prod-hosting-red
Date=Thu, 21 Aug 2025 17:39:10 GMT
target: 
https://www.storj.io/dcs-satellites
FAIL (2025-08-21 17:40:39 UTC) 
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 331.267926ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip: 
7 out of 15 is failed (threshold=6) [.XX..XXXX..X...]
duration: 
70.957752ms
remote: 
"tcp:34.202.203.47:443"
response headers: 
Content-Length=164
X-Cluster-Name=us-east-1-prod-hosting-red
Date=Thu, 21 Aug 2025 17:38:33 GMT
Content-Type=text/html
target: 
https://www.storj.io/
FAIL (2025-08-21 17:40:16 UTC) 
unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 70.980093ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip: 
1 out of 60 is failed (threshold=3) [.......................................X....................]
duration: 
421.989004ms
FAIL (2025-08-21 17:40:12 UTC) 
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 21 17:25:11.548962484 (311h58m52.280230114s) [upload=324350]: Starting upload
Aug 21 17:25:11.549002850 (311h58m52.28027047s) [upload=324350]: Done starting upload
Aug 21 17:25:11.549054988 (311h58m52.280322608s) [upload=324350]: Uploading segments...
Aug 21 17:25:11.549092488 (311h58m52.280360118s) [upload=324350]: Got next segment. Inline: true
Aug 21 17:25:11.549096727 (311h58m52.280364357s) [upload=324350]: Waiting for error group managing segments...
Aug 21 17:25:11.549145848 (311h58m52.280413478s) [upload=324350]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 17:25:11.549150006 (311h58m52.280417626s) [upload=324350]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 21 17:25:11.549152240 (311h58m52.280419871s) [upload=324350]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 17:25:11.553018232 (311h58m52.284285862s) [upload=324350]: Done uploading segments...
Aug 21 17:25:11.553025245 (311h58m52.284292866s) [upload=324350]: Upload finished. err: metaclient: Too Many Requests
Duration: 422.013561ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip: 
2 out of 60 is failed (threshold=3) [......X............................................X........]
duration: 
1.720872024s
FAIL (2025-08-21 17:40:09 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 21 17:33:59.350385001 (312h7m40.081652621s) [upload=324499]: Starting upload
Aug 21 17:33:59.350415309 (312h7m40.08168294s) [upload=324499]: Done starting upload
Aug 21 17:33:59.350640743 (312h7m40.081908373s) [upload=324499]: Uploading segments...
Aug 21 17:33:59.351323566 (312h7m40.082591187s) [upload=324499]: Got next segment. Inline: false
Aug 21 17:33:59.351374332 (312h7m40.082641952s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 17:33:59.351378549 (312h7m40.08264617s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 17:33:59.354517922 (312h7m40.085785582s) [upload=324499]: Next segment err: metaclient: Too Many Requests
Aug 21 17:33:59.354532639 (312h7m40.085800269s) [upload=324499]: Done uploading segments...
Aug 21 17:33:59.354542808 (312h7m40.085810438s) [upload=324499]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.720917331s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)
antiblip: 
6 out of 15 is failed (threshold=6) [X....XXXX....X.]
duration: 
393.276695ms
remote: 
"tcp:18.211.166.153:443"
response headers: 
Content-Type=text/html
Content-Length=164
X-Cluster-Name=us-east-1-prod-hosting-red
Date=Thu, 21 Aug 2025 17:39:10 GMT
target: 
https://www.storj.io/dcs-satellites
FAIL (2025-08-21 17:40:01 UTC) 
unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 393.323963ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip: 
1 out of 60 is failed (threshold=3) [........................................X...................]
duration: 
350.652765ms
FAIL (2025-08-21 17:39:56 UTC) 
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 21 17:25:11.548962484 (311h58m52.280230114s) [upload=324350]: Starting upload
Aug 21 17:25:11.549002850 (311h58m52.28027047s) [upload=324350]: Done starting upload
Aug 21 17:25:11.549054988 (311h58m52.280322608s) [upload=324350]: Uploading segments...
Aug 21 17:25:11.549092488 (311h58m52.280360118s) [upload=324350]: Got next segment. Inline: true
Aug 21 17:25:11.549096727 (311h58m52.280364357s) [upload=324350]: Waiting for error group managing segments...
Aug 21 17:25:11.549145848 (311h58m52.280413478s) [upload=324350]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 17:25:11.549150006 (311h58m52.280417626s) [upload=324350]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 21 17:25:11.549152240 (311h58m52.280419871s) [upload=324350]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 17:25:11.553018232 (311h58m52.284285862s) [upload=324350]: Done uploading segments...
Aug 21 17:25:11.553025245 (311h58m52.284292866s) [upload=324350]: Upload finished. err: metaclient: Too Many Requests
Duration: 350.675287ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip: 
7 out of 15 is failed (threshold=6) [..XX..XXXX..X..]
duration: 
108.389695ms
remote: 
"tcp:34.202.203.47:443"
response headers: 
Content-Length=164
X-Cluster-Name=us-east-1-prod-hosting-red
Date=Thu, 21 Aug 2025 17:38:33 GMT
Content-Type=text/html
target: 
https://www.storj.io/
FAIL (2025-08-21 17:39:53 UTC) 
unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 108.406786ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip: 
2 out of 60 is failed (threshold=3) [.......X............................................X.......]
duration: 
1.404685895s
FAIL (2025-08-21 17:39:35 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 21 17:33:59.350385001 (312h7m40.081652621s) [upload=324499]: Starting upload
Aug 21 17:33:59.350415309 (312h7m40.08168294s) [upload=324499]: Done starting upload
Aug 21 17:33:59.350640743 (312h7m40.081908373s) [upload=324499]: Uploading segments...
Aug 21 17:33:59.351323566 (312h7m40.082591187s) [upload=324499]: Got next segment. Inline: false
Aug 21 17:33:59.351374332 (312h7m40.082641952s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 17:33:59.351378549 (312h7m40.08264617s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 17:33:59.354517922 (312h7m40.085785582s) [upload=324499]: Next segment err: metaclient: Too Many Requests
Aug 21 17:33:59.354532639 (312h7m40.085800269s) [upload=324499]: Done uploading segments...
Aug 21 17:33:59.354542808 (312h7m40.085810438s) [upload=324499]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.404706313s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip: 
1 out of 60 is failed (threshold=3) [.........................................X..................]
duration: 
139.410532ms
FAIL (2025-08-21 17:39:18 UTC) 
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 21 17:25:11.548962484 (311h58m52.280230114s) [upload=324350]: Starting upload
Aug 21 17:25:11.549002850 (311h58m52.28027047s) [upload=324350]: Done starting upload
Aug 21 17:25:11.549054988 (311h58m52.280322608s) [upload=324350]: Uploading segments...
Aug 21 17:25:11.549092488 (311h58m52.280360118s) [upload=324350]: Got next segment. Inline: true
Aug 21 17:25:11.549096727 (311h58m52.280364357s) [upload=324350]: Waiting for error group managing segments...
Aug 21 17:25:11.549145848 (311h58m52.280413478s) [upload=324350]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 17:25:11.549150006 (311h58m52.280417626s) [upload=324350]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 21 17:25:11.549152240 (311h58m52.280419871s) [upload=324350]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 17:25:11.553018232 (311h58m52.284285862s) [upload=324350]: Done uploading segments...
Aug 21 17:25:11.553025245 (311h58m52.284292866s) [upload=324350]: Upload finished. err: metaclient: Too Many Requests
Duration: 139.429638ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)
antiblip: 
6 out of 15 is failed (threshold=6) [.X....XXXX....X]
duration: 
1.016497673s
remote: 
"tcp:18.211.166.153:443"
response headers: 
Content-Type=text/html
Content-Length=164
X-Cluster-Name=us-east-1-prod-hosting-red
Date=Thu, 21 Aug 2025 17:39:10 GMT
target: 
https://www.storj.io/dcs-satellites
FAIL (2025-08-21 17:39:10 UTC) 
unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 1.016525786s core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip: 
7 out of 15 is failed (threshold=6) [...XX..XXXX..X.]
duration: 
287.73224ms
remote: 
"tcp:34.202.203.47:443"
response headers: 
Content-Length=164
X-Cluster-Name=us-east-1-prod-hosting-red
Date=Thu, 21 Aug 2025 17:38:33 GMT
Content-Type=text/html
target: 
https://www.storj.io/
FAIL (2025-08-21 17:39:00 UTC) 
unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 287.747529ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)
antiblip: 
5 out of 15 is failed (threshold=6) [..X....XXXX....]
duration: 
91.529747ms
remote: 
"tcp:18.211.166.153:443"
response headers: 
Date=Thu, 21 Aug 2025 17:35:05 GMT
Content-Type=text/html
Content-Length=164
X-Cluster-Name=us-east-1-prod-hosting-red
target: 
https://www.storj.io/dcs-satellites
FAIL (2025-08-21 17:38:39 UTC) 
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 91.54739ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip: 
2 out of 60 is failed (threshold=3) [........X............................................X......]
duration: 
841.158354ms
FAIL (2025-08-21 17:38:33 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 21 17:33:59.350385001 (312h7m40.081652621s) [upload=324499]: Starting upload
Aug 21 17:33:59.350415309 (312h7m40.08168294s) [upload=324499]: Done starting upload
Aug 21 17:33:59.350640743 (312h7m40.081908373s) [upload=324499]: Uploading segments...
Aug 21 17:33:59.351323566 (312h7m40.082591187s) [upload=324499]: Got next segment. Inline: false
Aug 21 17:33:59.351374332 (312h7m40.082641952s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 17:33:59.351378549 (312h7m40.08264617s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 17:33:59.354517922 (312h7m40.085785582s) [upload=324499]: Next segment err: metaclient: Too Many Requests
Aug 21 17:33:59.354532639 (312h7m40.085800269s) [upload=324499]: Done uploading segments...
Aug 21 17:33:59.354542808 (312h7m40.085810438s) [upload=324499]: Upload finished. err: metaclient: Too Many Requests
Duration: 841.1823ms core uplink us-select-1 us1-placement-20 metainfo-projects