Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
3 out of 15 is failed (threshold=6) [X........X...X.] duration:
366.800992ms remote:
"tcp:54.243.86.28:443" response headers:
Content-Type=text/html Content-Length=164 X-Cluster-Name=us-east-1-prod-hosting-red Date=Thu, 21 Aug 2025 18:23:14 GMT target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-21 18:23:30 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 366.825226ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
1 out of 15 is failed (threshold=6) [.............X.] duration:
173.732852ms remote:
"tcp:18.211.166.153:443" response headers:
Content-Length=164 X-Cluster-Name=us-east-1-prod-hosting-red Date=Thu, 21 Aug 2025 18:22:52 GMT Content-Type=text/html target:
https://www.storj.io/
FAIL (2025-08-21 18:23:25 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 173.755134ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
157.379091ms
FAIL (2025-08-21 18:23:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 17:45:26.360745871 (312h19m7.092013491s) [upload=324704]: Starting upload Aug 21 17:45:26.360824949 (312h19m7.092092579s) [upload=324704]: Done starting upload Aug 21 17:45:26.360871646 (312h19m7.092139277s) [upload=324704]: Uploading segments... Aug 21 17:45:26.360901273 (312h19m7.092168892s) [upload=324704]: Got next segment. Inline: true Aug 21 17:45:26.360904679 (312h19m7.092172309s) [upload=324704]: Waiting for error group managing segments... Aug 21 17:45:26.360957487 (312h19m7.092225118s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 17:45:26.360961525 (312h19m7.092229155s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 17:45:26.360963790 (312h19m7.092231409s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 17:45:26.363758492 (312h19m7.095026112s) [upload=324704]: Done uploading segments... Aug 21 17:45:26.363766668 (312h19m7.095034299s) [upload=324704]: Upload finished. err: metaclient: Too Many Requests
Duration: 157.397988ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
420.552583ms
FAIL (2025-08-21 18:23:14 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 18:16:33.093033284 (312h50m13.824300914s) [upload=325238]: Starting upload Aug 21 18:16:33.093072998 (312h50m13.824340628s) [upload=325238]: Done starting upload Aug 21 18:16:33.093148541 (312h50m13.824416171s) [upload=325238]: Uploading segments... Aug 21 18:16:33.093288403 (312h50m13.824556024s) [upload=325238]: Got next segment. Inline: false Aug 21 18:16:33.093330613 (312h50m13.824598243s) [upload=325238]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 18:16:33.093347384 (312h50m13.824615004s) [upload=325238]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 18:16:33.097236411 (312h50m13.828504031s) [upload=325238]: Next segment err: metaclient: Too Many Requests Aug 21 18:16:33.097245538 (312h50m13.828513159s) [upload=325238]: Done uploading segments... Aug 21 18:16:33.097253794 (312h50m13.828521414s) [upload=325238]: Upload finished. err: metaclient: Too Many Requests
Duration: 420.601936ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
3 out of 15 is failed (threshold=6) [.X........X...X] duration:
1.016644986s remote:
"tcp:54.243.86.28:443" response headers:
Content-Type=text/html Content-Length=164 X-Cluster-Name=us-east-1-prod-hosting-red Date=Thu, 21 Aug 2025 18:23:14 GMT target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-21 18:23:14 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 1.016670143s
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
1 out of 15 is failed (threshold=6) [..............X] duration:
1.018099962s remote:
"tcp:18.211.166.153:443" response headers:
Content-Length=164 X-Cluster-Name=us-east-1-prod-hosting-red Date=Thu, 21 Aug 2025 18:22:52 GMT Content-Type=text/html target:
https://www.storj.io/
FAIL (2025-08-21 18:22:52 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 1.018128697s
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
519.70698ms
FAIL (2025-08-21 18:22:44 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 18:16:33.093033284 (312h50m13.824300914s) [upload=325238]: Starting upload Aug 21 18:16:33.093072998 (312h50m13.824340628s) [upload=325238]: Done starting upload Aug 21 18:16:33.093148541 (312h50m13.824416171s) [upload=325238]: Uploading segments... Aug 21 18:16:33.093288403 (312h50m13.824556024s) [upload=325238]: Got next segment. Inline: false Aug 21 18:16:33.093330613 (312h50m13.824598243s) [upload=325238]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 18:16:33.093347384 (312h50m13.824615004s) [upload=325238]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 18:16:33.097236411 (312h50m13.828504031s) [upload=325238]: Next segment err: metaclient: Too Many Requests Aug 21 18:16:33.097245538 (312h50m13.828513159s) [upload=325238]: Done uploading segments... Aug 21 18:16:33.097253794 (312h50m13.828521414s) [upload=325238]: Upload finished. err: metaclient: Too Many Requests
Duration: 519.73384ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
2 out of 15 is failed (threshold=6) [..X........X...] duration:
207.644932ms remote:
"tcp:54.243.86.28:443" response headers:
Content-Length=164 X-Cluster-Name=us-east-1-prod-hosting-red Date=Thu, 21 Aug 2025 18:20:42 GMT Content-Type=text/html target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-21 18:22:39 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 207.663668ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
2 out of 15 is failed (threshold=6) [...X........X..] duration:
520.745118ms remote:
"tcp:54.243.86.28:443" response headers:
Content-Length=164 X-Cluster-Name=us-east-1-prod-hosting-red Date=Thu, 21 Aug 2025 18:20:42 GMT Content-Type=text/html target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-21 18:22:22 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 520.765336ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
194.085667ms
FAIL (2025-08-21 18:22:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 17:45:26.360745871 (312h19m7.092013491s) [upload=324704]: Starting upload Aug 21 17:45:26.360824949 (312h19m7.092092579s) [upload=324704]: Done starting upload Aug 21 17:45:26.360871646 (312h19m7.092139277s) [upload=324704]: Uploading segments... Aug 21 17:45:26.360901273 (312h19m7.092168892s) [upload=324704]: Got next segment. Inline: true Aug 21 17:45:26.360904679 (312h19m7.092172309s) [upload=324704]: Waiting for error group managing segments... Aug 21 17:45:26.360957487 (312h19m7.092225118s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 17:45:26.360961525 (312h19m7.092229155s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 17:45:26.360963790 (312h19m7.092231409s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 17:45:26.363758492 (312h19m7.095026112s) [upload=324704]: Done uploading segments... Aug 21 17:45:26.363766668 (312h19m7.095034299s) [upload=324704]: Upload finished. err: metaclient: Too Many Requests
Duration: 194.113178ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
1.760077993s
FAIL (2025-08-21 18:22:09 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 18:16:33.093033284 (312h50m13.824300914s) [upload=325238]: Starting upload Aug 21 18:16:33.093072998 (312h50m13.824340628s) [upload=325238]: Done starting upload Aug 21 18:16:33.093148541 (312h50m13.824416171s) [upload=325238]: Uploading segments... Aug 21 18:16:33.093288403 (312h50m13.824556024s) [upload=325238]: Got next segment. Inline: false Aug 21 18:16:33.093330613 (312h50m13.824598243s) [upload=325238]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 18:16:33.093347384 (312h50m13.824615004s) [upload=325238]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 18:16:33.097236411 (312h50m13.828504031s) [upload=325238]: Next segment err: metaclient: Too Many Requests Aug 21 18:16:33.097245538 (312h50m13.828513159s) [upload=325238]: Done uploading segments... Aug 21 18:16:33.097253794 (312h50m13.828521414s) [upload=325238]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.760104081s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
1.849850182s
FAIL (2025-08-21 18:21:37 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 18:16:33.093033284 (312h50m13.824300914s) [upload=325238]: Starting upload Aug 21 18:16:33.093072998 (312h50m13.824340628s) [upload=325238]: Done starting upload Aug 21 18:16:33.093148541 (312h50m13.824416171s) [upload=325238]: Uploading segments... Aug 21 18:16:33.093288403 (312h50m13.824556024s) [upload=325238]: Got next segment. Inline: false Aug 21 18:16:33.093330613 (312h50m13.824598243s) [upload=325238]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 18:16:33.093347384 (312h50m13.824615004s) [upload=325238]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 18:16:33.097236411 (312h50m13.828504031s) [upload=325238]: Next segment err: metaclient: Too Many Requests Aug 21 18:16:33.097245538 (312h50m13.828513159s) [upload=325238]: Done uploading segments... Aug 21 18:16:33.097253794 (312h50m13.828521414s) [upload=325238]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.849870771s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
1 out of 15 is failed (threshold=6) [X..............] duration:
78.972208ms remote:
"tcp:34.202.203.47:443" response headers:
X-Cluster-Name=us-east-1-prod-hosting-red Date=Thu, 21 Aug 2025 18:10:05 GMT Content-Type=text/html Content-Length=164 target:
https://www.storj.io/
FAIL (2025-08-21 18:21:37 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 78.997015ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
2 out of 15 is failed (threshold=6) [....X........X.] duration:
1.604962894s remote:
"tcp:54.243.86.28:443" response headers:
Content-Length=164 X-Cluster-Name=us-east-1-prod-hosting-red Date=Thu, 21 Aug 2025 18:20:42 GMT Content-Type=text/html target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-21 18:21:30 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 1.604992721s
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
1 out of 15 is failed (threshold=6) [.X.............] duration:
133.855622ms remote:
"tcp:34.202.203.47:443" response headers:
X-Cluster-Name=us-east-1-prod-hosting-red Date=Thu, 21 Aug 2025 18:10:05 GMT Content-Type=text/html Content-Length=164 target:
https://www.storj.io/
FAIL (2025-08-21 18:21:19 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 133.87601ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
196.118255ms
FAIL (2025-08-21 18:21:18 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 17:45:26.360745871 (312h19m7.092013491s) [upload=324704]: Starting upload Aug 21 17:45:26.360824949 (312h19m7.092092579s) [upload=324704]: Done starting upload Aug 21 17:45:26.360871646 (312h19m7.092139277s) [upload=324704]: Uploading segments... Aug 21 17:45:26.360901273 (312h19m7.092168892s) [upload=324704]: Got next segment. Inline: true Aug 21 17:45:26.360904679 (312h19m7.092172309s) [upload=324704]: Waiting for error group managing segments... Aug 21 17:45:26.360957487 (312h19m7.092225118s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 17:45:26.360961525 (312h19m7.092229155s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 17:45:26.360963790 (312h19m7.092231409s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 17:45:26.363758492 (312h19m7.095026112s) [upload=324704]: Done uploading segments... Aug 21 17:45:26.363766668 (312h19m7.095034299s) [upload=324704]: Upload finished. err: metaclient: Too Many Requests
Duration: 196.136931ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
505.406513ms
FAIL (2025-08-21 18:21:16 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 18:16:33.093033284 (312h50m13.824300914s) [upload=325238]: Starting upload Aug 21 18:16:33.093072998 (312h50m13.824340628s) [upload=325238]: Done starting upload Aug 21 18:16:33.093148541 (312h50m13.824416171s) [upload=325238]: Uploading segments... Aug 21 18:16:33.093288403 (312h50m13.824556024s) [upload=325238]: Got next segment. Inline: false Aug 21 18:16:33.093330613 (312h50m13.824598243s) [upload=325238]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 18:16:33.093347384 (312h50m13.824615004s) [upload=325238]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 18:16:33.097236411 (312h50m13.828504031s) [upload=325238]: Next segment err: metaclient: Too Many Requests Aug 21 18:16:33.097245538 (312h50m13.828513159s) [upload=325238]: Done uploading segments... Aug 21 18:16:33.097253794 (312h50m13.828521414s) [upload=325238]: Upload finished. err: metaclient: Too Many Requests
Duration: 505.422052ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
2 out of 15 is failed (threshold=6) [.....X........X] duration:
1.015071432s remote:
"tcp:54.243.86.28:443" response headers:
Content-Length=164 X-Cluster-Name=us-east-1-prod-hosting-red Date=Thu, 21 Aug 2025 18:20:42 GMT Content-Type=text/html target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-21 18:20:42 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 1.015221124s
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
413.364792ms
FAIL (2025-08-21 18:20:24 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 18:16:33.093033284 (312h50m13.824300914s) [upload=325238]: Starting upload Aug 21 18:16:33.093072998 (312h50m13.824340628s) [upload=325238]: Done starting upload Aug 21 18:16:33.093148541 (312h50m13.824416171s) [upload=325238]: Uploading segments... Aug 21 18:16:33.093288403 (312h50m13.824556024s) [upload=325238]: Got next segment. Inline: false Aug 21 18:16:33.093330613 (312h50m13.824598243s) [upload=325238]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 18:16:33.093347384 (312h50m13.824615004s) [upload=325238]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 18:16:33.097236411 (312h50m13.828504031s) [upload=325238]: Next segment err: metaclient: Too Many Requests Aug 21 18:16:33.097245538 (312h50m13.828513159s) [upload=325238]: Done uploading segments... Aug 21 18:16:33.097253794 (312h50m13.828521414s) [upload=325238]: Upload finished. err: metaclient: Too Many Requests
Duration: 413.418832ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
2 out of 15 is failed (threshold=6) [X.X............] duration:
71.315888ms remote:
"tcp:34.202.203.47:443" response headers:
X-Cluster-Name=us-east-1-prod-hosting-red Date=Thu, 21 Aug 2025 18:10:05 GMT Content-Type=text/html Content-Length=164 target:
https://www.storj.io/
FAIL (2025-08-21 18:20:07 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 71.336628ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
2 out of 15 is failed (threshold=6) [X.....X........] duration:
402.040073ms remote:
"tcp:34.202.203.47:443" response headers:
Date=Thu, 21 Aug 2025 18:12:14 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=us-east-1-prod-hosting-red target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-21 18:20:07 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 402.062987ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
401.73068ms
FAIL (2025-08-21 18:20:06 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 17:45:26.360745871 (312h19m7.092013491s) [upload=324704]: Starting upload Aug 21 17:45:26.360824949 (312h19m7.092092579s) [upload=324704]: Done starting upload Aug 21 17:45:26.360871646 (312h19m7.092139277s) [upload=324704]: Uploading segments... Aug 21 17:45:26.360901273 (312h19m7.092168892s) [upload=324704]: Got next segment. Inline: true Aug 21 17:45:26.360904679 (312h19m7.092172309s) [upload=324704]: Waiting for error group managing segments... Aug 21 17:45:26.360957487 (312h19m7.092225118s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 17:45:26.360961525 (312h19m7.092229155s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 17:45:26.360963790 (312h19m7.092231409s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 17:45:26.363758492 (312h19m7.095026112s) [upload=324704]: Done uploading segments... Aug 21 17:45:26.363766668 (312h19m7.095034299s) [upload=324704]: Upload finished. err: metaclient: Too Many Requests
Duration: 401.753422ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
1.767854739s
FAIL (2025-08-21 18:19:51 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 18:16:33.093033284 (312h50m13.824300914s) [upload=325238]: Starting upload Aug 21 18:16:33.093072998 (312h50m13.824340628s) [upload=325238]: Done starting upload Aug 21 18:16:33.093148541 (312h50m13.824416171s) [upload=325238]: Uploading segments... Aug 21 18:16:33.093288403 (312h50m13.824556024s) [upload=325238]: Got next segment. Inline: false Aug 21 18:16:33.093330613 (312h50m13.824598243s) [upload=325238]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 18:16:33.093347384 (312h50m13.824615004s) [upload=325238]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 18:16:33.097236411 (312h50m13.828504031s) [upload=325238]: Next segment err: metaclient: Too Many Requests Aug 21 18:16:33.097245538 (312h50m13.828513159s) [upload=325238]: Done uploading segments... Aug 21 18:16:33.097253794 (312h50m13.828521414s) [upload=325238]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.767890596s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
2 out of 15 is failed (threshold=6) [.X.....X.......] duration:
69.488495ms remote:
"tcp:34.202.203.47:443" response headers:
Date=Thu, 21 Aug 2025 18:12:14 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=us-east-1-prod-hosting-red target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-21 18:19:33 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 69.508412ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
1.465500413s
FAIL (2025-08-21 18:19:30 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 18:16:33.093033284 (312h50m13.824300914s) [upload=325238]: Starting upload Aug 21 18:16:33.093072998 (312h50m13.824340628s) [upload=325238]: Done starting upload Aug 21 18:16:33.093148541 (312h50m13.824416171s) [upload=325238]: Uploading segments... Aug 21 18:16:33.093288403 (312h50m13.824556024s) [upload=325238]: Got next segment. Inline: false Aug 21 18:16:33.093330613 (312h50m13.824598243s) [upload=325238]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 18:16:33.093347384 (312h50m13.824615004s) [upload=325238]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 18:16:33.097236411 (312h50m13.828504031s) [upload=325238]: Next segment err: metaclient: Too Many Requests Aug 21 18:16:33.097245538 (312h50m13.828513159s) [upload=325238]: Done uploading segments... Aug 21 18:16:33.097253794 (312h50m13.828521414s) [upload=325238]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.4655252s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
187.162606ms
FAIL (2025-08-21 18:19:25 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 17:45:26.360745871 (312h19m7.092013491s) [upload=324704]: Starting upload Aug 21 17:45:26.360824949 (312h19m7.092092579s) [upload=324704]: Done starting upload Aug 21 17:45:26.360871646 (312h19m7.092139277s) [upload=324704]: Uploading segments... Aug 21 17:45:26.360901273 (312h19m7.092168892s) [upload=324704]: Got next segment. Inline: true Aug 21 17:45:26.360904679 (312h19m7.092172309s) [upload=324704]: Waiting for error group managing segments... Aug 21 17:45:26.360957487 (312h19m7.092225118s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 17:45:26.360961525 (312h19m7.092229155s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 17:45:26.360963790 (312h19m7.092231409s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 17:45:26.363758492 (312h19m7.095026112s) [upload=324704]: Done uploading segments... Aug 21 17:45:26.363766668 (312h19m7.095034299s) [upload=324704]: Upload finished. err: metaclient: Too Many Requests
Duration: 187.187844ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
2 out of 15 is failed (threshold=6) [.X.X...........] duration:
99.525336ms remote:
"tcp:34.202.203.47:443" response headers:
X-Cluster-Name=us-east-1-prod-hosting-red Date=Thu, 21 Aug 2025 18:10:05 GMT Content-Type=text/html Content-Length=164 target:
https://www.storj.io/
FAIL (2025-08-21 18:19:06 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 99.550984ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
155.666724ms
FAIL (2025-08-21 18:18:31 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 17:45:26.360745871 (312h19m7.092013491s) [upload=324704]: Starting upload Aug 21 17:45:26.360824949 (312h19m7.092092579s) [upload=324704]: Done starting upload Aug 21 17:45:26.360871646 (312h19m7.092139277s) [upload=324704]: Uploading segments... Aug 21 17:45:26.360901273 (312h19m7.092168892s) [upload=324704]: Got next segment. Inline: true Aug 21 17:45:26.360904679 (312h19m7.092172309s) [upload=324704]: Waiting for error group managing segments... Aug 21 17:45:26.360957487 (312h19m7.092225118s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 17:45:26.360961525 (312h19m7.092229155s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 17:45:26.360963790 (312h19m7.092231409s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 17:45:26.363758492 (312h19m7.095026112s) [upload=324704]: Done uploading segments... Aug 21 17:45:26.363766668 (312h19m7.095034299s) [upload=324704]: Upload finished. err: metaclient: Too Many Requests
Duration: 155.69623ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
2.038898008s
FAIL (2025-08-21 18:18:25 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 18:16:33.093033284 (312h50m13.824300914s) [upload=325238]: Starting upload Aug 21 18:16:33.093072998 (312h50m13.824340628s) [upload=325238]: Done starting upload Aug 21 18:16:33.093148541 (312h50m13.824416171s) [upload=325238]: Uploading segments... Aug 21 18:16:33.093288403 (312h50m13.824556024s) [upload=325238]: Got next segment. Inline: false Aug 21 18:16:33.093330613 (312h50m13.824598243s) [upload=325238]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 18:16:33.093347384 (312h50m13.824615004s) [upload=325238]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 18:16:33.097236411 (312h50m13.828504031s) [upload=325238]: Next segment err: metaclient: Too Many Requests Aug 21 18:16:33.097245538 (312h50m13.828513159s) [upload=325238]: Done uploading segments... Aug 21 18:16:33.097253794 (312h50m13.828521414s) [upload=325238]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.038917465s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
2 out of 15 is failed (threshold=6) [..X.....X......] duration:
474.03311ms remote:
"tcp:34.202.203.47:443" response headers:
Date=Thu, 21 Aug 2025 18:12:14 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=us-east-1-prod-hosting-red target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-21 18:18:25 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 474.051535ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
138.835073ms
FAIL (2025-08-21 18:17:55 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 17:45:26.360745871 (312h19m7.092013491s) [upload=324704]: Starting upload Aug 21 17:45:26.360824949 (312h19m7.092092579s) [upload=324704]: Done starting upload Aug 21 17:45:26.360871646 (312h19m7.092139277s) [upload=324704]: Uploading segments... Aug 21 17:45:26.360901273 (312h19m7.092168892s) [upload=324704]: Got next segment. Inline: true Aug 21 17:45:26.360904679 (312h19m7.092172309s) [upload=324704]: Waiting for error group managing segments... Aug 21 17:45:26.360957487 (312h19m7.092225118s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 17:45:26.360961525 (312h19m7.092229155s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 17:45:26.360963790 (312h19m7.092231409s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 17:45:26.363758492 (312h19m7.095026112s) [upload=324704]: Done uploading segments... Aug 21 17:45:26.363766668 (312h19m7.095034299s) [upload=324704]: Upload finished. err: metaclient: Too Many Requests
Duration: 138.856374ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
2 out of 15 is failed (threshold=6) [..X.X..........] duration:
90.756293ms remote:
"tcp:34.202.203.47:443" response headers:
X-Cluster-Name=us-east-1-prod-hosting-red Date=Thu, 21 Aug 2025 18:10:05 GMT Content-Type=text/html Content-Length=164 target:
https://www.storj.io/
FAIL (2025-08-21 18:17:53 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 90.776552ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
2 out of 15 is failed (threshold=6) [...X.X.........] duration:
54.376303ms remote:
"tcp:34.202.203.47:443" response headers:
X-Cluster-Name=us-east-1-prod-hosting-red Date=Thu, 21 Aug 2025 18:10:05 GMT Content-Type=text/html Content-Length=164 target:
https://www.storj.io/
FAIL (2025-08-21 18:17:27 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 54.399356ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
1.629561536s
FAIL (2025-08-21 18:17:25 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 18:16:33.093033284 (312h50m13.824300914s) [upload=325238]: Starting upload Aug 21 18:16:33.093072998 (312h50m13.824340628s) [upload=325238]: Done starting upload Aug 21 18:16:33.093148541 (312h50m13.824416171s) [upload=325238]: Uploading segments... Aug 21 18:16:33.093288403 (312h50m13.824556024s) [upload=325238]: Got next segment. Inline: false Aug 21 18:16:33.093330613 (312h50m13.824598243s) [upload=325238]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 18:16:33.093347384 (312h50m13.824615004s) [upload=325238]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 18:16:33.097236411 (312h50m13.828504031s) [upload=325238]: Next segment err: metaclient: Too Many Requests Aug 21 18:16:33.097245538 (312h50m13.828513159s) [upload=325238]: Done uploading segments... Aug 21 18:16:33.097253794 (312h50m13.828521414s) [upload=325238]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.629582776s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
149.000271ms
FAIL (2025-08-21 18:17:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 17:45:26.360745871 (312h19m7.092013491s) [upload=324704]: Starting upload Aug 21 17:45:26.360824949 (312h19m7.092092579s) [upload=324704]: Done starting upload Aug 21 17:45:26.360871646 (312h19m7.092139277s) [upload=324704]: Uploading segments... Aug 21 17:45:26.360901273 (312h19m7.092168892s) [upload=324704]: Got next segment. Inline: true Aug 21 17:45:26.360904679 (312h19m7.092172309s) [upload=324704]: Waiting for error group managing segments... Aug 21 17:45:26.360957487 (312h19m7.092225118s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 17:45:26.360961525 (312h19m7.092229155s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 17:45:26.360963790 (312h19m7.092231409s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 17:45:26.363758492 (312h19m7.095026112s) [upload=324704]: Done uploading segments... Aug 21 17:45:26.363766668 (312h19m7.095034299s) [upload=324704]: Upload finished. err: metaclient: Too Many Requests
Duration: 149.026409ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
2 out of 15 is failed (threshold=6) [...X.....X.....] duration:
427.279567ms remote:
"tcp:34.202.203.47:443" response headers:
Date=Thu, 21 Aug 2025 18:12:14 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=us-east-1-prod-hosting-red target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-21 18:17:16 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 427.327045ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
2 out of 15 is failed (threshold=6) [....X.X........] duration:
79.426253ms remote:
"tcp:34.202.203.47:443" response headers:
X-Cluster-Name=us-east-1-prod-hosting-red Date=Thu, 21 Aug 2025 18:10:05 GMT Content-Type=text/html Content-Length=164 target:
https://www.storj.io/
FAIL (2025-08-21 18:17:00 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 79.454177ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
2 out of 15 is failed (threshold=6) [.....X.X.......] duration:
1.433868785s remote:
"tcp:34.202.203.47:443" response headers:
X-Cluster-Name=us-east-1-prod-hosting-red Date=Thu, 21 Aug 2025 18:10:05 GMT Content-Type=text/html Content-Length=164 target:
https://www.storj.io/
FAIL (2025-08-21 18:16:43 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 1.433894604s
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
17.322613ms
FAIL (2025-08-21 18:16:33 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 18:16:33.093033284 (312h50m13.824300914s) [upload=325238]: Starting upload Aug 21 18:16:33.093072998 (312h50m13.824340628s) [upload=325238]: Done starting upload Aug 21 18:16:33.093148541 (312h50m13.824416171s) [upload=325238]: Uploading segments... Aug 21 18:16:33.093288403 (312h50m13.824556024s) [upload=325238]: Got next segment. Inline: false Aug 21 18:16:33.093330613 (312h50m13.824598243s) [upload=325238]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 18:16:33.093347384 (312h50m13.824615004s) [upload=325238]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 18:16:33.097236411 (312h50m13.828504031s) [upload=325238]: Next segment err: metaclient: Too Many Requests Aug 21 18:16:33.097245538 (312h50m13.828513159s) [upload=325238]: Done uploading segments... Aug 21 18:16:33.097253794 (312h50m13.828521414s) [upload=325238]: Upload finished. err: metaclient: Too Many Requests
Duration: 17.337281ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
439.262189ms
FAIL (2025-08-21 18:16:27 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 17:45:26.360745871 (312h19m7.092013491s) [upload=324704]: Starting upload Aug 21 17:45:26.360824949 (312h19m7.092092579s) [upload=324704]: Done starting upload Aug 21 17:45:26.360871646 (312h19m7.092139277s) [upload=324704]: Uploading segments... Aug 21 17:45:26.360901273 (312h19m7.092168892s) [upload=324704]: Got next segment. Inline: true Aug 21 17:45:26.360904679 (312h19m7.092172309s) [upload=324704]: Waiting for error group managing segments... Aug 21 17:45:26.360957487 (312h19m7.092225118s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 17:45:26.360961525 (312h19m7.092229155s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 17:45:26.360963790 (312h19m7.092231409s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 17:45:26.363758492 (312h19m7.095026112s) [upload=324704]: Done uploading segments... Aug 21 17:45:26.363766668 (312h19m7.095034299s) [upload=324704]: Upload finished. err: metaclient: Too Many Requests
Duration: 439.276214ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
510.234901ms
FAIL (2025-08-21 18:16:08 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 17:45:26.360745871 (312h19m7.092013491s) [upload=324704]: Starting upload Aug 21 17:45:26.360824949 (312h19m7.092092579s) [upload=324704]: Done starting upload Aug 21 17:45:26.360871646 (312h19m7.092139277s) [upload=324704]: Uploading segments... Aug 21 17:45:26.360901273 (312h19m7.092168892s) [upload=324704]: Got next segment. Inline: true Aug 21 17:45:26.360904679 (312h19m7.092172309s) [upload=324704]: Waiting for error group managing segments... Aug 21 17:45:26.360957487 (312h19m7.092225118s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 17:45:26.360961525 (312h19m7.092229155s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 17:45:26.360963790 (312h19m7.092231409s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 17:45:26.363758492 (312h19m7.095026112s) [upload=324704]: Done uploading segments... Aug 21 17:45:26.363766668 (312h19m7.095034299s) [upload=324704]: Upload finished. err: metaclient: Too Many Requests
Duration: 510.263324ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
2 out of 15 is failed (threshold=6) [....X.....X....] duration:
74.475824ms remote:
"tcp:34.202.203.47:443" response headers:
Date=Thu, 21 Aug 2025 18:12:14 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=us-east-1-prod-hosting-red target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-21 18:16:07 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 74.518485ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
2.042454834s
FAIL (2025-08-21 18:15:42 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 17:33:59.350385001 (312h7m40.081652621s) [upload=324499]: Starting upload Aug 21 17:33:59.350415309 (312h7m40.08168294s) [upload=324499]: Done starting upload Aug 21 17:33:59.350640743 (312h7m40.081908373s) [upload=324499]: Uploading segments... Aug 21 17:33:59.351323566 (312h7m40.082591187s) [upload=324499]: Got next segment. Inline: false Aug 21 17:33:59.351374332 (312h7m40.082641952s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 17:33:59.351378549 (312h7m40.08264617s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 17:33:59.354517922 (312h7m40.085785582s) [upload=324499]: Next segment err: metaclient: Too Many Requests Aug 21 17:33:59.354532639 (312h7m40.085800269s) [upload=324499]: Done uploading segments... Aug 21 17:33:59.354542808 (312h7m40.085810438s) [upload=324499]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.042480953s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
361.656643ms
FAIL (2025-08-21 18:15:38 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 17:45:26.360745871 (312h19m7.092013491s) [upload=324704]: Starting upload Aug 21 17:45:26.360824949 (312h19m7.092092579s) [upload=324704]: Done starting upload Aug 21 17:45:26.360871646 (312h19m7.092139277s) [upload=324704]: Uploading segments... Aug 21 17:45:26.360901273 (312h19m7.092168892s) [upload=324704]: Got next segment. Inline: true Aug 21 17:45:26.360904679 (312h19m7.092172309s) [upload=324704]: Waiting for error group managing segments... Aug 21 17:45:26.360957487 (312h19m7.092225118s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 17:45:26.360961525 (312h19m7.092229155s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 17:45:26.360963790 (312h19m7.092231409s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 17:45:26.363758492 (312h19m7.095026112s) [upload=324704]: Done uploading segments... Aug 21 17:45:26.363766668 (312h19m7.095034299s) [upload=324704]: Upload finished. err: metaclient: Too Many Requests
Duration: 361.67589ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
2 out of 15 is failed (threshold=6) [......X.X......] duration:
96.252673ms remote:
"tcp:34.202.203.47:443" response headers:
X-Cluster-Name=us-east-1-prod-hosting-red Date=Thu, 21 Aug 2025 18:10:05 GMT Content-Type=text/html Content-Length=164 target:
https://www.storj.io/
FAIL (2025-08-21 18:15:27 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 96.270086ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
171.342021ms
FAIL (2025-08-21 18:14:54 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 17:45:26.360745871 (312h19m7.092013491s) [upload=324704]: Starting upload Aug 21 17:45:26.360824949 (312h19m7.092092579s) [upload=324704]: Done starting upload Aug 21 17:45:26.360871646 (312h19m7.092139277s) [upload=324704]: Uploading segments... Aug 21 17:45:26.360901273 (312h19m7.092168892s) [upload=324704]: Got next segment. Inline: true Aug 21 17:45:26.360904679 (312h19m7.092172309s) [upload=324704]: Waiting for error group managing segments... Aug 21 17:45:26.360957487 (312h19m7.092225118s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 17:45:26.360961525 (312h19m7.092229155s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 17:45:26.360963790 (312h19m7.092231409s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 17:45:26.363758492 (312h19m7.095026112s) [upload=324704]: Done uploading segments... Aug 21 17:45:26.363766668 (312h19m7.095034299s) [upload=324704]: Upload finished. err: metaclient: Too Many Requests
Duration: 171.361027ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
2 out of 15 is failed (threshold=6) [.....X.....X...] duration:
219.362487ms remote:
"tcp:34.202.203.47:443" response headers:
Date=Thu, 21 Aug 2025 18:12:14 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=us-east-1-prod-hosting-red target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-21 18:14:52 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 219.38007ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
2 out of 15 is failed (threshold=6) [......X.....X..] duration:
479.681855ms remote:
"tcp:34.202.203.47:443" response headers:
Date=Thu, 21 Aug 2025 18:12:14 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=us-east-1-prod-hosting-red target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-21 18:14:29 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 479.709786ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
2.084243962s
FAIL (2025-08-21 18:14:28 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 17:33:59.350385001 (312h7m40.081652621s) [upload=324499]: Starting upload Aug 21 17:33:59.350415309 (312h7m40.08168294s) [upload=324499]: Done starting upload Aug 21 17:33:59.350640743 (312h7m40.081908373s) [upload=324499]: Uploading segments... Aug 21 17:33:59.351323566 (312h7m40.082591187s) [upload=324499]: Got next segment. Inline: false Aug 21 17:33:59.351374332 (312h7m40.082641952s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 17:33:59.351378549 (312h7m40.08264617s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 17:33:59.354517922 (312h7m40.085785582s) [upload=324499]: Next segment err: metaclient: Too Many Requests Aug 21 17:33:59.354532639 (312h7m40.085800269s) [upload=324499]: Done uploading segments... Aug 21 17:33:59.354542808 (312h7m40.085810438s) [upload=324499]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.084273488s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
2 out of 15 is failed (threshold=6) [.......X.X.....] duration:
81.479249ms remote:
"tcp:34.202.203.47:443" response headers:
X-Cluster-Name=us-east-1-prod-hosting-red Date=Thu, 21 Aug 2025 18:10:05 GMT Content-Type=text/html Content-Length=164 target:
https://www.storj.io/
FAIL (2025-08-21 18:14:23 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 81.500549ms
core
website
|