Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
1.343004087s
FAIL (2025-08-25 00:55:49 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 00:25:28.400683968 (390h59m9.131951598s) [upload=406444]: Starting upload Aug 25 00:25:28.400740554 (390h59m9.132008184s) [upload=406444]: Done starting upload Aug 25 00:25:28.400969294 (390h59m9.132236924s) [upload=406444]: Uploading segments... Aug 25 00:25:28.400998699 (390h59m9.132266329s) [upload=406444]: Got next segment. Inline: false Aug 25 00:25:28.401020590 (390h59m9.13228822s) [upload=406444]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 00:25:28.401024117 (390h59m9.132291747s) [upload=406444]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 00:25:28.403715205 (390h59m9.134982825s) [upload=406444]: Next segment err: metaclient: Too Many Requests Aug 25 00:25:28.403727398 (390h59m9.134995017s) [upload=406444]: Done uploading segments... Aug 25 00:25:28.403753247 (390h59m9.135020877s) [upload=406444]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.343027632s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
213.723313ms
FAIL (2025-08-25 00:55:34 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 00:34:31.724244888 (391h8m12.455512539s) [upload=406603]: Starting upload Aug 25 00:34:31.724305743 (391h8m12.455573392s) [upload=406603]: Done starting upload Aug 25 00:34:31.724386896 (391h8m12.455654555s) [upload=406603]: Uploading segments... Aug 25 00:34:31.724479178 (391h8m12.455746829s) [upload=406603]: Got next segment. Inline: true Aug 25 00:34:31.724484819 (391h8m12.455752479s) [upload=406603]: Waiting for error group managing segments... Aug 25 00:34:31.724528791 (391h8m12.455796442s) [upload=406603]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 00:34:31.724533932 (391h8m12.455801581s) [upload=406603]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 00:34:31.724537368 (391h8m12.455805018s) [upload=406603]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 00:34:31.727506599 (391h8m12.458774249s) [upload=406603]: Done uploading segments... Aug 25 00:34:31.727519223 (391h8m12.458786872s) [upload=406603]: Upload finished. err: metaclient: Too Many Requests
Duration: 213.748691ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
816.400914ms
FAIL (2025-08-25 00:55:30 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 00:25:28.400683968 (390h59m9.131951598s) [upload=406444]: Starting upload Aug 25 00:25:28.400740554 (390h59m9.132008184s) [upload=406444]: Done starting upload Aug 25 00:25:28.400969294 (390h59m9.132236924s) [upload=406444]: Uploading segments... Aug 25 00:25:28.400998699 (390h59m9.132266329s) [upload=406444]: Got next segment. Inline: false Aug 25 00:25:28.401020590 (390h59m9.13228822s) [upload=406444]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 00:25:28.401024117 (390h59m9.132291747s) [upload=406444]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 00:25:28.403715205 (390h59m9.134982825s) [upload=406444]: Next segment err: metaclient: Too Many Requests Aug 25 00:25:28.403727398 (390h59m9.134995017s) [upload=406444]: Done uploading segments... Aug 25 00:25:28.403753247 (390h59m9.135020877s) [upload=406444]: Upload finished. err: metaclient: Too Many Requests
Duration: 816.426872ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....XX.....................................................] duration:
3.037183967s
FAIL (2025-08-25 00:55:25 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 3.037208893s
core
uplink
eu1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
618.628666ms
FAIL (2025-08-25 00:55:15 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 618.649807ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
167.775242ms
FAIL (2025-08-25 00:55:11 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 00:34:31.724244888 (391h8m12.455512539s) [upload=406603]: Starting upload Aug 25 00:34:31.724305743 (391h8m12.455573392s) [upload=406603]: Done starting upload Aug 25 00:34:31.724386896 (391h8m12.455654555s) [upload=406603]: Uploading segments... Aug 25 00:34:31.724479178 (391h8m12.455746829s) [upload=406603]: Got next segment. Inline: true Aug 25 00:34:31.724484819 (391h8m12.455752479s) [upload=406603]: Waiting for error group managing segments... Aug 25 00:34:31.724528791 (391h8m12.455796442s) [upload=406603]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 00:34:31.724533932 (391h8m12.455801581s) [upload=406603]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 00:34:31.724537368 (391h8m12.455805018s) [upload=406603]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 00:34:31.727506599 (391h8m12.458774249s) [upload=406603]: Done uploading segments... Aug 25 00:34:31.727519223 (391h8m12.458786872s) [upload=406603]: Upload finished. err: metaclient: Too Many Requests
Duration: 167.802554ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
1.106198196s
FAIL (2025-08-25 00:55:10 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 00:25:28.400683968 (390h59m9.131951598s) [upload=406444]: Starting upload Aug 25 00:25:28.400740554 (390h59m9.132008184s) [upload=406444]: Done starting upload Aug 25 00:25:28.400969294 (390h59m9.132236924s) [upload=406444]: Uploading segments... Aug 25 00:25:28.400998699 (390h59m9.132266329s) [upload=406444]: Got next segment. Inline: false Aug 25 00:25:28.401020590 (390h59m9.13228822s) [upload=406444]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 00:25:28.401024117 (390h59m9.132291747s) [upload=406444]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 00:25:28.403715205 (390h59m9.134982825s) [upload=406444]: Next segment err: metaclient: Too Many Requests Aug 25 00:25:28.403727398 (390h59m9.134995017s) [upload=406444]: Done uploading segments... Aug 25 00:25:28.403753247 (390h59m9.135020877s) [upload=406444]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.106218865s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
243.868646ms
FAIL (2025-08-25 00:54:56 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 00:34:31.724244888 (391h8m12.455512539s) [upload=406603]: Starting upload Aug 25 00:34:31.724305743 (391h8m12.455573392s) [upload=406603]: Done starting upload Aug 25 00:34:31.724386896 (391h8m12.455654555s) [upload=406603]: Uploading segments... Aug 25 00:34:31.724479178 (391h8m12.455746829s) [upload=406603]: Got next segment. Inline: true Aug 25 00:34:31.724484819 (391h8m12.455752479s) [upload=406603]: Waiting for error group managing segments... Aug 25 00:34:31.724528791 (391h8m12.455796442s) [upload=406603]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 00:34:31.724533932 (391h8m12.455801581s) [upload=406603]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 00:34:31.724537368 (391h8m12.455805018s) [upload=406603]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 00:34:31.727506599 (391h8m12.458774249s) [upload=406603]: Done uploading segments... Aug 25 00:34:31.727519223 (391h8m12.458786872s) [upload=406603]: Upload finished. err: metaclient: Too Many Requests
Duration: 243.888214ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
619.764482ms
FAIL (2025-08-25 00:54:40 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 619.875832ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [......XX....................................................] duration:
3.517162716s
FAIL (2025-08-25 00:54:28 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 3.517184156s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
452.512414ms
FAIL (2025-08-25 00:54:20 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 00:25:28.400683968 (390h59m9.131951598s) [upload=406444]: Starting upload Aug 25 00:25:28.400740554 (390h59m9.132008184s) [upload=406444]: Done starting upload Aug 25 00:25:28.400969294 (390h59m9.132236924s) [upload=406444]: Uploading segments... Aug 25 00:25:28.400998699 (390h59m9.132266329s) [upload=406444]: Got next segment. Inline: false Aug 25 00:25:28.401020590 (390h59m9.13228822s) [upload=406444]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 00:25:28.401024117 (390h59m9.132291747s) [upload=406444]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 00:25:28.403715205 (390h59m9.134982825s) [upload=406444]: Next segment err: metaclient: Too Many Requests Aug 25 00:25:28.403727398 (390h59m9.134995017s) [upload=406444]: Done uploading segments... Aug 25 00:25:28.403753247 (390h59m9.135020877s) [upload=406444]: Upload finished. err: metaclient: Too Many Requests
Duration: 452.538722ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......XX...................................................] duration:
3.264653302s
FAIL (2025-08-25 00:54:09 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 3.264676135s
core
uplink
eu1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
337.870263ms
FAIL (2025-08-25 00:54:09 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 337.904ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
191.15541ms
FAIL (2025-08-25 00:54:08 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 00:34:31.724244888 (391h8m12.455512539s) [upload=406603]: Starting upload Aug 25 00:34:31.724305743 (391h8m12.455573392s) [upload=406603]: Done starting upload Aug 25 00:34:31.724386896 (391h8m12.455654555s) [upload=406603]: Uploading segments... Aug 25 00:34:31.724479178 (391h8m12.455746829s) [upload=406603]: Got next segment. Inline: true Aug 25 00:34:31.724484819 (391h8m12.455752479s) [upload=406603]: Waiting for error group managing segments... Aug 25 00:34:31.724528791 (391h8m12.455796442s) [upload=406603]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 00:34:31.724533932 (391h8m12.455801581s) [upload=406603]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 00:34:31.724537368 (391h8m12.455805018s) [upload=406603]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 00:34:31.727506599 (391h8m12.458774249s) [upload=406603]: Done uploading segments... Aug 25 00:34:31.727519223 (391h8m12.458786872s) [upload=406603]: Upload finished. err: metaclient: Too Many Requests
Duration: 191.186318ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
2.056444858s
FAIL (2025-08-25 00:54:06 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 00:25:28.400683968 (390h59m9.131951598s) [upload=406444]: Starting upload Aug 25 00:25:28.400740554 (390h59m9.132008184s) [upload=406444]: Done starting upload Aug 25 00:25:28.400969294 (390h59m9.132236924s) [upload=406444]: Uploading segments... Aug 25 00:25:28.400998699 (390h59m9.132266329s) [upload=406444]: Got next segment. Inline: false Aug 25 00:25:28.401020590 (390h59m9.13228822s) [upload=406444]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 00:25:28.401024117 (390h59m9.132291747s) [upload=406444]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 00:25:28.403715205 (390h59m9.134982825s) [upload=406444]: Next segment err: metaclient: Too Many Requests Aug 25 00:25:28.403727398 (390h59m9.134995017s) [upload=406444]: Done uploading segments... Aug 25 00:25:28.403753247 (390h59m9.135020877s) [upload=406444]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.056472049s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
273.906097ms
FAIL (2025-08-25 00:53:36 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 00:34:31.724244888 (391h8m12.455512539s) [upload=406603]: Starting upload Aug 25 00:34:31.724305743 (391h8m12.455573392s) [upload=406603]: Done starting upload Aug 25 00:34:31.724386896 (391h8m12.455654555s) [upload=406603]: Uploading segments... Aug 25 00:34:31.724479178 (391h8m12.455746829s) [upload=406603]: Got next segment. Inline: true Aug 25 00:34:31.724484819 (391h8m12.455752479s) [upload=406603]: Waiting for error group managing segments... Aug 25 00:34:31.724528791 (391h8m12.455796442s) [upload=406603]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 00:34:31.724533932 (391h8m12.455801581s) [upload=406603]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 00:34:31.724537368 (391h8m12.455805018s) [upload=406603]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 00:34:31.727506599 (391h8m12.458774249s) [upload=406603]: Done uploading segments... Aug 25 00:34:31.727519223 (391h8m12.458786872s) [upload=406603]: Upload finished. err: metaclient: Too Many Requests
Duration: 273.93455ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [........XX..................................................] duration:
2.847612911s
FAIL (2025-08-25 00:53:03 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 2.847645463s
core
uplink
eu1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
364.966858ms
FAIL (2025-08-25 00:53:00 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 364.996525ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
145.056519ms
FAIL (2025-08-25 00:52:56 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 00:34:31.724244888 (391h8m12.455512539s) [upload=406603]: Starting upload Aug 25 00:34:31.724305743 (391h8m12.455573392s) [upload=406603]: Done starting upload Aug 25 00:34:31.724386896 (391h8m12.455654555s) [upload=406603]: Uploading segments... Aug 25 00:34:31.724479178 (391h8m12.455746829s) [upload=406603]: Got next segment. Inline: true Aug 25 00:34:31.724484819 (391h8m12.455752479s) [upload=406603]: Waiting for error group managing segments... Aug 25 00:34:31.724528791 (391h8m12.455796442s) [upload=406603]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 00:34:31.724533932 (391h8m12.455801581s) [upload=406603]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 00:34:31.724537368 (391h8m12.455805018s) [upload=406603]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 00:34:31.727506599 (391h8m12.458774249s) [upload=406603]: Done uploading segments... Aug 25 00:34:31.727519223 (391h8m12.458786872s) [upload=406603]: Upload finished. err: metaclient: Too Many Requests
Duration: 145.076615ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
1.73029348s
FAIL (2025-08-25 00:52:54 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 00:25:28.400683968 (390h59m9.131951598s) [upload=406444]: Starting upload Aug 25 00:25:28.400740554 (390h59m9.132008184s) [upload=406444]: Done starting upload Aug 25 00:25:28.400969294 (390h59m9.132236924s) [upload=406444]: Uploading segments... Aug 25 00:25:28.400998699 (390h59m9.132266329s) [upload=406444]: Got next segment. Inline: false Aug 25 00:25:28.401020590 (390h59m9.13228822s) [upload=406444]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 00:25:28.401024117 (390h59m9.132291747s) [upload=406444]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 00:25:28.403715205 (390h59m9.134982825s) [upload=406444]: Next segment err: metaclient: Too Many Requests Aug 25 00:25:28.403727398 (390h59m9.134995017s) [upload=406444]: Done uploading segments... Aug 25 00:25:28.403753247 (390h59m9.135020877s) [upload=406444]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.730317745s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........XX.................................................] duration:
2.91029304s
FAIL (2025-08-25 00:52:47 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 2.91032582s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
2.096313771s
FAIL (2025-08-25 00:52:28 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 00:25:28.400683968 (390h59m9.131951598s) [upload=406444]: Starting upload Aug 25 00:25:28.400740554 (390h59m9.132008184s) [upload=406444]: Done starting upload Aug 25 00:25:28.400969294 (390h59m9.132236924s) [upload=406444]: Uploading segments... Aug 25 00:25:28.400998699 (390h59m9.132266329s) [upload=406444]: Got next segment. Inline: false Aug 25 00:25:28.401020590 (390h59m9.13228822s) [upload=406444]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 00:25:28.401024117 (390h59m9.132291747s) [upload=406444]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 00:25:28.403715205 (390h59m9.134982825s) [upload=406444]: Next segment err: metaclient: Too Many Requests Aug 25 00:25:28.403727398 (390h59m9.134995017s) [upload=406444]: Done uploading segments... Aug 25 00:25:28.403753247 (390h59m9.135020877s) [upload=406444]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.096340311s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
1.254582286s
FAIL (2025-08-25 00:52:13 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.254604829s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........XX................................................] duration:
3.573698539s
FAIL (2025-08-25 00:52:10 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 3.573852918s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
1.423202606s
FAIL (2025-08-25 00:52:06 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 00:25:28.400683968 (390h59m9.131951598s) [upload=406444]: Starting upload Aug 25 00:25:28.400740554 (390h59m9.132008184s) [upload=406444]: Done starting upload Aug 25 00:25:28.400969294 (390h59m9.132236924s) [upload=406444]: Uploading segments... Aug 25 00:25:28.400998699 (390h59m9.132266329s) [upload=406444]: Got next segment. Inline: false Aug 25 00:25:28.401020590 (390h59m9.13228822s) [upload=406444]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 00:25:28.401024117 (390h59m9.132291747s) [upload=406444]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 00:25:28.403715205 (390h59m9.134982825s) [upload=406444]: Next segment err: metaclient: Too Many Requests Aug 25 00:25:28.403727398 (390h59m9.134995017s) [upload=406444]: Done uploading segments... Aug 25 00:25:28.403753247 (390h59m9.135020877s) [upload=406444]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.423222523s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
180.773149ms
FAIL (2025-08-25 00:51:44 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 00:34:31.724244888 (391h8m12.455512539s) [upload=406603]: Starting upload Aug 25 00:34:31.724305743 (391h8m12.455573392s) [upload=406603]: Done starting upload Aug 25 00:34:31.724386896 (391h8m12.455654555s) [upload=406603]: Uploading segments... Aug 25 00:34:31.724479178 (391h8m12.455746829s) [upload=406603]: Got next segment. Inline: true Aug 25 00:34:31.724484819 (391h8m12.455752479s) [upload=406603]: Waiting for error group managing segments... Aug 25 00:34:31.724528791 (391h8m12.455796442s) [upload=406603]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 00:34:31.724533932 (391h8m12.455801581s) [upload=406603]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 00:34:31.724537368 (391h8m12.455805018s) [upload=406603]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 00:34:31.727506599 (391h8m12.458774249s) [upload=406603]: Done uploading segments... Aug 25 00:34:31.727519223 (391h8m12.458786872s) [upload=406603]: Upload finished. err: metaclient: Too Many Requests
Duration: 180.79487ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
495.182696ms
FAIL (2025-08-25 00:51:42 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 495.20616ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........XX...............................................] duration:
3.656842597s
FAIL (2025-08-25 00:51:24 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 3.656862285s
core
uplink
eu1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
439.148098ms
FAIL (2025-08-25 00:51:05 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 439.186571ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
2.103022393s
FAIL (2025-08-25 00:50:56 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 00:25:28.400683968 (390h59m9.131951598s) [upload=406444]: Starting upload Aug 25 00:25:28.400740554 (390h59m9.132008184s) [upload=406444]: Done starting upload Aug 25 00:25:28.400969294 (390h59m9.132236924s) [upload=406444]: Uploading segments... Aug 25 00:25:28.400998699 (390h59m9.132266329s) [upload=406444]: Got next segment. Inline: false Aug 25 00:25:28.401020590 (390h59m9.13228822s) [upload=406444]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 00:25:28.401024117 (390h59m9.132291747s) [upload=406444]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 00:25:28.403715205 (390h59m9.134982825s) [upload=406444]: Next segment err: metaclient: Too Many Requests Aug 25 00:25:28.403727398 (390h59m9.134995017s) [upload=406444]: Done uploading segments... Aug 25 00:25:28.403753247 (390h59m9.135020877s) [upload=406444]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.103044374s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
421.529135ms
FAIL (2025-08-25 00:50:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 00:34:31.724244888 (391h8m12.455512539s) [upload=406603]: Starting upload Aug 25 00:34:31.724305743 (391h8m12.455573392s) [upload=406603]: Done starting upload Aug 25 00:34:31.724386896 (391h8m12.455654555s) [upload=406603]: Uploading segments... Aug 25 00:34:31.724479178 (391h8m12.455746829s) [upload=406603]: Got next segment. Inline: true Aug 25 00:34:31.724484819 (391h8m12.455752479s) [upload=406603]: Waiting for error group managing segments... Aug 25 00:34:31.724528791 (391h8m12.455796442s) [upload=406603]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 00:34:31.724533932 (391h8m12.455801581s) [upload=406603]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 00:34:31.724537368 (391h8m12.455805018s) [upload=406603]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 00:34:31.727506599 (391h8m12.458774249s) [upload=406603]: Done uploading segments... Aug 25 00:34:31.727519223 (391h8m12.458786872s) [upload=406603]: Upload finished. err: metaclient: Too Many Requests
Duration: 421.567757ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [............XX..............................................] duration:
4.750969477s
FAIL (2025-08-25 00:50:34 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 4.750994093s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
1.89137539s
FAIL (2025-08-25 00:50:17 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 00:25:28.400683968 (390h59m9.131951598s) [upload=406444]: Starting upload Aug 25 00:25:28.400740554 (390h59m9.132008184s) [upload=406444]: Done starting upload Aug 25 00:25:28.400969294 (390h59m9.132236924s) [upload=406444]: Uploading segments... Aug 25 00:25:28.400998699 (390h59m9.132266329s) [upload=406444]: Got next segment. Inline: false Aug 25 00:25:28.401020590 (390h59m9.13228822s) [upload=406444]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 00:25:28.401024117 (390h59m9.132291747s) [upload=406444]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 00:25:28.403715205 (390h59m9.134982825s) [upload=406444]: Next segment err: metaclient: Too Many Requests Aug 25 00:25:28.403727398 (390h59m9.134995017s) [upload=406444]: Done uploading segments... Aug 25 00:25:28.403753247 (390h59m9.135020877s) [upload=406444]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.891398564s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
588.164475ms
FAIL (2025-08-25 00:50:13 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 588.249396ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
396.787781ms
FAIL (2025-08-25 00:49:59 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 00:25:28.400683968 (390h59m9.131951598s) [upload=406444]: Starting upload Aug 25 00:25:28.400740554 (390h59m9.132008184s) [upload=406444]: Done starting upload Aug 25 00:25:28.400969294 (390h59m9.132236924s) [upload=406444]: Uploading segments... Aug 25 00:25:28.400998699 (390h59m9.132266329s) [upload=406444]: Got next segment. Inline: false Aug 25 00:25:28.401020590 (390h59m9.13228822s) [upload=406444]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 00:25:28.401024117 (390h59m9.132291747s) [upload=406444]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 00:25:28.403715205 (390h59m9.134982825s) [upload=406444]: Next segment err: metaclient: Too Many Requests Aug 25 00:25:28.403727398 (390h59m9.134995017s) [upload=406444]: Done uploading segments... Aug 25 00:25:28.403753247 (390h59m9.135020877s) [upload=406444]: Upload finished. err: metaclient: Too Many Requests
Duration: 396.814621ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
442.316431ms
FAIL (2025-08-25 00:49:50 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 442.34755ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............XX.............................................] duration:
3.065132861s
FAIL (2025-08-25 00:49:34 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 3.065160772s
core
uplink
eu1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
652.106313ms
FAIL (2025-08-25 00:49:33 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 652.129787ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
1.343514202s
FAIL (2025-08-25 00:49:25 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 00:34:31.724244888 (391h8m12.455512539s) [upload=406603]: Starting upload Aug 25 00:34:31.724305743 (391h8m12.455573392s) [upload=406603]: Done starting upload Aug 25 00:34:31.724386896 (391h8m12.455654555s) [upload=406603]: Uploading segments... Aug 25 00:34:31.724479178 (391h8m12.455746829s) [upload=406603]: Got next segment. Inline: true Aug 25 00:34:31.724484819 (391h8m12.455752479s) [upload=406603]: Waiting for error group managing segments... Aug 25 00:34:31.724528791 (391h8m12.455796442s) [upload=406603]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 00:34:31.724533932 (391h8m12.455801581s) [upload=406603]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 00:34:31.724537368 (391h8m12.455805018s) [upload=406603]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 00:34:31.727506599 (391h8m12.458774249s) [upload=406603]: Done uploading segments... Aug 25 00:34:31.727519223 (391h8m12.458786872s) [upload=406603]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.343543136s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............XX............................................] duration:
3.267002183s
FAIL (2025-08-25 00:49:14 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 3.267035755s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
1.95978886s
FAIL (2025-08-25 00:49:09 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 00:25:28.400683968 (390h59m9.131951598s) [upload=406444]: Starting upload Aug 25 00:25:28.400740554 (390h59m9.132008184s) [upload=406444]: Done starting upload Aug 25 00:25:28.400969294 (390h59m9.132236924s) [upload=406444]: Uploading segments... Aug 25 00:25:28.400998699 (390h59m9.132266329s) [upload=406444]: Got next segment. Inline: false Aug 25 00:25:28.401020590 (390h59m9.13228822s) [upload=406444]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 00:25:28.401024117 (390h59m9.132291747s) [upload=406444]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 00:25:28.403715205 (390h59m9.134982825s) [upload=406444]: Next segment err: metaclient: Too Many Requests Aug 25 00:25:28.403727398 (390h59m9.134995017s) [upload=406444]: Done uploading segments... Aug 25 00:25:28.403753247 (390h59m9.135020877s) [upload=406444]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.959812415s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
390.578801ms
FAIL (2025-08-25 00:49:06 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 390.603669ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
590.758621ms
FAIL (2025-08-25 00:48:40 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 590.776425ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
360.182828ms
FAIL (2025-08-25 00:48:35 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 00:25:28.400683968 (390h59m9.131951598s) [upload=406444]: Starting upload Aug 25 00:25:28.400740554 (390h59m9.132008184s) [upload=406444]: Done starting upload Aug 25 00:25:28.400969294 (390h59m9.132236924s) [upload=406444]: Uploading segments... Aug 25 00:25:28.400998699 (390h59m9.132266329s) [upload=406444]: Got next segment. Inline: false Aug 25 00:25:28.401020590 (390h59m9.13228822s) [upload=406444]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 00:25:28.401024117 (390h59m9.132291747s) [upload=406444]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 00:25:28.403715205 (390h59m9.134982825s) [upload=406444]: Next segment err: metaclient: Too Many Requests Aug 25 00:25:28.403727398 (390h59m9.134995017s) [upload=406444]: Done uploading segments... Aug 25 00:25:28.403753247 (390h59m9.135020877s) [upload=406444]: Upload finished. err: metaclient: Too Many Requests
Duration: 360.198908ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
793.223525ms
FAIL (2025-08-25 00:48:22 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 793.246018ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
2.130401862s
FAIL (2025-08-25 00:48:18 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 00:25:28.400683968 (390h59m9.131951598s) [upload=406444]: Starting upload Aug 25 00:25:28.400740554 (390h59m9.132008184s) [upload=406444]: Done starting upload Aug 25 00:25:28.400969294 (390h59m9.132236924s) [upload=406444]: Uploading segments... Aug 25 00:25:28.400998699 (390h59m9.132266329s) [upload=406444]: Got next segment. Inline: false Aug 25 00:25:28.401020590 (390h59m9.13228822s) [upload=406444]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 00:25:28.401024117 (390h59m9.132291747s) [upload=406444]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 00:25:28.403715205 (390h59m9.134982825s) [upload=406444]: Next segment err: metaclient: Too Many Requests Aug 25 00:25:28.403727398 (390h59m9.134995017s) [upload=406444]: Done uploading segments... Aug 25 00:25:28.403753247 (390h59m9.135020877s) [upload=406444]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.130456854s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
134.576608ms
FAIL (2025-08-25 00:48:16 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 00:34:31.724244888 (391h8m12.455512539s) [upload=406603]: Starting upload Aug 25 00:34:31.724305743 (391h8m12.455573392s) [upload=406603]: Done starting upload Aug 25 00:34:31.724386896 (391h8m12.455654555s) [upload=406603]: Uploading segments... Aug 25 00:34:31.724479178 (391h8m12.455746829s) [upload=406603]: Got next segment. Inline: true Aug 25 00:34:31.724484819 (391h8m12.455752479s) [upload=406603]: Waiting for error group managing segments... Aug 25 00:34:31.724528791 (391h8m12.455796442s) [upload=406603]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 00:34:31.724533932 (391h8m12.455801581s) [upload=406603]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 00:34:31.724537368 (391h8m12.455805018s) [upload=406603]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 00:34:31.727506599 (391h8m12.458774249s) [upload=406603]: Done uploading segments... Aug 25 00:34:31.727519223 (391h8m12.458786872s) [upload=406603]: Upload finished. err: metaclient: Too Many Requests
Duration: 134.600374ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............XX...........................................] duration:
3.641874675s
FAIL (2025-08-25 00:48:14 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 3.641895404s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
1.967153352s
FAIL (2025-08-25 00:48:00 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 00:25:28.400683968 (390h59m9.131951598s) [upload=406444]: Starting upload Aug 25 00:25:28.400740554 (390h59m9.132008184s) [upload=406444]: Done starting upload Aug 25 00:25:28.400969294 (390h59m9.132236924s) [upload=406444]: Uploading segments... Aug 25 00:25:28.400998699 (390h59m9.132266329s) [upload=406444]: Got next segment. Inline: false Aug 25 00:25:28.401020590 (390h59m9.13228822s) [upload=406444]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 00:25:28.401024117 (390h59m9.132291747s) [upload=406444]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 00:25:28.403715205 (390h59m9.134982825s) [upload=406444]: Next segment err: metaclient: Too Many Requests Aug 25 00:25:28.403727398 (390h59m9.134995017s) [upload=406444]: Done uploading segments... Aug 25 00:25:28.403753247 (390h59m9.135020877s) [upload=406444]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.967176996s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
387.124399ms
FAIL (2025-08-25 00:47:55 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 387.144967ms
edge
gateway
us-select-1
|