Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
7 out of 60 is failed (threshold=3) [.....................X..............X......X.X......X.XX....] duration:
11.662915872s
FAIL (2025-08-28 04:13:24 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 11.662947121s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
147.255328ms
FAIL (2025-08-28 04:13:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 03:31:16.231447152 (9h52m39.460932539s) [upload=10235]: Starting upload Aug 28 03:31:16.231519408 (9h52m39.461004785s) [upload=10235]: Done starting upload Aug 28 03:31:16.231583228 (9h52m39.461068585s) [upload=10235]: Uploading segments... Aug 28 03:31:16.231643191 (9h52m39.461128548s) [upload=10235]: Got next segment. Inline: true Aug 28 03:31:16.231647810 (9h52m39.461133167s) [upload=10235]: Waiting for error group managing segments... Aug 28 03:31:16.231694668 (9h52m39.461180026s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 03:31:16.231700640 (9h52m39.461185987s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 03:31:16.231704798 (9h52m39.461190255s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 03:31:16.234679888 (9h52m39.464165245s) [upload=10235]: Done uploading segments... Aug 28 03:31:16.234688254 (9h52m39.464173611s) [upload=10235]: Upload finished. err: metaclient: Too Many Requests
Duration: 147.281507ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
8 out of 60 is failed (threshold=3) [.....................X.X........X.......X..XXX.......X......] duration:
3.19274516s
FAIL (2025-08-28 04:13:19 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 3.192770606s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
8 out of 60 is failed (threshold=3) [......................X.X........X.......X..XXX.......X.....] duration:
15.825625786s
FAIL (2025-08-28 04:13:16 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 15.82565395s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
117.667806ms
FAIL (2025-08-28 04:12:51 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 03:31:16.231447152 (9h52m39.460932539s) [upload=10235]: Starting upload Aug 28 03:31:16.231519408 (9h52m39.461004785s) [upload=10235]: Done starting upload Aug 28 03:31:16.231583228 (9h52m39.461068585s) [upload=10235]: Uploading segments... Aug 28 03:31:16.231643191 (9h52m39.461128548s) [upload=10235]: Got next segment. Inline: true Aug 28 03:31:16.231647810 (9h52m39.461133167s) [upload=10235]: Waiting for error group managing segments... Aug 28 03:31:16.231694668 (9h52m39.461180026s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 03:31:16.231700640 (9h52m39.461185987s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 03:31:16.231704798 (9h52m39.461190255s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 03:31:16.234679888 (9h52m39.464165245s) [upload=10235]: Done uploading segments... Aug 28 03:31:16.234688254 (9h52m39.464173611s) [upload=10235]: Upload finished. err: metaclient: Too Many Requests
Duration: 117.711138ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
887.196458ms
FAIL (2025-08-28 04:12:41 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 04:07:38.889091158 (10h29m2.118576516s) [upload=10874]: Starting upload Aug 28 04:07:38.889127759 (10h29m2.118613105s) [upload=10874]: Done starting upload Aug 28 04:07:38.889250649 (10h29m2.118736006s) [upload=10874]: Uploading segments... Aug 28 04:07:38.889348914 (10h29m2.118834261s) [upload=10874]: Got next segment. Inline: false Aug 28 04:07:38.889382427 (10h29m2.118867774s) [upload=10874]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 04:07:38.889386264 (10h29m2.118871611s) [upload=10874]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 04:07:38.891731439 (10h29m2.121216796s) [upload=10874]: Next segment err: metaclient: Too Many Requests Aug 28 04:07:38.891744373 (10h29m2.12122973s) [upload=10874]: Done uploading segments... Aug 28 04:07:38.891756856 (10h29m2.121242213s) [upload=10874]: Upload finished. err: metaclient: Too Many Requests
Duration: 887.221064ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
559.79144ms
FAIL (2025-08-28 04:12:21 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 04:07:38.889091158 (10h29m2.118576516s) [upload=10874]: Starting upload Aug 28 04:07:38.889127759 (10h29m2.118613105s) [upload=10874]: Done starting upload Aug 28 04:07:38.889250649 (10h29m2.118736006s) [upload=10874]: Uploading segments... Aug 28 04:07:38.889348914 (10h29m2.118834261s) [upload=10874]: Got next segment. Inline: false Aug 28 04:07:38.889382427 (10h29m2.118867774s) [upload=10874]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 04:07:38.889386264 (10h29m2.118871611s) [upload=10874]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 04:07:38.891731439 (10h29m2.121216796s) [upload=10874]: Next segment err: metaclient: Too Many Requests Aug 28 04:07:38.891744373 (10h29m2.12122973s) [upload=10874]: Done uploading segments... Aug 28 04:07:38.891756856 (10h29m2.121242213s) [upload=10874]: Upload finished. err: metaclient: Too Many Requests
Duration: 559.804504ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
7 out of 60 is failed (threshold=3) [......................X..............X......X.X......X.XX...] duration:
925.671403ms
FAIL (2025-08-28 04:12:21 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 925.694736ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
8 out of 60 is failed (threshold=3) [.......................X.X........X.......X..XXX.......X....] duration:
2.824590669s
FAIL (2025-08-28 04:12:14 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 2.824610809s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
8 out of 60 is failed (threshold=3) [........................X.X........X.......X..XXX.......X...] duration:
30.004009582s
FAIL (2025-08-28 04:12:11 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 30.004028838s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
605.434055ms
FAIL (2025-08-28 04:11:49 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 04:07:38.889091158 (10h29m2.118576516s) [upload=10874]: Starting upload Aug 28 04:07:38.889127759 (10h29m2.118613105s) [upload=10874]: Done starting upload Aug 28 04:07:38.889250649 (10h29m2.118736006s) [upload=10874]: Uploading segments... Aug 28 04:07:38.889348914 (10h29m2.118834261s) [upload=10874]: Got next segment. Inline: false Aug 28 04:07:38.889382427 (10h29m2.118867774s) [upload=10874]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 04:07:38.889386264 (10h29m2.118871611s) [upload=10874]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 04:07:38.891731439 (10h29m2.121216796s) [upload=10874]: Next segment err: metaclient: Too Many Requests Aug 28 04:07:38.891744373 (10h29m2.12122973s) [upload=10874]: Done uploading segments... Aug 28 04:07:38.891756856 (10h29m2.121242213s) [upload=10874]: Upload finished. err: metaclient: Too Many Requests
Duration: 605.471245ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
7 out of 60 is failed (threshold=3) [.......................X..............X......X.X......X.XX..] duration:
842.251726ms
FAIL (2025-08-28 04:11:47 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 842.278607ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
167.399378ms
FAIL (2025-08-28 04:11:43 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 03:31:16.231447152 (9h52m39.460932539s) [upload=10235]: Starting upload Aug 28 03:31:16.231519408 (9h52m39.461004785s) [upload=10235]: Done starting upload Aug 28 03:31:16.231583228 (9h52m39.461068585s) [upload=10235]: Uploading segments... Aug 28 03:31:16.231643191 (9h52m39.461128548s) [upload=10235]: Got next segment. Inline: true Aug 28 03:31:16.231647810 (9h52m39.461133167s) [upload=10235]: Waiting for error group managing segments... Aug 28 03:31:16.231694668 (9h52m39.461180026s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 03:31:16.231700640 (9h52m39.461185987s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 03:31:16.231704798 (9h52m39.461190255s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 03:31:16.234679888 (9h52m39.464165245s) [upload=10235]: Done uploading segments... Aug 28 03:31:16.234688254 (9h52m39.464173611s) [upload=10235]: Upload finished. err: metaclient: Too Many Requests
Duration: 167.421089ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
8 out of 60 is failed (threshold=3) [.........................X.X........X.......X..XXX.......X..] duration:
21.924088777s
FAIL (2025-08-28 04:11:26 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 21.924108936s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
7 out of 60 is failed (threshold=3) [........................X..............X......X.X......X.XX.] duration:
1.05971971s
FAIL (2025-08-28 04:11:24 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 1.059752601s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
7 out of 60 is failed (threshold=3) [.........................X..............X......X.X......X.XX] duration:
30.001198175s
FAIL (2025-08-28 04:11:17 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 30.001221729s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
380.808189ms
FAIL (2025-08-28 04:11:09 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 04:07:38.889091158 (10h29m2.118576516s) [upload=10874]: Starting upload Aug 28 04:07:38.889127759 (10h29m2.118613105s) [upload=10874]: Done starting upload Aug 28 04:07:38.889250649 (10h29m2.118736006s) [upload=10874]: Uploading segments... Aug 28 04:07:38.889348914 (10h29m2.118834261s) [upload=10874]: Got next segment. Inline: false Aug 28 04:07:38.889382427 (10h29m2.118867774s) [upload=10874]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 04:07:38.889386264 (10h29m2.118871611s) [upload=10874]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 04:07:38.891731439 (10h29m2.121216796s) [upload=10874]: Next segment err: metaclient: Too Many Requests Aug 28 04:07:38.891744373 (10h29m2.12122973s) [upload=10874]: Done uploading segments... Aug 28 04:07:38.891756856 (10h29m2.121242213s) [upload=10874]: Upload finished. err: metaclient: Too Many Requests
Duration: 380.83524ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
139.38495ms
FAIL (2025-08-28 04:11:04 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 03:31:16.231447152 (9h52m39.460932539s) [upload=10235]: Starting upload Aug 28 03:31:16.231519408 (9h52m39.461004785s) [upload=10235]: Done starting upload Aug 28 03:31:16.231583228 (9h52m39.461068585s) [upload=10235]: Uploading segments... Aug 28 03:31:16.231643191 (9h52m39.461128548s) [upload=10235]: Got next segment. Inline: true Aug 28 03:31:16.231647810 (9h52m39.461133167s) [upload=10235]: Waiting for error group managing segments... Aug 28 03:31:16.231694668 (9h52m39.461180026s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 03:31:16.231700640 (9h52m39.461185987s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 03:31:16.231704798 (9h52m39.461190255s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 03:31:16.234679888 (9h52m39.464165245s) [upload=10235]: Done uploading segments... Aug 28 03:31:16.234688254 (9h52m39.464173611s) [upload=10235]: Upload finished. err: metaclient: Too Many Requests
Duration: 139.41172ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
6 out of 60 is failed (threshold=3) [..........................X..............X......X.X......X.X] duration:
30.000986439s
FAIL (2025-08-28 04:10:26 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 30.001016206s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
8 out of 60 is failed (threshold=3) [..........................X.X........X.......X..XXX.......X.] duration:
3.168895565s
FAIL (2025-08-28 04:10:12 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 3.168920475s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
465.956849ms
FAIL (2025-08-28 04:10:08 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 04:07:38.889091158 (10h29m2.118576516s) [upload=10874]: Starting upload Aug 28 04:07:38.889127759 (10h29m2.118613105s) [upload=10874]: Done starting upload Aug 28 04:07:38.889250649 (10h29m2.118736006s) [upload=10874]: Uploading segments... Aug 28 04:07:38.889348914 (10h29m2.118834261s) [upload=10874]: Got next segment. Inline: false Aug 28 04:07:38.889382427 (10h29m2.118867774s) [upload=10874]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 04:07:38.889386264 (10h29m2.118871611s) [upload=10874]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 04:07:38.891731439 (10h29m2.121216796s) [upload=10874]: Next segment err: metaclient: Too Many Requests Aug 28 04:07:38.891744373 (10h29m2.12122973s) [upload=10874]: Done uploading segments... Aug 28 04:07:38.891756856 (10h29m2.121242213s) [upload=10874]: Upload finished. err: metaclient: Too Many Requests
Duration: 465.969453ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
133.89029ms
FAIL (2025-08-28 04:09:51 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 03:31:16.231447152 (9h52m39.460932539s) [upload=10235]: Starting upload Aug 28 03:31:16.231519408 (9h52m39.461004785s) [upload=10235]: Done starting upload Aug 28 03:31:16.231583228 (9h52m39.461068585s) [upload=10235]: Uploading segments... Aug 28 03:31:16.231643191 (9h52m39.461128548s) [upload=10235]: Got next segment. Inline: true Aug 28 03:31:16.231647810 (9h52m39.461133167s) [upload=10235]: Waiting for error group managing segments... Aug 28 03:31:16.231694668 (9h52m39.461180026s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 03:31:16.231700640 (9h52m39.461185987s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 03:31:16.231704798 (9h52m39.461190255s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 03:31:16.234679888 (9h52m39.464165245s) [upload=10235]: Done uploading segments... Aug 28 03:31:16.234688254 (9h52m39.464173611s) [upload=10235]: Upload finished. err: metaclient: Too Many Requests
Duration: 133.915187ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
8 out of 60 is failed (threshold=3) [...........................X.X........X.......X..XXX.......X] duration:
30.003723431s
FAIL (2025-08-28 04:09:44 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 30.003744091s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
926.416083ms
FAIL (2025-08-28 04:09:33 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 04:07:38.889091158 (10h29m2.118576516s) [upload=10874]: Starting upload Aug 28 04:07:38.889127759 (10h29m2.118613105s) [upload=10874]: Done starting upload Aug 28 04:07:38.889250649 (10h29m2.118736006s) [upload=10874]: Uploading segments... Aug 28 04:07:38.889348914 (10h29m2.118834261s) [upload=10874]: Got next segment. Inline: false Aug 28 04:07:38.889382427 (10h29m2.118867774s) [upload=10874]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 04:07:38.889386264 (10h29m2.118871611s) [upload=10874]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 04:07:38.891731439 (10h29m2.121216796s) [upload=10874]: Next segment err: metaclient: Too Many Requests Aug 28 04:07:38.891744373 (10h29m2.12122973s) [upload=10874]: Done uploading segments... Aug 28 04:07:38.891756856 (10h29m2.121242213s) [upload=10874]: Upload finished. err: metaclient: Too Many Requests
Duration: 926.443384ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
5 out of 60 is failed (threshold=3) [...........................X..............X......X.X......X.] duration:
929.868265ms
FAIL (2025-08-28 04:09:18 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 929.891458ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
417.16071ms
FAIL (2025-08-28 04:09:08 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 04:07:38.889091158 (10h29m2.118576516s) [upload=10874]: Starting upload Aug 28 04:07:38.889127759 (10h29m2.118613105s) [upload=10874]: Done starting upload Aug 28 04:07:38.889250649 (10h29m2.118736006s) [upload=10874]: Uploading segments... Aug 28 04:07:38.889348914 (10h29m2.118834261s) [upload=10874]: Got next segment. Inline: false Aug 28 04:07:38.889382427 (10h29m2.118867774s) [upload=10874]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 04:07:38.889386264 (10h29m2.118871611s) [upload=10874]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 04:07:38.891731439 (10h29m2.121216796s) [upload=10874]: Next segment err: metaclient: Too Many Requests Aug 28 04:07:38.891744373 (10h29m2.12122973s) [upload=10874]: Done uploading segments... Aug 28 04:07:38.891756856 (10h29m2.121242213s) [upload=10874]: Upload finished. err: metaclient: Too Many Requests
Duration: 417.185267ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
423.742027ms
FAIL (2025-08-28 04:09:05 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 03:31:16.231447152 (9h52m39.460932539s) [upload=10235]: Starting upload Aug 28 03:31:16.231519408 (9h52m39.461004785s) [upload=10235]: Done starting upload Aug 28 03:31:16.231583228 (9h52m39.461068585s) [upload=10235]: Uploading segments... Aug 28 03:31:16.231643191 (9h52m39.461128548s) [upload=10235]: Got next segment. Inline: true Aug 28 03:31:16.231647810 (9h52m39.461133167s) [upload=10235]: Waiting for error group managing segments... Aug 28 03:31:16.231694668 (9h52m39.461180026s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 03:31:16.231700640 (9h52m39.461185987s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 03:31:16.231704798 (9h52m39.461190255s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 03:31:16.234679888 (9h52m39.464165245s) [upload=10235]: Done uploading segments... Aug 28 03:31:16.234688254 (9h52m39.464173611s) [upload=10235]: Upload finished. err: metaclient: Too Many Requests
Duration: 423.875228ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
7 out of 60 is failed (threshold=3) [............................X.X........X.......X..XXX.......] duration:
2.728640628s
FAIL (2025-08-28 04:09:01 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 2.728667258s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
5 out of 60 is failed (threshold=3) [............................X..............X......X.X......X] duration:
30.000859335s
FAIL (2025-08-28 04:08:54 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 30.000875135s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
139.193079ms
FAIL (2025-08-28 04:08:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 03:31:16.231447152 (9h52m39.460932539s) [upload=10235]: Starting upload Aug 28 03:31:16.231519408 (9h52m39.461004785s) [upload=10235]: Done starting upload Aug 28 03:31:16.231583228 (9h52m39.461068585s) [upload=10235]: Uploading segments... Aug 28 03:31:16.231643191 (9h52m39.461128548s) [upload=10235]: Got next segment. Inline: true Aug 28 03:31:16.231647810 (9h52m39.461133167s) [upload=10235]: Waiting for error group managing segments... Aug 28 03:31:16.231694668 (9h52m39.461180026s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 03:31:16.231700640 (9h52m39.461185987s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 03:31:16.231704798 (9h52m39.461190255s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 03:31:16.234679888 (9h52m39.464165245s) [upload=10235]: Done uploading segments... Aug 28 03:31:16.234688254 (9h52m39.464173611s) [upload=10235]: Upload finished. err: metaclient: Too Many Requests
Duration: 139.215171ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
662.146225ms
FAIL (2025-08-28 04:08:16 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 04:07:38.889091158 (10h29m2.118576516s) [upload=10874]: Starting upload Aug 28 04:07:38.889127759 (10h29m2.118613105s) [upload=10874]: Done starting upload Aug 28 04:07:38.889250649 (10h29m2.118736006s) [upload=10874]: Uploading segments... Aug 28 04:07:38.889348914 (10h29m2.118834261s) [upload=10874]: Got next segment. Inline: false Aug 28 04:07:38.889382427 (10h29m2.118867774s) [upload=10874]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 04:07:38.889386264 (10h29m2.118871611s) [upload=10874]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 04:07:38.891731439 (10h29m2.121216796s) [upload=10874]: Next segment err: metaclient: Too Many Requests Aug 28 04:07:38.891744373 (10h29m2.12122973s) [upload=10874]: Done uploading segments... Aug 28 04:07:38.891756856 (10h29m2.121242213s) [upload=10874]: Upload finished. err: metaclient: Too Many Requests
Duration: 662.178495ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
7 out of 60 is failed (threshold=3) [.............................X.X........X.......X..XXX......] duration:
3.196159979s
FAIL (2025-08-28 04:07:54 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 3.196179627s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
15.07367ms
FAIL (2025-08-28 04:07:38 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 04:07:38.889091158 (10h29m2.118576516s) [upload=10874]: Starting upload Aug 28 04:07:38.889127759 (10h29m2.118613105s) [upload=10874]: Done starting upload Aug 28 04:07:38.889250649 (10h29m2.118736006s) [upload=10874]: Uploading segments... Aug 28 04:07:38.889348914 (10h29m2.118834261s) [upload=10874]: Got next segment. Inline: false Aug 28 04:07:38.889382427 (10h29m2.118867774s) [upload=10874]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 04:07:38.889386264 (10h29m2.118871611s) [upload=10874]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 04:07:38.891731439 (10h29m2.121216796s) [upload=10874]: Next segment err: metaclient: Too Many Requests Aug 28 04:07:38.891744373 (10h29m2.12122973s) [upload=10874]: Done uploading segments... Aug 28 04:07:38.891756856 (10h29m2.121242213s) [upload=10874]: Upload finished. err: metaclient: Too Many Requests
Duration: 15.091043ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
4 out of 60 is failed (threshold=3) [.............................X..............X......X.X......] duration:
895.722284ms
FAIL (2025-08-28 04:07:21 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 895.759403ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
182.697771ms
FAIL (2025-08-28 04:07:17 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 03:31:16.231447152 (9h52m39.460932539s) [upload=10235]: Starting upload Aug 28 03:31:16.231519408 (9h52m39.461004785s) [upload=10235]: Done starting upload Aug 28 03:31:16.231583228 (9h52m39.461068585s) [upload=10235]: Uploading segments... Aug 28 03:31:16.231643191 (9h52m39.461128548s) [upload=10235]: Got next segment. Inline: true Aug 28 03:31:16.231647810 (9h52m39.461133167s) [upload=10235]: Waiting for error group managing segments... Aug 28 03:31:16.231694668 (9h52m39.461180026s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 03:31:16.231700640 (9h52m39.461185987s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 03:31:16.231704798 (9h52m39.461190255s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 03:31:16.234679888 (9h52m39.464165245s) [upload=10235]: Done uploading segments... Aug 28 03:31:16.234688254 (9h52m39.464173611s) [upload=10235]: Upload finished. err: metaclient: Too Many Requests
Duration: 182.720764ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
7 out of 60 is failed (threshold=3) [..............................X.X........X.......X..XXX.....] duration:
2.905768076s
FAIL (2025-08-28 04:07:09 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 2.905788625s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
4 out of 60 is failed (threshold=3) [..............................X..............X......X.X.....] duration:
964.558042ms
FAIL (2025-08-28 04:06:58 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 964.576537ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
4 out of 60 is failed (threshold=3) [...............................X..............X......X.X....] duration:
27.263041851s
FAIL (2025-08-28 04:06:57 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 27.263122883s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
7 out of 60 is failed (threshold=3) [...............................X.X........X.......X..XXX....] duration:
3.06709137s
FAIL (2025-08-28 04:06:49 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 3.06713887s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
604.7446ms
FAIL (2025-08-28 04:06:15 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 03:31:16.231447152 (9h52m39.460932539s) [upload=10235]: Starting upload Aug 28 03:31:16.231519408 (9h52m39.461004785s) [upload=10235]: Done starting upload Aug 28 03:31:16.231583228 (9h52m39.461068585s) [upload=10235]: Uploading segments... Aug 28 03:31:16.231643191 (9h52m39.461128548s) [upload=10235]: Got next segment. Inline: true Aug 28 03:31:16.231647810 (9h52m39.461133167s) [upload=10235]: Waiting for error group managing segments... Aug 28 03:31:16.231694668 (9h52m39.461180026s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 03:31:16.231700640 (9h52m39.461185987s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 03:31:16.231704798 (9h52m39.461190255s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 03:31:16.234679888 (9h52m39.464165245s) [upload=10235]: Done uploading segments... Aug 28 03:31:16.234688254 (9h52m39.464173611s) [upload=10235]: Upload finished. err: metaclient: Too Many Requests
Duration: 604.800344ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
7 out of 60 is failed (threshold=3) [................................X.X........X.......X..XXX...] duration:
2.93330952s
FAIL (2025-08-28 04:06:06 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 2.933335959s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
4 out of 60 is failed (threshold=3) [................................X..............X......X.X...] duration:
894.438336ms
FAIL (2025-08-28 04:06:05 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 894.480265ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
465.414953ms
FAIL (2025-08-28 04:05:49 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 03:31:16.231447152 (9h52m39.460932539s) [upload=10235]: Starting upload Aug 28 03:31:16.231519408 (9h52m39.461004785s) [upload=10235]: Done starting upload Aug 28 03:31:16.231583228 (9h52m39.461068585s) [upload=10235]: Uploading segments... Aug 28 03:31:16.231643191 (9h52m39.461128548s) [upload=10235]: Got next segment. Inline: true Aug 28 03:31:16.231647810 (9h52m39.461133167s) [upload=10235]: Waiting for error group managing segments... Aug 28 03:31:16.231694668 (9h52m39.461180026s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 03:31:16.231700640 (9h52m39.461185987s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 03:31:16.231704798 (9h52m39.461190255s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 03:31:16.234679888 (9h52m39.464165245s) [upload=10235]: Done uploading segments... Aug 28 03:31:16.234688254 (9h52m39.464173611s) [upload=10235]: Upload finished. err: metaclient: Too Many Requests
Duration: 465.442926ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
7 out of 60 is failed (threshold=3) [.................................X.X........X.......X..XXX..] duration:
2.937716246s
FAIL (2025-08-28 04:05:34 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 2.937840359s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
114.730667ms
FAIL (2025-08-28 04:05:26 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 03:31:16.231447152 (9h52m39.460932539s) [upload=10235]: Starting upload Aug 28 03:31:16.231519408 (9h52m39.461004785s) [upload=10235]: Done starting upload Aug 28 03:31:16.231583228 (9h52m39.461068585s) [upload=10235]: Uploading segments... Aug 28 03:31:16.231643191 (9h52m39.461128548s) [upload=10235]: Got next segment. Inline: true Aug 28 03:31:16.231647810 (9h52m39.461133167s) [upload=10235]: Waiting for error group managing segments... Aug 28 03:31:16.231694668 (9h52m39.461180026s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 03:31:16.231700640 (9h52m39.461185987s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 03:31:16.231704798 (9h52m39.461190255s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 03:31:16.234679888 (9h52m39.464165245s) [upload=10235]: Done uploading segments... Aug 28 03:31:16.234688254 (9h52m39.464173611s) [upload=10235]: Upload finished. err: metaclient: Too Many Requests
Duration: 114.764952ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
4 out of 60 is failed (threshold=3) [.................................X..............X......X.X..] duration:
914.102028ms
FAIL (2025-08-28 04:05:12 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 914.131173ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
7 out of 60 is failed (threshold=3) [..................................X.X........X.......X..XXX.] duration:
3.002061804s
FAIL (2025-08-28 04:04:40 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 3.002090919s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
7 out of 60 is failed (threshold=3) [...................................X.X........X.......X..XXX] duration:
30.006462544s
FAIL (2025-08-28 04:04:37 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 30.006500996s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
309.138027ms
FAIL (2025-08-28 04:04:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 03:31:16.231447152 (9h52m39.460932539s) [upload=10235]: Starting upload Aug 28 03:31:16.231519408 (9h52m39.461004785s) [upload=10235]: Done starting upload Aug 28 03:31:16.231583228 (9h52m39.461068585s) [upload=10235]: Uploading segments... Aug 28 03:31:16.231643191 (9h52m39.461128548s) [upload=10235]: Got next segment. Inline: true Aug 28 03:31:16.231647810 (9h52m39.461133167s) [upload=10235]: Waiting for error group managing segments... Aug 28 03:31:16.231694668 (9h52m39.461180026s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 03:31:16.231700640 (9h52m39.461185987s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 03:31:16.231704798 (9h52m39.461190255s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 03:31:16.234679888 (9h52m39.464165245s) [upload=10235]: Done uploading segments... Aug 28 03:31:16.234688254 (9h52m39.464173611s) [upload=10235]: Upload finished. err: metaclient: Too Many Requests
Duration: 309.161531ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
4 out of 60 is failed (threshold=3) [..................................X..............X......X.X.] duration:
1.002458997s
FAIL (2025-08-28 04:04:13 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 1.002485306s
core
uplink
eu1
|