Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure

Orbiter Check History

Showing 50 of 119745 reports (Page 1282 of 2395)
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
2 out of 60 is failed (threshold=3) [..............................X..............X..............]
duration:
376.243078ms
FAIL (2025-08-28 03:39:54 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 28 03:31:16.231447152 (9h52m39.460932539s) [upload=10235]: Starting upload
Aug 28 03:31:16.231519408 (9h52m39.461004785s) [upload=10235]: Done starting upload
Aug 28 03:31:16.231583228 (9h52m39.461068585s) [upload=10235]: Uploading segments...
Aug 28 03:31:16.231643191 (9h52m39.461128548s) [upload=10235]: Got next segment. Inline: true
Aug 28 03:31:16.231647810 (9h52m39.461133167s) [upload=10235]: Waiting for error group managing segments...
Aug 28 03:31:16.231694668 (9h52m39.461180026s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 03:31:16.231700640 (9h52m39.461185987s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 28 03:31:16.231704798 (9h52m39.461190255s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 03:31:16.234679888 (9h52m39.464165245s) [upload=10235]: Done uploading segments...
Aug 28 03:31:16.234688254 (9h52m39.464173611s) [upload=10235]: Upload finished. err: metaclient: Too Many Requests
Duration: 376.262324ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................]
duration:
1.046558876s
FAIL (2025-08-28 03:39:44 UTC)
orbiter warning: operation: DownloadObject
uplink: metaclient: context deadline exceeded
Duration: 1.046578733s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
2 out of 60 is failed (threshold=3) [...............................X..............X.............]
duration:
129.113871ms
FAIL (2025-08-28 03:39:37 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 28 03:31:16.231447152 (9h52m39.460932539s) [upload=10235]: Starting upload
Aug 28 03:31:16.231519408 (9h52m39.461004785s) [upload=10235]: Done starting upload
Aug 28 03:31:16.231583228 (9h52m39.461068585s) [upload=10235]: Uploading segments...
Aug 28 03:31:16.231643191 (9h52m39.461128548s) [upload=10235]: Got next segment. Inline: true
Aug 28 03:31:16.231647810 (9h52m39.461133167s) [upload=10235]: Waiting for error group managing segments...
Aug 28 03:31:16.231694668 (9h52m39.461180026s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 03:31:16.231700640 (9h52m39.461185987s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 28 03:31:16.231704798 (9h52m39.461190255s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 03:31:16.234679888 (9h52m39.464165245s) [upload=10235]: Done uploading segments...
Aug 28 03:31:16.234688254 (9h52m39.464173611s) [upload=10235]: Upload finished. err: metaclient: Too Many Requests
Duration: 129.13493ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................]
duration:
1.179060544s
FAIL (2025-08-28 03:39:15 UTC)
orbiter warning: operation: DownloadObject
uplink: metaclient: context deadline exceeded
Duration: 1.179085821s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip:
5 out of 60 is failed (threshold=3) [..................XX...X.X.X................................]
duration:
23.813708405s
FAIL (2025-08-28 03:39:06 UTC)
orbiter warning: operation: DeleteObject
uplink: metaclient: context deadline exceeded
Duration: 23.813728873s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................]
duration:
22.1204011s
FAIL (2025-08-28 03:38:58 UTC)
orbiter warning: operation: DownloadObject
uplink: metaclient: context deadline exceeded
Duration: 22.12042257s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
2 out of 60 is failed (threshold=3) [................................X..............X............]
duration:
388.995263ms
FAIL (2025-08-28 03:38:34 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 28 03:31:16.231447152 (9h52m39.460932539s) [upload=10235]: Starting upload
Aug 28 03:31:16.231519408 (9h52m39.461004785s) [upload=10235]: Done starting upload
Aug 28 03:31:16.231583228 (9h52m39.461068585s) [upload=10235]: Uploading segments...
Aug 28 03:31:16.231643191 (9h52m39.461128548s) [upload=10235]: Got next segment. Inline: true
Aug 28 03:31:16.231647810 (9h52m39.461133167s) [upload=10235]: Waiting for error group managing segments...
Aug 28 03:31:16.231694668 (9h52m39.461180026s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 03:31:16.231700640 (9h52m39.461185987s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 28 03:31:16.231704798 (9h52m39.461190255s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 03:31:16.234679888 (9h52m39.464165245s) [upload=10235]: Done uploading segments...
Aug 28 03:31:16.234688254 (9h52m39.464173611s) [upload=10235]: Upload finished. err: metaclient: Too Many Requests
Duration: 389.027815ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
2 out of 60 is failed (threshold=3) [.................................X..............X...........]
duration:
245.569737ms
FAIL (2025-08-28 03:38:03 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 28 03:31:16.231447152 (9h52m39.460932539s) [upload=10235]: Starting upload
Aug 28 03:31:16.231519408 (9h52m39.461004785s) [upload=10235]: Done starting upload
Aug 28 03:31:16.231583228 (9h52m39.461068585s) [upload=10235]: Uploading segments...
Aug 28 03:31:16.231643191 (9h52m39.461128548s) [upload=10235]: Got next segment. Inline: true
Aug 28 03:31:16.231647810 (9h52m39.461133167s) [upload=10235]: Waiting for error group managing segments...
Aug 28 03:31:16.231694668 (9h52m39.461180026s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 03:31:16.231700640 (9h52m39.461185987s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 28 03:31:16.231704798 (9h52m39.461190255s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 03:31:16.234679888 (9h52m39.464165245s) [upload=10235]: Done uploading segments...
Aug 28 03:31:16.234688254 (9h52m39.464173611s) [upload=10235]: Upload finished. err: metaclient: Too Many Requests
Duration: 245.591096ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip:
5 out of 60 is failed (threshold=3) [...................XX...X.X.X...............................]
duration:
2.939625109s
FAIL (2025-08-28 03:37:43 UTC)
orbiter warning: operation: DeleteObject
uplink: metaclient: context deadline exceeded
Duration: 2.939645657s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................]
duration:
824.462364ms
FAIL (2025-08-28 03:37:37 UTC)
orbiter warning: operation: DownloadObject
uplink: metaclient: context deadline exceeded
Duration: 824.48801ms core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
2 out of 60 is failed (threshold=3) [..................................X..............X..........]
duration:
207.517804ms
FAIL (2025-08-28 03:37:27 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 28 03:31:16.231447152 (9h52m39.460932539s) [upload=10235]: Starting upload
Aug 28 03:31:16.231519408 (9h52m39.461004785s) [upload=10235]: Done starting upload
Aug 28 03:31:16.231583228 (9h52m39.461068585s) [upload=10235]: Uploading segments...
Aug 28 03:31:16.231643191 (9h52m39.461128548s) [upload=10235]: Got next segment. Inline: true
Aug 28 03:31:16.231647810 (9h52m39.461133167s) [upload=10235]: Waiting for error group managing segments...
Aug 28 03:31:16.231694668 (9h52m39.461180026s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 03:31:16.231700640 (9h52m39.461185987s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 28 03:31:16.231704798 (9h52m39.461190255s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 03:31:16.234679888 (9h52m39.464165245s) [upload=10235]: Done uploading segments...
Aug 28 03:31:16.234688254 (9h52m39.464173611s) [upload=10235]: Upload finished. err: metaclient: Too Many Requests
Duration: 207.54217ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
2 out of 60 is failed (threshold=3) [...................................X..............X.........]
duration:
477.861402ms
FAIL (2025-08-28 03:36:45 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 28 03:31:16.231447152 (9h52m39.460932539s) [upload=10235]: Starting upload
Aug 28 03:31:16.231519408 (9h52m39.461004785s) [upload=10235]: Done starting upload
Aug 28 03:31:16.231583228 (9h52m39.461068585s) [upload=10235]: Uploading segments...
Aug 28 03:31:16.231643191 (9h52m39.461128548s) [upload=10235]: Got next segment. Inline: true
Aug 28 03:31:16.231647810 (9h52m39.461133167s) [upload=10235]: Waiting for error group managing segments...
Aug 28 03:31:16.231694668 (9h52m39.461180026s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 03:31:16.231700640 (9h52m39.461185987s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 28 03:31:16.231704798 (9h52m39.461190255s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 03:31:16.234679888 (9h52m39.464165245s) [upload=10235]: Done uploading segments...
Aug 28 03:31:16.234688254 (9h52m39.464173611s) [upload=10235]: Upload finished. err: metaclient: Too Many Requests
Duration: 477.88678ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip:
5 out of 60 is failed (threshold=3) [....................XX...X.X.X..............................]
duration:
2.886496944s
FAIL (2025-08-28 03:36:42 UTC)
orbiter warning: operation: DeleteObject
uplink: metaclient: context deadline exceeded
Duration: 2.886519667s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip:
5 out of 60 is failed (threshold=3) [.....................XX...X.X.X.............................]
duration:
27.663306932s
FAIL (2025-08-28 03:36:39 UTC)
orbiter warning: operation: DeleteObject
uplink: metaclient: context deadline exceeded
Duration: 27.663334453s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................]
duration:
930.210791ms
FAIL (2025-08-28 03:36:33 UTC)
orbiter warning: operation: DownloadObject
uplink: metaclient: context deadline exceeded
Duration: 930.250385ms core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
2 out of 60 is failed (threshold=3) [....................................X..............X........]
duration:
170.423294ms
FAIL (2025-08-28 03:36:14 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 28 03:31:16.231447152 (9h52m39.460932539s) [upload=10235]: Starting upload
Aug 28 03:31:16.231519408 (9h52m39.461004785s) [upload=10235]: Done starting upload
Aug 28 03:31:16.231583228 (9h52m39.461068585s) [upload=10235]: Uploading segments...
Aug 28 03:31:16.231643191 (9h52m39.461128548s) [upload=10235]: Got next segment. Inline: true
Aug 28 03:31:16.231647810 (9h52m39.461133167s) [upload=10235]: Waiting for error group managing segments...
Aug 28 03:31:16.231694668 (9h52m39.461180026s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 03:31:16.231700640 (9h52m39.461185987s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 28 03:31:16.231704798 (9h52m39.461190255s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 03:31:16.234679888 (9h52m39.464165245s) [upload=10235]: Done uploading segments...
Aug 28 03:31:16.234688254 (9h52m39.464173611s) [upload=10235]: Upload finished. err: metaclient: Too Many Requests
Duration: 170.442541ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip:
5 out of 60 is failed (threshold=3) [......................XX...X.X.X............................]
duration:
21.057420077s
FAIL (2025-08-28 03:36:02 UTC)
orbiter warning: operation: DeleteObject
uplink: metaclient: context deadline exceeded
Duration: 21.057460322s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
2 out of 60 is failed (threshold=3) [.....................................X..............X.......]
duration:
214.430179ms
FAIL (2025-08-28 03:35:58 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 28 03:31:16.231447152 (9h52m39.460932539s) [upload=10235]: Starting upload
Aug 28 03:31:16.231519408 (9h52m39.461004785s) [upload=10235]: Done starting upload
Aug 28 03:31:16.231583228 (9h52m39.461068585s) [upload=10235]: Uploading segments...
Aug 28 03:31:16.231643191 (9h52m39.461128548s) [upload=10235]: Got next segment. Inline: true
Aug 28 03:31:16.231647810 (9h52m39.461133167s) [upload=10235]: Waiting for error group managing segments...
Aug 28 03:31:16.231694668 (9h52m39.461180026s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 03:31:16.231700640 (9h52m39.461185987s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 28 03:31:16.231704798 (9h52m39.461190255s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 03:31:16.234679888 (9h52m39.464165245s) [upload=10235]: Done uploading segments...
Aug 28 03:31:16.234688254 (9h52m39.464173611s) [upload=10235]: Upload finished. err: metaclient: Too Many Requests
Duration: 214.449405ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................]
duration:
944.904662ms
FAIL (2025-08-28 03:35:38 UTC)
orbiter warning: operation: DownloadObject
uplink: metaclient: context deadline exceeded
Duration: 944.922615ms core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................]
duration:
895.052947ms
FAIL (2025-08-28 03:35:14 UTC)
orbiter warning: operation: DownloadObject
uplink: metaclient: context deadline exceeded
Duration: 895.077783ms core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip:
5 out of 60 is failed (threshold=3) [.......................XX...X.X.X...........................]
duration:
22.58702063s
FAIL (2025-08-28 03:34:54 UTC)
orbiter warning: operation: DeleteObject
uplink: metaclient: context deadline exceeded
Duration: 22.587039676s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
2 out of 60 is failed (threshold=3) [......................................X..............X......]
duration:
178.071137ms
FAIL (2025-08-28 03:34:53 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 28 03:31:16.231447152 (9h52m39.460932539s) [upload=10235]: Starting upload
Aug 28 03:31:16.231519408 (9h52m39.461004785s) [upload=10235]: Done starting upload
Aug 28 03:31:16.231583228 (9h52m39.461068585s) [upload=10235]: Uploading segments...
Aug 28 03:31:16.231643191 (9h52m39.461128548s) [upload=10235]: Got next segment. Inline: true
Aug 28 03:31:16.231647810 (9h52m39.461133167s) [upload=10235]: Waiting for error group managing segments...
Aug 28 03:31:16.231694668 (9h52m39.461180026s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 03:31:16.231700640 (9h52m39.461185987s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 28 03:31:16.231704798 (9h52m39.461190255s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 03:31:16.234679888 (9h52m39.464165245s) [upload=10235]: Done uploading segments...
Aug 28 03:31:16.234688254 (9h52m39.464173611s) [upload=10235]: Upload finished. err: metaclient: Too Many Requests
Duration: 178.093168ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................]
duration:
969.939079ms
FAIL (2025-08-28 03:34:36 UTC)
orbiter warning: operation: DownloadObject
uplink: metaclient: context deadline exceeded
Duration: 969.964106ms core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip:
5 out of 60 is failed (threshold=3) [........................XX...X.X.X..........................]
duration:
2.923477026s
FAIL (2025-08-28 03:33:56 UTC)
orbiter warning: operation: DeleteObject
uplink: metaclient: context deadline exceeded
Duration: 2.923495812s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
2 out of 60 is failed (threshold=3) [.......................................X..............X.....]
duration:
112.837875ms
FAIL (2025-08-28 03:33:51 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 28 03:31:16.231447152 (9h52m39.460932539s) [upload=10235]: Starting upload
Aug 28 03:31:16.231519408 (9h52m39.461004785s) [upload=10235]: Done starting upload
Aug 28 03:31:16.231583228 (9h52m39.461068585s) [upload=10235]: Uploading segments...
Aug 28 03:31:16.231643191 (9h52m39.461128548s) [upload=10235]: Got next segment. Inline: true
Aug 28 03:31:16.231647810 (9h52m39.461133167s) [upload=10235]: Waiting for error group managing segments...
Aug 28 03:31:16.231694668 (9h52m39.461180026s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 03:31:16.231700640 (9h52m39.461185987s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 28 03:31:16.231704798 (9h52m39.461190255s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 03:31:16.234679888 (9h52m39.464165245s) [upload=10235]: Done uploading segments...
Aug 28 03:31:16.234688254 (9h52m39.464173611s) [upload=10235]: Upload finished. err: metaclient: Too Many Requests
Duration: 112.854607ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip:
5 out of 60 is failed (threshold=3) [.........................XX...X.X.X.........................]
duration:
2.77470875s
FAIL (2025-08-28 03:33:38 UTC)
orbiter warning: operation: DeleteObject
uplink: metaclient: context deadline exceeded
Duration: 2.774728046s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................]
duration:
825.140559ms
FAIL (2025-08-28 03:33:37 UTC)
orbiter warning: operation: DownloadObject
uplink: metaclient: context deadline exceeded
Duration: 825.153264ms core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................]
duration:
17.020622673s
FAIL (2025-08-28 03:33:26 UTC)
orbiter warning: operation: DownloadObject
uplink: metaclient: context deadline exceeded
Duration: 17.020646067s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
2 out of 60 is failed (threshold=3) [........................................X..............X....]
duration:
145.786732ms
FAIL (2025-08-28 03:33:10 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 28 03:31:16.231447152 (9h52m39.460932539s) [upload=10235]: Starting upload
Aug 28 03:31:16.231519408 (9h52m39.461004785s) [upload=10235]: Done starting upload
Aug 28 03:31:16.231583228 (9h52m39.461068585s) [upload=10235]: Uploading segments...
Aug 28 03:31:16.231643191 (9h52m39.461128548s) [upload=10235]: Got next segment. Inline: true
Aug 28 03:31:16.231647810 (9h52m39.461133167s) [upload=10235]: Waiting for error group managing segments...
Aug 28 03:31:16.231694668 (9h52m39.461180026s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 03:31:16.231700640 (9h52m39.461185987s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 28 03:31:16.231704798 (9h52m39.461190255s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 03:31:16.234679888 (9h52m39.464165245s) [upload=10235]: Done uploading segments...
Aug 28 03:31:16.234688254 (9h52m39.464173611s) [upload=10235]: Upload finished. err: metaclient: Too Many Requests
Duration: 145.846013ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip:
5 out of 60 is failed (threshold=3) [..........................XX...X.X.X........................]
duration:
2.814804801s
FAIL (2025-08-28 03:33:04 UTC)
orbiter warning: operation: DeleteObject
uplink: metaclient: context deadline exceeded
Duration: 2.814819539s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................]
duration:
449.839894ms
FAIL (2025-08-28 03:33:02 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 28 02:47:44.611300761 (9h9m7.840786109s) [upload=9486]: Starting upload
Aug 28 02:47:44.611340746 (9h9m7.840826094s) [upload=9486]: Done starting upload
Aug 28 02:47:44.611428663 (9h9m7.84091402s) [upload=9486]: Uploading segments...
Aug 28 02:47:44.611668895 (9h9m7.841154252s) [upload=9486]: Got next segment. Inline: false
Aug 28 02:47:44.611695745 (9h9m7.841181092s) [upload=9486]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 02:47:44.611699653 (9h9m7.841185s) [upload=9486]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 28 02:47:44.671595480 (9h9m7.901080837s) [upload=9486]: Next segment err: metaclient: Too Many Requests
Aug 28 02:47:44.671612302 (9h9m7.901097648s) [upload=9486]: Done uploading segments...
Aug 28 02:47:44.671629464 (9h9m7.901114821s) [upload=9486]: Upload finished. err: metaclient: Too Many Requests
Duration: 449.868848ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip:
5 out of 60 is failed (threshold=3) [...........................XX...X.X.X.......................]
duration:
26.032960037s
FAIL (2025-08-28 03:33:01 UTC)
orbiter warning: operation: DeleteObject
uplink: metaclient: context deadline exceeded
Duration: 26.032988863s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
2 out of 60 is failed (threshold=3) [.........................................X..............X...]
duration:
129.414236ms
FAIL (2025-08-28 03:32:41 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 28 03:31:16.231447152 (9h52m39.460932539s) [upload=10235]: Starting upload
Aug 28 03:31:16.231519408 (9h52m39.461004785s) [upload=10235]: Done starting upload
Aug 28 03:31:16.231583228 (9h52m39.461068585s) [upload=10235]: Uploading segments...
Aug 28 03:31:16.231643191 (9h52m39.461128548s) [upload=10235]: Got next segment. Inline: true
Aug 28 03:31:16.231647810 (9h52m39.461133167s) [upload=10235]: Waiting for error group managing segments...
Aug 28 03:31:16.231694668 (9h52m39.461180026s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 03:31:16.231700640 (9h52m39.461185987s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 28 03:31:16.231704798 (9h52m39.461190255s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 03:31:16.234679888 (9h52m39.464165245s) [upload=10235]: Done uploading segments...
Aug 28 03:31:16.234688254 (9h52m39.464173611s) [upload=10235]: Upload finished. err: metaclient: Too Many Requests
Duration: 129.428762ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................]
duration:
301.093963ms
FAIL (2025-08-28 03:32:40 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 28 02:47:44.611300761 (9h9m7.840786109s) [upload=9486]: Starting upload
Aug 28 02:47:44.611340746 (9h9m7.840826094s) [upload=9486]: Done starting upload
Aug 28 02:47:44.611428663 (9h9m7.84091402s) [upload=9486]: Uploading segments...
Aug 28 02:47:44.611668895 (9h9m7.841154252s) [upload=9486]: Got next segment. Inline: false
Aug 28 02:47:44.611695745 (9h9m7.841181092s) [upload=9486]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 02:47:44.611699653 (9h9m7.841185s) [upload=9486]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 28 02:47:44.671595480 (9h9m7.901080837s) [upload=9486]: Next segment err: metaclient: Too Many Requests
Aug 28 02:47:44.671612302 (9h9m7.901097648s) [upload=9486]: Done uploading segments...
Aug 28 02:47:44.671629464 (9h9m7.901114821s) [upload=9486]: Upload finished. err: metaclient: Too Many Requests
Duration: 301.117918ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................]
duration:
907.659021ms
FAIL (2025-08-28 03:32:40 UTC)
orbiter warning: operation: DownloadObject
uplink: metaclient: context deadline exceeded
Duration: 907.678538ms core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
2 out of 60 is failed (threshold=3) [..........................................X..............X..]
duration:
135.451501ms
FAIL (2025-08-28 03:32:18 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 28 03:31:16.231447152 (9h52m39.460932539s) [upload=10235]: Starting upload
Aug 28 03:31:16.231519408 (9h52m39.461004785s) [upload=10235]: Done starting upload
Aug 28 03:31:16.231583228 (9h52m39.461068585s) [upload=10235]: Uploading segments...
Aug 28 03:31:16.231643191 (9h52m39.461128548s) [upload=10235]: Got next segment. Inline: true
Aug 28 03:31:16.231647810 (9h52m39.461133167s) [upload=10235]: Waiting for error group managing segments...
Aug 28 03:31:16.231694668 (9h52m39.461180026s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 03:31:16.231700640 (9h52m39.461185987s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 28 03:31:16.231704798 (9h52m39.461190255s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 03:31:16.234679888 (9h52m39.464165245s) [upload=10235]: Done uploading segments...
Aug 28 03:31:16.234688254 (9h52m39.464173611s) [upload=10235]: Upload finished. err: metaclient: Too Many Requests
Duration: 135.469916ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
2 out of 60 is failed (threshold=3) [...........................................X..............X.]
duration:
137.911613ms
FAIL (2025-08-28 03:31:57 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 28 03:31:16.231447152 (9h52m39.460932539s) [upload=10235]: Starting upload
Aug 28 03:31:16.231519408 (9h52m39.461004785s) [upload=10235]: Done starting upload
Aug 28 03:31:16.231583228 (9h52m39.461068585s) [upload=10235]: Uploading segments...
Aug 28 03:31:16.231643191 (9h52m39.461128548s) [upload=10235]: Got next segment. Inline: true
Aug 28 03:31:16.231647810 (9h52m39.461133167s) [upload=10235]: Waiting for error group managing segments...
Aug 28 03:31:16.231694668 (9h52m39.461180026s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 03:31:16.231700640 (9h52m39.461185987s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 28 03:31:16.231704798 (9h52m39.461190255s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 03:31:16.234679888 (9h52m39.464165245s) [upload=10235]: Done uploading segments...
Aug 28 03:31:16.234688254 (9h52m39.464173611s) [upload=10235]: Upload finished. err: metaclient: Too Many Requests
Duration: 137.929867ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip:
5 out of 60 is failed (threshold=3) [............................XX...X.X.X......................]
duration:
18.207054951s
FAIL (2025-08-28 03:31:49 UTC)
orbiter warning: operation: DeleteObject
uplink: metaclient: context deadline exceeded
Duration: 18.207073035s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................]
duration:
875.143573ms
FAIL (2025-08-28 03:31:48 UTC)
orbiter warning: operation: DownloadObject
uplink: metaclient: context deadline exceeded
Duration: 875.166788ms core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................]
duration:
439.849385ms
FAIL (2025-08-28 03:31:39 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 28 02:47:44.611300761 (9h9m7.840786109s) [upload=9486]: Starting upload
Aug 28 02:47:44.611340746 (9h9m7.840826094s) [upload=9486]: Done starting upload
Aug 28 02:47:44.611428663 (9h9m7.84091402s) [upload=9486]: Uploading segments...
Aug 28 02:47:44.611668895 (9h9m7.841154252s) [upload=9486]: Got next segment. Inline: false
Aug 28 02:47:44.611695745 (9h9m7.841181092s) [upload=9486]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 02:47:44.611699653 (9h9m7.841185s) [upload=9486]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 28 02:47:44.671595480 (9h9m7.901080837s) [upload=9486]: Next segment err: metaclient: Too Many Requests
Aug 28 02:47:44.671612302 (9h9m7.901097648s) [upload=9486]: Done uploading segments...
Aug 28 02:47:44.671629464 (9h9m7.901114821s) [upload=9486]: Upload finished. err: metaclient: Too Many Requests
Duration: 439.869122ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................]
duration:
19.250800234s
FAIL (2025-08-28 03:31:27 UTC)
orbiter warning: operation: DownloadObject
uplink: metaclient: context deadline exceeded
Duration: 19.250826744s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
2 out of 60 is failed (threshold=3) [............................................X..............X]
duration:
16.466963ms
FAIL (2025-08-28 03:31:16 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 28 03:31:16.231447152 (9h52m39.460932539s) [upload=10235]: Starting upload
Aug 28 03:31:16.231519408 (9h52m39.461004785s) [upload=10235]: Done starting upload
Aug 28 03:31:16.231583228 (9h52m39.461068585s) [upload=10235]: Uploading segments...
Aug 28 03:31:16.231643191 (9h52m39.461128548s) [upload=10235]: Got next segment. Inline: true
Aug 28 03:31:16.231647810 (9h52m39.461133167s) [upload=10235]: Waiting for error group managing segments...
Aug 28 03:31:16.231694668 (9h52m39.461180026s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 03:31:16.231700640 (9h52m39.461185987s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 28 03:31:16.231704798 (9h52m39.461190255s) [upload=10235]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 03:31:16.234679888 (9h52m39.464165245s) [upload=10235]: Done uploading segments...
Aug 28 03:31:16.234688254 (9h52m39.464173611s) [upload=10235]: Upload finished. err: metaclient: Too Many Requests
Duration: 16.482963ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................]
duration:
324.097113ms
FAIL (2025-08-28 03:31:13 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 28 02:47:44.611300761 (9h9m7.840786109s) [upload=9486]: Starting upload
Aug 28 02:47:44.611340746 (9h9m7.840826094s) [upload=9486]: Done starting upload
Aug 28 02:47:44.611428663 (9h9m7.84091402s) [upload=9486]: Uploading segments...
Aug 28 02:47:44.611668895 (9h9m7.841154252s) [upload=9486]: Got next segment. Inline: false
Aug 28 02:47:44.611695745 (9h9m7.841181092s) [upload=9486]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 02:47:44.611699653 (9h9m7.841185s) [upload=9486]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 28 02:47:44.671595480 (9h9m7.901080837s) [upload=9486]: Next segment err: metaclient: Too Many Requests
Aug 28 02:47:44.671612302 (9h9m7.901097648s) [upload=9486]: Done uploading segments...
Aug 28 02:47:44.671629464 (9h9m7.901114821s) [upload=9486]: Upload finished. err: metaclient: Too Many Requests
Duration: 324.118282ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip:
5 out of 60 is failed (threshold=3) [.............................XX...X.X.X.....................]
duration:
3.441687236s
FAIL (2025-08-28 03:30:28 UTC)
orbiter warning: operation: DeleteObject
uplink: metaclient: context deadline exceeded
Duration: 3.44170634s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................]
duration:
375.569372ms
FAIL (2025-08-28 03:30:18 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 28 02:47:44.611300761 (9h9m7.840786109s) [upload=9486]: Starting upload
Aug 28 02:47:44.611340746 (9h9m7.840826094s) [upload=9486]: Done starting upload
Aug 28 02:47:44.611428663 (9h9m7.84091402s) [upload=9486]: Uploading segments...
Aug 28 02:47:44.611668895 (9h9m7.841154252s) [upload=9486]: Got next segment. Inline: false
Aug 28 02:47:44.611695745 (9h9m7.841181092s) [upload=9486]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 02:47:44.611699653 (9h9m7.841185s) [upload=9486]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 28 02:47:44.671595480 (9h9m7.901080837s) [upload=9486]: Next segment err: metaclient: Too Many Requests
Aug 28 02:47:44.671612302 (9h9m7.901097648s) [upload=9486]: Done uploading segments...
Aug 28 02:47:44.671629464 (9h9m7.901114821s) [upload=9486]: Upload finished. err: metaclient: Too Many Requests
Duration: 375.594549ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............]
duration:
160.841254ms
FAIL (2025-08-28 03:30:11 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 28 03:19:17.907342448 (9h40m41.136827835s) [upload=10025]: Starting upload
Aug 28 03:19:17.907407560 (9h40m41.136892937s) [upload=10025]: Done starting upload
Aug 28 03:19:17.907477272 (9h40m41.136962649s) [upload=10025]: Uploading segments...
Aug 28 03:19:17.907514572 (9h40m41.136999949s) [upload=10025]: Got next segment. Inline: true
Aug 28 03:19:17.907520152 (9h40m41.13700553s) [upload=10025]: Waiting for error group managing segments...
Aug 28 03:19:17.907568372 (9h40m41.13705375s) [upload=10025]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 03:19:17.907574675 (9h40m41.137060051s) [upload=10025]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 28 03:19:17.907578672 (9h40m41.137064049s) [upload=10025]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 03:19:17.910171414 (9h40m41.13965679s) [upload=10025]: Done uploading segments...
Aug 28 03:19:17.910184448 (9h40m41.139669825s) [upload=10025]: Upload finished. err: metaclient: Too Many Requests
Duration: 160.868615ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................]
duration:
994.655847ms
FAIL (2025-08-28 03:30:09 UTC)
orbiter warning: operation: DownloadObject
uplink: metaclient: context deadline exceeded
Duration: 994.687797ms core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................]
duration:
12.945356522s
FAIL (2025-08-28 03:29:58 UTC)
orbiter warning: operation: DownloadObject
uplink: metaclient: context deadline exceeded
Duration: 12.945379166s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............]
duration:
147.453733ms
FAIL (2025-08-28 03:29:37 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 28 03:19:17.907342448 (9h40m41.136827835s) [upload=10025]: Starting upload
Aug 28 03:19:17.907407560 (9h40m41.136892937s) [upload=10025]: Done starting upload
Aug 28 03:19:17.907477272 (9h40m41.136962649s) [upload=10025]: Uploading segments...
Aug 28 03:19:17.907514572 (9h40m41.136999949s) [upload=10025]: Got next segment. Inline: true
Aug 28 03:19:17.907520152 (9h40m41.13700553s) [upload=10025]: Waiting for error group managing segments...
Aug 28 03:19:17.907568372 (9h40m41.13705375s) [upload=10025]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 03:19:17.907574675 (9h40m41.137060051s) [upload=10025]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 28 03:19:17.907578672 (9h40m41.137064049s) [upload=10025]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 03:19:17.910171414 (9h40m41.13965679s) [upload=10025]: Done uploading segments...
Aug 28 03:19:17.910184448 (9h40m41.139669825s) [upload=10025]: Upload finished. err: metaclient: Too Many Requests
Duration: 147.476345ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip:
5 out of 60 is failed (threshold=3) [..............................XX...X.X.X....................]
duration:
2.877812663s
FAIL (2025-08-28 03:29:35 UTC)
orbiter warning: operation: DeleteObject
uplink: metaclient: context deadline exceeded
Duration: 2.878061441s core uplink eu1