Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
147.8187ms
FAIL (2025-08-28 05:11:18 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 04:55:48.665926701 (11h17m11.895412078s) [upload=11707]: Starting upload Aug 28 04:55:48.665998676 (11h17m11.895484053s) [upload=11707]: Done starting upload Aug 28 04:55:48.666080210 (11h17m11.895565587s) [upload=11707]: Uploading segments... Aug 28 04:55:48.666119644 (11h17m11.895605031s) [upload=11707]: Got next segment. Inline: true Aug 28 04:55:48.666125715 (11h17m11.895611092s) [upload=11707]: Waiting for error group managing segments... Aug 28 04:55:48.666174087 (11h17m11.895659464s) [upload=11707]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 04:55:48.666180149 (11h17m11.895665535s) [upload=11707]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 04:55:48.666207990 (11h17m11.895693368s) [upload=11707]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 04:55:48.669539422 (11h17m11.899024779s) [upload=11707]: Done uploading segments... Aug 28 04:55:48.669551275 (11h17m11.899036622s) [upload=11707]: Upload finished. err: metaclient: Too Many Requests
Duration: 147.839261ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
549.491494ms
FAIL (2025-08-28 05:11:08 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 04:57:48.688387574 (11h19m11.91787295s) [upload=11737]: Starting upload Aug 28 04:57:48.688465841 (11h19m11.917951227s) [upload=11737]: Done starting upload Aug 28 04:57:48.688512168 (11h19m11.917997526s) [upload=11737]: Uploading segments... Aug 28 04:57:48.688849262 (11h19m11.91833464s) [upload=11737]: Got next segment. Inline: false Aug 28 04:57:48.688895209 (11h19m11.918380586s) [upload=11737]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 04:57:48.688900589 (11h19m11.918385965s) [upload=11737]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 04:57:48.691544778 (11h19m11.921030135s) [upload=11737]: Next segment err: metaclient: Too Many Requests Aug 28 04:57:48.691568693 (11h19m11.92105405s) [upload=11737]: Done uploading segments... Aug 28 04:57:48.691579984 (11h19m11.921065341s) [upload=11737]: Upload finished. err: metaclient: Too Many Requests
Duration: 549.509267ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
493.661937ms
FAIL (2025-08-28 05:10:48 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 04:57:48.688387574 (11h19m11.91787295s) [upload=11737]: Starting upload Aug 28 04:57:48.688465841 (11h19m11.917951227s) [upload=11737]: Done starting upload Aug 28 04:57:48.688512168 (11h19m11.917997526s) [upload=11737]: Uploading segments... Aug 28 04:57:48.688849262 (11h19m11.91833464s) [upload=11737]: Got next segment. Inline: false Aug 28 04:57:48.688895209 (11h19m11.918380586s) [upload=11737]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 04:57:48.688900589 (11h19m11.918385965s) [upload=11737]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 04:57:48.691544778 (11h19m11.921030135s) [upload=11737]: Next segment err: metaclient: Too Many Requests Aug 28 04:57:48.691568693 (11h19m11.92105405s) [upload=11737]: Done uploading segments... Aug 28 04:57:48.691579984 (11h19m11.921065341s) [upload=11737]: Upload finished. err: metaclient: Too Many Requests
Duration: 493.685923ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
131.178249ms
FAIL (2025-08-28 05:10:11 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 04:55:48.665926701 (11h17m11.895412078s) [upload=11707]: Starting upload Aug 28 04:55:48.665998676 (11h17m11.895484053s) [upload=11707]: Done starting upload Aug 28 04:55:48.666080210 (11h17m11.895565587s) [upload=11707]: Uploading segments... Aug 28 04:55:48.666119644 (11h17m11.895605031s) [upload=11707]: Got next segment. Inline: true Aug 28 04:55:48.666125715 (11h17m11.895611092s) [upload=11707]: Waiting for error group managing segments... Aug 28 04:55:48.666174087 (11h17m11.895659464s) [upload=11707]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 04:55:48.666180149 (11h17m11.895665535s) [upload=11707]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 04:55:48.666207990 (11h17m11.895693368s) [upload=11707]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 04:55:48.669539422 (11h17m11.899024779s) [upload=11707]: Done uploading segments... Aug 28 04:55:48.669551275 (11h17m11.899036622s) [upload=11707]: Upload finished. err: metaclient: Too Many Requests
Duration: 131.207563ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
139.056243ms
FAIL (2025-08-28 05:09:46 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 04:55:48.665926701 (11h17m11.895412078s) [upload=11707]: Starting upload Aug 28 04:55:48.665998676 (11h17m11.895484053s) [upload=11707]: Done starting upload Aug 28 04:55:48.666080210 (11h17m11.895565587s) [upload=11707]: Uploading segments... Aug 28 04:55:48.666119644 (11h17m11.895605031s) [upload=11707]: Got next segment. Inline: true Aug 28 04:55:48.666125715 (11h17m11.895611092s) [upload=11707]: Waiting for error group managing segments... Aug 28 04:55:48.666174087 (11h17m11.895659464s) [upload=11707]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 04:55:48.666180149 (11h17m11.895665535s) [upload=11707]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 04:55:48.666207990 (11h17m11.895693368s) [upload=11707]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 04:55:48.669539422 (11h17m11.899024779s) [upload=11707]: Done uploading segments... Aug 28 04:55:48.669551275 (11h17m11.899036622s) [upload=11707]: Upload finished. err: metaclient: Too Many Requests
Duration: 139.08175ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
709.44498ms
FAIL (2025-08-28 05:09:35 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 04:57:48.688387574 (11h19m11.91787295s) [upload=11737]: Starting upload Aug 28 04:57:48.688465841 (11h19m11.917951227s) [upload=11737]: Done starting upload Aug 28 04:57:48.688512168 (11h19m11.917997526s) [upload=11737]: Uploading segments... Aug 28 04:57:48.688849262 (11h19m11.91833464s) [upload=11737]: Got next segment. Inline: false Aug 28 04:57:48.688895209 (11h19m11.918380586s) [upload=11737]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 04:57:48.688900589 (11h19m11.918385965s) [upload=11737]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 04:57:48.691544778 (11h19m11.921030135s) [upload=11737]: Next segment err: metaclient: Too Many Requests Aug 28 04:57:48.691568693 (11h19m11.92105405s) [upload=11737]: Done uploading segments... Aug 28 04:57:48.691579984 (11h19m11.921065341s) [upload=11737]: Upload finished. err: metaclient: Too Many Requests
Duration: 709.505553ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
431.193682ms
FAIL (2025-08-28 05:09:11 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 04:57:48.688387574 (11h19m11.91787295s) [upload=11737]: Starting upload Aug 28 04:57:48.688465841 (11h19m11.917951227s) [upload=11737]: Done starting upload Aug 28 04:57:48.688512168 (11h19m11.917997526s) [upload=11737]: Uploading segments... Aug 28 04:57:48.688849262 (11h19m11.91833464s) [upload=11737]: Got next segment. Inline: false Aug 28 04:57:48.688895209 (11h19m11.918380586s) [upload=11737]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 04:57:48.688900589 (11h19m11.918385965s) [upload=11737]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 04:57:48.691544778 (11h19m11.921030135s) [upload=11737]: Next segment err: metaclient: Too Many Requests Aug 28 04:57:48.691568693 (11h19m11.92105405s) [upload=11737]: Done uploading segments... Aug 28 04:57:48.691579984 (11h19m11.921065341s) [upload=11737]: Upload finished. err: metaclient: Too Many Requests
Duration: 431.224662ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
1.057224977s
FAIL (2025-08-28 05:09:07 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 04:55:48.665926701 (11h17m11.895412078s) [upload=11707]: Starting upload Aug 28 04:55:48.665998676 (11h17m11.895484053s) [upload=11707]: Done starting upload Aug 28 04:55:48.666080210 (11h17m11.895565587s) [upload=11707]: Uploading segments... Aug 28 04:55:48.666119644 (11h17m11.895605031s) [upload=11707]: Got next segment. Inline: true Aug 28 04:55:48.666125715 (11h17m11.895611092s) [upload=11707]: Waiting for error group managing segments... Aug 28 04:55:48.666174087 (11h17m11.895659464s) [upload=11707]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 04:55:48.666180149 (11h17m11.895665535s) [upload=11707]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 04:55:48.666207990 (11h17m11.895693368s) [upload=11707]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 04:55:48.669539422 (11h17m11.899024779s) [upload=11707]: Done uploading segments... Aug 28 04:55:48.669551275 (11h17m11.899036622s) [upload=11707]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.057249543s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
353.81303ms
FAIL (2025-08-28 05:08:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 04:55:48.665926701 (11h17m11.895412078s) [upload=11707]: Starting upload Aug 28 04:55:48.665998676 (11h17m11.895484053s) [upload=11707]: Done starting upload Aug 28 04:55:48.666080210 (11h17m11.895565587s) [upload=11707]: Uploading segments... Aug 28 04:55:48.666119644 (11h17m11.895605031s) [upload=11707]: Got next segment. Inline: true Aug 28 04:55:48.666125715 (11h17m11.895611092s) [upload=11707]: Waiting for error group managing segments... Aug 28 04:55:48.666174087 (11h17m11.895659464s) [upload=11707]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 04:55:48.666180149 (11h17m11.895665535s) [upload=11707]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 04:55:48.666207990 (11h17m11.895693368s) [upload=11707]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 04:55:48.669539422 (11h17m11.899024779s) [upload=11707]: Done uploading segments... Aug 28 04:55:48.669551275 (11h17m11.899036622s) [upload=11707]: Upload finished. err: metaclient: Too Many Requests
Duration: 353.843287ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
409.429998ms
FAIL (2025-08-28 05:08:10 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 04:57:48.688387574 (11h19m11.91787295s) [upload=11737]: Starting upload Aug 28 04:57:48.688465841 (11h19m11.917951227s) [upload=11737]: Done starting upload Aug 28 04:57:48.688512168 (11h19m11.917997526s) [upload=11737]: Uploading segments... Aug 28 04:57:48.688849262 (11h19m11.91833464s) [upload=11737]: Got next segment. Inline: false Aug 28 04:57:48.688895209 (11h19m11.918380586s) [upload=11737]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 04:57:48.688900589 (11h19m11.918385965s) [upload=11737]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 04:57:48.691544778 (11h19m11.921030135s) [upload=11737]: Next segment err: metaclient: Too Many Requests Aug 28 04:57:48.691568693 (11h19m11.92105405s) [upload=11737]: Done uploading segments... Aug 28 04:57:48.691579984 (11h19m11.921065341s) [upload=11737]: Upload finished. err: metaclient: Too Many Requests
Duration: 409.448191ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
134.736989ms
FAIL (2025-08-28 05:07:49 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 04:55:48.665926701 (11h17m11.895412078s) [upload=11707]: Starting upload Aug 28 04:55:48.665998676 (11h17m11.895484053s) [upload=11707]: Done starting upload Aug 28 04:55:48.666080210 (11h17m11.895565587s) [upload=11707]: Uploading segments... Aug 28 04:55:48.666119644 (11h17m11.895605031s) [upload=11707]: Got next segment. Inline: true Aug 28 04:55:48.666125715 (11h17m11.895611092s) [upload=11707]: Waiting for error group managing segments... Aug 28 04:55:48.666174087 (11h17m11.895659464s) [upload=11707]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 04:55:48.666180149 (11h17m11.895665535s) [upload=11707]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 04:55:48.666207990 (11h17m11.895693368s) [upload=11707]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 04:55:48.669539422 (11h17m11.899024779s) [upload=11707]: Done uploading segments... Aug 28 04:55:48.669551275 (11h17m11.899036622s) [upload=11707]: Upload finished. err: metaclient: Too Many Requests
Duration: 134.761034ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
427.624894ms
FAIL (2025-08-28 05:07:36 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 04:57:48.688387574 (11h19m11.91787295s) [upload=11737]: Starting upload Aug 28 04:57:48.688465841 (11h19m11.917951227s) [upload=11737]: Done starting upload Aug 28 04:57:48.688512168 (11h19m11.917997526s) [upload=11737]: Uploading segments... Aug 28 04:57:48.688849262 (11h19m11.91833464s) [upload=11737]: Got next segment. Inline: false Aug 28 04:57:48.688895209 (11h19m11.918380586s) [upload=11737]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 04:57:48.688900589 (11h19m11.918385965s) [upload=11737]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 04:57:48.691544778 (11h19m11.921030135s) [upload=11737]: Next segment err: metaclient: Too Many Requests Aug 28 04:57:48.691568693 (11h19m11.92105405s) [upload=11737]: Done uploading segments... Aug 28 04:57:48.691579984 (11h19m11.921065341s) [upload=11737]: Upload finished. err: metaclient: Too Many Requests
Duration: 427.652327ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
743.357811ms
FAIL (2025-08-28 05:07:17 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 04:57:48.688387574 (11h19m11.91787295s) [upload=11737]: Starting upload Aug 28 04:57:48.688465841 (11h19m11.917951227s) [upload=11737]: Done starting upload Aug 28 04:57:48.688512168 (11h19m11.917997526s) [upload=11737]: Uploading segments... Aug 28 04:57:48.688849262 (11h19m11.91833464s) [upload=11737]: Got next segment. Inline: false Aug 28 04:57:48.688895209 (11h19m11.918380586s) [upload=11737]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 04:57:48.688900589 (11h19m11.918385965s) [upload=11737]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 04:57:48.691544778 (11h19m11.921030135s) [upload=11737]: Next segment err: metaclient: Too Many Requests Aug 28 04:57:48.691568693 (11h19m11.92105405s) [upload=11737]: Done uploading segments... Aug 28 04:57:48.691579984 (11h19m11.921065341s) [upload=11737]: Upload finished. err: metaclient: Too Many Requests
Duration: 743.38399ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
110.543468ms
FAIL (2025-08-28 05:06:45 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 04:55:48.665926701 (11h17m11.895412078s) [upload=11707]: Starting upload Aug 28 04:55:48.665998676 (11h17m11.895484053s) [upload=11707]: Done starting upload Aug 28 04:55:48.666080210 (11h17m11.895565587s) [upload=11707]: Uploading segments... Aug 28 04:55:48.666119644 (11h17m11.895605031s) [upload=11707]: Got next segment. Inline: true Aug 28 04:55:48.666125715 (11h17m11.895611092s) [upload=11707]: Waiting for error group managing segments... Aug 28 04:55:48.666174087 (11h17m11.895659464s) [upload=11707]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 04:55:48.666180149 (11h17m11.895665535s) [upload=11707]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 04:55:48.666207990 (11h17m11.895693368s) [upload=11707]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 04:55:48.669539422 (11h17m11.899024779s) [upload=11707]: Done uploading segments... Aug 28 04:55:48.669551275 (11h17m11.899036622s) [upload=11707]: Upload finished. err: metaclient: Too Many Requests
Duration: 110.564779ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
479.146717ms
FAIL (2025-08-28 05:06:44 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 04:57:48.688387574 (11h19m11.91787295s) [upload=11737]: Starting upload Aug 28 04:57:48.688465841 (11h19m11.917951227s) [upload=11737]: Done starting upload Aug 28 04:57:48.688512168 (11h19m11.917997526s) [upload=11737]: Uploading segments... Aug 28 04:57:48.688849262 (11h19m11.91833464s) [upload=11737]: Got next segment. Inline: false Aug 28 04:57:48.688895209 (11h19m11.918380586s) [upload=11737]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 04:57:48.688900589 (11h19m11.918385965s) [upload=11737]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 04:57:48.691544778 (11h19m11.921030135s) [upload=11737]: Next segment err: metaclient: Too Many Requests Aug 28 04:57:48.691568693 (11h19m11.92105405s) [upload=11737]: Done uploading segments... Aug 28 04:57:48.691579984 (11h19m11.921065341s) [upload=11737]: Upload finished. err: metaclient: Too Many Requests
Duration: 479.174839ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
227.738833ms
FAIL (2025-08-28 05:05:50 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 04:55:48.665926701 (11h17m11.895412078s) [upload=11707]: Starting upload Aug 28 04:55:48.665998676 (11h17m11.895484053s) [upload=11707]: Done starting upload Aug 28 04:55:48.666080210 (11h17m11.895565587s) [upload=11707]: Uploading segments... Aug 28 04:55:48.666119644 (11h17m11.895605031s) [upload=11707]: Got next segment. Inline: true Aug 28 04:55:48.666125715 (11h17m11.895611092s) [upload=11707]: Waiting for error group managing segments... Aug 28 04:55:48.666174087 (11h17m11.895659464s) [upload=11707]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 04:55:48.666180149 (11h17m11.895665535s) [upload=11707]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 04:55:48.666207990 (11h17m11.895693368s) [upload=11707]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 04:55:48.669539422 (11h17m11.899024779s) [upload=11707]: Done uploading segments... Aug 28 04:55:48.669551275 (11h17m11.899036622s) [upload=11707]: Upload finished. err: metaclient: Too Many Requests
Duration: 227.764582ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
658.360099ms
FAIL (2025-08-28 05:05:29 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 04:57:48.688387574 (11h19m11.91787295s) [upload=11737]: Starting upload Aug 28 04:57:48.688465841 (11h19m11.917951227s) [upload=11737]: Done starting upload Aug 28 04:57:48.688512168 (11h19m11.917997526s) [upload=11737]: Uploading segments... Aug 28 04:57:48.688849262 (11h19m11.91833464s) [upload=11737]: Got next segment. Inline: false Aug 28 04:57:48.688895209 (11h19m11.918380586s) [upload=11737]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 04:57:48.688900589 (11h19m11.918385965s) [upload=11737]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 04:57:48.691544778 (11h19m11.921030135s) [upload=11737]: Next segment err: metaclient: Too Many Requests Aug 28 04:57:48.691568693 (11h19m11.92105405s) [upload=11737]: Done uploading segments... Aug 28 04:57:48.691579984 (11h19m11.921065341s) [upload=11737]: Upload finished. err: metaclient: Too Many Requests
Duration: 658.384976ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
142.371384ms
FAIL (2025-08-28 05:05:26 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 04:55:48.665926701 (11h17m11.895412078s) [upload=11707]: Starting upload Aug 28 04:55:48.665998676 (11h17m11.895484053s) [upload=11707]: Done starting upload Aug 28 04:55:48.666080210 (11h17m11.895565587s) [upload=11707]: Uploading segments... Aug 28 04:55:48.666119644 (11h17m11.895605031s) [upload=11707]: Got next segment. Inline: true Aug 28 04:55:48.666125715 (11h17m11.895611092s) [upload=11707]: Waiting for error group managing segments... Aug 28 04:55:48.666174087 (11h17m11.895659464s) [upload=11707]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 04:55:48.666180149 (11h17m11.895665535s) [upload=11707]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 04:55:48.666207990 (11h17m11.895693368s) [upload=11707]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 04:55:48.669539422 (11h17m11.899024779s) [upload=11707]: Done uploading segments... Aug 28 04:55:48.669551275 (11h17m11.899036622s) [upload=11707]: Upload finished. err: metaclient: Too Many Requests
Duration: 142.396219ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
523.130428ms
FAIL (2025-08-28 05:04:53 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 04:57:48.688387574 (11h19m11.91787295s) [upload=11737]: Starting upload Aug 28 04:57:48.688465841 (11h19m11.917951227s) [upload=11737]: Done starting upload Aug 28 04:57:48.688512168 (11h19m11.917997526s) [upload=11737]: Uploading segments... Aug 28 04:57:48.688849262 (11h19m11.91833464s) [upload=11737]: Got next segment. Inline: false Aug 28 04:57:48.688895209 (11h19m11.918380586s) [upload=11737]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 04:57:48.688900589 (11h19m11.918385965s) [upload=11737]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 04:57:48.691544778 (11h19m11.921030135s) [upload=11737]: Next segment err: metaclient: Too Many Requests Aug 28 04:57:48.691568693 (11h19m11.92105405s) [upload=11737]: Done uploading segments... Aug 28 04:57:48.691579984 (11h19m11.921065341s) [upload=11737]: Upload finished. err: metaclient: Too Many Requests
Duration: 523.159763ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
136.468873ms
FAIL (2025-08-28 05:04:33 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 04:55:48.665926701 (11h17m11.895412078s) [upload=11707]: Starting upload Aug 28 04:55:48.665998676 (11h17m11.895484053s) [upload=11707]: Done starting upload Aug 28 04:55:48.666080210 (11h17m11.895565587s) [upload=11707]: Uploading segments... Aug 28 04:55:48.666119644 (11h17m11.895605031s) [upload=11707]: Got next segment. Inline: true Aug 28 04:55:48.666125715 (11h17m11.895611092s) [upload=11707]: Waiting for error group managing segments... Aug 28 04:55:48.666174087 (11h17m11.895659464s) [upload=11707]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 04:55:48.666180149 (11h17m11.895665535s) [upload=11707]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 04:55:48.666207990 (11h17m11.895693368s) [upload=11707]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 04:55:48.669539422 (11h17m11.899024779s) [upload=11707]: Done uploading segments... Aug 28 04:55:48.669551275 (11h17m11.899036622s) [upload=11707]: Upload finished. err: metaclient: Too Many Requests
Duration: 136.500062ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
455.596875ms
FAIL (2025-08-28 05:03:41 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 04:57:48.688387574 (11h19m11.91787295s) [upload=11737]: Starting upload Aug 28 04:57:48.688465841 (11h19m11.917951227s) [upload=11737]: Done starting upload Aug 28 04:57:48.688512168 (11h19m11.917997526s) [upload=11737]: Uploading segments... Aug 28 04:57:48.688849262 (11h19m11.91833464s) [upload=11737]: Got next segment. Inline: false Aug 28 04:57:48.688895209 (11h19m11.918380586s) [upload=11737]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 04:57:48.688900589 (11h19m11.918385965s) [upload=11737]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 04:57:48.691544778 (11h19m11.921030135s) [upload=11737]: Next segment err: metaclient: Too Many Requests Aug 28 04:57:48.691568693 (11h19m11.92105405s) [upload=11737]: Done uploading segments... Aug 28 04:57:48.691579984 (11h19m11.921065341s) [upload=11737]: Upload finished. err: metaclient: Too Many Requests
Duration: 455.632774ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
509.906802ms
FAIL (2025-08-28 05:03:29 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 04:55:48.665926701 (11h17m11.895412078s) [upload=11707]: Starting upload Aug 28 04:55:48.665998676 (11h17m11.895484053s) [upload=11707]: Done starting upload Aug 28 04:55:48.666080210 (11h17m11.895565587s) [upload=11707]: Uploading segments... Aug 28 04:55:48.666119644 (11h17m11.895605031s) [upload=11707]: Got next segment. Inline: true Aug 28 04:55:48.666125715 (11h17m11.895611092s) [upload=11707]: Waiting for error group managing segments... Aug 28 04:55:48.666174087 (11h17m11.895659464s) [upload=11707]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 04:55:48.666180149 (11h17m11.895665535s) [upload=11707]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 04:55:48.666207990 (11h17m11.895693368s) [upload=11707]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 04:55:48.669539422 (11h17m11.899024779s) [upload=11707]: Done uploading segments... Aug 28 04:55:48.669551275 (11h17m11.899036622s) [upload=11707]: Upload finished. err: metaclient: Too Many Requests
Duration: 509.935867ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
728.946348ms
FAIL (2025-08-28 05:02:59 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 04:57:48.688387574 (11h19m11.91787295s) [upload=11737]: Starting upload Aug 28 04:57:48.688465841 (11h19m11.917951227s) [upload=11737]: Done starting upload Aug 28 04:57:48.688512168 (11h19m11.917997526s) [upload=11737]: Uploading segments... Aug 28 04:57:48.688849262 (11h19m11.91833464s) [upload=11737]: Got next segment. Inline: false Aug 28 04:57:48.688895209 (11h19m11.918380586s) [upload=11737]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 04:57:48.688900589 (11h19m11.918385965s) [upload=11737]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 04:57:48.691544778 (11h19m11.921030135s) [upload=11737]: Next segment err: metaclient: Too Many Requests Aug 28 04:57:48.691568693 (11h19m11.92105405s) [upload=11737]: Done uploading segments... Aug 28 04:57:48.691579984 (11h19m11.921065341s) [upload=11737]: Upload finished. err: metaclient: Too Many Requests
Duration: 728.978248ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
126.156787ms
FAIL (2025-08-28 05:02:57 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 04:55:48.665926701 (11h17m11.895412078s) [upload=11707]: Starting upload Aug 28 04:55:48.665998676 (11h17m11.895484053s) [upload=11707]: Done starting upload Aug 28 04:55:48.666080210 (11h17m11.895565587s) [upload=11707]: Uploading segments... Aug 28 04:55:48.666119644 (11h17m11.895605031s) [upload=11707]: Got next segment. Inline: true Aug 28 04:55:48.666125715 (11h17m11.895611092s) [upload=11707]: Waiting for error group managing segments... Aug 28 04:55:48.666174087 (11h17m11.895659464s) [upload=11707]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 04:55:48.666180149 (11h17m11.895665535s) [upload=11707]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 04:55:48.666207990 (11h17m11.895693368s) [upload=11707]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 04:55:48.669539422 (11h17m11.899024779s) [upload=11707]: Done uploading segments... Aug 28 04:55:48.669551275 (11h17m11.899036622s) [upload=11707]: Upload finished. err: metaclient: Too Many Requests
Duration: 126.174201ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
150.759989ms
FAIL (2025-08-28 05:02:26 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 04:55:48.665926701 (11h17m11.895412078s) [upload=11707]: Starting upload Aug 28 04:55:48.665998676 (11h17m11.895484053s) [upload=11707]: Done starting upload Aug 28 04:55:48.666080210 (11h17m11.895565587s) [upload=11707]: Uploading segments... Aug 28 04:55:48.666119644 (11h17m11.895605031s) [upload=11707]: Got next segment. Inline: true Aug 28 04:55:48.666125715 (11h17m11.895611092s) [upload=11707]: Waiting for error group managing segments... Aug 28 04:55:48.666174087 (11h17m11.895659464s) [upload=11707]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 04:55:48.666180149 (11h17m11.895665535s) [upload=11707]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 04:55:48.666207990 (11h17m11.895693368s) [upload=11707]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 04:55:48.669539422 (11h17m11.899024779s) [upload=11707]: Done uploading segments... Aug 28 04:55:48.669551275 (11h17m11.899036622s) [upload=11707]: Upload finished. err: metaclient: Too Many Requests
Duration: 150.785717ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
803.914388ms
FAIL (2025-08-28 05:02:15 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 04:57:48.688387574 (11h19m11.91787295s) [upload=11737]: Starting upload Aug 28 04:57:48.688465841 (11h19m11.917951227s) [upload=11737]: Done starting upload Aug 28 04:57:48.688512168 (11h19m11.917997526s) [upload=11737]: Uploading segments... Aug 28 04:57:48.688849262 (11h19m11.91833464s) [upload=11737]: Got next segment. Inline: false Aug 28 04:57:48.688895209 (11h19m11.918380586s) [upload=11737]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 04:57:48.688900589 (11h19m11.918385965s) [upload=11737]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 04:57:48.691544778 (11h19m11.921030135s) [upload=11737]: Next segment err: metaclient: Too Many Requests Aug 28 04:57:48.691568693 (11h19m11.92105405s) [upload=11737]: Done uploading segments... Aug 28 04:57:48.691579984 (11h19m11.921065341s) [upload=11737]: Upload finished. err: metaclient: Too Many Requests
Duration: 803.929756ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
412.304655ms
FAIL (2025-08-28 05:02:10 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 04:55:48.665926701 (11h17m11.895412078s) [upload=11707]: Starting upload Aug 28 04:55:48.665998676 (11h17m11.895484053s) [upload=11707]: Done starting upload Aug 28 04:55:48.666080210 (11h17m11.895565587s) [upload=11707]: Uploading segments... Aug 28 04:55:48.666119644 (11h17m11.895605031s) [upload=11707]: Got next segment. Inline: true Aug 28 04:55:48.666125715 (11h17m11.895611092s) [upload=11707]: Waiting for error group managing segments... Aug 28 04:55:48.666174087 (11h17m11.895659464s) [upload=11707]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 04:55:48.666180149 (11h17m11.895665535s) [upload=11707]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 04:55:48.666207990 (11h17m11.895693368s) [upload=11707]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 04:55:48.669539422 (11h17m11.899024779s) [upload=11707]: Done uploading segments... Aug 28 04:55:48.669551275 (11h17m11.899036622s) [upload=11707]: Upload finished. err: metaclient: Too Many Requests
Duration: 412.36109ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
1.073266022s
FAIL (2025-08-28 05:01:10 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 04:57:48.688387574 (11h19m11.91787295s) [upload=11737]: Starting upload Aug 28 04:57:48.688465841 (11h19m11.917951227s) [upload=11737]: Done starting upload Aug 28 04:57:48.688512168 (11h19m11.917997526s) [upload=11737]: Uploading segments... Aug 28 04:57:48.688849262 (11h19m11.91833464s) [upload=11737]: Got next segment. Inline: false Aug 28 04:57:48.688895209 (11h19m11.918380586s) [upload=11737]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 04:57:48.688900589 (11h19m11.918385965s) [upload=11737]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 04:57:48.691544778 (11h19m11.921030135s) [upload=11737]: Next segment err: metaclient: Too Many Requests Aug 28 04:57:48.691568693 (11h19m11.92105405s) [upload=11737]: Done uploading segments... Aug 28 04:57:48.691579984 (11h19m11.921065341s) [upload=11737]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.073289677s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
418.930741ms
FAIL (2025-08-28 05:01:00 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 04:55:48.665926701 (11h17m11.895412078s) [upload=11707]: Starting upload Aug 28 04:55:48.665998676 (11h17m11.895484053s) [upload=11707]: Done starting upload Aug 28 04:55:48.666080210 (11h17m11.895565587s) [upload=11707]: Uploading segments... Aug 28 04:55:48.666119644 (11h17m11.895605031s) [upload=11707]: Got next segment. Inline: true Aug 28 04:55:48.666125715 (11h17m11.895611092s) [upload=11707]: Waiting for error group managing segments... Aug 28 04:55:48.666174087 (11h17m11.895659464s) [upload=11707]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 04:55:48.666180149 (11h17m11.895665535s) [upload=11707]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 04:55:48.666207990 (11h17m11.895693368s) [upload=11707]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 04:55:48.669539422 (11h17m11.899024779s) [upload=11707]: Done uploading segments... Aug 28 04:55:48.669551275 (11h17m11.899036622s) [upload=11707]: Upload finished. err: metaclient: Too Many Requests
Duration: 418.948083ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
354.191143ms
FAIL (2025-08-28 05:00:44 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 04:57:48.688387574 (11h19m11.91787295s) [upload=11737]: Starting upload Aug 28 04:57:48.688465841 (11h19m11.917951227s) [upload=11737]: Done starting upload Aug 28 04:57:48.688512168 (11h19m11.917997526s) [upload=11737]: Uploading segments... Aug 28 04:57:48.688849262 (11h19m11.91833464s) [upload=11737]: Got next segment. Inline: false Aug 28 04:57:48.688895209 (11h19m11.918380586s) [upload=11737]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 04:57:48.688900589 (11h19m11.918385965s) [upload=11737]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 04:57:48.691544778 (11h19m11.921030135s) [upload=11737]: Next segment err: metaclient: Too Many Requests Aug 28 04:57:48.691568693 (11h19m11.92105405s) [upload=11737]: Done uploading segments... Aug 28 04:57:48.691579984 (11h19m11.921065341s) [upload=11737]: Upload finished. err: metaclient: Too Many Requests
Duration: 354.22178ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
419.35452ms
FAIL (2025-08-28 04:59:55 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 04:57:48.688387574 (11h19m11.91787295s) [upload=11737]: Starting upload Aug 28 04:57:48.688465841 (11h19m11.917951227s) [upload=11737]: Done starting upload Aug 28 04:57:48.688512168 (11h19m11.917997526s) [upload=11737]: Uploading segments... Aug 28 04:57:48.688849262 (11h19m11.91833464s) [upload=11737]: Got next segment. Inline: false Aug 28 04:57:48.688895209 (11h19m11.918380586s) [upload=11737]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 04:57:48.688900589 (11h19m11.918385965s) [upload=11737]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 04:57:48.691544778 (11h19m11.921030135s) [upload=11737]: Next segment err: metaclient: Too Many Requests Aug 28 04:57:48.691568693 (11h19m11.92105405s) [upload=11737]: Done uploading segments... Aug 28 04:57:48.691579984 (11h19m11.921065341s) [upload=11737]: Upload finished. err: metaclient: Too Many Requests
Duration: 419.374577ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
355.282746ms
FAIL (2025-08-28 04:59:45 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 04:55:48.665926701 (11h17m11.895412078s) [upload=11707]: Starting upload Aug 28 04:55:48.665998676 (11h17m11.895484053s) [upload=11707]: Done starting upload Aug 28 04:55:48.666080210 (11h17m11.895565587s) [upload=11707]: Uploading segments... Aug 28 04:55:48.666119644 (11h17m11.895605031s) [upload=11707]: Got next segment. Inline: true Aug 28 04:55:48.666125715 (11h17m11.895611092s) [upload=11707]: Waiting for error group managing segments... Aug 28 04:55:48.666174087 (11h17m11.895659464s) [upload=11707]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 04:55:48.666180149 (11h17m11.895665535s) [upload=11707]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 04:55:48.666207990 (11h17m11.895693368s) [upload=11707]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 04:55:48.669539422 (11h17m11.899024779s) [upload=11707]: Done uploading segments... Aug 28 04:55:48.669551275 (11h17m11.899036622s) [upload=11707]: Upload finished. err: metaclient: Too Many Requests
Duration: 355.301672ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
155.557925ms
FAIL (2025-08-28 04:58:54 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 04:55:48.665926701 (11h17m11.895412078s) [upload=11707]: Starting upload Aug 28 04:55:48.665998676 (11h17m11.895484053s) [upload=11707]: Done starting upload Aug 28 04:55:48.666080210 (11h17m11.895565587s) [upload=11707]: Uploading segments... Aug 28 04:55:48.666119644 (11h17m11.895605031s) [upload=11707]: Got next segment. Inline: true Aug 28 04:55:48.666125715 (11h17m11.895611092s) [upload=11707]: Waiting for error group managing segments... Aug 28 04:55:48.666174087 (11h17m11.895659464s) [upload=11707]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 04:55:48.666180149 (11h17m11.895665535s) [upload=11707]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 04:55:48.666207990 (11h17m11.895693368s) [upload=11707]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 04:55:48.669539422 (11h17m11.899024779s) [upload=11707]: Done uploading segments... Aug 28 04:55:48.669551275 (11h17m11.899036622s) [upload=11707]: Upload finished. err: metaclient: Too Many Requests
Duration: 155.585586ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
370.052754ms
FAIL (2025-08-28 04:58:44 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 04:57:48.688387574 (11h19m11.91787295s) [upload=11737]: Starting upload Aug 28 04:57:48.688465841 (11h19m11.917951227s) [upload=11737]: Done starting upload Aug 28 04:57:48.688512168 (11h19m11.917997526s) [upload=11737]: Uploading segments... Aug 28 04:57:48.688849262 (11h19m11.91833464s) [upload=11737]: Got next segment. Inline: false Aug 28 04:57:48.688895209 (11h19m11.918380586s) [upload=11737]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 04:57:48.688900589 (11h19m11.918385965s) [upload=11737]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 04:57:48.691544778 (11h19m11.921030135s) [upload=11737]: Next segment err: metaclient: Too Many Requests Aug 28 04:57:48.691568693 (11h19m11.92105405s) [upload=11737]: Done uploading segments... Aug 28 04:57:48.691579984 (11h19m11.921065341s) [upload=11737]: Upload finished. err: metaclient: Too Many Requests
Duration: 370.105694ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
390.077224ms
FAIL (2025-08-28 04:58:21 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 04:57:48.688387574 (11h19m11.91787295s) [upload=11737]: Starting upload Aug 28 04:57:48.688465841 (11h19m11.917951227s) [upload=11737]: Done starting upload Aug 28 04:57:48.688512168 (11h19m11.917997526s) [upload=11737]: Uploading segments... Aug 28 04:57:48.688849262 (11h19m11.91833464s) [upload=11737]: Got next segment. Inline: false Aug 28 04:57:48.688895209 (11h19m11.918380586s) [upload=11737]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 04:57:48.688900589 (11h19m11.918385965s) [upload=11737]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 04:57:48.691544778 (11h19m11.921030135s) [upload=11737]: Next segment err: metaclient: Too Many Requests Aug 28 04:57:48.691568693 (11h19m11.92105405s) [upload=11737]: Done uploading segments... Aug 28 04:57:48.691579984 (11h19m11.921065341s) [upload=11737]: Upload finished. err: metaclient: Too Many Requests
Duration: 390.102663ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
17.092561ms
FAIL (2025-08-28 04:57:48 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 04:57:48.688387574 (11h19m11.91787295s) [upload=11737]: Starting upload Aug 28 04:57:48.688465841 (11h19m11.917951227s) [upload=11737]: Done starting upload Aug 28 04:57:48.688512168 (11h19m11.917997526s) [upload=11737]: Uploading segments... Aug 28 04:57:48.688849262 (11h19m11.91833464s) [upload=11737]: Got next segment. Inline: false Aug 28 04:57:48.688895209 (11h19m11.918380586s) [upload=11737]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 04:57:48.688900589 (11h19m11.918385965s) [upload=11737]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 04:57:48.691544778 (11h19m11.921030135s) [upload=11737]: Next segment err: metaclient: Too Many Requests Aug 28 04:57:48.691568693 (11h19m11.92105405s) [upload=11737]: Done uploading segments... Aug 28 04:57:48.691579984 (11h19m11.921065341s) [upload=11737]: Upload finished. err: metaclient: Too Many Requests
Duration: 17.112239ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
210.436418ms
FAIL (2025-08-28 04:57:40 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 04:55:48.665926701 (11h17m11.895412078s) [upload=11707]: Starting upload Aug 28 04:55:48.665998676 (11h17m11.895484053s) [upload=11707]: Done starting upload Aug 28 04:55:48.666080210 (11h17m11.895565587s) [upload=11707]: Uploading segments... Aug 28 04:55:48.666119644 (11h17m11.895605031s) [upload=11707]: Got next segment. Inline: true Aug 28 04:55:48.666125715 (11h17m11.895611092s) [upload=11707]: Waiting for error group managing segments... Aug 28 04:55:48.666174087 (11h17m11.895659464s) [upload=11707]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 04:55:48.666180149 (11h17m11.895665535s) [upload=11707]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 04:55:48.666207990 (11h17m11.895693368s) [upload=11707]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 04:55:48.669539422 (11h17m11.899024779s) [upload=11707]: Done uploading segments... Aug 28 04:55:48.669551275 (11h17m11.899036622s) [upload=11707]: Upload finished. err: metaclient: Too Many Requests
Duration: 210.450966ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
337.671887ms
FAIL (2025-08-28 04:57:24 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 04:55:48.665926701 (11h17m11.895412078s) [upload=11707]: Starting upload Aug 28 04:55:48.665998676 (11h17m11.895484053s) [upload=11707]: Done starting upload Aug 28 04:55:48.666080210 (11h17m11.895565587s) [upload=11707]: Uploading segments... Aug 28 04:55:48.666119644 (11h17m11.895605031s) [upload=11707]: Got next segment. Inline: true Aug 28 04:55:48.666125715 (11h17m11.895611092s) [upload=11707]: Waiting for error group managing segments... Aug 28 04:55:48.666174087 (11h17m11.895659464s) [upload=11707]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 04:55:48.666180149 (11h17m11.895665535s) [upload=11707]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 04:55:48.666207990 (11h17m11.895693368s) [upload=11707]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 04:55:48.669539422 (11h17m11.899024779s) [upload=11707]: Done uploading segments... Aug 28 04:55:48.669551275 (11h17m11.899036622s) [upload=11707]: Upload finished. err: metaclient: Too Many Requests
Duration: 337.697323ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
124.666963ms
FAIL (2025-08-28 04:56:52 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 04:55:48.665926701 (11h17m11.895412078s) [upload=11707]: Starting upload Aug 28 04:55:48.665998676 (11h17m11.895484053s) [upload=11707]: Done starting upload Aug 28 04:55:48.666080210 (11h17m11.895565587s) [upload=11707]: Uploading segments... Aug 28 04:55:48.666119644 (11h17m11.895605031s) [upload=11707]: Got next segment. Inline: true Aug 28 04:55:48.666125715 (11h17m11.895611092s) [upload=11707]: Waiting for error group managing segments... Aug 28 04:55:48.666174087 (11h17m11.895659464s) [upload=11707]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 04:55:48.666180149 (11h17m11.895665535s) [upload=11707]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 04:55:48.666207990 (11h17m11.895693368s) [upload=11707]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 04:55:48.669539422 (11h17m11.899024779s) [upload=11707]: Done uploading segments... Aug 28 04:55:48.669551275 (11h17m11.899036622s) [upload=11707]: Upload finished. err: metaclient: Too Many Requests
Duration: 124.696038ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
2.905748551s
FAIL (2025-08-28 04:56:45 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 2.905777776s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
2.851355161s
FAIL (2025-08-28 04:55:57 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 2.851376422s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
20.293618ms
FAIL (2025-08-28 04:55:48 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 04:55:48.665926701 (11h17m11.895412078s) [upload=11707]: Starting upload Aug 28 04:55:48.665998676 (11h17m11.895484053s) [upload=11707]: Done starting upload Aug 28 04:55:48.666080210 (11h17m11.895565587s) [upload=11707]: Uploading segments... Aug 28 04:55:48.666119644 (11h17m11.895605031s) [upload=11707]: Got next segment. Inline: true Aug 28 04:55:48.666125715 (11h17m11.895611092s) [upload=11707]: Waiting for error group managing segments... Aug 28 04:55:48.666174087 (11h17m11.895659464s) [upload=11707]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 04:55:48.666180149 (11h17m11.895665535s) [upload=11707]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 04:55:48.666207990 (11h17m11.895693368s) [upload=11707]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 04:55:48.669539422 (11h17m11.899024779s) [upload=11707]: Done uploading segments... Aug 28 04:55:48.669551275 (11h17m11.899036622s) [upload=11707]: Upload finished. err: metaclient: Too Many Requests
Duration: 20.311041ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
2.795091331s
FAIL (2025-08-28 04:55:18 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 2.795110174s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
2.693161731s
FAIL (2025-08-28 04:54:35 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 2.693186808s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
2.773000821s
FAIL (2025-08-28 04:54:17 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 2.77302632s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
2.640438578s
FAIL (2025-08-28 04:53:21 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 2.640460809s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
933.73786ms
FAIL (2025-08-28 04:53:19 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 933.76464ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
2.888578923s
FAIL (2025-08-28 04:52:37 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 2.888615392s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [XX..........................................................] duration:
1.014373746s
FAIL (2025-08-28 04:52:24 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 1.014433629s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
451.801241ms
FAIL (2025-08-28 04:52:18 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 04:07:38.889091158 (10h29m2.118576516s) [upload=10874]: Starting upload Aug 28 04:07:38.889127759 (10h29m2.118613105s) [upload=10874]: Done starting upload Aug 28 04:07:38.889250649 (10h29m2.118736006s) [upload=10874]: Uploading segments... Aug 28 04:07:38.889348914 (10h29m2.118834261s) [upload=10874]: Got next segment. Inline: false Aug 28 04:07:38.889382427 (10h29m2.118867774s) [upload=10874]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 04:07:38.889386264 (10h29m2.118871611s) [upload=10874]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 04:07:38.891731439 (10h29m2.121216796s) [upload=10874]: Next segment err: metaclient: Too Many Requests Aug 28 04:07:38.891744373 (10h29m2.12122973s) [upload=10874]: Done uploading segments... Aug 28 04:07:38.891756856 (10h29m2.121242213s) [upload=10874]: Upload finished. err: metaclient: Too Many Requests
Duration: 451.822682ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|