Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............................................X..X.........] duration:
582.521458ms
FAIL (2025-08-11 04:10:58 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 04:02:42.297674681 (58h36m23.028942311s) [upload=61069]: Starting upload Aug 11 04:02:42.297718934 (58h36m23.028986564s) [upload=61069]: Done starting upload Aug 11 04:02:42.297772433 (58h36m23.029040063s) [upload=61069]: Uploading segments... Aug 11 04:02:42.297954333 (58h36m23.029221963s) [upload=61069]: Got next segment. Inline: false Aug 11 04:02:42.298002814 (58h36m23.029270444s) [upload=61069]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 04:02:42.298009046 (58h36m23.029276676s) [upload=61069]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 04:02:42.300715126 (58h36m23.031982747s) [upload=61069]: Next segment err: metaclient: Too Many Requests Aug 11 04:02:42.300723593 (58h36m23.031991212s) [upload=61069]: Done uploading segments... Aug 11 04:02:42.300731137 (58h36m23.031998757s) [upload=61069]: Upload finished. err: metaclient: Too Many Requests
Duration: 582.5384ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [................................................X..X........] duration:
489.567294ms
FAIL (2025-08-11 04:10:07 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 04:02:42.297674681 (58h36m23.028942311s) [upload=61069]: Starting upload Aug 11 04:02:42.297718934 (58h36m23.028986564s) [upload=61069]: Done starting upload Aug 11 04:02:42.297772433 (58h36m23.029040063s) [upload=61069]: Uploading segments... Aug 11 04:02:42.297954333 (58h36m23.029221963s) [upload=61069]: Got next segment. Inline: false Aug 11 04:02:42.298002814 (58h36m23.029270444s) [upload=61069]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 04:02:42.298009046 (58h36m23.029276676s) [upload=61069]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 04:02:42.300715126 (58h36m23.031982747s) [upload=61069]: Next segment err: metaclient: Too Many Requests Aug 11 04:02:42.300723593 (58h36m23.031991212s) [upload=61069]: Done uploading segments... Aug 11 04:02:42.300731137 (58h36m23.031998757s) [upload=61069]: Upload finished. err: metaclient: Too Many Requests
Duration: 489.588574ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....................X.......................X...............] duration:
125.661843ms
FAIL (2025-08-11 04:10:02 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 03:57:57.361395597 (58h31m38.092663258s) [upload=60989]: Starting upload Aug 11 03:57:57.361459798 (58h31m38.092727448s) [upload=60989]: Done starting upload Aug 11 03:57:57.361529187 (58h31m38.092796847s) [upload=60989]: Uploading segments... Aug 11 03:57:57.361566487 (58h31m38.092834147s) [upload=60989]: Got next segment. Inline: true Aug 11 03:57:57.361571977 (58h31m38.092839628s) [upload=60989]: Waiting for error group managing segments... Aug 11 03:57:57.361614677 (58h31m38.092882337s) [upload=60989]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 03:57:57.361620047 (58h31m38.092887696s) [upload=60989]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 03:57:57.361623593 (58h31m38.092891243s) [upload=60989]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 03:57:57.364494583 (58h31m38.095762243s) [upload=60989]: Done uploading segments... Aug 11 03:57:57.364507026 (58h31m38.095774676s) [upload=60989]: Upload finished. err: metaclient: Too Many Requests
Duration: 125.682211ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....................X.......................X..............] duration:
403.509373ms
FAIL (2025-08-11 04:09:40 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 03:57:57.361395597 (58h31m38.092663258s) [upload=60989]: Starting upload Aug 11 03:57:57.361459798 (58h31m38.092727448s) [upload=60989]: Done starting upload Aug 11 03:57:57.361529187 (58h31m38.092796847s) [upload=60989]: Uploading segments... Aug 11 03:57:57.361566487 (58h31m38.092834147s) [upload=60989]: Got next segment. Inline: true Aug 11 03:57:57.361571977 (58h31m38.092839628s) [upload=60989]: Waiting for error group managing segments... Aug 11 03:57:57.361614677 (58h31m38.092882337s) [upload=60989]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 03:57:57.361620047 (58h31m38.092887696s) [upload=60989]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 03:57:57.361623593 (58h31m38.092891243s) [upload=60989]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 03:57:57.364494583 (58h31m38.095762243s) [upload=60989]: Done uploading segments... Aug 11 03:57:57.364507026 (58h31m38.095774676s) [upload=60989]: Upload finished. err: metaclient: Too Many Requests
Duration: 403.534479ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [X................................................X..X.......] duration:
428.977265ms
FAIL (2025-08-11 04:09:12 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 04:02:42.297674681 (58h36m23.028942311s) [upload=61069]: Starting upload Aug 11 04:02:42.297718934 (58h36m23.028986564s) [upload=61069]: Done starting upload Aug 11 04:02:42.297772433 (58h36m23.029040063s) [upload=61069]: Uploading segments... Aug 11 04:02:42.297954333 (58h36m23.029221963s) [upload=61069]: Got next segment. Inline: false Aug 11 04:02:42.298002814 (58h36m23.029270444s) [upload=61069]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 04:02:42.298009046 (58h36m23.029276676s) [upload=61069]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 04:02:42.300715126 (58h36m23.031982747s) [upload=61069]: Next segment err: metaclient: Too Many Requests Aug 11 04:02:42.300723593 (58h36m23.031991212s) [upload=61069]: Done uploading segments... Aug 11 04:02:42.300731137 (58h36m23.031998757s) [upload=61069]: Upload finished. err: metaclient: Too Many Requests
Duration: 428.996251ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......................X.......................X.............] duration:
155.159959ms
FAIL (2025-08-11 04:08:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 03:57:57.361395597 (58h31m38.092663258s) [upload=60989]: Starting upload Aug 11 03:57:57.361459798 (58h31m38.092727448s) [upload=60989]: Done starting upload Aug 11 03:57:57.361529187 (58h31m38.092796847s) [upload=60989]: Uploading segments... Aug 11 03:57:57.361566487 (58h31m38.092834147s) [upload=60989]: Got next segment. Inline: true Aug 11 03:57:57.361571977 (58h31m38.092839628s) [upload=60989]: Waiting for error group managing segments... Aug 11 03:57:57.361614677 (58h31m38.092882337s) [upload=60989]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 03:57:57.361620047 (58h31m38.092887696s) [upload=60989]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 03:57:57.361623593 (58h31m38.092891243s) [upload=60989]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 03:57:57.364494583 (58h31m38.095762243s) [upload=60989]: Done uploading segments... Aug 11 03:57:57.364507026 (58h31m38.095774676s) [upload=60989]: Upload finished. err: metaclient: Too Many Requests
Duration: 155.187761ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.X................................................X..X......] duration:
1.007544821s
FAIL (2025-08-11 04:08:06 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 04:02:42.297674681 (58h36m23.028942311s) [upload=61069]: Starting upload Aug 11 04:02:42.297718934 (58h36m23.028986564s) [upload=61069]: Done starting upload Aug 11 04:02:42.297772433 (58h36m23.029040063s) [upload=61069]: Uploading segments... Aug 11 04:02:42.297954333 (58h36m23.029221963s) [upload=61069]: Got next segment. Inline: false Aug 11 04:02:42.298002814 (58h36m23.029270444s) [upload=61069]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 04:02:42.298009046 (58h36m23.029276676s) [upload=61069]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 04:02:42.300715126 (58h36m23.031982747s) [upload=61069]: Next segment err: metaclient: Too Many Requests Aug 11 04:02:42.300723593 (58h36m23.031991212s) [upload=61069]: Done uploading segments... Aug 11 04:02:42.300731137 (58h36m23.031998757s) [upload=61069]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.007568946s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......................X.......................X............] duration:
199.291822ms
FAIL (2025-08-11 04:07:39 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 03:57:57.361395597 (58h31m38.092663258s) [upload=60989]: Starting upload Aug 11 03:57:57.361459798 (58h31m38.092727448s) [upload=60989]: Done starting upload Aug 11 03:57:57.361529187 (58h31m38.092796847s) [upload=60989]: Uploading segments... Aug 11 03:57:57.361566487 (58h31m38.092834147s) [upload=60989]: Got next segment. Inline: true Aug 11 03:57:57.361571977 (58h31m38.092839628s) [upload=60989]: Waiting for error group managing segments... Aug 11 03:57:57.361614677 (58h31m38.092882337s) [upload=60989]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 03:57:57.361620047 (58h31m38.092887696s) [upload=60989]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 03:57:57.361623593 (58h31m38.092891243s) [upload=60989]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 03:57:57.364494583 (58h31m38.095762243s) [upload=60989]: Done uploading segments... Aug 11 03:57:57.364507026 (58h31m38.095774676s) [upload=60989]: Upload finished. err: metaclient: Too Many Requests
Duration: 199.317572ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..X................................................X..X.....] duration:
478.355376ms
FAIL (2025-08-11 04:07:17 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 04:02:42.297674681 (58h36m23.028942311s) [upload=61069]: Starting upload Aug 11 04:02:42.297718934 (58h36m23.028986564s) [upload=61069]: Done starting upload Aug 11 04:02:42.297772433 (58h36m23.029040063s) [upload=61069]: Uploading segments... Aug 11 04:02:42.297954333 (58h36m23.029221963s) [upload=61069]: Got next segment. Inline: false Aug 11 04:02:42.298002814 (58h36m23.029270444s) [upload=61069]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 04:02:42.298009046 (58h36m23.029276676s) [upload=61069]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 04:02:42.300715126 (58h36m23.031982747s) [upload=61069]: Next segment err: metaclient: Too Many Requests Aug 11 04:02:42.300723593 (58h36m23.031991212s) [upload=61069]: Done uploading segments... Aug 11 04:02:42.300731137 (58h36m23.031998757s) [upload=61069]: Upload finished. err: metaclient: Too Many Requests
Duration: 478.3843ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...X................................................X..X....] duration:
486.26021ms
FAIL (2025-08-11 04:06:50 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 04:02:42.297674681 (58h36m23.028942311s) [upload=61069]: Starting upload Aug 11 04:02:42.297718934 (58h36m23.028986564s) [upload=61069]: Done starting upload Aug 11 04:02:42.297772433 (58h36m23.029040063s) [upload=61069]: Uploading segments... Aug 11 04:02:42.297954333 (58h36m23.029221963s) [upload=61069]: Got next segment. Inline: false Aug 11 04:02:42.298002814 (58h36m23.029270444s) [upload=61069]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 04:02:42.298009046 (58h36m23.029276676s) [upload=61069]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 04:02:42.300715126 (58h36m23.031982747s) [upload=61069]: Next segment err: metaclient: Too Many Requests Aug 11 04:02:42.300723593 (58h36m23.031991212s) [upload=61069]: Done uploading segments... Aug 11 04:02:42.300731137 (58h36m23.031998757s) [upload=61069]: Upload finished. err: metaclient: Too Many Requests
Duration: 486.280468ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........................X.......................X...........] duration:
471.863847ms
FAIL (2025-08-11 04:06:26 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 03:57:57.361395597 (58h31m38.092663258s) [upload=60989]: Starting upload Aug 11 03:57:57.361459798 (58h31m38.092727448s) [upload=60989]: Done starting upload Aug 11 03:57:57.361529187 (58h31m38.092796847s) [upload=60989]: Uploading segments... Aug 11 03:57:57.361566487 (58h31m38.092834147s) [upload=60989]: Got next segment. Inline: true Aug 11 03:57:57.361571977 (58h31m38.092839628s) [upload=60989]: Waiting for error group managing segments... Aug 11 03:57:57.361614677 (58h31m38.092882337s) [upload=60989]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 03:57:57.361620047 (58h31m38.092887696s) [upload=60989]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 03:57:57.361623593 (58h31m38.092891243s) [upload=60989]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 03:57:57.364494583 (58h31m38.095762243s) [upload=60989]: Done uploading segments... Aug 11 03:57:57.364507026 (58h31m38.095774676s) [upload=60989]: Upload finished. err: metaclient: Too Many Requests
Duration: 471.88775ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [....X................................................X..X...] duration:
370.350633ms
FAIL (2025-08-11 04:06:11 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 04:02:42.297674681 (58h36m23.028942311s) [upload=61069]: Starting upload Aug 11 04:02:42.297718934 (58h36m23.028986564s) [upload=61069]: Done starting upload Aug 11 04:02:42.297772433 (58h36m23.029040063s) [upload=61069]: Uploading segments... Aug 11 04:02:42.297954333 (58h36m23.029221963s) [upload=61069]: Got next segment. Inline: false Aug 11 04:02:42.298002814 (58h36m23.029270444s) [upload=61069]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 04:02:42.298009046 (58h36m23.029276676s) [upload=61069]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 04:02:42.300715126 (58h36m23.031982747s) [upload=61069]: Next segment err: metaclient: Too Many Requests Aug 11 04:02:42.300723593 (58h36m23.031991212s) [upload=61069]: Done uploading segments... Aug 11 04:02:42.300731137 (58h36m23.031998757s) [upload=61069]: Upload finished. err: metaclient: Too Many Requests
Duration: 370.371092ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........................X.......................X..........] duration:
303.470552ms
FAIL (2025-08-11 04:05:33 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 03:57:57.361395597 (58h31m38.092663258s) [upload=60989]: Starting upload Aug 11 03:57:57.361459798 (58h31m38.092727448s) [upload=60989]: Done starting upload Aug 11 03:57:57.361529187 (58h31m38.092796847s) [upload=60989]: Uploading segments... Aug 11 03:57:57.361566487 (58h31m38.092834147s) [upload=60989]: Got next segment. Inline: true Aug 11 03:57:57.361571977 (58h31m38.092839628s) [upload=60989]: Waiting for error group managing segments... Aug 11 03:57:57.361614677 (58h31m38.092882337s) [upload=60989]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 03:57:57.361620047 (58h31m38.092887696s) [upload=60989]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 03:57:57.361623593 (58h31m38.092891243s) [upload=60989]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 03:57:57.364494583 (58h31m38.095762243s) [upload=60989]: Done uploading segments... Aug 11 03:57:57.364507026 (58h31m38.095774676s) [upload=60989]: Upload finished. err: metaclient: Too Many Requests
Duration: 303.492043ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........................X.......................X.........] duration:
154.82679ms
FAIL (2025-08-11 04:05:04 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 03:57:57.361395597 (58h31m38.092663258s) [upload=60989]: Starting upload Aug 11 03:57:57.361459798 (58h31m38.092727448s) [upload=60989]: Done starting upload Aug 11 03:57:57.361529187 (58h31m38.092796847s) [upload=60989]: Uploading segments... Aug 11 03:57:57.361566487 (58h31m38.092834147s) [upload=60989]: Got next segment. Inline: true Aug 11 03:57:57.361571977 (58h31m38.092839628s) [upload=60989]: Waiting for error group managing segments... Aug 11 03:57:57.361614677 (58h31m38.092882337s) [upload=60989]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 03:57:57.361620047 (58h31m38.092887696s) [upload=60989]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 03:57:57.361623593 (58h31m38.092891243s) [upload=60989]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 03:57:57.364494583 (58h31m38.095762243s) [upload=60989]: Done uploading segments... Aug 11 03:57:57.364507026 (58h31m38.095774676s) [upload=60989]: Upload finished. err: metaclient: Too Many Requests
Duration: 154.84845ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....X................................................X..X..] duration:
418.714919ms
FAIL (2025-08-11 04:04:57 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 04:02:42.297674681 (58h36m23.028942311s) [upload=61069]: Starting upload Aug 11 04:02:42.297718934 (58h36m23.028986564s) [upload=61069]: Done starting upload Aug 11 04:02:42.297772433 (58h36m23.029040063s) [upload=61069]: Uploading segments... Aug 11 04:02:42.297954333 (58h36m23.029221963s) [upload=61069]: Got next segment. Inline: false Aug 11 04:02:42.298002814 (58h36m23.029270444s) [upload=61069]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 04:02:42.298009046 (58h36m23.029276676s) [upload=61069]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 04:02:42.300715126 (58h36m23.031982747s) [upload=61069]: Next segment err: metaclient: Too Many Requests Aug 11 04:02:42.300723593 (58h36m23.031991212s) [upload=61069]: Done uploading segments... Aug 11 04:02:42.300731137 (58h36m23.031998757s) [upload=61069]: Upload finished. err: metaclient: Too Many Requests
Duration: 418.740166ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........................X.......................X........] duration:
162.644109ms
FAIL (2025-08-11 04:04:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 03:57:57.361395597 (58h31m38.092663258s) [upload=60989]: Starting upload Aug 11 03:57:57.361459798 (58h31m38.092727448s) [upload=60989]: Done starting upload Aug 11 03:57:57.361529187 (58h31m38.092796847s) [upload=60989]: Uploading segments... Aug 11 03:57:57.361566487 (58h31m38.092834147s) [upload=60989]: Got next segment. Inline: true Aug 11 03:57:57.361571977 (58h31m38.092839628s) [upload=60989]: Waiting for error group managing segments... Aug 11 03:57:57.361614677 (58h31m38.092882337s) [upload=60989]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 03:57:57.361620047 (58h31m38.092887696s) [upload=60989]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 03:57:57.361623593 (58h31m38.092891243s) [upload=60989]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 03:57:57.364494583 (58h31m38.095762243s) [upload=60989]: Done uploading segments... Aug 11 03:57:57.364507026 (58h31m38.095774676s) [upload=60989]: Upload finished. err: metaclient: Too Many Requests
Duration: 162.668665ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......X................................................X..X.] duration:
411.904641ms
FAIL (2025-08-11 04:03:50 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 04:02:42.297674681 (58h36m23.028942311s) [upload=61069]: Starting upload Aug 11 04:02:42.297718934 (58h36m23.028986564s) [upload=61069]: Done starting upload Aug 11 04:02:42.297772433 (58h36m23.029040063s) [upload=61069]: Uploading segments... Aug 11 04:02:42.297954333 (58h36m23.029221963s) [upload=61069]: Got next segment. Inline: false Aug 11 04:02:42.298002814 (58h36m23.029270444s) [upload=61069]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 04:02:42.298009046 (58h36m23.029276676s) [upload=61069]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 04:02:42.300715126 (58h36m23.031982747s) [upload=61069]: Next segment err: metaclient: Too Many Requests Aug 11 04:02:42.300723593 (58h36m23.031991212s) [upload=61069]: Done uploading segments... Aug 11 04:02:42.300731137 (58h36m23.031998757s) [upload=61069]: Upload finished. err: metaclient: Too Many Requests
Duration: 411.929908ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [............................X.......................X.......] duration:
373.641663ms
FAIL (2025-08-11 04:03:08 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 03:57:57.361395597 (58h31m38.092663258s) [upload=60989]: Starting upload Aug 11 03:57:57.361459798 (58h31m38.092727448s) [upload=60989]: Done starting upload Aug 11 03:57:57.361529187 (58h31m38.092796847s) [upload=60989]: Uploading segments... Aug 11 03:57:57.361566487 (58h31m38.092834147s) [upload=60989]: Got next segment. Inline: true Aug 11 03:57:57.361571977 (58h31m38.092839628s) [upload=60989]: Waiting for error group managing segments... Aug 11 03:57:57.361614677 (58h31m38.092882337s) [upload=60989]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 03:57:57.361620047 (58h31m38.092887696s) [upload=60989]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 03:57:57.361623593 (58h31m38.092891243s) [upload=60989]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 03:57:57.364494583 (58h31m38.095762243s) [upload=60989]: Done uploading segments... Aug 11 03:57:57.364507026 (58h31m38.095774676s) [upload=60989]: Upload finished. err: metaclient: Too Many Requests
Duration: 373.668292ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......X................................................X..X] duration:
16.998964ms
FAIL (2025-08-11 04:02:42 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 04:02:42.297674681 (58h36m23.028942311s) [upload=61069]: Starting upload Aug 11 04:02:42.297718934 (58h36m23.028986564s) [upload=61069]: Done starting upload Aug 11 04:02:42.297772433 (58h36m23.029040063s) [upload=61069]: Uploading segments... Aug 11 04:02:42.297954333 (58h36m23.029221963s) [upload=61069]: Got next segment. Inline: false Aug 11 04:02:42.298002814 (58h36m23.029270444s) [upload=61069]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 04:02:42.298009046 (58h36m23.029276676s) [upload=61069]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 04:02:42.300715126 (58h36m23.031982747s) [upload=61069]: Next segment err: metaclient: Too Many Requests Aug 11 04:02:42.300723593 (58h36m23.031991212s) [upload=61069]: Done uploading segments... Aug 11 04:02:42.300731137 (58h36m23.031998757s) [upload=61069]: Upload finished. err: metaclient: Too Many Requests
Duration: 17.012739ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............................X.......................X......] duration:
189.785957ms
FAIL (2025-08-11 04:02:39 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 03:57:57.361395597 (58h31m38.092663258s) [upload=60989]: Starting upload Aug 11 03:57:57.361459798 (58h31m38.092727448s) [upload=60989]: Done starting upload Aug 11 03:57:57.361529187 (58h31m38.092796847s) [upload=60989]: Uploading segments... Aug 11 03:57:57.361566487 (58h31m38.092834147s) [upload=60989]: Got next segment. Inline: true Aug 11 03:57:57.361571977 (58h31m38.092839628s) [upload=60989]: Waiting for error group managing segments... Aug 11 03:57:57.361614677 (58h31m38.092882337s) [upload=60989]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 03:57:57.361620047 (58h31m38.092887696s) [upload=60989]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 03:57:57.361623593 (58h31m38.092891243s) [upload=60989]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 03:57:57.364494583 (58h31m38.095762243s) [upload=60989]: Done uploading segments... Aug 11 03:57:57.364507026 (58h31m38.095774676s) [upload=60989]: Upload finished. err: metaclient: Too Many Requests
Duration: 189.809152ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........X................................................X..] duration:
792.81949ms
FAIL (2025-08-11 04:01:59 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 04:00:13.912808457 (58h33m54.644076107s) [upload=61027]: Starting upload
Aug 11 04:00:13.912882536 (58h33m54.644150186s) [upload=61027]: Done starting upload
Aug 11 04:00:13.912991098 (58h33m54.644258759s) [upload=61027]: Uploading segments...
Aug 11 04:00:13.913226398 (58h33m54.644494038s) [upload=61027]: Got next segment. Inline: false
Aug 11 04:00:13.913270971 (58h33m54.64453861s) [upload=61027]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 04:00:13.913276371 (58h33m54.644544021s) [upload=61027]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 04:00:14.108835543 (58h33m54.840103192s) [seg_pos={0 0}, upload=61027]: Begin upload segment...
Aug 11 04:00:14.108904421 (58h33m54.840172081s) [seg_pos={0 0}, upload=61027]: Done begin upload segment.
Aug 11 04:00:14.108934428 (58h33m54.840202078s) [noise=true , address=104.36.82.58:4285 , piece_id=V4PTCQB75DGVLQTHJ3LOR4GFAC4UTBA5TIABWZI5QTHET4AGBKSQ, seg_pos={0 0}, upload=61027]: Uploading piece...
Aug 11 04:00:14.108953122 (58h33m54.840220772s) [noise=true , address=104.36.82.44:4886 , piece_id=CHO4S7E2JV27JPJD5NP3LZPGBAIZF56YAW74B4R3UBZD43QW7PEA, seg_pos={0 0}, upload=61027]: Uploading piece...
Aug 11 04:00:14.109363989 (58h33m54.84063164s) [noise=true , address=104.36.82.59:4316 , piece_id=MAFGTGTR7V3SSKQBT4J6AO4FP2O6ARBTPQEER2CMX4XSZPJ5POBQ, seg_pos={0 0}, upload=61027]: Uploading piece...
Aug 11 04:00:14.109443608 (58h33m54.840711257s) [noise=true , address=104.36.82.21:4503 , piece_id=NXR5RYJGFI3T6CUZN45UFPTK3S7XVJWOQRU7SUU6SYLHXSLPWUGA, seg_pos={0 0}, upload=61027]: Uploading piece...
Aug 11 04:00:14.109768784 (58h33m54.841036424s) [noise=true , address=104.36.82.46:4509 , piece_id=BMTMSSGIC2BEBHQ4ACYISIQPCVINUN6V2SNYX5ZQGQZKXDIKUGSQ, seg_pos={0 0}, upload=61027]: Uploading piece...
Aug 11 04:00:14.110061532 (58h33m54.841329182s) [noise=true , address=104.36.82.61:4385 , piece_id=46BVCEI3IA2XNKMN663STFKTXTATZR77LPSB2C5WY5OSRR4CXDVQ, seg_pos={0 0}, upload=61027]: Uploading piece...
Aug 11 04:00:14.110111845 (58h33m54.841379495s) [noise=true , address=104.36.82.36:4640 , piece_id=FZJD5MAWIY3VLU5X2V6EXYWKL3QF5ARQWYWK3KAILVUFBNJLPDDQ, seg_pos={0 0}, upload=61027]: Uploading piece...
Aug 11 04:00:14.110572515 (58h33m54.841840195s) [noise=true , address=104.36.82.6:4890 , piece_id=C6BYZCDF4B4QOQHBKVBCJT2YOCOWAKUL4JGRYUDKW2XPDDQDKNPA, seg_pos={0 0}, upload=61027]: Uploading piece...
Aug 11 04:00:14.110977311 (58h33m54.842244961s) [noise=true , address=104.36.82.60:4369 , piece_id=MLD6GZF3DTS5HDXT3LZF32ECIRB3IJC72C4OAEUYYANOE4GZ7VTQ, seg_pos={0 0}, upload=61027]: Uploading piece...
Aug 11 04:00:14.111339006 (58h33m54.842606657s) [noise=true , address=104.36.82.5:4850 , piece_id=VE6EJ7ZPLSN7GUXNOTCLFZNAUHEMWSNXA6DOZPCOMIJNZHXPS36Q, seg_pos={0 0}, upload=61027]: Uploading piece...
Aug 11 04:00:14.111718404 (58h33m54.842986054s) [noise=true , address=104.36.82.22:4531 , piece_id=562QXW3DKVK6J7AIG4HROHFVNIEM4PHGIZ6N7MVHZHOGIBK323GQ, seg_pos={0 0}, upload=61027]: Uploading piece...
Aug 11 04:00:14.111726219 (58h33m54.842993869s) [noise=true , address=104.36.82.16:4302 , piece_id=M7OAB3JCVRJ4BZ67TUJPDAHRI3TT7BFJCTTTWMV2E336UXCB3BFQ, seg_pos={0 0}, upload=61027]: Uploading piece...
Aug 11 04:00:14.112151093 (58h33m54.843418743s) [noise=true , address=104.36.82.59:4329 , piece_id=RFURLTE32SIHYENTMF4HUHWFVF4YUVMZGMV6EKGU7HM2N2YIW6XA, seg_pos={0 0}, upload=61027]: Uploading piece...
Aug 11 04:00:14.112187750 (58h33m54.843455391s) [noise=true , address=104.36.82.37:4658 , piece_id=ZVWO4OPVW3EDU6FHK6Z2W4LR5HRCXX3Y34RTZ5DEXJJP2VWYCD2A, seg_pos={0 0}, upload=61027]: Uploading piece...
Aug 11 04:00:14.112536682 (58h33m54.843804332s) [noise=true , address=104.36.82.35:4616 , piece_id=F5MMGO5OGUBU5KXL7ZTGAMKWBC5SMGCH27GMCK3QQ5FJ2ZPHWPIA, seg_pos={0 0}, upload=61027]: Uploading piece...
Aug 11 04:00:14.112554175 (58h33m54.843821824s) [noise=true , address=104.36.82.43:4864 , piece_id=3Y4YVHJ2UR5QGZFFNO5FR7AI62L6GBNUV3KKCASIFTU4JUJVN3HQ, seg_pos={0 0}, upload=61027]: Uploading piece...
Aug 11 04:00:14.112940756 (58h33m54.844208407s) [noise=true , address=104.36.82.9:4024 , piece_id=XRO7M4WDZYYRM34KAKIOVBYJJ6QCNFTQTFM2PJHDHHPF6GIBHZXQ, seg_pos={0 0}, upload=61027]: Uploading piece...
Aug 11 04:00:14.113290650 (58h33m54.8445583s) [noise=true , address=104.36.82.34:4550 , piece_id=X5HSHOYEUYVFH4SL5OE26K3HGIFPE3YGTNN3QRL5TDH77SGBZVZQ, seg_pos={0 0}, upload=61027]: Uploading piece...
Aug 11 04:00:14.250535536 (58h33m54.981803196s) [upload=61027]: Next returned nil segment
Aug 11 04:00:14.250579538 (58h33m54.981847188s) [upload=61027]: Waiting for error group managing segments...
Aug 11 04:00:14.262443515 (58h33m54.993711175s) [noise=true , address=104.36.82.58:4285 , piece_id=V4PTCQB75DGVLQTHJ3LOR4GFAC4UTBA5TIABWZI5QTHET4AGBKSQ, seg_pos={0 0}, upload=61027]: Done uploading piece. err: <nil>
Aug 11 04:00:14.265348729 (58h33m54.996616389s) [noise=true , address=104.36.82.61:4385 , piece_id=46BVCEI3IA2XNKMN663STFKTXTATZR77LPSB2C5WY5OSRR4CXDVQ, seg_pos={0 0}, upload=61027]: Done uploading piece. err: <nil>
Aug 11 04:00:14.265953557 (58h33m54.997221207s) [noise=true , address=104.36.82.21:4503 , piece_id=NXR5RYJGFI3T6CUZN45UFPTK3S7XVJWOQRU7SUU6SYLHXSLPWUGA, seg_pos={0 0}, upload=61027]: Done uploading piece. err: <nil>
Aug 11 04:00:14.266441559 (58h33m54.997709209s) [noise=true , address=104.36.82.22:4531 , piece_id=562QXW3DKVK6J7AIG4HROHFVNIEM4PHGIZ6N7MVHZHOGIBK323GQ, seg_pos={0 0}, upload=61027]: Done uploading piece. err: <nil>
Aug 11 04:00:14.267779556 (58h33m54.999047216s) [noise=true , address=104.36.82.37:4658 , piece_id=ZVWO4OPVW3EDU6FHK6Z2W4LR5HRCXX3Y34RTZ5DEXJJP2VWYCD2A, seg_pos={0 0}, upload=61027]: Done uploading piece. err: <nil>
Aug 11 04:00:14.271239936 (58h33m55.002507586s) [noise=true , address=104.36.82.60:4369 , piece_id=MLD6GZF3DTS5HDXT3LZF32ECIRB3IJC72C4OAEUYYANOE4GZ7VTQ, seg_pos={0 0}, upload=61027]: Done uploading piece. err: <nil>
Aug 11 04:00:14.273828808 (58h33m55.005096459s) [noise=true , address=104.36.82.43:4864 , piece_id=3Y4YVHJ2UR5QGZFFNO5FR7AI62L6GBNUV3KKCASIFTU4JUJVN3HQ, seg_pos={0 0}, upload=61027]: Done uploading piece. err: <nil>
Aug 11 04:00:14.274427356 (58h33m55.005695017s) [noise=true , address=104.36.82.6:4890 , piece_id=C6BYZCDF4B4QOQHBKVBCJT2YOCOWAKUL4JGRYUDKW2XPDDQDKNPA, seg_pos={0 0}, upload=61027]: Done uploading piece. err: <nil>
Aug 11 04:00:14.274813207 (58h33m55.006080857s) [noise=true , address=104.36.82.44:4886 , piece_id=CHO4S7E2JV27JPJD5NP3LZPGBAIZF56YAW74B4R3UBZD43QW7PEA, seg_pos={0 0}, upload=61027]: Done uploading piece. err: <nil>
Aug 11 04:00:14.276128542 (58h33m55.007396202s) [noise=true , address=104.36.82.36:4640 , piece_id=FZJD5MAWIY3VLU5X2V6EXYWKL3QF5ARQWYWK3KAILVUFBNJLPDDQ, seg_pos={0 0}, upload=61027]: Done uploading piece. err: <nil>
Aug 11 04:00:14.280189081 (58h33m55.011456732s) [noise=true , address=104.36.82.35:4616 , piece_id=F5MMGO5OGUBU5KXL7ZTGAMKWBC5SMGCH27GMCK3QQ5FJ2ZPHWPIA, seg_pos={0 0}, upload=61027]: Done uploading piece. err: <nil>
Aug 11 04:00:14.282511006 (58h33m55.013778656s) [noise=true , address=104.36.82.16:4302 , piece_id=M7OAB3JCVRJ4BZ67TUJPDAHRI3TT7BFJCTTTWMV2E336UXCB3BFQ, seg_pos={0 0}, upload=61027]: Done uploading piece. err: <nil>
Aug 11 04:00:14.288521537 (58h33m55.019789187s) [noise=true , address=104.36.82.34:4550 , piece_id=X5HSHOYEUYVFH4SL5OE26K3HGIFPE3YGTNN3QRL5TDH77SGBZVZQ, seg_pos={0 0}, upload=61027]: Done uploading piece. err: <nil>
Aug 11 04:00:14.289063839 (58h33m55.020331489s) [noise=true , address=104.36.82.5:4850 , piece_id=VE6EJ7ZPLSN7GUXNOTCLFZNAUHEMWSNXA6DOZPCOMIJNZHXPS36Q, seg_pos={0 0}, upload=61027]: Done uploading piece. err: <nil>
Aug 11 04:00:14.289092132 (58h33m55.020359793s) [seg_pos={0 0}, upload=61027]: Segment reached optimal threshold of 14 pieces.
Aug 11 04:00:14.289224460 (58h33m55.020492109s) [noise=true , address=104.36.82.9:4024 , piece_id=XRO7M4WDZYYRM34KAKIOVBYJJ6QCNFTQTFM2PJHDHHPF6GIBHZXQ, seg_pos={0 0}, upload=61027]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bHv9jsVASv3dP3iowvir74PDEHkaaqA3sstiLk7qLSpK2Duzz): protocol: expected piece hash; context canceled; EOF
Aug 11 04:00:14.289311542 (58h33m55.020579192s) [noise=true , address=104.36.82.59:4316 , piece_id=MAFGTGTR7V3SSKQBT4J6AO4FP2O6ARBTPQEER2CMX4XSZPJ5POBQ, seg_pos={0 0}, upload=61027]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn): protocol: expected piece hash; context canceled; EOF
Aug 11 04:00:14.289388024 (58h33m55.020655674s) [noise=true , address=104.36.82.59:4329 , piece_id=RFURLTE32SIHYENTMF4HUHWFVF4YUVMZGMV6EKGU7HM2N2YIW6XA, seg_pos={0 0}, upload=61027]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dGY6BG4FULjuRwnEKd9wV4cZPVJsgo32oFHKZn5BgjxVaojbk): protocol: expected piece hash; context canceled; EOF
Aug 11 04:00:14.289473554 (58h33m55.020741213s) [noise=true , address=104.36.82.46:4509 , piece_id=BMTMSSGIC2BEBHQ4ACYISIQPCVINUN6V2SNYX5ZQGQZKXDIKUGSQ, seg_pos={0 0}, upload=61027]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y2NmauNvCyrMJ5z66Lihb3h3C9nwdJYqfSfNmC5dwDGYQqUKh): protocol: expected piece hash; context canceled; EOF
Aug 11 04:00:14.289519710 (58h33m55.02078736s) [seg_pos={0 0}, upload=61027]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 04:00:14.289765639 (58h33m55.0210333s) [upload=61027]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 04:00:14.289776500 (58h33m55.02104415s) [upload=61027]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 04:00:14.643591049 (58h33m55.374858698s) [upload=61027]: Done uploading segments...
Aug 11 04:00:14.643610425 (58h33m55.374878075s) [upload=61027]: Upload finished. err: <nil>
Duration: 792.834148ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............................X.......................X.....] duration:
174.211282ms
FAIL (2025-08-11 04:01:34 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 03:57:57.361395597 (58h31m38.092663258s) [upload=60989]: Starting upload Aug 11 03:57:57.361459798 (58h31m38.092727448s) [upload=60989]: Done starting upload Aug 11 03:57:57.361529187 (58h31m38.092796847s) [upload=60989]: Uploading segments... Aug 11 03:57:57.361566487 (58h31m38.092834147s) [upload=60989]: Got next segment. Inline: true Aug 11 03:57:57.361571977 (58h31m38.092839628s) [upload=60989]: Waiting for error group managing segments... Aug 11 03:57:57.361614677 (58h31m38.092882337s) [upload=60989]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 03:57:57.361620047 (58h31m38.092887696s) [upload=60989]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 03:57:57.361623593 (58h31m38.092891243s) [upload=60989]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 03:57:57.364494583 (58h31m38.095762243s) [upload=60989]: Done uploading segments... Aug 11 03:57:57.364507026 (58h31m38.095774676s) [upload=60989]: Upload finished. err: metaclient: Too Many Requests
Duration: 174.24823ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........X................................................X.] duration:
410.889865ms
FAIL (2025-08-11 04:00:59 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 04:00:13.912808457 (58h33m54.644076107s) [upload=61027]: Starting upload
Aug 11 04:00:13.912882536 (58h33m54.644150186s) [upload=61027]: Done starting upload
Aug 11 04:00:13.912991098 (58h33m54.644258759s) [upload=61027]: Uploading segments...
Aug 11 04:00:13.913226398 (58h33m54.644494038s) [upload=61027]: Got next segment. Inline: false
Aug 11 04:00:13.913270971 (58h33m54.64453861s) [upload=61027]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 04:00:13.913276371 (58h33m54.644544021s) [upload=61027]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 04:00:14.108835543 (58h33m54.840103192s) [seg_pos={0 0}, upload=61027]: Begin upload segment...
Aug 11 04:00:14.108904421 (58h33m54.840172081s) [seg_pos={0 0}, upload=61027]: Done begin upload segment.
Aug 11 04:00:14.108934428 (58h33m54.840202078s) [noise=true , address=104.36.82.58:4285 , piece_id=V4PTCQB75DGVLQTHJ3LOR4GFAC4UTBA5TIABWZI5QTHET4AGBKSQ, seg_pos={0 0}, upload=61027]: Uploading piece...
Aug 11 04:00:14.108953122 (58h33m54.840220772s) [noise=true , address=104.36.82.44:4886 , piece_id=CHO4S7E2JV27JPJD5NP3LZPGBAIZF56YAW74B4R3UBZD43QW7PEA, seg_pos={0 0}, upload=61027]: Uploading piece...
Aug 11 04:00:14.109363989 (58h33m54.84063164s) [noise=true , address=104.36.82.59:4316 , piece_id=MAFGTGTR7V3SSKQBT4J6AO4FP2O6ARBTPQEER2CMX4XSZPJ5POBQ, seg_pos={0 0}, upload=61027]: Uploading piece...
Aug 11 04:00:14.109443608 (58h33m54.840711257s) [noise=true , address=104.36.82.21:4503 , piece_id=NXR5RYJGFI3T6CUZN45UFPTK3S7XVJWOQRU7SUU6SYLHXSLPWUGA, seg_pos={0 0}, upload=61027]: Uploading piece...
Aug 11 04:00:14.109768784 (58h33m54.841036424s) [noise=true , address=104.36.82.46:4509 , piece_id=BMTMSSGIC2BEBHQ4ACYISIQPCVINUN6V2SNYX5ZQGQZKXDIKUGSQ, seg_pos={0 0}, upload=61027]: Uploading piece...
Aug 11 04:00:14.110061532 (58h33m54.841329182s) [noise=true , address=104.36.82.61:4385 , piece_id=46BVCEI3IA2XNKMN663STFKTXTATZR77LPSB2C5WY5OSRR4CXDVQ, seg_pos={0 0}, upload=61027]: Uploading piece...
Aug 11 04:00:14.110111845 (58h33m54.841379495s) [noise=true , address=104.36.82.36:4640 , piece_id=FZJD5MAWIY3VLU5X2V6EXYWKL3QF5ARQWYWK3KAILVUFBNJLPDDQ, seg_pos={0 0}, upload=61027]: Uploading piece...
Aug 11 04:00:14.110572515 (58h33m54.841840195s) [noise=true , address=104.36.82.6:4890 , piece_id=C6BYZCDF4B4QOQHBKVBCJT2YOCOWAKUL4JGRYUDKW2XPDDQDKNPA, seg_pos={0 0}, upload=61027]: Uploading piece...
Aug 11 04:00:14.110977311 (58h33m54.842244961s) [noise=true , address=104.36.82.60:4369 , piece_id=MLD6GZF3DTS5HDXT3LZF32ECIRB3IJC72C4OAEUYYANOE4GZ7VTQ, seg_pos={0 0}, upload=61027]: Uploading piece...
Aug 11 04:00:14.111339006 (58h33m54.842606657s) [noise=true , address=104.36.82.5:4850 , piece_id=VE6EJ7ZPLSN7GUXNOTCLFZNAUHEMWSNXA6DOZPCOMIJNZHXPS36Q, seg_pos={0 0}, upload=61027]: Uploading piece...
Aug 11 04:00:14.111718404 (58h33m54.842986054s) [noise=true , address=104.36.82.22:4531 , piece_id=562QXW3DKVK6J7AIG4HROHFVNIEM4PHGIZ6N7MVHZHOGIBK323GQ, seg_pos={0 0}, upload=61027]: Uploading piece...
Aug 11 04:00:14.111726219 (58h33m54.842993869s) [noise=true , address=104.36.82.16:4302 , piece_id=M7OAB3JCVRJ4BZ67TUJPDAHRI3TT7BFJCTTTWMV2E336UXCB3BFQ, seg_pos={0 0}, upload=61027]: Uploading piece...
Aug 11 04:00:14.112151093 (58h33m54.843418743s) [noise=true , address=104.36.82.59:4329 , piece_id=RFURLTE32SIHYENTMF4HUHWFVF4YUVMZGMV6EKGU7HM2N2YIW6XA, seg_pos={0 0}, upload=61027]: Uploading piece...
Aug 11 04:00:14.112187750 (58h33m54.843455391s) [noise=true , address=104.36.82.37:4658 , piece_id=ZVWO4OPVW3EDU6FHK6Z2W4LR5HRCXX3Y34RTZ5DEXJJP2VWYCD2A, seg_pos={0 0}, upload=61027]: Uploading piece...
Aug 11 04:00:14.112536682 (58h33m54.843804332s) [noise=true , address=104.36.82.35:4616 , piece_id=F5MMGO5OGUBU5KXL7ZTGAMKWBC5SMGCH27GMCK3QQ5FJ2ZPHWPIA, seg_pos={0 0}, upload=61027]: Uploading piece...
Aug 11 04:00:14.112554175 (58h33m54.843821824s) [noise=true , address=104.36.82.43:4864 , piece_id=3Y4YVHJ2UR5QGZFFNO5FR7AI62L6GBNUV3KKCASIFTU4JUJVN3HQ, seg_pos={0 0}, upload=61027]: Uploading piece...
Aug 11 04:00:14.112940756 (58h33m54.844208407s) [noise=true , address=104.36.82.9:4024 , piece_id=XRO7M4WDZYYRM34KAKIOVBYJJ6QCNFTQTFM2PJHDHHPF6GIBHZXQ, seg_pos={0 0}, upload=61027]: Uploading piece...
Aug 11 04:00:14.113290650 (58h33m54.8445583s) [noise=true , address=104.36.82.34:4550 , piece_id=X5HSHOYEUYVFH4SL5OE26K3HGIFPE3YGTNN3QRL5TDH77SGBZVZQ, seg_pos={0 0}, upload=61027]: Uploading piece...
Aug 11 04:00:14.250535536 (58h33m54.981803196s) [upload=61027]: Next returned nil segment
Aug 11 04:00:14.250579538 (58h33m54.981847188s) [upload=61027]: Waiting for error group managing segments...
Aug 11 04:00:14.262443515 (58h33m54.993711175s) [noise=true , address=104.36.82.58:4285 , piece_id=V4PTCQB75DGVLQTHJ3LOR4GFAC4UTBA5TIABWZI5QTHET4AGBKSQ, seg_pos={0 0}, upload=61027]: Done uploading piece. err: <nil>
Aug 11 04:00:14.265348729 (58h33m54.996616389s) [noise=true , address=104.36.82.61:4385 , piece_id=46BVCEI3IA2XNKMN663STFKTXTATZR77LPSB2C5WY5OSRR4CXDVQ, seg_pos={0 0}, upload=61027]: Done uploading piece. err: <nil>
Aug 11 04:00:14.265953557 (58h33m54.997221207s) [noise=true , address=104.36.82.21:4503 , piece_id=NXR5RYJGFI3T6CUZN45UFPTK3S7XVJWOQRU7SUU6SYLHXSLPWUGA, seg_pos={0 0}, upload=61027]: Done uploading piece. err: <nil>
Aug 11 04:00:14.266441559 (58h33m54.997709209s) [noise=true , address=104.36.82.22:4531 , piece_id=562QXW3DKVK6J7AIG4HROHFVNIEM4PHGIZ6N7MVHZHOGIBK323GQ, seg_pos={0 0}, upload=61027]: Done uploading piece. err: <nil>
Aug 11 04:00:14.267779556 (58h33m54.999047216s) [noise=true , address=104.36.82.37:4658 , piece_id=ZVWO4OPVW3EDU6FHK6Z2W4LR5HRCXX3Y34RTZ5DEXJJP2VWYCD2A, seg_pos={0 0}, upload=61027]: Done uploading piece. err: <nil>
Aug 11 04:00:14.271239936 (58h33m55.002507586s) [noise=true , address=104.36.82.60:4369 , piece_id=MLD6GZF3DTS5HDXT3LZF32ECIRB3IJC72C4OAEUYYANOE4GZ7VTQ, seg_pos={0 0}, upload=61027]: Done uploading piece. err: <nil>
Aug 11 04:00:14.273828808 (58h33m55.005096459s) [noise=true , address=104.36.82.43:4864 , piece_id=3Y4YVHJ2UR5QGZFFNO5FR7AI62L6GBNUV3KKCASIFTU4JUJVN3HQ, seg_pos={0 0}, upload=61027]: Done uploading piece. err: <nil>
Aug 11 04:00:14.274427356 (58h33m55.005695017s) [noise=true , address=104.36.82.6:4890 , piece_id=C6BYZCDF4B4QOQHBKVBCJT2YOCOWAKUL4JGRYUDKW2XPDDQDKNPA, seg_pos={0 0}, upload=61027]: Done uploading piece. err: <nil>
Aug 11 04:00:14.274813207 (58h33m55.006080857s) [noise=true , address=104.36.82.44:4886 , piece_id=CHO4S7E2JV27JPJD5NP3LZPGBAIZF56YAW74B4R3UBZD43QW7PEA, seg_pos={0 0}, upload=61027]: Done uploading piece. err: <nil>
Aug 11 04:00:14.276128542 (58h33m55.007396202s) [noise=true , address=104.36.82.36:4640 , piece_id=FZJD5MAWIY3VLU5X2V6EXYWKL3QF5ARQWYWK3KAILVUFBNJLPDDQ, seg_pos={0 0}, upload=61027]: Done uploading piece. err: <nil>
Aug 11 04:00:14.280189081 (58h33m55.011456732s) [noise=true , address=104.36.82.35:4616 , piece_id=F5MMGO5OGUBU5KXL7ZTGAMKWBC5SMGCH27GMCK3QQ5FJ2ZPHWPIA, seg_pos={0 0}, upload=61027]: Done uploading piece. err: <nil>
Aug 11 04:00:14.282511006 (58h33m55.013778656s) [noise=true , address=104.36.82.16:4302 , piece_id=M7OAB3JCVRJ4BZ67TUJPDAHRI3TT7BFJCTTTWMV2E336UXCB3BFQ, seg_pos={0 0}, upload=61027]: Done uploading piece. err: <nil>
Aug 11 04:00:14.288521537 (58h33m55.019789187s) [noise=true , address=104.36.82.34:4550 , piece_id=X5HSHOYEUYVFH4SL5OE26K3HGIFPE3YGTNN3QRL5TDH77SGBZVZQ, seg_pos={0 0}, upload=61027]: Done uploading piece. err: <nil>
Aug 11 04:00:14.289063839 (58h33m55.020331489s) [noise=true , address=104.36.82.5:4850 , piece_id=VE6EJ7ZPLSN7GUXNOTCLFZNAUHEMWSNXA6DOZPCOMIJNZHXPS36Q, seg_pos={0 0}, upload=61027]: Done uploading piece. err: <nil>
Aug 11 04:00:14.289092132 (58h33m55.020359793s) [seg_pos={0 0}, upload=61027]: Segment reached optimal threshold of 14 pieces.
Aug 11 04:00:14.289224460 (58h33m55.020492109s) [noise=true , address=104.36.82.9:4024 , piece_id=XRO7M4WDZYYRM34KAKIOVBYJJ6QCNFTQTFM2PJHDHHPF6GIBHZXQ, seg_pos={0 0}, upload=61027]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bHv9jsVASv3dP3iowvir74PDEHkaaqA3sstiLk7qLSpK2Duzz): protocol: expected piece hash; context canceled; EOF
Aug 11 04:00:14.289311542 (58h33m55.020579192s) [noise=true , address=104.36.82.59:4316 , piece_id=MAFGTGTR7V3SSKQBT4J6AO4FP2O6ARBTPQEER2CMX4XSZPJ5POBQ, seg_pos={0 0}, upload=61027]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn): protocol: expected piece hash; context canceled; EOF
Aug 11 04:00:14.289388024 (58h33m55.020655674s) [noise=true , address=104.36.82.59:4329 , piece_id=RFURLTE32SIHYENTMF4HUHWFVF4YUVMZGMV6EKGU7HM2N2YIW6XA, seg_pos={0 0}, upload=61027]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dGY6BG4FULjuRwnEKd9wV4cZPVJsgo32oFHKZn5BgjxVaojbk): protocol: expected piece hash; context canceled; EOF
Aug 11 04:00:14.289473554 (58h33m55.020741213s) [noise=true , address=104.36.82.46:4509 , piece_id=BMTMSSGIC2BEBHQ4ACYISIQPCVINUN6V2SNYX5ZQGQZKXDIKUGSQ, seg_pos={0 0}, upload=61027]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y2NmauNvCyrMJ5z66Lihb3h3C9nwdJYqfSfNmC5dwDGYQqUKh): protocol: expected piece hash; context canceled; EOF
Aug 11 04:00:14.289519710 (58h33m55.02078736s) [seg_pos={0 0}, upload=61027]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 04:00:14.289765639 (58h33m55.0210333s) [upload=61027]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 04:00:14.289776500 (58h33m55.02104415s) [upload=61027]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 04:00:14.643591049 (58h33m55.374858698s) [upload=61027]: Done uploading segments...
Aug 11 04:00:14.643610425 (58h33m55.374878075s) [upload=61027]: Upload finished. err: <nil>
Duration: 410.91319ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............................X.......................X....] duration:
227.693419ms
FAIL (2025-08-11 04:00:34 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 03:57:57.361395597 (58h31m38.092663258s) [upload=60989]: Starting upload Aug 11 03:57:57.361459798 (58h31m38.092727448s) [upload=60989]: Done starting upload Aug 11 03:57:57.361529187 (58h31m38.092796847s) [upload=60989]: Uploading segments... Aug 11 03:57:57.361566487 (58h31m38.092834147s) [upload=60989]: Got next segment. Inline: true Aug 11 03:57:57.361571977 (58h31m38.092839628s) [upload=60989]: Waiting for error group managing segments... Aug 11 03:57:57.361614677 (58h31m38.092882337s) [upload=60989]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 03:57:57.361620047 (58h31m38.092887696s) [upload=60989]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 03:57:57.361623593 (58h31m38.092891243s) [upload=60989]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 03:57:57.364494583 (58h31m38.095762243s) [upload=60989]: Done uploading segments... Aug 11 03:57:57.364507026 (58h31m38.095774676s) [upload=60989]: Upload finished. err: metaclient: Too Many Requests
Duration: 227.716903ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........X................................................X] duration:
949.576881ms
FAIL (2025-08-11 04:00:14 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 04:00:13.912808457 (58h33m54.644076107s) [upload=61027]: Starting upload
Aug 11 04:00:13.912882536 (58h33m54.644150186s) [upload=61027]: Done starting upload
Aug 11 04:00:13.912991098 (58h33m54.644258759s) [upload=61027]: Uploading segments...
Aug 11 04:00:13.913226398 (58h33m54.644494038s) [upload=61027]: Got next segment. Inline: false
Aug 11 04:00:13.913270971 (58h33m54.64453861s) [upload=61027]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 04:00:13.913276371 (58h33m54.644544021s) [upload=61027]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 04:00:14.108835543 (58h33m54.840103192s) [seg_pos={0 0}, upload=61027]: Begin upload segment...
Aug 11 04:00:14.108904421 (58h33m54.840172081s) [seg_pos={0 0}, upload=61027]: Done begin upload segment.
Aug 11 04:00:14.108934428 (58h33m54.840202078s) [noise=true , address=104.36.82.58:4285 , piece_id=V4PTCQB75DGVLQTHJ3LOR4GFAC4UTBA5TIABWZI5QTHET4AGBKSQ, seg_pos={0 0}, upload=61027]: Uploading piece...
Aug 11 04:00:14.108953122 (58h33m54.840220772s) [noise=true , address=104.36.82.44:4886 , piece_id=CHO4S7E2JV27JPJD5NP3LZPGBAIZF56YAW74B4R3UBZD43QW7PEA, seg_pos={0 0}, upload=61027]: Uploading piece...
Aug 11 04:00:14.109363989 (58h33m54.84063164s) [noise=true , address=104.36.82.59:4316 , piece_id=MAFGTGTR7V3SSKQBT4J6AO4FP2O6ARBTPQEER2CMX4XSZPJ5POBQ, seg_pos={0 0}, upload=61027]: Uploading piece...
Aug 11 04:00:14.109443608 (58h33m54.840711257s) [noise=true , address=104.36.82.21:4503 , piece_id=NXR5RYJGFI3T6CUZN45UFPTK3S7XVJWOQRU7SUU6SYLHXSLPWUGA, seg_pos={0 0}, upload=61027]: Uploading piece...
Aug 11 04:00:14.109768784 (58h33m54.841036424s) [noise=true , address=104.36.82.46:4509 , piece_id=BMTMSSGIC2BEBHQ4ACYISIQPCVINUN6V2SNYX5ZQGQZKXDIKUGSQ, seg_pos={0 0}, upload=61027]: Uploading piece...
Aug 11 04:00:14.110061532 (58h33m54.841329182s) [noise=true , address=104.36.82.61:4385 , piece_id=46BVCEI3IA2XNKMN663STFKTXTATZR77LPSB2C5WY5OSRR4CXDVQ, seg_pos={0 0}, upload=61027]: Uploading piece...
Aug 11 04:00:14.110111845 (58h33m54.841379495s) [noise=true , address=104.36.82.36:4640 , piece_id=FZJD5MAWIY3VLU5X2V6EXYWKL3QF5ARQWYWK3KAILVUFBNJLPDDQ, seg_pos={0 0}, upload=61027]: Uploading piece...
Aug 11 04:00:14.110572515 (58h33m54.841840195s) [noise=true , address=104.36.82.6:4890 , piece_id=C6BYZCDF4B4QOQHBKVBCJT2YOCOWAKUL4JGRYUDKW2XPDDQDKNPA, seg_pos={0 0}, upload=61027]: Uploading piece...
Aug 11 04:00:14.110977311 (58h33m54.842244961s) [noise=true , address=104.36.82.60:4369 , piece_id=MLD6GZF3DTS5HDXT3LZF32ECIRB3IJC72C4OAEUYYANOE4GZ7VTQ, seg_pos={0 0}, upload=61027]: Uploading piece...
Aug 11 04:00:14.111339006 (58h33m54.842606657s) [noise=true , address=104.36.82.5:4850 , piece_id=VE6EJ7ZPLSN7GUXNOTCLFZNAUHEMWSNXA6DOZPCOMIJNZHXPS36Q, seg_pos={0 0}, upload=61027]: Uploading piece...
Aug 11 04:00:14.111718404 (58h33m54.842986054s) [noise=true , address=104.36.82.22:4531 , piece_id=562QXW3DKVK6J7AIG4HROHFVNIEM4PHGIZ6N7MVHZHOGIBK323GQ, seg_pos={0 0}, upload=61027]: Uploading piece...
Aug 11 04:00:14.111726219 (58h33m54.842993869s) [noise=true , address=104.36.82.16:4302 , piece_id=M7OAB3JCVRJ4BZ67TUJPDAHRI3TT7BFJCTTTWMV2E336UXCB3BFQ, seg_pos={0 0}, upload=61027]: Uploading piece...
Aug 11 04:00:14.112151093 (58h33m54.843418743s) [noise=true , address=104.36.82.59:4329 , piece_id=RFURLTE32SIHYENTMF4HUHWFVF4YUVMZGMV6EKGU7HM2N2YIW6XA, seg_pos={0 0}, upload=61027]: Uploading piece...
Aug 11 04:00:14.112187750 (58h33m54.843455391s) [noise=true , address=104.36.82.37:4658 , piece_id=ZVWO4OPVW3EDU6FHK6Z2W4LR5HRCXX3Y34RTZ5DEXJJP2VWYCD2A, seg_pos={0 0}, upload=61027]: Uploading piece...
Aug 11 04:00:14.112536682 (58h33m54.843804332s) [noise=true , address=104.36.82.35:4616 , piece_id=F5MMGO5OGUBU5KXL7ZTGAMKWBC5SMGCH27GMCK3QQ5FJ2ZPHWPIA, seg_pos={0 0}, upload=61027]: Uploading piece...
Aug 11 04:00:14.112554175 (58h33m54.843821824s) [noise=true , address=104.36.82.43:4864 , piece_id=3Y4YVHJ2UR5QGZFFNO5FR7AI62L6GBNUV3KKCASIFTU4JUJVN3HQ, seg_pos={0 0}, upload=61027]: Uploading piece...
Aug 11 04:00:14.112940756 (58h33m54.844208407s) [noise=true , address=104.36.82.9:4024 , piece_id=XRO7M4WDZYYRM34KAKIOVBYJJ6QCNFTQTFM2PJHDHHPF6GIBHZXQ, seg_pos={0 0}, upload=61027]: Uploading piece...
Aug 11 04:00:14.113290650 (58h33m54.8445583s) [noise=true , address=104.36.82.34:4550 , piece_id=X5HSHOYEUYVFH4SL5OE26K3HGIFPE3YGTNN3QRL5TDH77SGBZVZQ, seg_pos={0 0}, upload=61027]: Uploading piece...
Aug 11 04:00:14.250535536 (58h33m54.981803196s) [upload=61027]: Next returned nil segment
Aug 11 04:00:14.250579538 (58h33m54.981847188s) [upload=61027]: Waiting for error group managing segments...
Aug 11 04:00:14.262443515 (58h33m54.993711175s) [noise=true , address=104.36.82.58:4285 , piece_id=V4PTCQB75DGVLQTHJ3LOR4GFAC4UTBA5TIABWZI5QTHET4AGBKSQ, seg_pos={0 0}, upload=61027]: Done uploading piece. err: <nil>
Aug 11 04:00:14.265348729 (58h33m54.996616389s) [noise=true , address=104.36.82.61:4385 , piece_id=46BVCEI3IA2XNKMN663STFKTXTATZR77LPSB2C5WY5OSRR4CXDVQ, seg_pos={0 0}, upload=61027]: Done uploading piece. err: <nil>
Aug 11 04:00:14.265953557 (58h33m54.997221207s) [noise=true , address=104.36.82.21:4503 , piece_id=NXR5RYJGFI3T6CUZN45UFPTK3S7XVJWOQRU7SUU6SYLHXSLPWUGA, seg_pos={0 0}, upload=61027]: Done uploading piece. err: <nil>
Aug 11 04:00:14.266441559 (58h33m54.997709209s) [noise=true , address=104.36.82.22:4531 , piece_id=562QXW3DKVK6J7AIG4HROHFVNIEM4PHGIZ6N7MVHZHOGIBK323GQ, seg_pos={0 0}, upload=61027]: Done uploading piece. err: <nil>
Aug 11 04:00:14.267779556 (58h33m54.999047216s) [noise=true , address=104.36.82.37:4658 , piece_id=ZVWO4OPVW3EDU6FHK6Z2W4LR5HRCXX3Y34RTZ5DEXJJP2VWYCD2A, seg_pos={0 0}, upload=61027]: Done uploading piece. err: <nil>
Aug 11 04:00:14.271239936 (58h33m55.002507586s) [noise=true , address=104.36.82.60:4369 , piece_id=MLD6GZF3DTS5HDXT3LZF32ECIRB3IJC72C4OAEUYYANOE4GZ7VTQ, seg_pos={0 0}, upload=61027]: Done uploading piece. err: <nil>
Aug 11 04:00:14.273828808 (58h33m55.005096459s) [noise=true , address=104.36.82.43:4864 , piece_id=3Y4YVHJ2UR5QGZFFNO5FR7AI62L6GBNUV3KKCASIFTU4JUJVN3HQ, seg_pos={0 0}, upload=61027]: Done uploading piece. err: <nil>
Aug 11 04:00:14.274427356 (58h33m55.005695017s) [noise=true , address=104.36.82.6:4890 , piece_id=C6BYZCDF4B4QOQHBKVBCJT2YOCOWAKUL4JGRYUDKW2XPDDQDKNPA, seg_pos={0 0}, upload=61027]: Done uploading piece. err: <nil>
Aug 11 04:00:14.274813207 (58h33m55.006080857s) [noise=true , address=104.36.82.44:4886 , piece_id=CHO4S7E2JV27JPJD5NP3LZPGBAIZF56YAW74B4R3UBZD43QW7PEA, seg_pos={0 0}, upload=61027]: Done uploading piece. err: <nil>
Aug 11 04:00:14.276128542 (58h33m55.007396202s) [noise=true , address=104.36.82.36:4640 , piece_id=FZJD5MAWIY3VLU5X2V6EXYWKL3QF5ARQWYWK3KAILVUFBNJLPDDQ, seg_pos={0 0}, upload=61027]: Done uploading piece. err: <nil>
Aug 11 04:00:14.280189081 (58h33m55.011456732s) [noise=true , address=104.36.82.35:4616 , piece_id=F5MMGO5OGUBU5KXL7ZTGAMKWBC5SMGCH27GMCK3QQ5FJ2ZPHWPIA, seg_pos={0 0}, upload=61027]: Done uploading piece. err: <nil>
Aug 11 04:00:14.282511006 (58h33m55.013778656s) [noise=true , address=104.36.82.16:4302 , piece_id=M7OAB3JCVRJ4BZ67TUJPDAHRI3TT7BFJCTTTWMV2E336UXCB3BFQ, seg_pos={0 0}, upload=61027]: Done uploading piece. err: <nil>
Aug 11 04:00:14.288521537 (58h33m55.019789187s) [noise=true , address=104.36.82.34:4550 , piece_id=X5HSHOYEUYVFH4SL5OE26K3HGIFPE3YGTNN3QRL5TDH77SGBZVZQ, seg_pos={0 0}, upload=61027]: Done uploading piece. err: <nil>
Aug 11 04:00:14.289063839 (58h33m55.020331489s) [noise=true , address=104.36.82.5:4850 , piece_id=VE6EJ7ZPLSN7GUXNOTCLFZNAUHEMWSNXA6DOZPCOMIJNZHXPS36Q, seg_pos={0 0}, upload=61027]: Done uploading piece. err: <nil>
Aug 11 04:00:14.289092132 (58h33m55.020359793s) [seg_pos={0 0}, upload=61027]: Segment reached optimal threshold of 14 pieces.
Aug 11 04:00:14.289224460 (58h33m55.020492109s) [noise=true , address=104.36.82.9:4024 , piece_id=XRO7M4WDZYYRM34KAKIOVBYJJ6QCNFTQTFM2PJHDHHPF6GIBHZXQ, seg_pos={0 0}, upload=61027]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bHv9jsVASv3dP3iowvir74PDEHkaaqA3sstiLk7qLSpK2Duzz): protocol: expected piece hash; context canceled; EOF
Aug 11 04:00:14.289311542 (58h33m55.020579192s) [noise=true , address=104.36.82.59:4316 , piece_id=MAFGTGTR7V3SSKQBT4J6AO4FP2O6ARBTPQEER2CMX4XSZPJ5POBQ, seg_pos={0 0}, upload=61027]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn): protocol: expected piece hash; context canceled; EOF
Aug 11 04:00:14.289388024 (58h33m55.020655674s) [noise=true , address=104.36.82.59:4329 , piece_id=RFURLTE32SIHYENTMF4HUHWFVF4YUVMZGMV6EKGU7HM2N2YIW6XA, seg_pos={0 0}, upload=61027]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dGY6BG4FULjuRwnEKd9wV4cZPVJsgo32oFHKZn5BgjxVaojbk): protocol: expected piece hash; context canceled; EOF
Aug 11 04:00:14.289473554 (58h33m55.020741213s) [noise=true , address=104.36.82.46:4509 , piece_id=BMTMSSGIC2BEBHQ4ACYISIQPCVINUN6V2SNYX5ZQGQZKXDIKUGSQ, seg_pos={0 0}, upload=61027]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y2NmauNvCyrMJ5z66Lihb3h3C9nwdJYqfSfNmC5dwDGYQqUKh): protocol: expected piece hash; context canceled; EOF
Aug 11 04:00:14.289519710 (58h33m55.02078736s) [seg_pos={0 0}, upload=61027]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 04:00:14.289765639 (58h33m55.0210333s) [upload=61027]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 04:00:14.289776500 (58h33m55.02104415s) [upload=61027]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 04:00:14.643591049 (58h33m55.374858698s) [upload=61027]: Done uploading segments...
Aug 11 04:00:14.643610425 (58h33m55.374878075s) [upload=61027]: Upload finished. err: <nil>
Duration: 949.605776ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [................................X.......................X...] duration:
269.011231ms
FAIL (2025-08-11 04:00:07 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 03:57:57.361395597 (58h31m38.092663258s) [upload=60989]: Starting upload Aug 11 03:57:57.361459798 (58h31m38.092727448s) [upload=60989]: Done starting upload Aug 11 03:57:57.361529187 (58h31m38.092796847s) [upload=60989]: Uploading segments... Aug 11 03:57:57.361566487 (58h31m38.092834147s) [upload=60989]: Got next segment. Inline: true Aug 11 03:57:57.361571977 (58h31m38.092839628s) [upload=60989]: Waiting for error group managing segments... Aug 11 03:57:57.361614677 (58h31m38.092882337s) [upload=60989]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 03:57:57.361620047 (58h31m38.092887696s) [upload=60989]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 03:57:57.361623593 (58h31m38.092891243s) [upload=60989]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 03:57:57.364494583 (58h31m38.095762243s) [upload=60989]: Done uploading segments... Aug 11 03:57:57.364507026 (58h31m38.095774676s) [upload=60989]: Upload finished. err: metaclient: Too Many Requests
Duration: 269.03744ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................................X.......................X..] duration:
133.441046ms
FAIL (2025-08-11 03:59:30 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 03:57:57.361395597 (58h31m38.092663258s) [upload=60989]: Starting upload Aug 11 03:57:57.361459798 (58h31m38.092727448s) [upload=60989]: Done starting upload Aug 11 03:57:57.361529187 (58h31m38.092796847s) [upload=60989]: Uploading segments... Aug 11 03:57:57.361566487 (58h31m38.092834147s) [upload=60989]: Got next segment. Inline: true Aug 11 03:57:57.361571977 (58h31m38.092839628s) [upload=60989]: Waiting for error group managing segments... Aug 11 03:57:57.361614677 (58h31m38.092882337s) [upload=60989]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 03:57:57.361620047 (58h31m38.092887696s) [upload=60989]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 03:57:57.361623593 (58h31m38.092891243s) [upload=60989]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 03:57:57.364494583 (58h31m38.095762243s) [upload=60989]: Done uploading segments... Aug 11 03:57:57.364507026 (58h31m38.095774676s) [upload=60989]: Upload finished. err: metaclient: Too Many Requests
Duration: 133.470029ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
447.979121ms
FAIL (2025-08-11 03:59:13 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 03:19:55.139806021 (57h53m35.871073671s) [upload=60328]: Starting upload Aug 11 03:19:55.139875520 (57h53m35.87114317s) [upload=60328]: Done starting upload Aug 11 03:19:55.139987489 (57h53m35.871255139s) [upload=60328]: Uploading segments... Aug 11 03:19:55.140403776 (57h53m35.871671426s) [upload=60328]: Got next segment. Inline: false Aug 11 03:19:55.140455613 (57h53m35.871723263s) [upload=60328]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 03:19:55.140461725 (57h53m35.871729374s) [upload=60328]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 03:19:55.153099918 (57h53m35.884367568s) [upload=60328]: Next segment err: metaclient: Too Many Requests Aug 11 03:19:55.153120145 (57h53m35.884387796s) [upload=60328]: Done uploading segments... Aug 11 03:19:55.153136455 (57h53m35.884404105s) [upload=60328]: Upload finished. err: metaclient: Too Many Requests
Duration: 448.006163ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................................X.......................X.] duration:
134.083042ms
FAIL (2025-08-11 03:58:52 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 03:57:57.361395597 (58h31m38.092663258s) [upload=60989]: Starting upload Aug 11 03:57:57.361459798 (58h31m38.092727448s) [upload=60989]: Done starting upload Aug 11 03:57:57.361529187 (58h31m38.092796847s) [upload=60989]: Uploading segments... Aug 11 03:57:57.361566487 (58h31m38.092834147s) [upload=60989]: Got next segment. Inline: true Aug 11 03:57:57.361571977 (58h31m38.092839628s) [upload=60989]: Waiting for error group managing segments... Aug 11 03:57:57.361614677 (58h31m38.092882337s) [upload=60989]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 03:57:57.361620047 (58h31m38.092887696s) [upload=60989]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 03:57:57.361623593 (58h31m38.092891243s) [upload=60989]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 03:57:57.364494583 (58h31m38.095762243s) [upload=60989]: Done uploading segments... Aug 11 03:57:57.364507026 (58h31m38.095774676s) [upload=60989]: Upload finished. err: metaclient: Too Many Requests
Duration: 134.106836ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
363.81566ms
FAIL (2025-08-11 03:58:04 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 03:19:55.139806021 (57h53m35.871073671s) [upload=60328]: Starting upload Aug 11 03:19:55.139875520 (57h53m35.87114317s) [upload=60328]: Done starting upload Aug 11 03:19:55.139987489 (57h53m35.871255139s) [upload=60328]: Uploading segments... Aug 11 03:19:55.140403776 (57h53m35.871671426s) [upload=60328]: Got next segment. Inline: false Aug 11 03:19:55.140455613 (57h53m35.871723263s) [upload=60328]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 03:19:55.140461725 (57h53m35.871729374s) [upload=60328]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 03:19:55.153099918 (57h53m35.884367568s) [upload=60328]: Next segment err: metaclient: Too Many Requests Aug 11 03:19:55.153120145 (57h53m35.884387796s) [upload=60328]: Done uploading segments... Aug 11 03:19:55.153136455 (57h53m35.884404105s) [upload=60328]: Upload finished. err: metaclient: Too Many Requests
Duration: 363.832362ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...................................X.......................X] duration:
22.019374ms
FAIL (2025-08-11 03:57:57 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 03:57:57.361395597 (58h31m38.092663258s) [upload=60989]: Starting upload Aug 11 03:57:57.361459798 (58h31m38.092727448s) [upload=60989]: Done starting upload Aug 11 03:57:57.361529187 (58h31m38.092796847s) [upload=60989]: Uploading segments... Aug 11 03:57:57.361566487 (58h31m38.092834147s) [upload=60989]: Got next segment. Inline: true Aug 11 03:57:57.361571977 (58h31m38.092839628s) [upload=60989]: Waiting for error group managing segments... Aug 11 03:57:57.361614677 (58h31m38.092882337s) [upload=60989]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 03:57:57.361620047 (58h31m38.092887696s) [upload=60989]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 03:57:57.361623593 (58h31m38.092891243s) [upload=60989]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 03:57:57.364494583 (58h31m38.095762243s) [upload=60989]: Done uploading segments... Aug 11 03:57:57.364507026 (58h31m38.095774676s) [upload=60989]: Upload finished. err: metaclient: Too Many Requests
Duration: 22.042898ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
150.32356ms
FAIL (2025-08-11 03:57:25 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 03:39:44.787052529 (58h13m25.518320159s) [upload=60677]: Starting upload Aug 11 03:39:44.787099497 (58h13m25.518367127s) [upload=60677]: Done starting upload Aug 11 03:39:44.787190667 (58h13m25.518458307s) [upload=60677]: Uploading segments... Aug 11 03:39:44.787259876 (58h13m25.518527516s) [upload=60677]: Got next segment. Inline: true Aug 11 03:39:44.787267310 (58h13m25.51853495s) [upload=60677]: Waiting for error group managing segments... Aug 11 03:39:44.787313006 (58h13m25.518580636s) [upload=60677]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 03:39:44.787318195 (58h13m25.518585835s) [upload=60677]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 03:39:44.787321211 (58h13m25.518588851s) [upload=60677]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 03:39:44.789990514 (58h13m25.521258155s) [upload=60677]: Done uploading segments... Aug 11 03:39:44.790008027 (58h13m25.521275668s) [upload=60677]: Upload finished. err: metaclient: Too Many Requests
Duration: 150.339681ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
621.229281ms
FAIL (2025-08-11 03:57:23 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 03:19:55.139806021 (57h53m35.871073671s) [upload=60328]: Starting upload Aug 11 03:19:55.139875520 (57h53m35.87114317s) [upload=60328]: Done starting upload Aug 11 03:19:55.139987489 (57h53m35.871255139s) [upload=60328]: Uploading segments... Aug 11 03:19:55.140403776 (57h53m35.871671426s) [upload=60328]: Got next segment. Inline: false Aug 11 03:19:55.140455613 (57h53m35.871723263s) [upload=60328]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 03:19:55.140461725 (57h53m35.871729374s) [upload=60328]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 03:19:55.153099918 (57h53m35.884367568s) [upload=60328]: Next segment err: metaclient: Too Many Requests Aug 11 03:19:55.153120145 (57h53m35.884387796s) [upload=60328]: Done uploading segments... Aug 11 03:19:55.153136455 (57h53m35.884404105s) [upload=60328]: Upload finished. err: metaclient: Too Many Requests
Duration: 621.253247ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
492.341588ms
FAIL (2025-08-11 03:56:37 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 03:19:55.139806021 (57h53m35.871073671s) [upload=60328]: Starting upload Aug 11 03:19:55.139875520 (57h53m35.87114317s) [upload=60328]: Done starting upload Aug 11 03:19:55.139987489 (57h53m35.871255139s) [upload=60328]: Uploading segments... Aug 11 03:19:55.140403776 (57h53m35.871671426s) [upload=60328]: Got next segment. Inline: false Aug 11 03:19:55.140455613 (57h53m35.871723263s) [upload=60328]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 03:19:55.140461725 (57h53m35.871729374s) [upload=60328]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 03:19:55.153099918 (57h53m35.884367568s) [upload=60328]: Next segment err: metaclient: Too Many Requests Aug 11 03:19:55.153120145 (57h53m35.884387796s) [upload=60328]: Done uploading segments... Aug 11 03:19:55.153136455 (57h53m35.884404105s) [upload=60328]: Upload finished. err: metaclient: Too Many Requests
Duration: 492.365682ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
140.622748ms
FAIL (2025-08-11 03:56:12 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 03:39:44.787052529 (58h13m25.518320159s) [upload=60677]: Starting upload Aug 11 03:39:44.787099497 (58h13m25.518367127s) [upload=60677]: Done starting upload Aug 11 03:39:44.787190667 (58h13m25.518458307s) [upload=60677]: Uploading segments... Aug 11 03:39:44.787259876 (58h13m25.518527516s) [upload=60677]: Got next segment. Inline: true Aug 11 03:39:44.787267310 (58h13m25.51853495s) [upload=60677]: Waiting for error group managing segments... Aug 11 03:39:44.787313006 (58h13m25.518580636s) [upload=60677]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 03:39:44.787318195 (58h13m25.518585835s) [upload=60677]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 03:39:44.787321211 (58h13m25.518588851s) [upload=60677]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 03:39:44.789990514 (58h13m25.521258155s) [upload=60677]: Done uploading segments... Aug 11 03:39:44.790008027 (58h13m25.521275668s) [upload=60677]: Upload finished. err: metaclient: Too Many Requests
Duration: 140.650871ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
404.610283ms
FAIL (2025-08-11 03:55:37 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 03:19:55.139806021 (57h53m35.871073671s) [upload=60328]: Starting upload Aug 11 03:19:55.139875520 (57h53m35.87114317s) [upload=60328]: Done starting upload Aug 11 03:19:55.139987489 (57h53m35.871255139s) [upload=60328]: Uploading segments... Aug 11 03:19:55.140403776 (57h53m35.871671426s) [upload=60328]: Got next segment. Inline: false Aug 11 03:19:55.140455613 (57h53m35.871723263s) [upload=60328]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 03:19:55.140461725 (57h53m35.871729374s) [upload=60328]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 03:19:55.153099918 (57h53m35.884367568s) [upload=60328]: Next segment err: metaclient: Too Many Requests Aug 11 03:19:55.153120145 (57h53m35.884387796s) [upload=60328]: Done uploading segments... Aug 11 03:19:55.153136455 (57h53m35.884404105s) [upload=60328]: Upload finished. err: metaclient: Too Many Requests
Duration: 404.630441ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
383.433241ms
FAIL (2025-08-11 03:55:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 03:39:44.787052529 (58h13m25.518320159s) [upload=60677]: Starting upload Aug 11 03:39:44.787099497 (58h13m25.518367127s) [upload=60677]: Done starting upload Aug 11 03:39:44.787190667 (58h13m25.518458307s) [upload=60677]: Uploading segments... Aug 11 03:39:44.787259876 (58h13m25.518527516s) [upload=60677]: Got next segment. Inline: true Aug 11 03:39:44.787267310 (58h13m25.51853495s) [upload=60677]: Waiting for error group managing segments... Aug 11 03:39:44.787313006 (58h13m25.518580636s) [upload=60677]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 03:39:44.787318195 (58h13m25.518585835s) [upload=60677]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 03:39:44.787321211 (58h13m25.518588851s) [upload=60677]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 03:39:44.789990514 (58h13m25.521258155s) [upload=60677]: Done uploading segments... Aug 11 03:39:44.790008027 (58h13m25.521275668s) [upload=60677]: Upload finished. err: metaclient: Too Many Requests
Duration: 383.457285ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
181.451417ms
FAIL (2025-08-11 03:54:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 03:39:44.787052529 (58h13m25.518320159s) [upload=60677]: Starting upload Aug 11 03:39:44.787099497 (58h13m25.518367127s) [upload=60677]: Done starting upload Aug 11 03:39:44.787190667 (58h13m25.518458307s) [upload=60677]: Uploading segments... Aug 11 03:39:44.787259876 (58h13m25.518527516s) [upload=60677]: Got next segment. Inline: true Aug 11 03:39:44.787267310 (58h13m25.51853495s) [upload=60677]: Waiting for error group managing segments... Aug 11 03:39:44.787313006 (58h13m25.518580636s) [upload=60677]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 03:39:44.787318195 (58h13m25.518585835s) [upload=60677]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 03:39:44.787321211 (58h13m25.518588851s) [upload=60677]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 03:39:44.789990514 (58h13m25.521258155s) [upload=60677]: Done uploading segments... Aug 11 03:39:44.790008027 (58h13m25.521275668s) [upload=60677]: Upload finished. err: metaclient: Too Many Requests
Duration: 181.47482ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
409.580272ms
FAIL (2025-08-11 03:54:25 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 03:19:55.139806021 (57h53m35.871073671s) [upload=60328]: Starting upload Aug 11 03:19:55.139875520 (57h53m35.87114317s) [upload=60328]: Done starting upload Aug 11 03:19:55.139987489 (57h53m35.871255139s) [upload=60328]: Uploading segments... Aug 11 03:19:55.140403776 (57h53m35.871671426s) [upload=60328]: Got next segment. Inline: false Aug 11 03:19:55.140455613 (57h53m35.871723263s) [upload=60328]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 03:19:55.140461725 (57h53m35.871729374s) [upload=60328]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 03:19:55.153099918 (57h53m35.884367568s) [upload=60328]: Next segment err: metaclient: Too Many Requests Aug 11 03:19:55.153120145 (57h53m35.884387796s) [upload=60328]: Done uploading segments... Aug 11 03:19:55.153136455 (57h53m35.884404105s) [upload=60328]: Upload finished. err: metaclient: Too Many Requests
Duration: 409.604767ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
150.659135ms
FAIL (2025-08-11 03:54:05 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 03:39:44.787052529 (58h13m25.518320159s) [upload=60677]: Starting upload Aug 11 03:39:44.787099497 (58h13m25.518367127s) [upload=60677]: Done starting upload Aug 11 03:39:44.787190667 (58h13m25.518458307s) [upload=60677]: Uploading segments... Aug 11 03:39:44.787259876 (58h13m25.518527516s) [upload=60677]: Got next segment. Inline: true Aug 11 03:39:44.787267310 (58h13m25.51853495s) [upload=60677]: Waiting for error group managing segments... Aug 11 03:39:44.787313006 (58h13m25.518580636s) [upload=60677]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 03:39:44.787318195 (58h13m25.518585835s) [upload=60677]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 03:39:44.787321211 (58h13m25.518588851s) [upload=60677]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 03:39:44.789990514 (58h13m25.521258155s) [upload=60677]: Done uploading segments... Aug 11 03:39:44.790008027 (58h13m25.521275668s) [upload=60677]: Upload finished. err: metaclient: Too Many Requests
Duration: 150.68817ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
880.058133ms
FAIL (2025-08-11 03:53:55 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 03:19:55.139806021 (57h53m35.871073671s) [upload=60328]: Starting upload Aug 11 03:19:55.139875520 (57h53m35.87114317s) [upload=60328]: Done starting upload Aug 11 03:19:55.139987489 (57h53m35.871255139s) [upload=60328]: Uploading segments... Aug 11 03:19:55.140403776 (57h53m35.871671426s) [upload=60328]: Got next segment. Inline: false Aug 11 03:19:55.140455613 (57h53m35.871723263s) [upload=60328]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 03:19:55.140461725 (57h53m35.871729374s) [upload=60328]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 03:19:55.153099918 (57h53m35.884367568s) [upload=60328]: Next segment err: metaclient: Too Many Requests Aug 11 03:19:55.153120145 (57h53m35.884387796s) [upload=60328]: Done uploading segments... Aug 11 03:19:55.153136455 (57h53m35.884404105s) [upload=60328]: Upload finished. err: metaclient: Too Many Requests
Duration: 880.080375ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
147.385856ms
FAIL (2025-08-11 03:53:05 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 03:39:44.787052529 (58h13m25.518320159s) [upload=60677]: Starting upload Aug 11 03:39:44.787099497 (58h13m25.518367127s) [upload=60677]: Done starting upload Aug 11 03:39:44.787190667 (58h13m25.518458307s) [upload=60677]: Uploading segments... Aug 11 03:39:44.787259876 (58h13m25.518527516s) [upload=60677]: Got next segment. Inline: true Aug 11 03:39:44.787267310 (58h13m25.51853495s) [upload=60677]: Waiting for error group managing segments... Aug 11 03:39:44.787313006 (58h13m25.518580636s) [upload=60677]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 03:39:44.787318195 (58h13m25.518585835s) [upload=60677]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 03:39:44.787321211 (58h13m25.518588851s) [upload=60677]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 03:39:44.789990514 (58h13m25.521258155s) [upload=60677]: Done uploading segments... Aug 11 03:39:44.790008027 (58h13m25.521275668s) [upload=60677]: Upload finished. err: metaclient: Too Many Requests
Duration: 147.409049ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
440.630315ms
FAIL (2025-08-11 03:52:40 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 03:19:55.139806021 (57h53m35.871073671s) [upload=60328]: Starting upload Aug 11 03:19:55.139875520 (57h53m35.87114317s) [upload=60328]: Done starting upload Aug 11 03:19:55.139987489 (57h53m35.871255139s) [upload=60328]: Uploading segments... Aug 11 03:19:55.140403776 (57h53m35.871671426s) [upload=60328]: Got next segment. Inline: false Aug 11 03:19:55.140455613 (57h53m35.871723263s) [upload=60328]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 03:19:55.140461725 (57h53m35.871729374s) [upload=60328]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 03:19:55.153099918 (57h53m35.884367568s) [upload=60328]: Next segment err: metaclient: Too Many Requests Aug 11 03:19:55.153120145 (57h53m35.884387796s) [upload=60328]: Done uploading segments... Aug 11 03:19:55.153136455 (57h53m35.884404105s) [upload=60328]: Upload finished. err: metaclient: Too Many Requests
Duration: 440.645774ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
133.983805ms
FAIL (2025-08-11 03:52:28 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 03:39:44.787052529 (58h13m25.518320159s) [upload=60677]: Starting upload Aug 11 03:39:44.787099497 (58h13m25.518367127s) [upload=60677]: Done starting upload Aug 11 03:39:44.787190667 (58h13m25.518458307s) [upload=60677]: Uploading segments... Aug 11 03:39:44.787259876 (58h13m25.518527516s) [upload=60677]: Got next segment. Inline: true Aug 11 03:39:44.787267310 (58h13m25.51853495s) [upload=60677]: Waiting for error group managing segments... Aug 11 03:39:44.787313006 (58h13m25.518580636s) [upload=60677]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 03:39:44.787318195 (58h13m25.518585835s) [upload=60677]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 03:39:44.787321211 (58h13m25.518588851s) [upload=60677]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 03:39:44.789990514 (58h13m25.521258155s) [upload=60677]: Done uploading segments... Aug 11 03:39:44.790008027 (58h13m25.521275668s) [upload=60677]: Upload finished. err: metaclient: Too Many Requests
Duration: 134.006098ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
697.064558ms
FAIL (2025-08-11 03:51:53 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 03:19:55.139806021 (57h53m35.871073671s) [upload=60328]: Starting upload Aug 11 03:19:55.139875520 (57h53m35.87114317s) [upload=60328]: Done starting upload Aug 11 03:19:55.139987489 (57h53m35.871255139s) [upload=60328]: Uploading segments... Aug 11 03:19:55.140403776 (57h53m35.871671426s) [upload=60328]: Got next segment. Inline: false Aug 11 03:19:55.140455613 (57h53m35.871723263s) [upload=60328]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 03:19:55.140461725 (57h53m35.871729374s) [upload=60328]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 03:19:55.153099918 (57h53m35.884367568s) [upload=60328]: Next segment err: metaclient: Too Many Requests Aug 11 03:19:55.153120145 (57h53m35.884387796s) [upload=60328]: Done uploading segments... Aug 11 03:19:55.153136455 (57h53m35.884404105s) [upload=60328]: Upload finished. err: metaclient: Too Many Requests
Duration: 697.082563ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
147.08351ms
FAIL (2025-08-11 03:51:20 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 03:39:44.787052529 (58h13m25.518320159s) [upload=60677]: Starting upload Aug 11 03:39:44.787099497 (58h13m25.518367127s) [upload=60677]: Done starting upload Aug 11 03:39:44.787190667 (58h13m25.518458307s) [upload=60677]: Uploading segments... Aug 11 03:39:44.787259876 (58h13m25.518527516s) [upload=60677]: Got next segment. Inline: true Aug 11 03:39:44.787267310 (58h13m25.51853495s) [upload=60677]: Waiting for error group managing segments... Aug 11 03:39:44.787313006 (58h13m25.518580636s) [upload=60677]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 03:39:44.787318195 (58h13m25.518585835s) [upload=60677]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 03:39:44.787321211 (58h13m25.518588851s) [upload=60677]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 03:39:44.789990514 (58h13m25.521258155s) [upload=60677]: Done uploading segments... Aug 11 03:39:44.790008027 (58h13m25.521275668s) [upload=60677]: Upload finished. err: metaclient: Too Many Requests
Duration: 147.107284ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
404.267784ms
FAIL (2025-08-11 03:50:46 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 03:19:55.139806021 (57h53m35.871073671s) [upload=60328]: Starting upload Aug 11 03:19:55.139875520 (57h53m35.87114317s) [upload=60328]: Done starting upload Aug 11 03:19:55.139987489 (57h53m35.871255139s) [upload=60328]: Uploading segments... Aug 11 03:19:55.140403776 (57h53m35.871671426s) [upload=60328]: Got next segment. Inline: false Aug 11 03:19:55.140455613 (57h53m35.871723263s) [upload=60328]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 03:19:55.140461725 (57h53m35.871729374s) [upload=60328]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 03:19:55.153099918 (57h53m35.884367568s) [upload=60328]: Next segment err: metaclient: Too Many Requests Aug 11 03:19:55.153120145 (57h53m35.884387796s) [upload=60328]: Done uploading segments... Aug 11 03:19:55.153136455 (57h53m35.884404105s) [upload=60328]: Upload finished. err: metaclient: Too Many Requests
Duration: 404.297469ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
437.369998ms
FAIL (2025-08-11 03:50:29 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 03:19:55.139806021 (57h53m35.871073671s) [upload=60328]: Starting upload Aug 11 03:19:55.139875520 (57h53m35.87114317s) [upload=60328]: Done starting upload Aug 11 03:19:55.139987489 (57h53m35.871255139s) [upload=60328]: Uploading segments... Aug 11 03:19:55.140403776 (57h53m35.871671426s) [upload=60328]: Got next segment. Inline: false Aug 11 03:19:55.140455613 (57h53m35.871723263s) [upload=60328]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 03:19:55.140461725 (57h53m35.871729374s) [upload=60328]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 03:19:55.153099918 (57h53m35.884367568s) [upload=60328]: Next segment err: metaclient: Too Many Requests Aug 11 03:19:55.153120145 (57h53m35.884387796s) [upload=60328]: Done uploading segments... Aug 11 03:19:55.153136455 (57h53m35.884404105s) [upload=60328]: Upload finished. err: metaclient: Too Many Requests
Duration: 437.399704ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
154.085713ms
FAIL (2025-08-11 03:50:25 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 03:39:44.787052529 (58h13m25.518320159s) [upload=60677]: Starting upload Aug 11 03:39:44.787099497 (58h13m25.518367127s) [upload=60677]: Done starting upload Aug 11 03:39:44.787190667 (58h13m25.518458307s) [upload=60677]: Uploading segments... Aug 11 03:39:44.787259876 (58h13m25.518527516s) [upload=60677]: Got next segment. Inline: true Aug 11 03:39:44.787267310 (58h13m25.51853495s) [upload=60677]: Waiting for error group managing segments... Aug 11 03:39:44.787313006 (58h13m25.518580636s) [upload=60677]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 03:39:44.787318195 (58h13m25.518585835s) [upload=60677]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 03:39:44.787321211 (58h13m25.518588851s) [upload=60677]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 03:39:44.789990514 (58h13m25.521258155s) [upload=60677]: Done uploading segments... Aug 11 03:39:44.790008027 (58h13m25.521275668s) [upload=60677]: Upload finished. err: metaclient: Too Many Requests
Duration: 154.103004ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
883.588413ms
FAIL (2025-08-11 03:49:53 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 03:19:55.139806021 (57h53m35.871073671s) [upload=60328]: Starting upload Aug 11 03:19:55.139875520 (57h53m35.87114317s) [upload=60328]: Done starting upload Aug 11 03:19:55.139987489 (57h53m35.871255139s) [upload=60328]: Uploading segments... Aug 11 03:19:55.140403776 (57h53m35.871671426s) [upload=60328]: Got next segment. Inline: false Aug 11 03:19:55.140455613 (57h53m35.871723263s) [upload=60328]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 03:19:55.140461725 (57h53m35.871729374s) [upload=60328]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 03:19:55.153099918 (57h53m35.884367568s) [upload=60328]: Next segment err: metaclient: Too Many Requests Aug 11 03:19:55.153120145 (57h53m35.884387796s) [upload=60328]: Done uploading segments... Aug 11 03:19:55.153136455 (57h53m35.884404105s) [upload=60328]: Upload finished. err: metaclient: Too Many Requests
Duration: 883.616747ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|