Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
569.961794ms
FAIL (2025-08-10 16:11:29 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 16:01:08.025518856 (46h34m48.756786475s) [upload=48496]: Starting upload Aug 10 16:01:08.025590799 (46h34m48.75685842s) [upload=48496]: Done starting upload Aug 10 16:01:08.025660299 (46h34m48.75692792s) [upload=48496]: Uploading segments... Aug 10 16:01:08.025898604 (46h34m48.757166263s) [upload=48496]: Got next segment. Inline: false Aug 10 16:01:08.025951603 (46h34m48.757219223s) [upload=48496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 16:01:08.025958816 (46h34m48.757226456s) [upload=48496]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 16:01:08.029040750 (46h34m48.760308369s) [upload=48496]: Next segment err: metaclient: Too Many Requests Aug 10 16:01:08.029054876 (46h34m48.760322506s) [upload=48496]: Done uploading segments... Aug 10 16:01:08.029067099 (46h34m48.760334719s) [upload=48496]: Upload finished. err: metaclient: Too Many Requests
Duration: 569.988223ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....X....X..................................................] duration:
139.950248ms
FAIL (2025-08-10 16:11:16 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 15:37:14.062718051 (46h10m54.793985702s) [upload=48086]: Starting upload Aug 10 15:37:14.062837083 (46h10m54.794104734s) [upload=48086]: Done starting upload Aug 10 15:37:14.062979950 (46h10m54.794247601s) [upload=48086]: Uploading segments... Aug 10 15:37:14.063042687 (46h10m54.794310417s) [upload=48086]: Got next segment. Inline: true Aug 10 15:37:14.063052335 (46h10m54.794319985s) [upload=48086]: Waiting for error group managing segments... Aug 10 15:37:14.063101798 (46h10m54.794369448s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 15:37:14.063107228 (46h10m54.794374878s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 15:37:14.063110825 (46h10m54.794378475s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 15:37:14.065912845 (46h10m54.797180506s) [upload=48086]: Done uploading segments... Aug 10 15:37:14.065928184 (46h10m54.797195834s) [upload=48086]: Upload finished. err: metaclient: Too Many Requests
Duration: 139.97886ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
504.441642ms
FAIL (2025-08-10 16:11:04 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 16:01:08.025518856 (46h34m48.756786475s) [upload=48496]: Starting upload Aug 10 16:01:08.025590799 (46h34m48.75685842s) [upload=48496]: Done starting upload Aug 10 16:01:08.025660299 (46h34m48.75692792s) [upload=48496]: Uploading segments... Aug 10 16:01:08.025898604 (46h34m48.757166263s) [upload=48496]: Got next segment. Inline: false Aug 10 16:01:08.025951603 (46h34m48.757219223s) [upload=48496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 16:01:08.025958816 (46h34m48.757226456s) [upload=48496]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 16:01:08.029040750 (46h34m48.760308369s) [upload=48496]: Next segment err: metaclient: Too Many Requests Aug 10 16:01:08.029054876 (46h34m48.760322506s) [upload=48496]: Done uploading segments... Aug 10 16:01:08.029067099 (46h34m48.760334719s) [upload=48496]: Upload finished. err: metaclient: Too Many Requests
Duration: 504.461349ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....X....X.................................................] duration:
283.740454ms
FAIL (2025-08-10 16:10:15 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 15:37:14.062718051 (46h10m54.793985702s) [upload=48086]: Starting upload Aug 10 15:37:14.062837083 (46h10m54.794104734s) [upload=48086]: Done starting upload Aug 10 15:37:14.062979950 (46h10m54.794247601s) [upload=48086]: Uploading segments... Aug 10 15:37:14.063042687 (46h10m54.794310417s) [upload=48086]: Got next segment. Inline: true Aug 10 15:37:14.063052335 (46h10m54.794319985s) [upload=48086]: Waiting for error group managing segments... Aug 10 15:37:14.063101798 (46h10m54.794369448s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 15:37:14.063107228 (46h10m54.794374878s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 15:37:14.063110825 (46h10m54.794378475s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 15:37:14.065912845 (46h10m54.797180506s) [upload=48086]: Done uploading segments... Aug 10 15:37:14.065928184 (46h10m54.797195834s) [upload=48086]: Upload finished. err: metaclient: Too Many Requests
Duration: 283.754018ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
379.25314ms
FAIL (2025-08-10 16:10:14 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 16:01:08.025518856 (46h34m48.756786475s) [upload=48496]: Starting upload Aug 10 16:01:08.025590799 (46h34m48.75685842s) [upload=48496]: Done starting upload Aug 10 16:01:08.025660299 (46h34m48.75692792s) [upload=48496]: Uploading segments... Aug 10 16:01:08.025898604 (46h34m48.757166263s) [upload=48496]: Got next segment. Inline: false Aug 10 16:01:08.025951603 (46h34m48.757219223s) [upload=48496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 16:01:08.025958816 (46h34m48.757226456s) [upload=48496]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 16:01:08.029040750 (46h34m48.760308369s) [upload=48496]: Next segment err: metaclient: Too Many Requests Aug 10 16:01:08.029054876 (46h34m48.760322506s) [upload=48496]: Done uploading segments... Aug 10 16:01:08.029067099 (46h34m48.760334719s) [upload=48496]: Upload finished. err: metaclient: Too Many Requests
Duration: 379.271725ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......X....X................................................] duration:
163.58241ms
FAIL (2025-08-10 16:09:18 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 15:37:14.062718051 (46h10m54.793985702s) [upload=48086]: Starting upload Aug 10 15:37:14.062837083 (46h10m54.794104734s) [upload=48086]: Done starting upload Aug 10 15:37:14.062979950 (46h10m54.794247601s) [upload=48086]: Uploading segments... Aug 10 15:37:14.063042687 (46h10m54.794310417s) [upload=48086]: Got next segment. Inline: true Aug 10 15:37:14.063052335 (46h10m54.794319985s) [upload=48086]: Waiting for error group managing segments... Aug 10 15:37:14.063101798 (46h10m54.794369448s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 15:37:14.063107228 (46h10m54.794374878s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 15:37:14.063110825 (46h10m54.794378475s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 15:37:14.065912845 (46h10m54.797180506s) [upload=48086]: Done uploading segments... Aug 10 15:37:14.065928184 (46h10m54.797195834s) [upload=48086]: Upload finished. err: metaclient: Too Many Requests
Duration: 163.607347ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
375.949684ms
FAIL (2025-08-10 16:09:16 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 16:01:08.025518856 (46h34m48.756786475s) [upload=48496]: Starting upload Aug 10 16:01:08.025590799 (46h34m48.75685842s) [upload=48496]: Done starting upload Aug 10 16:01:08.025660299 (46h34m48.75692792s) [upload=48496]: Uploading segments... Aug 10 16:01:08.025898604 (46h34m48.757166263s) [upload=48496]: Got next segment. Inline: false Aug 10 16:01:08.025951603 (46h34m48.757219223s) [upload=48496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 16:01:08.025958816 (46h34m48.757226456s) [upload=48496]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 16:01:08.029040750 (46h34m48.760308369s) [upload=48496]: Next segment err: metaclient: Too Many Requests Aug 10 16:01:08.029054876 (46h34m48.760322506s) [upload=48496]: Done uploading segments... Aug 10 16:01:08.029067099 (46h34m48.760334719s) [upload=48496]: Upload finished. err: metaclient: Too Many Requests
Duration: 375.980371ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
427.617929ms
FAIL (2025-08-10 16:08:30 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 16:01:08.025518856 (46h34m48.756786475s) [upload=48496]: Starting upload Aug 10 16:01:08.025590799 (46h34m48.75685842s) [upload=48496]: Done starting upload Aug 10 16:01:08.025660299 (46h34m48.75692792s) [upload=48496]: Uploading segments... Aug 10 16:01:08.025898604 (46h34m48.757166263s) [upload=48496]: Got next segment. Inline: false Aug 10 16:01:08.025951603 (46h34m48.757219223s) [upload=48496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 16:01:08.025958816 (46h34m48.757226456s) [upload=48496]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 16:01:08.029040750 (46h34m48.760308369s) [upload=48496]: Next segment err: metaclient: Too Many Requests Aug 10 16:01:08.029054876 (46h34m48.760322506s) [upload=48496]: Done uploading segments... Aug 10 16:01:08.029067099 (46h34m48.760334719s) [upload=48496]: Upload finished. err: metaclient: Too Many Requests
Duration: 427.641403ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......X....X...............................................] duration:
184.846312ms
FAIL (2025-08-10 16:08:07 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 15:37:14.062718051 (46h10m54.793985702s) [upload=48086]: Starting upload Aug 10 15:37:14.062837083 (46h10m54.794104734s) [upload=48086]: Done starting upload Aug 10 15:37:14.062979950 (46h10m54.794247601s) [upload=48086]: Uploading segments... Aug 10 15:37:14.063042687 (46h10m54.794310417s) [upload=48086]: Got next segment. Inline: true Aug 10 15:37:14.063052335 (46h10m54.794319985s) [upload=48086]: Waiting for error group managing segments... Aug 10 15:37:14.063101798 (46h10m54.794369448s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 15:37:14.063107228 (46h10m54.794374878s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 15:37:14.063110825 (46h10m54.794378475s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 15:37:14.065912845 (46h10m54.797180506s) [upload=48086]: Done uploading segments... Aug 10 15:37:14.065928184 (46h10m54.797195834s) [upload=48086]: Upload finished. err: metaclient: Too Many Requests
Duration: 184.86733ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
506.853824ms
FAIL (2025-08-10 16:07:59 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 16:01:08.025518856 (46h34m48.756786475s) [upload=48496]: Starting upload Aug 10 16:01:08.025590799 (46h34m48.75685842s) [upload=48496]: Done starting upload Aug 10 16:01:08.025660299 (46h34m48.75692792s) [upload=48496]: Uploading segments... Aug 10 16:01:08.025898604 (46h34m48.757166263s) [upload=48496]: Got next segment. Inline: false Aug 10 16:01:08.025951603 (46h34m48.757219223s) [upload=48496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 16:01:08.025958816 (46h34m48.757226456s) [upload=48496]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 16:01:08.029040750 (46h34m48.760308369s) [upload=48496]: Next segment err: metaclient: Too Many Requests Aug 10 16:01:08.029054876 (46h34m48.760322506s) [upload=48496]: Done uploading segments... Aug 10 16:01:08.029067099 (46h34m48.760334719s) [upload=48496]: Upload finished. err: metaclient: Too Many Requests
Duration: 506.885283ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
785.370322ms
FAIL (2025-08-10 16:07:42 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 16:01:08.025518856 (46h34m48.756786475s) [upload=48496]: Starting upload Aug 10 16:01:08.025590799 (46h34m48.75685842s) [upload=48496]: Done starting upload Aug 10 16:01:08.025660299 (46h34m48.75692792s) [upload=48496]: Uploading segments... Aug 10 16:01:08.025898604 (46h34m48.757166263s) [upload=48496]: Got next segment. Inline: false Aug 10 16:01:08.025951603 (46h34m48.757219223s) [upload=48496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 16:01:08.025958816 (46h34m48.757226456s) [upload=48496]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 16:01:08.029040750 (46h34m48.760308369s) [upload=48496]: Next segment err: metaclient: Too Many Requests Aug 10 16:01:08.029054876 (46h34m48.760322506s) [upload=48496]: Done uploading segments... Aug 10 16:01:08.029067099 (46h34m48.760334719s) [upload=48496]: Upload finished. err: metaclient: Too Many Requests
Duration: 785.397283ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........X....X..............................................] duration:
175.776302ms
FAIL (2025-08-10 16:07:00 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 15:37:14.062718051 (46h10m54.793985702s) [upload=48086]: Starting upload Aug 10 15:37:14.062837083 (46h10m54.794104734s) [upload=48086]: Done starting upload Aug 10 15:37:14.062979950 (46h10m54.794247601s) [upload=48086]: Uploading segments... Aug 10 15:37:14.063042687 (46h10m54.794310417s) [upload=48086]: Got next segment. Inline: true Aug 10 15:37:14.063052335 (46h10m54.794319985s) [upload=48086]: Waiting for error group managing segments... Aug 10 15:37:14.063101798 (46h10m54.794369448s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 15:37:14.063107228 (46h10m54.794374878s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 15:37:14.063110825 (46h10m54.794378475s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 15:37:14.065912845 (46h10m54.797180506s) [upload=48086]: Done uploading segments... Aug 10 15:37:14.065928184 (46h10m54.797195834s) [upload=48086]: Upload finished. err: metaclient: Too Many Requests
Duration: 175.800697ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
453.69665ms
FAIL (2025-08-10 16:06:29 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 16:01:08.025518856 (46h34m48.756786475s) [upload=48496]: Starting upload Aug 10 16:01:08.025590799 (46h34m48.75685842s) [upload=48496]: Done starting upload Aug 10 16:01:08.025660299 (46h34m48.75692792s) [upload=48496]: Uploading segments... Aug 10 16:01:08.025898604 (46h34m48.757166263s) [upload=48496]: Got next segment. Inline: false Aug 10 16:01:08.025951603 (46h34m48.757219223s) [upload=48496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 16:01:08.025958816 (46h34m48.757226456s) [upload=48496]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 16:01:08.029040750 (46h34m48.760308369s) [upload=48496]: Next segment err: metaclient: Too Many Requests Aug 10 16:01:08.029054876 (46h34m48.760322506s) [upload=48496]: Done uploading segments... Aug 10 16:01:08.029067099 (46h34m48.760334719s) [upload=48496]: Upload finished. err: metaclient: Too Many Requests
Duration: 453.722328ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........X....X.............................................] duration:
881.925156ms
FAIL (2025-08-10 16:06:08 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 15:37:14.062718051 (46h10m54.793985702s) [upload=48086]: Starting upload Aug 10 15:37:14.062837083 (46h10m54.794104734s) [upload=48086]: Done starting upload Aug 10 15:37:14.062979950 (46h10m54.794247601s) [upload=48086]: Uploading segments... Aug 10 15:37:14.063042687 (46h10m54.794310417s) [upload=48086]: Got next segment. Inline: true Aug 10 15:37:14.063052335 (46h10m54.794319985s) [upload=48086]: Waiting for error group managing segments... Aug 10 15:37:14.063101798 (46h10m54.794369448s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 15:37:14.063107228 (46h10m54.794374878s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 15:37:14.063110825 (46h10m54.794378475s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 15:37:14.065912845 (46h10m54.797180506s) [upload=48086]: Done uploading segments... Aug 10 15:37:14.065928184 (46h10m54.797195834s) [upload=48086]: Upload finished. err: metaclient: Too Many Requests
Duration: 881.942549ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
424.108028ms
FAIL (2025-08-10 16:05:48 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 16:01:08.025518856 (46h34m48.756786475s) [upload=48496]: Starting upload Aug 10 16:01:08.025590799 (46h34m48.75685842s) [upload=48496]: Done starting upload Aug 10 16:01:08.025660299 (46h34m48.75692792s) [upload=48496]: Uploading segments... Aug 10 16:01:08.025898604 (46h34m48.757166263s) [upload=48496]: Got next segment. Inline: false Aug 10 16:01:08.025951603 (46h34m48.757219223s) [upload=48496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 16:01:08.025958816 (46h34m48.757226456s) [upload=48496]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 16:01:08.029040750 (46h34m48.760308369s) [upload=48496]: Next segment err: metaclient: Too Many Requests Aug 10 16:01:08.029054876 (46h34m48.760322506s) [upload=48496]: Done uploading segments... Aug 10 16:01:08.029067099 (46h34m48.760334719s) [upload=48496]: Upload finished. err: metaclient: Too Many Requests
Duration: 424.14028ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........X....X............................................] duration:
189.14173ms
FAIL (2025-08-10 16:04:53 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 15:37:14.062718051 (46h10m54.793985702s) [upload=48086]: Starting upload Aug 10 15:37:14.062837083 (46h10m54.794104734s) [upload=48086]: Done starting upload Aug 10 15:37:14.062979950 (46h10m54.794247601s) [upload=48086]: Uploading segments... Aug 10 15:37:14.063042687 (46h10m54.794310417s) [upload=48086]: Got next segment. Inline: true Aug 10 15:37:14.063052335 (46h10m54.794319985s) [upload=48086]: Waiting for error group managing segments... Aug 10 15:37:14.063101798 (46h10m54.794369448s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 15:37:14.063107228 (46h10m54.794374878s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 15:37:14.063110825 (46h10m54.794378475s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 15:37:14.065912845 (46h10m54.797180506s) [upload=48086]: Done uploading segments... Aug 10 15:37:14.065928184 (46h10m54.797195834s) [upload=48086]: Upload finished. err: metaclient: Too Many Requests
Duration: 189.165814ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
474.225308ms
FAIL (2025-08-10 16:04:39 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 16:01:08.025518856 (46h34m48.756786475s) [upload=48496]: Starting upload Aug 10 16:01:08.025590799 (46h34m48.75685842s) [upload=48496]: Done starting upload Aug 10 16:01:08.025660299 (46h34m48.75692792s) [upload=48496]: Uploading segments... Aug 10 16:01:08.025898604 (46h34m48.757166263s) [upload=48496]: Got next segment. Inline: false Aug 10 16:01:08.025951603 (46h34m48.757219223s) [upload=48496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 16:01:08.025958816 (46h34m48.757226456s) [upload=48496]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 16:01:08.029040750 (46h34m48.760308369s) [upload=48496]: Next segment err: metaclient: Too Many Requests Aug 10 16:01:08.029054876 (46h34m48.760322506s) [upload=48496]: Done uploading segments... Aug 10 16:01:08.029067099 (46h34m48.760334719s) [upload=48496]: Upload finished. err: metaclient: Too Many Requests
Duration: 474.247239ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [X..........X....X...........................................] duration:
221.625294ms
FAIL (2025-08-10 16:04:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 15:37:14.062718051 (46h10m54.793985702s) [upload=48086]: Starting upload Aug 10 15:37:14.062837083 (46h10m54.794104734s) [upload=48086]: Done starting upload Aug 10 15:37:14.062979950 (46h10m54.794247601s) [upload=48086]: Uploading segments... Aug 10 15:37:14.063042687 (46h10m54.794310417s) [upload=48086]: Got next segment. Inline: true Aug 10 15:37:14.063052335 (46h10m54.794319985s) [upload=48086]: Waiting for error group managing segments... Aug 10 15:37:14.063101798 (46h10m54.794369448s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 15:37:14.063107228 (46h10m54.794374878s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 15:37:14.063110825 (46h10m54.794378475s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 15:37:14.065912845 (46h10m54.797180506s) [upload=48086]: Done uploading segments... Aug 10 15:37:14.065928184 (46h10m54.797195834s) [upload=48086]: Upload finished. err: metaclient: Too Many Requests
Duration: 221.651724ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.X..........X....X..........................................] duration:
161.593488ms
FAIL (2025-08-10 16:03:57 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 15:37:14.062718051 (46h10m54.793985702s) [upload=48086]: Starting upload Aug 10 15:37:14.062837083 (46h10m54.794104734s) [upload=48086]: Done starting upload Aug 10 15:37:14.062979950 (46h10m54.794247601s) [upload=48086]: Uploading segments... Aug 10 15:37:14.063042687 (46h10m54.794310417s) [upload=48086]: Got next segment. Inline: true Aug 10 15:37:14.063052335 (46h10m54.794319985s) [upload=48086]: Waiting for error group managing segments... Aug 10 15:37:14.063101798 (46h10m54.794369448s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 15:37:14.063107228 (46h10m54.794374878s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 15:37:14.063110825 (46h10m54.794378475s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 15:37:14.065912845 (46h10m54.797180506s) [upload=48086]: Done uploading segments... Aug 10 15:37:14.065928184 (46h10m54.797195834s) [upload=48086]: Upload finished. err: metaclient: Too Many Requests
Duration: 161.612312ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
440.268694ms
FAIL (2025-08-10 16:03:52 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 16:01:08.025518856 (46h34m48.756786475s) [upload=48496]: Starting upload Aug 10 16:01:08.025590799 (46h34m48.75685842s) [upload=48496]: Done starting upload Aug 10 16:01:08.025660299 (46h34m48.75692792s) [upload=48496]: Uploading segments... Aug 10 16:01:08.025898604 (46h34m48.757166263s) [upload=48496]: Got next segment. Inline: false Aug 10 16:01:08.025951603 (46h34m48.757219223s) [upload=48496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 16:01:08.025958816 (46h34m48.757226456s) [upload=48496]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 16:01:08.029040750 (46h34m48.760308369s) [upload=48496]: Next segment err: metaclient: Too Many Requests Aug 10 16:01:08.029054876 (46h34m48.760322506s) [upload=48496]: Done uploading segments... Aug 10 16:01:08.029067099 (46h34m48.760334719s) [upload=48496]: Upload finished. err: metaclient: Too Many Requests
Duration: 440.29912ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..X..........X....X.........................................] duration:
162.450807ms
FAIL (2025-08-10 16:03:27 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 15:37:14.062718051 (46h10m54.793985702s) [upload=48086]: Starting upload Aug 10 15:37:14.062837083 (46h10m54.794104734s) [upload=48086]: Done starting upload Aug 10 15:37:14.062979950 (46h10m54.794247601s) [upload=48086]: Uploading segments... Aug 10 15:37:14.063042687 (46h10m54.794310417s) [upload=48086]: Got next segment. Inline: true Aug 10 15:37:14.063052335 (46h10m54.794319985s) [upload=48086]: Waiting for error group managing segments... Aug 10 15:37:14.063101798 (46h10m54.794369448s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 15:37:14.063107228 (46h10m54.794374878s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 15:37:14.063110825 (46h10m54.794378475s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 15:37:14.065912845 (46h10m54.797180506s) [upload=48086]: Done uploading segments... Aug 10 15:37:14.065928184 (46h10m54.797195834s) [upload=48086]: Upload finished. err: metaclient: Too Many Requests
Duration: 162.482837ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...X..........X....X........................................] duration:
419.154481ms
FAIL (2025-08-10 16:02:55 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 15:37:14.062718051 (46h10m54.793985702s) [upload=48086]: Starting upload Aug 10 15:37:14.062837083 (46h10m54.794104734s) [upload=48086]: Done starting upload Aug 10 15:37:14.062979950 (46h10m54.794247601s) [upload=48086]: Uploading segments... Aug 10 15:37:14.063042687 (46h10m54.794310417s) [upload=48086]: Got next segment. Inline: true Aug 10 15:37:14.063052335 (46h10m54.794319985s) [upload=48086]: Waiting for error group managing segments... Aug 10 15:37:14.063101798 (46h10m54.794369448s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 15:37:14.063107228 (46h10m54.794374878s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 15:37:14.063110825 (46h10m54.794378475s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 15:37:14.065912845 (46h10m54.797180506s) [upload=48086]: Done uploading segments... Aug 10 15:37:14.065928184 (46h10m54.797195834s) [upload=48086]: Upload finished. err: metaclient: Too Many Requests
Duration: 419.169559ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
525.074856ms
FAIL (2025-08-10 16:02:38 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 16:01:08.025518856 (46h34m48.756786475s) [upload=48496]: Starting upload Aug 10 16:01:08.025590799 (46h34m48.75685842s) [upload=48496]: Done starting upload Aug 10 16:01:08.025660299 (46h34m48.75692792s) [upload=48496]: Uploading segments... Aug 10 16:01:08.025898604 (46h34m48.757166263s) [upload=48496]: Got next segment. Inline: false Aug 10 16:01:08.025951603 (46h34m48.757219223s) [upload=48496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 16:01:08.025958816 (46h34m48.757226456s) [upload=48496]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 16:01:08.029040750 (46h34m48.760308369s) [upload=48496]: Next segment err: metaclient: Too Many Requests Aug 10 16:01:08.029054876 (46h34m48.760322506s) [upload=48496]: Done uploading segments... Aug 10 16:01:08.029067099 (46h34m48.760334719s) [upload=48496]: Upload finished. err: metaclient: Too Many Requests
Duration: 525.090566ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....X..........X....X.......................................] duration:
215.195912ms
FAIL (2025-08-10 16:02:16 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 15:37:14.062718051 (46h10m54.793985702s) [upload=48086]: Starting upload Aug 10 15:37:14.062837083 (46h10m54.794104734s) [upload=48086]: Done starting upload Aug 10 15:37:14.062979950 (46h10m54.794247601s) [upload=48086]: Uploading segments... Aug 10 15:37:14.063042687 (46h10m54.794310417s) [upload=48086]: Got next segment. Inline: true Aug 10 15:37:14.063052335 (46h10m54.794319985s) [upload=48086]: Waiting for error group managing segments... Aug 10 15:37:14.063101798 (46h10m54.794369448s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 15:37:14.063107228 (46h10m54.794374878s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 15:37:14.063110825 (46h10m54.794378475s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 15:37:14.065912845 (46h10m54.797180506s) [upload=48086]: Done uploading segments... Aug 10 15:37:14.065928184 (46h10m54.797195834s) [upload=48086]: Upload finished. err: metaclient: Too Many Requests
Duration: 215.22241ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
646.510131ms
FAIL (2025-08-10 16:01:35 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 16:01:08.025518856 (46h34m48.756786475s) [upload=48496]: Starting upload Aug 10 16:01:08.025590799 (46h34m48.75685842s) [upload=48496]: Done starting upload Aug 10 16:01:08.025660299 (46h34m48.75692792s) [upload=48496]: Uploading segments... Aug 10 16:01:08.025898604 (46h34m48.757166263s) [upload=48496]: Got next segment. Inline: false Aug 10 16:01:08.025951603 (46h34m48.757219223s) [upload=48496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 16:01:08.025958816 (46h34m48.757226456s) [upload=48496]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 16:01:08.029040750 (46h34m48.760308369s) [upload=48496]: Next segment err: metaclient: Too Many Requests Aug 10 16:01:08.029054876 (46h34m48.760322506s) [upload=48496]: Done uploading segments... Aug 10 16:01:08.029067099 (46h34m48.760334719s) [upload=48496]: Upload finished. err: metaclient: Too Many Requests
Duration: 646.539074ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....X..........X....X......................................] duration:
174.262476ms
FAIL (2025-08-10 16:01:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 15:37:14.062718051 (46h10m54.793985702s) [upload=48086]: Starting upload Aug 10 15:37:14.062837083 (46h10m54.794104734s) [upload=48086]: Done starting upload Aug 10 15:37:14.062979950 (46h10m54.794247601s) [upload=48086]: Uploading segments... Aug 10 15:37:14.063042687 (46h10m54.794310417s) [upload=48086]: Got next segment. Inline: true Aug 10 15:37:14.063052335 (46h10m54.794319985s) [upload=48086]: Waiting for error group managing segments... Aug 10 15:37:14.063101798 (46h10m54.794369448s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 15:37:14.063107228 (46h10m54.794374878s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 15:37:14.063110825 (46h10m54.794378475s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 15:37:14.065912845 (46h10m54.797180506s) [upload=48086]: Done uploading segments... Aug 10 15:37:14.065928184 (46h10m54.797195834s) [upload=48086]: Upload finished. err: metaclient: Too Many Requests
Duration: 174.279277ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
19.177358ms
FAIL (2025-08-10 16:01:08 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 16:01:08.025518856 (46h34m48.756786475s) [upload=48496]: Starting upload Aug 10 16:01:08.025590799 (46h34m48.75685842s) [upload=48496]: Done starting upload Aug 10 16:01:08.025660299 (46h34m48.75692792s) [upload=48496]: Uploading segments... Aug 10 16:01:08.025898604 (46h34m48.757166263s) [upload=48496]: Got next segment. Inline: false Aug 10 16:01:08.025951603 (46h34m48.757219223s) [upload=48496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 16:01:08.025958816 (46h34m48.757226456s) [upload=48496]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 16:01:08.029040750 (46h34m48.760308369s) [upload=48496]: Next segment err: metaclient: Too Many Requests Aug 10 16:01:08.029054876 (46h34m48.760322506s) [upload=48496]: Done uploading segments... Aug 10 16:01:08.029067099 (46h34m48.760334719s) [upload=48496]: Upload finished. err: metaclient: Too Many Requests
Duration: 19.195122ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [......X..........X....X.....................................] duration:
150.691146ms
FAIL (2025-08-10 16:00:59 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 15:37:14.062718051 (46h10m54.793985702s) [upload=48086]: Starting upload Aug 10 15:37:14.062837083 (46h10m54.794104734s) [upload=48086]: Done starting upload Aug 10 15:37:14.062979950 (46h10m54.794247601s) [upload=48086]: Uploading segments... Aug 10 15:37:14.063042687 (46h10m54.794310417s) [upload=48086]: Got next segment. Inline: true Aug 10 15:37:14.063052335 (46h10m54.794319985s) [upload=48086]: Waiting for error group managing segments... Aug 10 15:37:14.063101798 (46h10m54.794369448s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 15:37:14.063107228 (46h10m54.794374878s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 15:37:14.063110825 (46h10m54.794378475s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 15:37:14.065912845 (46h10m54.797180506s) [upload=48086]: Done uploading segments... Aug 10 15:37:14.065928184 (46h10m54.797195834s) [upload=48086]: Upload finished. err: metaclient: Too Many Requests
Duration: 150.747532ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.......X..........X....X....................................] duration:
561.28614ms
FAIL (2025-08-10 16:00:13 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 15:37:14.062718051 (46h10m54.793985702s) [upload=48086]: Starting upload Aug 10 15:37:14.062837083 (46h10m54.794104734s) [upload=48086]: Done starting upload Aug 10 15:37:14.062979950 (46h10m54.794247601s) [upload=48086]: Uploading segments... Aug 10 15:37:14.063042687 (46h10m54.794310417s) [upload=48086]: Got next segment. Inline: true Aug 10 15:37:14.063052335 (46h10m54.794319985s) [upload=48086]: Waiting for error group managing segments... Aug 10 15:37:14.063101798 (46h10m54.794369448s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 15:37:14.063107228 (46h10m54.794374878s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 15:37:14.063110825 (46h10m54.794378475s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 15:37:14.065912845 (46h10m54.797180506s) [upload=48086]: Done uploading segments... Aug 10 15:37:14.065928184 (46h10m54.797195834s) [upload=48086]: Upload finished. err: metaclient: Too Many Requests
Duration: 561.311578ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [........X..........X....X...................................] duration:
166.419034ms
FAIL (2025-08-10 15:59:47 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 15:37:14.062718051 (46h10m54.793985702s) [upload=48086]: Starting upload Aug 10 15:37:14.062837083 (46h10m54.794104734s) [upload=48086]: Done starting upload Aug 10 15:37:14.062979950 (46h10m54.794247601s) [upload=48086]: Uploading segments... Aug 10 15:37:14.063042687 (46h10m54.794310417s) [upload=48086]: Got next segment. Inline: true Aug 10 15:37:14.063052335 (46h10m54.794319985s) [upload=48086]: Waiting for error group managing segments... Aug 10 15:37:14.063101798 (46h10m54.794369448s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 15:37:14.063107228 (46h10m54.794374878s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 15:37:14.063110825 (46h10m54.794378475s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 15:37:14.065912845 (46h10m54.797180506s) [upload=48086]: Done uploading segments... Aug 10 15:37:14.065928184 (46h10m54.797195834s) [upload=48086]: Upload finished. err: metaclient: Too Many Requests
Duration: 166.442779ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.........X..........X....X..................................] duration:
215.321198ms
FAIL (2025-08-10 15:58:48 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 15:37:14.062718051 (46h10m54.793985702s) [upload=48086]: Starting upload Aug 10 15:37:14.062837083 (46h10m54.794104734s) [upload=48086]: Done starting upload Aug 10 15:37:14.062979950 (46h10m54.794247601s) [upload=48086]: Uploading segments... Aug 10 15:37:14.063042687 (46h10m54.794310417s) [upload=48086]: Got next segment. Inline: true Aug 10 15:37:14.063052335 (46h10m54.794319985s) [upload=48086]: Waiting for error group managing segments... Aug 10 15:37:14.063101798 (46h10m54.794369448s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 15:37:14.063107228 (46h10m54.794374878s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 15:37:14.063110825 (46h10m54.794378475s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 15:37:14.065912845 (46h10m54.797180506s) [upload=48086]: Done uploading segments... Aug 10 15:37:14.065928184 (46h10m54.797195834s) [upload=48086]: Upload finished. err: metaclient: Too Many Requests
Duration: 215.341186ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..........X..........X....X.................................] duration:
147.774242ms
FAIL (2025-08-10 15:57:57 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 15:37:14.062718051 (46h10m54.793985702s) [upload=48086]: Starting upload Aug 10 15:37:14.062837083 (46h10m54.794104734s) [upload=48086]: Done starting upload Aug 10 15:37:14.062979950 (46h10m54.794247601s) [upload=48086]: Uploading segments... Aug 10 15:37:14.063042687 (46h10m54.794310417s) [upload=48086]: Got next segment. Inline: true Aug 10 15:37:14.063052335 (46h10m54.794319985s) [upload=48086]: Waiting for error group managing segments... Aug 10 15:37:14.063101798 (46h10m54.794369448s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 15:37:14.063107228 (46h10m54.794374878s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 15:37:14.063110825 (46h10m54.794378475s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 15:37:14.065912845 (46h10m54.797180506s) [upload=48086]: Done uploading segments... Aug 10 15:37:14.065928184 (46h10m54.797195834s) [upload=48086]: Upload finished. err: metaclient: Too Many Requests
Duration: 147.791985ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...........X..........X....X................................] duration:
331.274721ms
FAIL (2025-08-10 15:57:28 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 15:37:14.062718051 (46h10m54.793985702s) [upload=48086]: Starting upload Aug 10 15:37:14.062837083 (46h10m54.794104734s) [upload=48086]: Done starting upload Aug 10 15:37:14.062979950 (46h10m54.794247601s) [upload=48086]: Uploading segments... Aug 10 15:37:14.063042687 (46h10m54.794310417s) [upload=48086]: Got next segment. Inline: true Aug 10 15:37:14.063052335 (46h10m54.794319985s) [upload=48086]: Waiting for error group managing segments... Aug 10 15:37:14.063101798 (46h10m54.794369448s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 15:37:14.063107228 (46h10m54.794374878s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 15:37:14.063110825 (46h10m54.794378475s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 15:37:14.065912845 (46h10m54.797180506s) [upload=48086]: Done uploading segments... Aug 10 15:37:14.065928184 (46h10m54.797195834s) [upload=48086]: Upload finished. err: metaclient: Too Many Requests
Duration: 331.315498ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [............X..........X....X...............................] duration:
348.571016ms
FAIL (2025-08-10 15:57:05 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 15:37:14.062718051 (46h10m54.793985702s) [upload=48086]: Starting upload Aug 10 15:37:14.062837083 (46h10m54.794104734s) [upload=48086]: Done starting upload Aug 10 15:37:14.062979950 (46h10m54.794247601s) [upload=48086]: Uploading segments... Aug 10 15:37:14.063042687 (46h10m54.794310417s) [upload=48086]: Got next segment. Inline: true Aug 10 15:37:14.063052335 (46h10m54.794319985s) [upload=48086]: Waiting for error group managing segments... Aug 10 15:37:14.063101798 (46h10m54.794369448s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 15:37:14.063107228 (46h10m54.794374878s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 15:37:14.063110825 (46h10m54.794378475s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 15:37:14.065912845 (46h10m54.797180506s) [upload=48086]: Done uploading segments... Aug 10 15:37:14.065928184 (46h10m54.797195834s) [upload=48086]: Upload finished. err: metaclient: Too Many Requests
Duration: 348.593529ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.............X..........X....X..............................] duration:
182.28619ms
FAIL (2025-08-10 15:56:20 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 15:37:14.062718051 (46h10m54.793985702s) [upload=48086]: Starting upload Aug 10 15:37:14.062837083 (46h10m54.794104734s) [upload=48086]: Done starting upload Aug 10 15:37:14.062979950 (46h10m54.794247601s) [upload=48086]: Uploading segments... Aug 10 15:37:14.063042687 (46h10m54.794310417s) [upload=48086]: Got next segment. Inline: true Aug 10 15:37:14.063052335 (46h10m54.794319985s) [upload=48086]: Waiting for error group managing segments... Aug 10 15:37:14.063101798 (46h10m54.794369448s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 15:37:14.063107228 (46h10m54.794374878s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 15:37:14.063110825 (46h10m54.794378475s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 15:37:14.065912845 (46h10m54.797180506s) [upload=48086]: Done uploading segments... Aug 10 15:37:14.065928184 (46h10m54.797195834s) [upload=48086]: Upload finished. err: metaclient: Too Many Requests
Duration: 182.31245ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
421.341926ms
FAIL (2025-08-10 15:56:17 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 10 15:09:59.787351700 (45h43m40.518619349s) [upload=47611]: Starting upload
Aug 10 15:09:59.787411981 (45h43m40.518679632s) [upload=47611]: Done starting upload
Aug 10 15:09:59.787658021 (45h43m40.518925681s) [upload=47611]: Uploading segments...
Aug 10 15:09:59.788012333 (45h43m40.519279982s) [upload=47611]: Got next segment. Inline: false
Aug 10 15:09:59.788100537 (45h43m40.519368187s) [upload=47611]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 15:09:59.788109734 (45h43m40.519377394s) [upload=47611]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 15:09:59.818839786 (45h43m40.550107435s) [seg_pos={0 0}, upload=47611]: Begin upload segment...
Aug 10 15:09:59.818880411 (45h43m40.550148062s) [seg_pos={0 0}, upload=47611]: Done begin upload segment.
Aug 10 15:09:59.818939441 (45h43m40.550207091s) [noise=true , address=104.36.82.3:4784 , piece_id=M3O5MSFKJR6JV7WNZFVBYIUANN7C4CJ6HOFFHK3MCAUC3KBFXJZA, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.818961633 (45h43m40.550229283s) [noise=true , address=104.36.82.9:4035 , piece_id=FG6PDKDR7JL4JVZQIBQ4L75Y7WGJIYYLGXOEOAIBMVXNZN67CI5Q, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.819429006 (45h43m40.550696655s) [noise=true , address=104.36.82.37:4661 , piece_id=25FX3LY55YQNXAOXOSCNWNPANDP2TBKDK26IFXLGFLDMQWPWOSOQ, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.819461846 (45h43m40.550729496s) [noise=true , address=104.36.82.62:4435 , piece_id=B5MPTEKOAB3QENCP5KOY5VOMEBNHQLBFNY25V4G7YN75YHVGLTUA, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.819818021 (45h43m40.551085681s) [noise=true , address=104.36.82.41:4771 , piece_id=AYOBEAFPCAOUTTBFFHBI4TY27YM6QR6H7RVDB7G5G4PSQW3P3DWA, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.819865650 (45h43m40.551133301s) [noise=true , address=104.36.82.58:4268 , piece_id=JJN3LQBXJKEGV2HIC4VVWKBN6MAECNABHQCM7GBDKATXZKXRD5OA, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.820243354 (45h43m40.551511005s) [noise=true , address=104.36.82.44:4876 , piece_id=RUKE6OD5LYA4YNMRUJCJOEXX77PQ4DUIZWWTCQYLXCB42VY732BA, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.820372275 (45h43m40.551639926s) [noise=true , address=104.36.82.43:4864 , piece_id=W3QY4CMQHRNFJFC6FC3GGGPY2G3EAYRYXUWA6TO57EXALJGKTIDQ, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.820667828 (45h43m40.551935478s) [noise=true , address=104.36.82.60:4358 , piece_id=XZDJXSAJ2MZM7RIKQZLCIWAINBYXPI6ZWXK7BFMTA5NLND2ZMKJQ, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.820804262 (45h43m40.552071912s) [noise=true , address=104.36.82.62:4422 , piece_id=4IAGLHJZ4J43DKP43PEQFGBKV225NGMCSNLYTTYTZGW7FB7HN23Q, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.821082061 (45h43m40.552349711s) [noise=true , address=104.36.82.46:4491 , piece_id=VZXBE2ECF4IBUKOZ6SY7P4DE3CYISEWOW73OIG6RRCS5WZWOAXOA, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.821217544 (45h43m40.552485194s) [noise=true , address=64.49.13.26:4945 , piece_id=TUGINSBWLBR53QZQ6UWI7KELNW6PFQVSOKU4N3SURLRKAXLYO24A, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.821448986 (45h43m40.552716636s) [noise=true , address=104.36.82.45:4919 , piece_id=3JU4456N26HY7ESXJLYCO57L7CI5X7OUB3IKFFTFMUHSGTCEFYYA, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.821577575 (45h43m40.552845225s) [noise=true , address=104.36.82.16:4299 , piece_id=O3UULS4AO5ZBITQ6JHR2OHCRTR35XIJP4BX467RJTP3AP63DPGIA, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.821955511 (45h43m40.553223161s) [noise=true , address=104.36.82.14:4249 , piece_id=ASCWPLO4VIJLAEOJMBJER3JCZ2PHU6V6HT6GT4WJLBS2TOHIY4XQ, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.822413426 (45h43m40.553681076s) [noise=true , address=45.91.116.9:4287 , piece_id=VZVV2UM5PGMQ57Q4ZA5FNVBV5WMRVSFXNKG7LACMFIRIK2TU23JA, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.822804857 (45h43m40.554072507s) [noise=true , address=77.90.31.19:4849 , piece_id=HV7U2FY6PULU2NTDL3J6Q4UZO22PVJOMBECTF5DZOKMODIC53E6Q, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.823192029 (45h43m40.554459679s) [noise=true , address=104.36.82.38:4697 , piece_id=MSEIITRWMQUQSN5UXTNWCB5OXHIDJLEUAMAO5AEWHZI66QR2JT3Q, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.984896781 (45h43m40.716164432s) [upload=47611]: Next returned nil segment
Aug 10 15:09:59.984932287 (45h43m40.716199928s) [upload=47611]: Waiting for error group managing segments...
Aug 10 15:09:59.997630360 (45h43m40.72889801s) [noise=true , address=104.36.82.14:4249 , piece_id=ASCWPLO4VIJLAEOJMBJER3JCZ2PHU6V6HT6GT4WJLBS2TOHIY4XQ, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.001635787 (45h43m40.732903427s) [noise=true , address=104.36.82.46:4491 , piece_id=VZXBE2ECF4IBUKOZ6SY7P4DE3CYISEWOW73OIG6RRCS5WZWOAXOA, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.003020712 (45h43m40.734288352s) [noise=true , address=104.36.82.62:4422 , piece_id=4IAGLHJZ4J43DKP43PEQFGBKV225NGMCSNLYTTYTZGW7FB7HN23Q, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.003308269 (45h43m40.734575909s) [noise=true , address=104.36.82.44:4876 , piece_id=RUKE6OD5LYA4YNMRUJCJOEXX77PQ4DUIZWWTCQYLXCB42VY732BA, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.004821423 (45h43m40.736089063s) [noise=true , address=104.36.82.58:4268 , piece_id=JJN3LQBXJKEGV2HIC4VVWKBN6MAECNABHQCM7GBDKATXZKXRD5OA, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.011997037 (45h43m40.743264667s) [noise=true , address=104.36.82.37:4661 , piece_id=25FX3LY55YQNXAOXOSCNWNPANDP2TBKDK26IFXLGFLDMQWPWOSOQ, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.015508351 (45h43m40.746775972s) [noise=true , address=104.36.82.38:4697 , piece_id=MSEIITRWMQUQSN5UXTNWCB5OXHIDJLEUAMAO5AEWHZI66QR2JT3Q, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.018242986 (45h43m40.749510606s) [noise=true , address=104.36.82.62:4435 , piece_id=B5MPTEKOAB3QENCP5KOY5VOMEBNHQLBFNY25V4G7YN75YHVGLTUA, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.020890178 (45h43m40.752157808s) [noise=true , address=104.36.82.43:4864 , piece_id=W3QY4CMQHRNFJFC6FC3GGGPY2G3EAYRYXUWA6TO57EXALJGKTIDQ, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.028680359 (45h43m40.759947979s) [noise=true , address=104.36.82.45:4919 , piece_id=3JU4456N26HY7ESXJLYCO57L7CI5X7OUB3IKFFTFMUHSGTCEFYYA, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.029973602 (45h43m40.761241232s) [noise=true , address=104.36.82.60:4358 , piece_id=XZDJXSAJ2MZM7RIKQZLCIWAINBYXPI6ZWXK7BFMTA5NLND2ZMKJQ, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.037480355 (45h43m40.768747985s) [noise=true , address=104.36.82.3:4784 , piece_id=M3O5MSFKJR6JV7WNZFVBYIUANN7C4CJ6HOFFHK3MCAUC3KBFXJZA, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.037755499 (45h43m40.769023118s) [noise=true , address=104.36.82.9:4035 , piece_id=FG6PDKDR7JL4JVZQIBQ4L75Y7WGJIYYLGXOEOAIBMVXNZN67CI5Q, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.043057886 (45h43m40.774325517s) [noise=true , address=104.36.82.16:4299 , piece_id=O3UULS4AO5ZBITQ6JHR2OHCRTR35XIJP4BX467RJTP3AP63DPGIA, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.043074908 (45h43m40.774342538s) [seg_pos={0 0}, upload=47611]: Segment reached optimal threshold of 14 pieces.
Aug 10 15:10:00.043189661 (45h43m40.774457282s) [noise=true , address=77.90.31.19:4849 , piece_id=HV7U2FY6PULU2NTDL3J6Q4UZO22PVJOMBECTF5DZOKMODIC53E6Q, seg_pos={0 0}, upload=47611]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12F8hBt2nRQBHGzba5pPKyYJF37b7gRUnmBoZfDAYZAkYaUfk2V): protocol: expected piece hash; context canceled; EOF
Aug 10 15:10:00.043245917 (45h43m40.774513547s) [noise=true , address=104.36.82.41:4771 , piece_id=AYOBEAFPCAOUTTBFFHBI4TY27YM6QR6H7RVDB7G5G4PSQW3P3DWA, seg_pos={0 0}, upload=47611]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PggYtrfQ5ozsJL1HeAVJWc4jLvf5jiHspX3CgFY89swMimWto): protocol: expected piece hash; context canceled; EOF
Aug 10 15:10:00.043256808 (45h43m40.774524438s) [noise=true , address=45.91.116.9:4287 , piece_id=VZVV2UM5PGMQ57Q4ZA5FNVBV5WMRVSFXNKG7LACMFIRIK2TU23JA, seg_pos={0 0}, upload=47611]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cNuooGmeprkK8fRRBY5ZSAbWda7fdfPbYwbg3fV2TKGsYikwf): protocol: expected piece hash; context canceled; EOF
Aug 10 15:10:00.043367594 (45h43m40.774635224s) [noise=true , address=64.49.13.26:4945 , piece_id=TUGINSBWLBR53QZQ6UWI7KELNW6PFQVSOKU4N3SURLRKAXLYO24A, seg_pos={0 0}, upload=47611]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aPQ1AM7icmWJDhLQtS8pu3FCnun1peLjUdKZ7uBpAQ9yYrsYx): protocol: context canceled; context canceled
Aug 10 15:10:00.043377403 (45h43m40.774645033s) [seg_pos={0 0}, upload=47611]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 15:10:00.043428868 (45h43m40.774696498s) [upload=47611]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 15:10:00.043432135 (45h43m40.774699765s) [upload=47611]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 15:10:00.268407329 (45h43m40.999674979s) [upload=47611]: Done uploading segments...
Aug 10 15:10:00.268427305 (45h43m40.999694966s) [upload=47611]: Upload finished. err: <nil>
Duration: 421.364539ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..............X..........X....X.............................] duration:
445.005155ms
FAIL (2025-08-10 15:56:00 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 15:37:14.062718051 (46h10m54.793985702s) [upload=48086]: Starting upload Aug 10 15:37:14.062837083 (46h10m54.794104734s) [upload=48086]: Done starting upload Aug 10 15:37:14.062979950 (46h10m54.794247601s) [upload=48086]: Uploading segments... Aug 10 15:37:14.063042687 (46h10m54.794310417s) [upload=48086]: Got next segment. Inline: true Aug 10 15:37:14.063052335 (46h10m54.794319985s) [upload=48086]: Waiting for error group managing segments... Aug 10 15:37:14.063101798 (46h10m54.794369448s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 15:37:14.063107228 (46h10m54.794374878s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 15:37:14.063110825 (46h10m54.794378475s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 15:37:14.065912845 (46h10m54.797180506s) [upload=48086]: Done uploading segments... Aug 10 15:37:14.065928184 (46h10m54.797195834s) [upload=48086]: Upload finished. err: metaclient: Too Many Requests
Duration: 445.030533ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
1.350571637s
FAIL (2025-08-10 15:55:49 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 10 15:09:59.787351700 (45h43m40.518619349s) [upload=47611]: Starting upload
Aug 10 15:09:59.787411981 (45h43m40.518679632s) [upload=47611]: Done starting upload
Aug 10 15:09:59.787658021 (45h43m40.518925681s) [upload=47611]: Uploading segments...
Aug 10 15:09:59.788012333 (45h43m40.519279982s) [upload=47611]: Got next segment. Inline: false
Aug 10 15:09:59.788100537 (45h43m40.519368187s) [upload=47611]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 15:09:59.788109734 (45h43m40.519377394s) [upload=47611]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 15:09:59.818839786 (45h43m40.550107435s) [seg_pos={0 0}, upload=47611]: Begin upload segment...
Aug 10 15:09:59.818880411 (45h43m40.550148062s) [seg_pos={0 0}, upload=47611]: Done begin upload segment.
Aug 10 15:09:59.818939441 (45h43m40.550207091s) [noise=true , address=104.36.82.3:4784 , piece_id=M3O5MSFKJR6JV7WNZFVBYIUANN7C4CJ6HOFFHK3MCAUC3KBFXJZA, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.818961633 (45h43m40.550229283s) [noise=true , address=104.36.82.9:4035 , piece_id=FG6PDKDR7JL4JVZQIBQ4L75Y7WGJIYYLGXOEOAIBMVXNZN67CI5Q, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.819429006 (45h43m40.550696655s) [noise=true , address=104.36.82.37:4661 , piece_id=25FX3LY55YQNXAOXOSCNWNPANDP2TBKDK26IFXLGFLDMQWPWOSOQ, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.819461846 (45h43m40.550729496s) [noise=true , address=104.36.82.62:4435 , piece_id=B5MPTEKOAB3QENCP5KOY5VOMEBNHQLBFNY25V4G7YN75YHVGLTUA, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.819818021 (45h43m40.551085681s) [noise=true , address=104.36.82.41:4771 , piece_id=AYOBEAFPCAOUTTBFFHBI4TY27YM6QR6H7RVDB7G5G4PSQW3P3DWA, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.819865650 (45h43m40.551133301s) [noise=true , address=104.36.82.58:4268 , piece_id=JJN3LQBXJKEGV2HIC4VVWKBN6MAECNABHQCM7GBDKATXZKXRD5OA, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.820243354 (45h43m40.551511005s) [noise=true , address=104.36.82.44:4876 , piece_id=RUKE6OD5LYA4YNMRUJCJOEXX77PQ4DUIZWWTCQYLXCB42VY732BA, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.820372275 (45h43m40.551639926s) [noise=true , address=104.36.82.43:4864 , piece_id=W3QY4CMQHRNFJFC6FC3GGGPY2G3EAYRYXUWA6TO57EXALJGKTIDQ, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.820667828 (45h43m40.551935478s) [noise=true , address=104.36.82.60:4358 , piece_id=XZDJXSAJ2MZM7RIKQZLCIWAINBYXPI6ZWXK7BFMTA5NLND2ZMKJQ, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.820804262 (45h43m40.552071912s) [noise=true , address=104.36.82.62:4422 , piece_id=4IAGLHJZ4J43DKP43PEQFGBKV225NGMCSNLYTTYTZGW7FB7HN23Q, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.821082061 (45h43m40.552349711s) [noise=true , address=104.36.82.46:4491 , piece_id=VZXBE2ECF4IBUKOZ6SY7P4DE3CYISEWOW73OIG6RRCS5WZWOAXOA, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.821217544 (45h43m40.552485194s) [noise=true , address=64.49.13.26:4945 , piece_id=TUGINSBWLBR53QZQ6UWI7KELNW6PFQVSOKU4N3SURLRKAXLYO24A, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.821448986 (45h43m40.552716636s) [noise=true , address=104.36.82.45:4919 , piece_id=3JU4456N26HY7ESXJLYCO57L7CI5X7OUB3IKFFTFMUHSGTCEFYYA, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.821577575 (45h43m40.552845225s) [noise=true , address=104.36.82.16:4299 , piece_id=O3UULS4AO5ZBITQ6JHR2OHCRTR35XIJP4BX467RJTP3AP63DPGIA, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.821955511 (45h43m40.553223161s) [noise=true , address=104.36.82.14:4249 , piece_id=ASCWPLO4VIJLAEOJMBJER3JCZ2PHU6V6HT6GT4WJLBS2TOHIY4XQ, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.822413426 (45h43m40.553681076s) [noise=true , address=45.91.116.9:4287 , piece_id=VZVV2UM5PGMQ57Q4ZA5FNVBV5WMRVSFXNKG7LACMFIRIK2TU23JA, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.822804857 (45h43m40.554072507s) [noise=true , address=77.90.31.19:4849 , piece_id=HV7U2FY6PULU2NTDL3J6Q4UZO22PVJOMBECTF5DZOKMODIC53E6Q, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.823192029 (45h43m40.554459679s) [noise=true , address=104.36.82.38:4697 , piece_id=MSEIITRWMQUQSN5UXTNWCB5OXHIDJLEUAMAO5AEWHZI66QR2JT3Q, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.984896781 (45h43m40.716164432s) [upload=47611]: Next returned nil segment
Aug 10 15:09:59.984932287 (45h43m40.716199928s) [upload=47611]: Waiting for error group managing segments...
Aug 10 15:09:59.997630360 (45h43m40.72889801s) [noise=true , address=104.36.82.14:4249 , piece_id=ASCWPLO4VIJLAEOJMBJER3JCZ2PHU6V6HT6GT4WJLBS2TOHIY4XQ, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.001635787 (45h43m40.732903427s) [noise=true , address=104.36.82.46:4491 , piece_id=VZXBE2ECF4IBUKOZ6SY7P4DE3CYISEWOW73OIG6RRCS5WZWOAXOA, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.003020712 (45h43m40.734288352s) [noise=true , address=104.36.82.62:4422 , piece_id=4IAGLHJZ4J43DKP43PEQFGBKV225NGMCSNLYTTYTZGW7FB7HN23Q, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.003308269 (45h43m40.734575909s) [noise=true , address=104.36.82.44:4876 , piece_id=RUKE6OD5LYA4YNMRUJCJOEXX77PQ4DUIZWWTCQYLXCB42VY732BA, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.004821423 (45h43m40.736089063s) [noise=true , address=104.36.82.58:4268 , piece_id=JJN3LQBXJKEGV2HIC4VVWKBN6MAECNABHQCM7GBDKATXZKXRD5OA, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.011997037 (45h43m40.743264667s) [noise=true , address=104.36.82.37:4661 , piece_id=25FX3LY55YQNXAOXOSCNWNPANDP2TBKDK26IFXLGFLDMQWPWOSOQ, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.015508351 (45h43m40.746775972s) [noise=true , address=104.36.82.38:4697 , piece_id=MSEIITRWMQUQSN5UXTNWCB5OXHIDJLEUAMAO5AEWHZI66QR2JT3Q, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.018242986 (45h43m40.749510606s) [noise=true , address=104.36.82.62:4435 , piece_id=B5MPTEKOAB3QENCP5KOY5VOMEBNHQLBFNY25V4G7YN75YHVGLTUA, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.020890178 (45h43m40.752157808s) [noise=true , address=104.36.82.43:4864 , piece_id=W3QY4CMQHRNFJFC6FC3GGGPY2G3EAYRYXUWA6TO57EXALJGKTIDQ, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.028680359 (45h43m40.759947979s) [noise=true , address=104.36.82.45:4919 , piece_id=3JU4456N26HY7ESXJLYCO57L7CI5X7OUB3IKFFTFMUHSGTCEFYYA, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.029973602 (45h43m40.761241232s) [noise=true , address=104.36.82.60:4358 , piece_id=XZDJXSAJ2MZM7RIKQZLCIWAINBYXPI6ZWXK7BFMTA5NLND2ZMKJQ, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.037480355 (45h43m40.768747985s) [noise=true , address=104.36.82.3:4784 , piece_id=M3O5MSFKJR6JV7WNZFVBYIUANN7C4CJ6HOFFHK3MCAUC3KBFXJZA, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.037755499 (45h43m40.769023118s) [noise=true , address=104.36.82.9:4035 , piece_id=FG6PDKDR7JL4JVZQIBQ4L75Y7WGJIYYLGXOEOAIBMVXNZN67CI5Q, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.043057886 (45h43m40.774325517s) [noise=true , address=104.36.82.16:4299 , piece_id=O3UULS4AO5ZBITQ6JHR2OHCRTR35XIJP4BX467RJTP3AP63DPGIA, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.043074908 (45h43m40.774342538s) [seg_pos={0 0}, upload=47611]: Segment reached optimal threshold of 14 pieces.
Aug 10 15:10:00.043189661 (45h43m40.774457282s) [noise=true , address=77.90.31.19:4849 , piece_id=HV7U2FY6PULU2NTDL3J6Q4UZO22PVJOMBECTF5DZOKMODIC53E6Q, seg_pos={0 0}, upload=47611]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12F8hBt2nRQBHGzba5pPKyYJF37b7gRUnmBoZfDAYZAkYaUfk2V): protocol: expected piece hash; context canceled; EOF
Aug 10 15:10:00.043245917 (45h43m40.774513547s) [noise=true , address=104.36.82.41:4771 , piece_id=AYOBEAFPCAOUTTBFFHBI4TY27YM6QR6H7RVDB7G5G4PSQW3P3DWA, seg_pos={0 0}, upload=47611]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PggYtrfQ5ozsJL1HeAVJWc4jLvf5jiHspX3CgFY89swMimWto): protocol: expected piece hash; context canceled; EOF
Aug 10 15:10:00.043256808 (45h43m40.774524438s) [noise=true , address=45.91.116.9:4287 , piece_id=VZVV2UM5PGMQ57Q4ZA5FNVBV5WMRVSFXNKG7LACMFIRIK2TU23JA, seg_pos={0 0}, upload=47611]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cNuooGmeprkK8fRRBY5ZSAbWda7fdfPbYwbg3fV2TKGsYikwf): protocol: expected piece hash; context canceled; EOF
Aug 10 15:10:00.043367594 (45h43m40.774635224s) [noise=true , address=64.49.13.26:4945 , piece_id=TUGINSBWLBR53QZQ6UWI7KELNW6PFQVSOKU4N3SURLRKAXLYO24A, seg_pos={0 0}, upload=47611]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aPQ1AM7icmWJDhLQtS8pu3FCnun1peLjUdKZ7uBpAQ9yYrsYx): protocol: context canceled; context canceled
Aug 10 15:10:00.043377403 (45h43m40.774645033s) [seg_pos={0 0}, upload=47611]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 15:10:00.043428868 (45h43m40.774696498s) [upload=47611]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 15:10:00.043432135 (45h43m40.774699765s) [upload=47611]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 15:10:00.268407329 (45h43m40.999674979s) [upload=47611]: Done uploading segments...
Aug 10 15:10:00.268427305 (45h43m40.999694966s) [upload=47611]: Upload finished. err: <nil>
Duration: 1.350594851s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...............X..........X....X............................] duration:
212.256787ms
FAIL (2025-08-10 15:54:52 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 15:37:14.062718051 (46h10m54.793985702s) [upload=48086]: Starting upload Aug 10 15:37:14.062837083 (46h10m54.794104734s) [upload=48086]: Done starting upload Aug 10 15:37:14.062979950 (46h10m54.794247601s) [upload=48086]: Uploading segments... Aug 10 15:37:14.063042687 (46h10m54.794310417s) [upload=48086]: Got next segment. Inline: true Aug 10 15:37:14.063052335 (46h10m54.794319985s) [upload=48086]: Waiting for error group managing segments... Aug 10 15:37:14.063101798 (46h10m54.794369448s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 15:37:14.063107228 (46h10m54.794374878s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 15:37:14.063110825 (46h10m54.794378475s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 15:37:14.065912845 (46h10m54.797180506s) [upload=48086]: Done uploading segments... Aug 10 15:37:14.065928184 (46h10m54.797195834s) [upload=48086]: Upload finished. err: metaclient: Too Many Requests
Duration: 212.27978ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
561.506092ms
FAIL (2025-08-10 15:54:47 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 10 15:09:59.787351700 (45h43m40.518619349s) [upload=47611]: Starting upload
Aug 10 15:09:59.787411981 (45h43m40.518679632s) [upload=47611]: Done starting upload
Aug 10 15:09:59.787658021 (45h43m40.518925681s) [upload=47611]: Uploading segments...
Aug 10 15:09:59.788012333 (45h43m40.519279982s) [upload=47611]: Got next segment. Inline: false
Aug 10 15:09:59.788100537 (45h43m40.519368187s) [upload=47611]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 15:09:59.788109734 (45h43m40.519377394s) [upload=47611]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 15:09:59.818839786 (45h43m40.550107435s) [seg_pos={0 0}, upload=47611]: Begin upload segment...
Aug 10 15:09:59.818880411 (45h43m40.550148062s) [seg_pos={0 0}, upload=47611]: Done begin upload segment.
Aug 10 15:09:59.818939441 (45h43m40.550207091s) [noise=true , address=104.36.82.3:4784 , piece_id=M3O5MSFKJR6JV7WNZFVBYIUANN7C4CJ6HOFFHK3MCAUC3KBFXJZA, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.818961633 (45h43m40.550229283s) [noise=true , address=104.36.82.9:4035 , piece_id=FG6PDKDR7JL4JVZQIBQ4L75Y7WGJIYYLGXOEOAIBMVXNZN67CI5Q, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.819429006 (45h43m40.550696655s) [noise=true , address=104.36.82.37:4661 , piece_id=25FX3LY55YQNXAOXOSCNWNPANDP2TBKDK26IFXLGFLDMQWPWOSOQ, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.819461846 (45h43m40.550729496s) [noise=true , address=104.36.82.62:4435 , piece_id=B5MPTEKOAB3QENCP5KOY5VOMEBNHQLBFNY25V4G7YN75YHVGLTUA, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.819818021 (45h43m40.551085681s) [noise=true , address=104.36.82.41:4771 , piece_id=AYOBEAFPCAOUTTBFFHBI4TY27YM6QR6H7RVDB7G5G4PSQW3P3DWA, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.819865650 (45h43m40.551133301s) [noise=true , address=104.36.82.58:4268 , piece_id=JJN3LQBXJKEGV2HIC4VVWKBN6MAECNABHQCM7GBDKATXZKXRD5OA, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.820243354 (45h43m40.551511005s) [noise=true , address=104.36.82.44:4876 , piece_id=RUKE6OD5LYA4YNMRUJCJOEXX77PQ4DUIZWWTCQYLXCB42VY732BA, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.820372275 (45h43m40.551639926s) [noise=true , address=104.36.82.43:4864 , piece_id=W3QY4CMQHRNFJFC6FC3GGGPY2G3EAYRYXUWA6TO57EXALJGKTIDQ, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.820667828 (45h43m40.551935478s) [noise=true , address=104.36.82.60:4358 , piece_id=XZDJXSAJ2MZM7RIKQZLCIWAINBYXPI6ZWXK7BFMTA5NLND2ZMKJQ, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.820804262 (45h43m40.552071912s) [noise=true , address=104.36.82.62:4422 , piece_id=4IAGLHJZ4J43DKP43PEQFGBKV225NGMCSNLYTTYTZGW7FB7HN23Q, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.821082061 (45h43m40.552349711s) [noise=true , address=104.36.82.46:4491 , piece_id=VZXBE2ECF4IBUKOZ6SY7P4DE3CYISEWOW73OIG6RRCS5WZWOAXOA, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.821217544 (45h43m40.552485194s) [noise=true , address=64.49.13.26:4945 , piece_id=TUGINSBWLBR53QZQ6UWI7KELNW6PFQVSOKU4N3SURLRKAXLYO24A, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.821448986 (45h43m40.552716636s) [noise=true , address=104.36.82.45:4919 , piece_id=3JU4456N26HY7ESXJLYCO57L7CI5X7OUB3IKFFTFMUHSGTCEFYYA, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.821577575 (45h43m40.552845225s) [noise=true , address=104.36.82.16:4299 , piece_id=O3UULS4AO5ZBITQ6JHR2OHCRTR35XIJP4BX467RJTP3AP63DPGIA, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.821955511 (45h43m40.553223161s) [noise=true , address=104.36.82.14:4249 , piece_id=ASCWPLO4VIJLAEOJMBJER3JCZ2PHU6V6HT6GT4WJLBS2TOHIY4XQ, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.822413426 (45h43m40.553681076s) [noise=true , address=45.91.116.9:4287 , piece_id=VZVV2UM5PGMQ57Q4ZA5FNVBV5WMRVSFXNKG7LACMFIRIK2TU23JA, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.822804857 (45h43m40.554072507s) [noise=true , address=77.90.31.19:4849 , piece_id=HV7U2FY6PULU2NTDL3J6Q4UZO22PVJOMBECTF5DZOKMODIC53E6Q, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.823192029 (45h43m40.554459679s) [noise=true , address=104.36.82.38:4697 , piece_id=MSEIITRWMQUQSN5UXTNWCB5OXHIDJLEUAMAO5AEWHZI66QR2JT3Q, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.984896781 (45h43m40.716164432s) [upload=47611]: Next returned nil segment
Aug 10 15:09:59.984932287 (45h43m40.716199928s) [upload=47611]: Waiting for error group managing segments...
Aug 10 15:09:59.997630360 (45h43m40.72889801s) [noise=true , address=104.36.82.14:4249 , piece_id=ASCWPLO4VIJLAEOJMBJER3JCZ2PHU6V6HT6GT4WJLBS2TOHIY4XQ, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.001635787 (45h43m40.732903427s) [noise=true , address=104.36.82.46:4491 , piece_id=VZXBE2ECF4IBUKOZ6SY7P4DE3CYISEWOW73OIG6RRCS5WZWOAXOA, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.003020712 (45h43m40.734288352s) [noise=true , address=104.36.82.62:4422 , piece_id=4IAGLHJZ4J43DKP43PEQFGBKV225NGMCSNLYTTYTZGW7FB7HN23Q, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.003308269 (45h43m40.734575909s) [noise=true , address=104.36.82.44:4876 , piece_id=RUKE6OD5LYA4YNMRUJCJOEXX77PQ4DUIZWWTCQYLXCB42VY732BA, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.004821423 (45h43m40.736089063s) [noise=true , address=104.36.82.58:4268 , piece_id=JJN3LQBXJKEGV2HIC4VVWKBN6MAECNABHQCM7GBDKATXZKXRD5OA, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.011997037 (45h43m40.743264667s) [noise=true , address=104.36.82.37:4661 , piece_id=25FX3LY55YQNXAOXOSCNWNPANDP2TBKDK26IFXLGFLDMQWPWOSOQ, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.015508351 (45h43m40.746775972s) [noise=true , address=104.36.82.38:4697 , piece_id=MSEIITRWMQUQSN5UXTNWCB5OXHIDJLEUAMAO5AEWHZI66QR2JT3Q, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.018242986 (45h43m40.749510606s) [noise=true , address=104.36.82.62:4435 , piece_id=B5MPTEKOAB3QENCP5KOY5VOMEBNHQLBFNY25V4G7YN75YHVGLTUA, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.020890178 (45h43m40.752157808s) [noise=true , address=104.36.82.43:4864 , piece_id=W3QY4CMQHRNFJFC6FC3GGGPY2G3EAYRYXUWA6TO57EXALJGKTIDQ, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.028680359 (45h43m40.759947979s) [noise=true , address=104.36.82.45:4919 , piece_id=3JU4456N26HY7ESXJLYCO57L7CI5X7OUB3IKFFTFMUHSGTCEFYYA, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.029973602 (45h43m40.761241232s) [noise=true , address=104.36.82.60:4358 , piece_id=XZDJXSAJ2MZM7RIKQZLCIWAINBYXPI6ZWXK7BFMTA5NLND2ZMKJQ, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.037480355 (45h43m40.768747985s) [noise=true , address=104.36.82.3:4784 , piece_id=M3O5MSFKJR6JV7WNZFVBYIUANN7C4CJ6HOFFHK3MCAUC3KBFXJZA, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.037755499 (45h43m40.769023118s) [noise=true , address=104.36.82.9:4035 , piece_id=FG6PDKDR7JL4JVZQIBQ4L75Y7WGJIYYLGXOEOAIBMVXNZN67CI5Q, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.043057886 (45h43m40.774325517s) [noise=true , address=104.36.82.16:4299 , piece_id=O3UULS4AO5ZBITQ6JHR2OHCRTR35XIJP4BX467RJTP3AP63DPGIA, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.043074908 (45h43m40.774342538s) [seg_pos={0 0}, upload=47611]: Segment reached optimal threshold of 14 pieces.
Aug 10 15:10:00.043189661 (45h43m40.774457282s) [noise=true , address=77.90.31.19:4849 , piece_id=HV7U2FY6PULU2NTDL3J6Q4UZO22PVJOMBECTF5DZOKMODIC53E6Q, seg_pos={0 0}, upload=47611]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12F8hBt2nRQBHGzba5pPKyYJF37b7gRUnmBoZfDAYZAkYaUfk2V): protocol: expected piece hash; context canceled; EOF
Aug 10 15:10:00.043245917 (45h43m40.774513547s) [noise=true , address=104.36.82.41:4771 , piece_id=AYOBEAFPCAOUTTBFFHBI4TY27YM6QR6H7RVDB7G5G4PSQW3P3DWA, seg_pos={0 0}, upload=47611]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PggYtrfQ5ozsJL1HeAVJWc4jLvf5jiHspX3CgFY89swMimWto): protocol: expected piece hash; context canceled; EOF
Aug 10 15:10:00.043256808 (45h43m40.774524438s) [noise=true , address=45.91.116.9:4287 , piece_id=VZVV2UM5PGMQ57Q4ZA5FNVBV5WMRVSFXNKG7LACMFIRIK2TU23JA, seg_pos={0 0}, upload=47611]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cNuooGmeprkK8fRRBY5ZSAbWda7fdfPbYwbg3fV2TKGsYikwf): protocol: expected piece hash; context canceled; EOF
Aug 10 15:10:00.043367594 (45h43m40.774635224s) [noise=true , address=64.49.13.26:4945 , piece_id=TUGINSBWLBR53QZQ6UWI7KELNW6PFQVSOKU4N3SURLRKAXLYO24A, seg_pos={0 0}, upload=47611]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aPQ1AM7icmWJDhLQtS8pu3FCnun1peLjUdKZ7uBpAQ9yYrsYx): protocol: context canceled; context canceled
Aug 10 15:10:00.043377403 (45h43m40.774645033s) [seg_pos={0 0}, upload=47611]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 15:10:00.043428868 (45h43m40.774696498s) [upload=47611]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 15:10:00.043432135 (45h43m40.774699765s) [upload=47611]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 15:10:00.268407329 (45h43m40.999674979s) [upload=47611]: Done uploading segments...
Aug 10 15:10:00.268427305 (45h43m40.999694966s) [upload=47611]: Upload finished. err: <nil>
Duration: 561.567737ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [................X..........X....X...........................] duration:
358.519078ms
FAIL (2025-08-10 15:54:20 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 15:37:14.062718051 (46h10m54.793985702s) [upload=48086]: Starting upload Aug 10 15:37:14.062837083 (46h10m54.794104734s) [upload=48086]: Done starting upload Aug 10 15:37:14.062979950 (46h10m54.794247601s) [upload=48086]: Uploading segments... Aug 10 15:37:14.063042687 (46h10m54.794310417s) [upload=48086]: Got next segment. Inline: true Aug 10 15:37:14.063052335 (46h10m54.794319985s) [upload=48086]: Waiting for error group managing segments... Aug 10 15:37:14.063101798 (46h10m54.794369448s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 15:37:14.063107228 (46h10m54.794374878s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 15:37:14.063110825 (46h10m54.794378475s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 15:37:14.065912845 (46h10m54.797180506s) [upload=48086]: Done uploading segments... Aug 10 15:37:14.065928184 (46h10m54.797195834s) [upload=48086]: Upload finished. err: metaclient: Too Many Requests
Duration: 358.548552ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.................X..........X....X..........................] duration:
166.010794ms
FAIL (2025-08-10 15:53:49 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 15:37:14.062718051 (46h10m54.793985702s) [upload=48086]: Starting upload Aug 10 15:37:14.062837083 (46h10m54.794104734s) [upload=48086]: Done starting upload Aug 10 15:37:14.062979950 (46h10m54.794247601s) [upload=48086]: Uploading segments... Aug 10 15:37:14.063042687 (46h10m54.794310417s) [upload=48086]: Got next segment. Inline: true Aug 10 15:37:14.063052335 (46h10m54.794319985s) [upload=48086]: Waiting for error group managing segments... Aug 10 15:37:14.063101798 (46h10m54.794369448s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 15:37:14.063107228 (46h10m54.794374878s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 15:37:14.063110825 (46h10m54.794378475s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 15:37:14.065912845 (46h10m54.797180506s) [upload=48086]: Done uploading segments... Aug 10 15:37:14.065928184 (46h10m54.797195834s) [upload=48086]: Upload finished. err: metaclient: Too Many Requests
Duration: 166.115349ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
490.274326ms
FAIL (2025-08-10 15:53:33 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 10 15:09:59.787351700 (45h43m40.518619349s) [upload=47611]: Starting upload
Aug 10 15:09:59.787411981 (45h43m40.518679632s) [upload=47611]: Done starting upload
Aug 10 15:09:59.787658021 (45h43m40.518925681s) [upload=47611]: Uploading segments...
Aug 10 15:09:59.788012333 (45h43m40.519279982s) [upload=47611]: Got next segment. Inline: false
Aug 10 15:09:59.788100537 (45h43m40.519368187s) [upload=47611]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 15:09:59.788109734 (45h43m40.519377394s) [upload=47611]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 15:09:59.818839786 (45h43m40.550107435s) [seg_pos={0 0}, upload=47611]: Begin upload segment...
Aug 10 15:09:59.818880411 (45h43m40.550148062s) [seg_pos={0 0}, upload=47611]: Done begin upload segment.
Aug 10 15:09:59.818939441 (45h43m40.550207091s) [noise=true , address=104.36.82.3:4784 , piece_id=M3O5MSFKJR6JV7WNZFVBYIUANN7C4CJ6HOFFHK3MCAUC3KBFXJZA, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.818961633 (45h43m40.550229283s) [noise=true , address=104.36.82.9:4035 , piece_id=FG6PDKDR7JL4JVZQIBQ4L75Y7WGJIYYLGXOEOAIBMVXNZN67CI5Q, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.819429006 (45h43m40.550696655s) [noise=true , address=104.36.82.37:4661 , piece_id=25FX3LY55YQNXAOXOSCNWNPANDP2TBKDK26IFXLGFLDMQWPWOSOQ, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.819461846 (45h43m40.550729496s) [noise=true , address=104.36.82.62:4435 , piece_id=B5MPTEKOAB3QENCP5KOY5VOMEBNHQLBFNY25V4G7YN75YHVGLTUA, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.819818021 (45h43m40.551085681s) [noise=true , address=104.36.82.41:4771 , piece_id=AYOBEAFPCAOUTTBFFHBI4TY27YM6QR6H7RVDB7G5G4PSQW3P3DWA, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.819865650 (45h43m40.551133301s) [noise=true , address=104.36.82.58:4268 , piece_id=JJN3LQBXJKEGV2HIC4VVWKBN6MAECNABHQCM7GBDKATXZKXRD5OA, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.820243354 (45h43m40.551511005s) [noise=true , address=104.36.82.44:4876 , piece_id=RUKE6OD5LYA4YNMRUJCJOEXX77PQ4DUIZWWTCQYLXCB42VY732BA, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.820372275 (45h43m40.551639926s) [noise=true , address=104.36.82.43:4864 , piece_id=W3QY4CMQHRNFJFC6FC3GGGPY2G3EAYRYXUWA6TO57EXALJGKTIDQ, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.820667828 (45h43m40.551935478s) [noise=true , address=104.36.82.60:4358 , piece_id=XZDJXSAJ2MZM7RIKQZLCIWAINBYXPI6ZWXK7BFMTA5NLND2ZMKJQ, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.820804262 (45h43m40.552071912s) [noise=true , address=104.36.82.62:4422 , piece_id=4IAGLHJZ4J43DKP43PEQFGBKV225NGMCSNLYTTYTZGW7FB7HN23Q, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.821082061 (45h43m40.552349711s) [noise=true , address=104.36.82.46:4491 , piece_id=VZXBE2ECF4IBUKOZ6SY7P4DE3CYISEWOW73OIG6RRCS5WZWOAXOA, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.821217544 (45h43m40.552485194s) [noise=true , address=64.49.13.26:4945 , piece_id=TUGINSBWLBR53QZQ6UWI7KELNW6PFQVSOKU4N3SURLRKAXLYO24A, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.821448986 (45h43m40.552716636s) [noise=true , address=104.36.82.45:4919 , piece_id=3JU4456N26HY7ESXJLYCO57L7CI5X7OUB3IKFFTFMUHSGTCEFYYA, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.821577575 (45h43m40.552845225s) [noise=true , address=104.36.82.16:4299 , piece_id=O3UULS4AO5ZBITQ6JHR2OHCRTR35XIJP4BX467RJTP3AP63DPGIA, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.821955511 (45h43m40.553223161s) [noise=true , address=104.36.82.14:4249 , piece_id=ASCWPLO4VIJLAEOJMBJER3JCZ2PHU6V6HT6GT4WJLBS2TOHIY4XQ, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.822413426 (45h43m40.553681076s) [noise=true , address=45.91.116.9:4287 , piece_id=VZVV2UM5PGMQ57Q4ZA5FNVBV5WMRVSFXNKG7LACMFIRIK2TU23JA, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.822804857 (45h43m40.554072507s) [noise=true , address=77.90.31.19:4849 , piece_id=HV7U2FY6PULU2NTDL3J6Q4UZO22PVJOMBECTF5DZOKMODIC53E6Q, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.823192029 (45h43m40.554459679s) [noise=true , address=104.36.82.38:4697 , piece_id=MSEIITRWMQUQSN5UXTNWCB5OXHIDJLEUAMAO5AEWHZI66QR2JT3Q, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.984896781 (45h43m40.716164432s) [upload=47611]: Next returned nil segment
Aug 10 15:09:59.984932287 (45h43m40.716199928s) [upload=47611]: Waiting for error group managing segments...
Aug 10 15:09:59.997630360 (45h43m40.72889801s) [noise=true , address=104.36.82.14:4249 , piece_id=ASCWPLO4VIJLAEOJMBJER3JCZ2PHU6V6HT6GT4WJLBS2TOHIY4XQ, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.001635787 (45h43m40.732903427s) [noise=true , address=104.36.82.46:4491 , piece_id=VZXBE2ECF4IBUKOZ6SY7P4DE3CYISEWOW73OIG6RRCS5WZWOAXOA, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.003020712 (45h43m40.734288352s) [noise=true , address=104.36.82.62:4422 , piece_id=4IAGLHJZ4J43DKP43PEQFGBKV225NGMCSNLYTTYTZGW7FB7HN23Q, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.003308269 (45h43m40.734575909s) [noise=true , address=104.36.82.44:4876 , piece_id=RUKE6OD5LYA4YNMRUJCJOEXX77PQ4DUIZWWTCQYLXCB42VY732BA, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.004821423 (45h43m40.736089063s) [noise=true , address=104.36.82.58:4268 , piece_id=JJN3LQBXJKEGV2HIC4VVWKBN6MAECNABHQCM7GBDKATXZKXRD5OA, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.011997037 (45h43m40.743264667s) [noise=true , address=104.36.82.37:4661 , piece_id=25FX3LY55YQNXAOXOSCNWNPANDP2TBKDK26IFXLGFLDMQWPWOSOQ, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.015508351 (45h43m40.746775972s) [noise=true , address=104.36.82.38:4697 , piece_id=MSEIITRWMQUQSN5UXTNWCB5OXHIDJLEUAMAO5AEWHZI66QR2JT3Q, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.018242986 (45h43m40.749510606s) [noise=true , address=104.36.82.62:4435 , piece_id=B5MPTEKOAB3QENCP5KOY5VOMEBNHQLBFNY25V4G7YN75YHVGLTUA, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.020890178 (45h43m40.752157808s) [noise=true , address=104.36.82.43:4864 , piece_id=W3QY4CMQHRNFJFC6FC3GGGPY2G3EAYRYXUWA6TO57EXALJGKTIDQ, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.028680359 (45h43m40.759947979s) [noise=true , address=104.36.82.45:4919 , piece_id=3JU4456N26HY7ESXJLYCO57L7CI5X7OUB3IKFFTFMUHSGTCEFYYA, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.029973602 (45h43m40.761241232s) [noise=true , address=104.36.82.60:4358 , piece_id=XZDJXSAJ2MZM7RIKQZLCIWAINBYXPI6ZWXK7BFMTA5NLND2ZMKJQ, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.037480355 (45h43m40.768747985s) [noise=true , address=104.36.82.3:4784 , piece_id=M3O5MSFKJR6JV7WNZFVBYIUANN7C4CJ6HOFFHK3MCAUC3KBFXJZA, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.037755499 (45h43m40.769023118s) [noise=true , address=104.36.82.9:4035 , piece_id=FG6PDKDR7JL4JVZQIBQ4L75Y7WGJIYYLGXOEOAIBMVXNZN67CI5Q, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.043057886 (45h43m40.774325517s) [noise=true , address=104.36.82.16:4299 , piece_id=O3UULS4AO5ZBITQ6JHR2OHCRTR35XIJP4BX467RJTP3AP63DPGIA, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.043074908 (45h43m40.774342538s) [seg_pos={0 0}, upload=47611]: Segment reached optimal threshold of 14 pieces.
Aug 10 15:10:00.043189661 (45h43m40.774457282s) [noise=true , address=77.90.31.19:4849 , piece_id=HV7U2FY6PULU2NTDL3J6Q4UZO22PVJOMBECTF5DZOKMODIC53E6Q, seg_pos={0 0}, upload=47611]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12F8hBt2nRQBHGzba5pPKyYJF37b7gRUnmBoZfDAYZAkYaUfk2V): protocol: expected piece hash; context canceled; EOF
Aug 10 15:10:00.043245917 (45h43m40.774513547s) [noise=true , address=104.36.82.41:4771 , piece_id=AYOBEAFPCAOUTTBFFHBI4TY27YM6QR6H7RVDB7G5G4PSQW3P3DWA, seg_pos={0 0}, upload=47611]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PggYtrfQ5ozsJL1HeAVJWc4jLvf5jiHspX3CgFY89swMimWto): protocol: expected piece hash; context canceled; EOF
Aug 10 15:10:00.043256808 (45h43m40.774524438s) [noise=true , address=45.91.116.9:4287 , piece_id=VZVV2UM5PGMQ57Q4ZA5FNVBV5WMRVSFXNKG7LACMFIRIK2TU23JA, seg_pos={0 0}, upload=47611]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cNuooGmeprkK8fRRBY5ZSAbWda7fdfPbYwbg3fV2TKGsYikwf): protocol: expected piece hash; context canceled; EOF
Aug 10 15:10:00.043367594 (45h43m40.774635224s) [noise=true , address=64.49.13.26:4945 , piece_id=TUGINSBWLBR53QZQ6UWI7KELNW6PFQVSOKU4N3SURLRKAXLYO24A, seg_pos={0 0}, upload=47611]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aPQ1AM7icmWJDhLQtS8pu3FCnun1peLjUdKZ7uBpAQ9yYrsYx): protocol: context canceled; context canceled
Aug 10 15:10:00.043377403 (45h43m40.774645033s) [seg_pos={0 0}, upload=47611]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 15:10:00.043428868 (45h43m40.774696498s) [upload=47611]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 15:10:00.043432135 (45h43m40.774699765s) [upload=47611]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 15:10:00.268407329 (45h43m40.999674979s) [upload=47611]: Done uploading segments...
Aug 10 15:10:00.268427305 (45h43m40.999694966s) [upload=47611]: Upload finished. err: <nil>
Duration: 490.29768ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..................X..........X....X.........................] duration:
171.45751ms
FAIL (2025-08-10 15:52:56 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 15:37:14.062718051 (46h10m54.793985702s) [upload=48086]: Starting upload Aug 10 15:37:14.062837083 (46h10m54.794104734s) [upload=48086]: Done starting upload Aug 10 15:37:14.062979950 (46h10m54.794247601s) [upload=48086]: Uploading segments... Aug 10 15:37:14.063042687 (46h10m54.794310417s) [upload=48086]: Got next segment. Inline: true Aug 10 15:37:14.063052335 (46h10m54.794319985s) [upload=48086]: Waiting for error group managing segments... Aug 10 15:37:14.063101798 (46h10m54.794369448s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 15:37:14.063107228 (46h10m54.794374878s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 15:37:14.063110825 (46h10m54.794378475s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 15:37:14.065912845 (46h10m54.797180506s) [upload=48086]: Done uploading segments... Aug 10 15:37:14.065928184 (46h10m54.797195834s) [upload=48086]: Upload finished. err: metaclient: Too Many Requests
Duration: 171.485834ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
712.951076ms
FAIL (2025-08-10 15:52:33 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 10 15:09:59.787351700 (45h43m40.518619349s) [upload=47611]: Starting upload
Aug 10 15:09:59.787411981 (45h43m40.518679632s) [upload=47611]: Done starting upload
Aug 10 15:09:59.787658021 (45h43m40.518925681s) [upload=47611]: Uploading segments...
Aug 10 15:09:59.788012333 (45h43m40.519279982s) [upload=47611]: Got next segment. Inline: false
Aug 10 15:09:59.788100537 (45h43m40.519368187s) [upload=47611]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 15:09:59.788109734 (45h43m40.519377394s) [upload=47611]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 15:09:59.818839786 (45h43m40.550107435s) [seg_pos={0 0}, upload=47611]: Begin upload segment...
Aug 10 15:09:59.818880411 (45h43m40.550148062s) [seg_pos={0 0}, upload=47611]: Done begin upload segment.
Aug 10 15:09:59.818939441 (45h43m40.550207091s) [noise=true , address=104.36.82.3:4784 , piece_id=M3O5MSFKJR6JV7WNZFVBYIUANN7C4CJ6HOFFHK3MCAUC3KBFXJZA, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.818961633 (45h43m40.550229283s) [noise=true , address=104.36.82.9:4035 , piece_id=FG6PDKDR7JL4JVZQIBQ4L75Y7WGJIYYLGXOEOAIBMVXNZN67CI5Q, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.819429006 (45h43m40.550696655s) [noise=true , address=104.36.82.37:4661 , piece_id=25FX3LY55YQNXAOXOSCNWNPANDP2TBKDK26IFXLGFLDMQWPWOSOQ, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.819461846 (45h43m40.550729496s) [noise=true , address=104.36.82.62:4435 , piece_id=B5MPTEKOAB3QENCP5KOY5VOMEBNHQLBFNY25V4G7YN75YHVGLTUA, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.819818021 (45h43m40.551085681s) [noise=true , address=104.36.82.41:4771 , piece_id=AYOBEAFPCAOUTTBFFHBI4TY27YM6QR6H7RVDB7G5G4PSQW3P3DWA, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.819865650 (45h43m40.551133301s) [noise=true , address=104.36.82.58:4268 , piece_id=JJN3LQBXJKEGV2HIC4VVWKBN6MAECNABHQCM7GBDKATXZKXRD5OA, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.820243354 (45h43m40.551511005s) [noise=true , address=104.36.82.44:4876 , piece_id=RUKE6OD5LYA4YNMRUJCJOEXX77PQ4DUIZWWTCQYLXCB42VY732BA, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.820372275 (45h43m40.551639926s) [noise=true , address=104.36.82.43:4864 , piece_id=W3QY4CMQHRNFJFC6FC3GGGPY2G3EAYRYXUWA6TO57EXALJGKTIDQ, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.820667828 (45h43m40.551935478s) [noise=true , address=104.36.82.60:4358 , piece_id=XZDJXSAJ2MZM7RIKQZLCIWAINBYXPI6ZWXK7BFMTA5NLND2ZMKJQ, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.820804262 (45h43m40.552071912s) [noise=true , address=104.36.82.62:4422 , piece_id=4IAGLHJZ4J43DKP43PEQFGBKV225NGMCSNLYTTYTZGW7FB7HN23Q, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.821082061 (45h43m40.552349711s) [noise=true , address=104.36.82.46:4491 , piece_id=VZXBE2ECF4IBUKOZ6SY7P4DE3CYISEWOW73OIG6RRCS5WZWOAXOA, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.821217544 (45h43m40.552485194s) [noise=true , address=64.49.13.26:4945 , piece_id=TUGINSBWLBR53QZQ6UWI7KELNW6PFQVSOKU4N3SURLRKAXLYO24A, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.821448986 (45h43m40.552716636s) [noise=true , address=104.36.82.45:4919 , piece_id=3JU4456N26HY7ESXJLYCO57L7CI5X7OUB3IKFFTFMUHSGTCEFYYA, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.821577575 (45h43m40.552845225s) [noise=true , address=104.36.82.16:4299 , piece_id=O3UULS4AO5ZBITQ6JHR2OHCRTR35XIJP4BX467RJTP3AP63DPGIA, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.821955511 (45h43m40.553223161s) [noise=true , address=104.36.82.14:4249 , piece_id=ASCWPLO4VIJLAEOJMBJER3JCZ2PHU6V6HT6GT4WJLBS2TOHIY4XQ, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.822413426 (45h43m40.553681076s) [noise=true , address=45.91.116.9:4287 , piece_id=VZVV2UM5PGMQ57Q4ZA5FNVBV5WMRVSFXNKG7LACMFIRIK2TU23JA, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.822804857 (45h43m40.554072507s) [noise=true , address=77.90.31.19:4849 , piece_id=HV7U2FY6PULU2NTDL3J6Q4UZO22PVJOMBECTF5DZOKMODIC53E6Q, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.823192029 (45h43m40.554459679s) [noise=true , address=104.36.82.38:4697 , piece_id=MSEIITRWMQUQSN5UXTNWCB5OXHIDJLEUAMAO5AEWHZI66QR2JT3Q, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.984896781 (45h43m40.716164432s) [upload=47611]: Next returned nil segment
Aug 10 15:09:59.984932287 (45h43m40.716199928s) [upload=47611]: Waiting for error group managing segments...
Aug 10 15:09:59.997630360 (45h43m40.72889801s) [noise=true , address=104.36.82.14:4249 , piece_id=ASCWPLO4VIJLAEOJMBJER3JCZ2PHU6V6HT6GT4WJLBS2TOHIY4XQ, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.001635787 (45h43m40.732903427s) [noise=true , address=104.36.82.46:4491 , piece_id=VZXBE2ECF4IBUKOZ6SY7P4DE3CYISEWOW73OIG6RRCS5WZWOAXOA, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.003020712 (45h43m40.734288352s) [noise=true , address=104.36.82.62:4422 , piece_id=4IAGLHJZ4J43DKP43PEQFGBKV225NGMCSNLYTTYTZGW7FB7HN23Q, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.003308269 (45h43m40.734575909s) [noise=true , address=104.36.82.44:4876 , piece_id=RUKE6OD5LYA4YNMRUJCJOEXX77PQ4DUIZWWTCQYLXCB42VY732BA, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.004821423 (45h43m40.736089063s) [noise=true , address=104.36.82.58:4268 , piece_id=JJN3LQBXJKEGV2HIC4VVWKBN6MAECNABHQCM7GBDKATXZKXRD5OA, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.011997037 (45h43m40.743264667s) [noise=true , address=104.36.82.37:4661 , piece_id=25FX3LY55YQNXAOXOSCNWNPANDP2TBKDK26IFXLGFLDMQWPWOSOQ, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.015508351 (45h43m40.746775972s) [noise=true , address=104.36.82.38:4697 , piece_id=MSEIITRWMQUQSN5UXTNWCB5OXHIDJLEUAMAO5AEWHZI66QR2JT3Q, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.018242986 (45h43m40.749510606s) [noise=true , address=104.36.82.62:4435 , piece_id=B5MPTEKOAB3QENCP5KOY5VOMEBNHQLBFNY25V4G7YN75YHVGLTUA, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.020890178 (45h43m40.752157808s) [noise=true , address=104.36.82.43:4864 , piece_id=W3QY4CMQHRNFJFC6FC3GGGPY2G3EAYRYXUWA6TO57EXALJGKTIDQ, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.028680359 (45h43m40.759947979s) [noise=true , address=104.36.82.45:4919 , piece_id=3JU4456N26HY7ESXJLYCO57L7CI5X7OUB3IKFFTFMUHSGTCEFYYA, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.029973602 (45h43m40.761241232s) [noise=true , address=104.36.82.60:4358 , piece_id=XZDJXSAJ2MZM7RIKQZLCIWAINBYXPI6ZWXK7BFMTA5NLND2ZMKJQ, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.037480355 (45h43m40.768747985s) [noise=true , address=104.36.82.3:4784 , piece_id=M3O5MSFKJR6JV7WNZFVBYIUANN7C4CJ6HOFFHK3MCAUC3KBFXJZA, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.037755499 (45h43m40.769023118s) [noise=true , address=104.36.82.9:4035 , piece_id=FG6PDKDR7JL4JVZQIBQ4L75Y7WGJIYYLGXOEOAIBMVXNZN67CI5Q, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.043057886 (45h43m40.774325517s) [noise=true , address=104.36.82.16:4299 , piece_id=O3UULS4AO5ZBITQ6JHR2OHCRTR35XIJP4BX467RJTP3AP63DPGIA, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.043074908 (45h43m40.774342538s) [seg_pos={0 0}, upload=47611]: Segment reached optimal threshold of 14 pieces.
Aug 10 15:10:00.043189661 (45h43m40.774457282s) [noise=true , address=77.90.31.19:4849 , piece_id=HV7U2FY6PULU2NTDL3J6Q4UZO22PVJOMBECTF5DZOKMODIC53E6Q, seg_pos={0 0}, upload=47611]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12F8hBt2nRQBHGzba5pPKyYJF37b7gRUnmBoZfDAYZAkYaUfk2V): protocol: expected piece hash; context canceled; EOF
Aug 10 15:10:00.043245917 (45h43m40.774513547s) [noise=true , address=104.36.82.41:4771 , piece_id=AYOBEAFPCAOUTTBFFHBI4TY27YM6QR6H7RVDB7G5G4PSQW3P3DWA, seg_pos={0 0}, upload=47611]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PggYtrfQ5ozsJL1HeAVJWc4jLvf5jiHspX3CgFY89swMimWto): protocol: expected piece hash; context canceled; EOF
Aug 10 15:10:00.043256808 (45h43m40.774524438s) [noise=true , address=45.91.116.9:4287 , piece_id=VZVV2UM5PGMQ57Q4ZA5FNVBV5WMRVSFXNKG7LACMFIRIK2TU23JA, seg_pos={0 0}, upload=47611]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cNuooGmeprkK8fRRBY5ZSAbWda7fdfPbYwbg3fV2TKGsYikwf): protocol: expected piece hash; context canceled; EOF
Aug 10 15:10:00.043367594 (45h43m40.774635224s) [noise=true , address=64.49.13.26:4945 , piece_id=TUGINSBWLBR53QZQ6UWI7KELNW6PFQVSOKU4N3SURLRKAXLYO24A, seg_pos={0 0}, upload=47611]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aPQ1AM7icmWJDhLQtS8pu3FCnun1peLjUdKZ7uBpAQ9yYrsYx): protocol: context canceled; context canceled
Aug 10 15:10:00.043377403 (45h43m40.774645033s) [seg_pos={0 0}, upload=47611]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 15:10:00.043428868 (45h43m40.774696498s) [upload=47611]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 15:10:00.043432135 (45h43m40.774699765s) [upload=47611]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 15:10:00.268407329 (45h43m40.999674979s) [upload=47611]: Done uploading segments...
Aug 10 15:10:00.268427305 (45h43m40.999694966s) [upload=47611]: Upload finished. err: <nil>
Duration: 712.968058ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...................X..........X....X........................] duration:
162.322897ms
FAIL (2025-08-10 15:52:12 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 15:37:14.062718051 (46h10m54.793985702s) [upload=48086]: Starting upload Aug 10 15:37:14.062837083 (46h10m54.794104734s) [upload=48086]: Done starting upload Aug 10 15:37:14.062979950 (46h10m54.794247601s) [upload=48086]: Uploading segments... Aug 10 15:37:14.063042687 (46h10m54.794310417s) [upload=48086]: Got next segment. Inline: true Aug 10 15:37:14.063052335 (46h10m54.794319985s) [upload=48086]: Waiting for error group managing segments... Aug 10 15:37:14.063101798 (46h10m54.794369448s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 15:37:14.063107228 (46h10m54.794374878s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 15:37:14.063110825 (46h10m54.794378475s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 15:37:14.065912845 (46h10m54.797180506s) [upload=48086]: Done uploading segments... Aug 10 15:37:14.065928184 (46h10m54.797195834s) [upload=48086]: Upload finished. err: metaclient: Too Many Requests
Duration: 162.350097ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....................X..........X....X.......................] duration:
429.267109ms
FAIL (2025-08-10 15:51:48 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 15:37:14.062718051 (46h10m54.793985702s) [upload=48086]: Starting upload Aug 10 15:37:14.062837083 (46h10m54.794104734s) [upload=48086]: Done starting upload Aug 10 15:37:14.062979950 (46h10m54.794247601s) [upload=48086]: Uploading segments... Aug 10 15:37:14.063042687 (46h10m54.794310417s) [upload=48086]: Got next segment. Inline: true Aug 10 15:37:14.063052335 (46h10m54.794319985s) [upload=48086]: Waiting for error group managing segments... Aug 10 15:37:14.063101798 (46h10m54.794369448s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 15:37:14.063107228 (46h10m54.794374878s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 15:37:14.063110825 (46h10m54.794378475s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 15:37:14.065912845 (46h10m54.797180506s) [upload=48086]: Done uploading segments... Aug 10 15:37:14.065928184 (46h10m54.797195834s) [upload=48086]: Upload finished. err: metaclient: Too Many Requests
Duration: 429.28414ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
732.861992ms
FAIL (2025-08-10 15:51:37 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 10 15:09:59.787351700 (45h43m40.518619349s) [upload=47611]: Starting upload
Aug 10 15:09:59.787411981 (45h43m40.518679632s) [upload=47611]: Done starting upload
Aug 10 15:09:59.787658021 (45h43m40.518925681s) [upload=47611]: Uploading segments...
Aug 10 15:09:59.788012333 (45h43m40.519279982s) [upload=47611]: Got next segment. Inline: false
Aug 10 15:09:59.788100537 (45h43m40.519368187s) [upload=47611]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 15:09:59.788109734 (45h43m40.519377394s) [upload=47611]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 15:09:59.818839786 (45h43m40.550107435s) [seg_pos={0 0}, upload=47611]: Begin upload segment...
Aug 10 15:09:59.818880411 (45h43m40.550148062s) [seg_pos={0 0}, upload=47611]: Done begin upload segment.
Aug 10 15:09:59.818939441 (45h43m40.550207091s) [noise=true , address=104.36.82.3:4784 , piece_id=M3O5MSFKJR6JV7WNZFVBYIUANN7C4CJ6HOFFHK3MCAUC3KBFXJZA, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.818961633 (45h43m40.550229283s) [noise=true , address=104.36.82.9:4035 , piece_id=FG6PDKDR7JL4JVZQIBQ4L75Y7WGJIYYLGXOEOAIBMVXNZN67CI5Q, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.819429006 (45h43m40.550696655s) [noise=true , address=104.36.82.37:4661 , piece_id=25FX3LY55YQNXAOXOSCNWNPANDP2TBKDK26IFXLGFLDMQWPWOSOQ, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.819461846 (45h43m40.550729496s) [noise=true , address=104.36.82.62:4435 , piece_id=B5MPTEKOAB3QENCP5KOY5VOMEBNHQLBFNY25V4G7YN75YHVGLTUA, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.819818021 (45h43m40.551085681s) [noise=true , address=104.36.82.41:4771 , piece_id=AYOBEAFPCAOUTTBFFHBI4TY27YM6QR6H7RVDB7G5G4PSQW3P3DWA, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.819865650 (45h43m40.551133301s) [noise=true , address=104.36.82.58:4268 , piece_id=JJN3LQBXJKEGV2HIC4VVWKBN6MAECNABHQCM7GBDKATXZKXRD5OA, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.820243354 (45h43m40.551511005s) [noise=true , address=104.36.82.44:4876 , piece_id=RUKE6OD5LYA4YNMRUJCJOEXX77PQ4DUIZWWTCQYLXCB42VY732BA, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.820372275 (45h43m40.551639926s) [noise=true , address=104.36.82.43:4864 , piece_id=W3QY4CMQHRNFJFC6FC3GGGPY2G3EAYRYXUWA6TO57EXALJGKTIDQ, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.820667828 (45h43m40.551935478s) [noise=true , address=104.36.82.60:4358 , piece_id=XZDJXSAJ2MZM7RIKQZLCIWAINBYXPI6ZWXK7BFMTA5NLND2ZMKJQ, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.820804262 (45h43m40.552071912s) [noise=true , address=104.36.82.62:4422 , piece_id=4IAGLHJZ4J43DKP43PEQFGBKV225NGMCSNLYTTYTZGW7FB7HN23Q, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.821082061 (45h43m40.552349711s) [noise=true , address=104.36.82.46:4491 , piece_id=VZXBE2ECF4IBUKOZ6SY7P4DE3CYISEWOW73OIG6RRCS5WZWOAXOA, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.821217544 (45h43m40.552485194s) [noise=true , address=64.49.13.26:4945 , piece_id=TUGINSBWLBR53QZQ6UWI7KELNW6PFQVSOKU4N3SURLRKAXLYO24A, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.821448986 (45h43m40.552716636s) [noise=true , address=104.36.82.45:4919 , piece_id=3JU4456N26HY7ESXJLYCO57L7CI5X7OUB3IKFFTFMUHSGTCEFYYA, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.821577575 (45h43m40.552845225s) [noise=true , address=104.36.82.16:4299 , piece_id=O3UULS4AO5ZBITQ6JHR2OHCRTR35XIJP4BX467RJTP3AP63DPGIA, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.821955511 (45h43m40.553223161s) [noise=true , address=104.36.82.14:4249 , piece_id=ASCWPLO4VIJLAEOJMBJER3JCZ2PHU6V6HT6GT4WJLBS2TOHIY4XQ, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.822413426 (45h43m40.553681076s) [noise=true , address=45.91.116.9:4287 , piece_id=VZVV2UM5PGMQ57Q4ZA5FNVBV5WMRVSFXNKG7LACMFIRIK2TU23JA, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.822804857 (45h43m40.554072507s) [noise=true , address=77.90.31.19:4849 , piece_id=HV7U2FY6PULU2NTDL3J6Q4UZO22PVJOMBECTF5DZOKMODIC53E6Q, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.823192029 (45h43m40.554459679s) [noise=true , address=104.36.82.38:4697 , piece_id=MSEIITRWMQUQSN5UXTNWCB5OXHIDJLEUAMAO5AEWHZI66QR2JT3Q, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.984896781 (45h43m40.716164432s) [upload=47611]: Next returned nil segment
Aug 10 15:09:59.984932287 (45h43m40.716199928s) [upload=47611]: Waiting for error group managing segments...
Aug 10 15:09:59.997630360 (45h43m40.72889801s) [noise=true , address=104.36.82.14:4249 , piece_id=ASCWPLO4VIJLAEOJMBJER3JCZ2PHU6V6HT6GT4WJLBS2TOHIY4XQ, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.001635787 (45h43m40.732903427s) [noise=true , address=104.36.82.46:4491 , piece_id=VZXBE2ECF4IBUKOZ6SY7P4DE3CYISEWOW73OIG6RRCS5WZWOAXOA, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.003020712 (45h43m40.734288352s) [noise=true , address=104.36.82.62:4422 , piece_id=4IAGLHJZ4J43DKP43PEQFGBKV225NGMCSNLYTTYTZGW7FB7HN23Q, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.003308269 (45h43m40.734575909s) [noise=true , address=104.36.82.44:4876 , piece_id=RUKE6OD5LYA4YNMRUJCJOEXX77PQ4DUIZWWTCQYLXCB42VY732BA, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.004821423 (45h43m40.736089063s) [noise=true , address=104.36.82.58:4268 , piece_id=JJN3LQBXJKEGV2HIC4VVWKBN6MAECNABHQCM7GBDKATXZKXRD5OA, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.011997037 (45h43m40.743264667s) [noise=true , address=104.36.82.37:4661 , piece_id=25FX3LY55YQNXAOXOSCNWNPANDP2TBKDK26IFXLGFLDMQWPWOSOQ, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.015508351 (45h43m40.746775972s) [noise=true , address=104.36.82.38:4697 , piece_id=MSEIITRWMQUQSN5UXTNWCB5OXHIDJLEUAMAO5AEWHZI66QR2JT3Q, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.018242986 (45h43m40.749510606s) [noise=true , address=104.36.82.62:4435 , piece_id=B5MPTEKOAB3QENCP5KOY5VOMEBNHQLBFNY25V4G7YN75YHVGLTUA, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.020890178 (45h43m40.752157808s) [noise=true , address=104.36.82.43:4864 , piece_id=W3QY4CMQHRNFJFC6FC3GGGPY2G3EAYRYXUWA6TO57EXALJGKTIDQ, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.028680359 (45h43m40.759947979s) [noise=true , address=104.36.82.45:4919 , piece_id=3JU4456N26HY7ESXJLYCO57L7CI5X7OUB3IKFFTFMUHSGTCEFYYA, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.029973602 (45h43m40.761241232s) [noise=true , address=104.36.82.60:4358 , piece_id=XZDJXSAJ2MZM7RIKQZLCIWAINBYXPI6ZWXK7BFMTA5NLND2ZMKJQ, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.037480355 (45h43m40.768747985s) [noise=true , address=104.36.82.3:4784 , piece_id=M3O5MSFKJR6JV7WNZFVBYIUANN7C4CJ6HOFFHK3MCAUC3KBFXJZA, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.037755499 (45h43m40.769023118s) [noise=true , address=104.36.82.9:4035 , piece_id=FG6PDKDR7JL4JVZQIBQ4L75Y7WGJIYYLGXOEOAIBMVXNZN67CI5Q, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.043057886 (45h43m40.774325517s) [noise=true , address=104.36.82.16:4299 , piece_id=O3UULS4AO5ZBITQ6JHR2OHCRTR35XIJP4BX467RJTP3AP63DPGIA, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.043074908 (45h43m40.774342538s) [seg_pos={0 0}, upload=47611]: Segment reached optimal threshold of 14 pieces.
Aug 10 15:10:00.043189661 (45h43m40.774457282s) [noise=true , address=77.90.31.19:4849 , piece_id=HV7U2FY6PULU2NTDL3J6Q4UZO22PVJOMBECTF5DZOKMODIC53E6Q, seg_pos={0 0}, upload=47611]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12F8hBt2nRQBHGzba5pPKyYJF37b7gRUnmBoZfDAYZAkYaUfk2V): protocol: expected piece hash; context canceled; EOF
Aug 10 15:10:00.043245917 (45h43m40.774513547s) [noise=true , address=104.36.82.41:4771 , piece_id=AYOBEAFPCAOUTTBFFHBI4TY27YM6QR6H7RVDB7G5G4PSQW3P3DWA, seg_pos={0 0}, upload=47611]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PggYtrfQ5ozsJL1HeAVJWc4jLvf5jiHspX3CgFY89swMimWto): protocol: expected piece hash; context canceled; EOF
Aug 10 15:10:00.043256808 (45h43m40.774524438s) [noise=true , address=45.91.116.9:4287 , piece_id=VZVV2UM5PGMQ57Q4ZA5FNVBV5WMRVSFXNKG7LACMFIRIK2TU23JA, seg_pos={0 0}, upload=47611]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cNuooGmeprkK8fRRBY5ZSAbWda7fdfPbYwbg3fV2TKGsYikwf): protocol: expected piece hash; context canceled; EOF
Aug 10 15:10:00.043367594 (45h43m40.774635224s) [noise=true , address=64.49.13.26:4945 , piece_id=TUGINSBWLBR53QZQ6UWI7KELNW6PFQVSOKU4N3SURLRKAXLYO24A, seg_pos={0 0}, upload=47611]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aPQ1AM7icmWJDhLQtS8pu3FCnun1peLjUdKZ7uBpAQ9yYrsYx): protocol: context canceled; context canceled
Aug 10 15:10:00.043377403 (45h43m40.774645033s) [seg_pos={0 0}, upload=47611]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 15:10:00.043428868 (45h43m40.774696498s) [upload=47611]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 15:10:00.043432135 (45h43m40.774699765s) [upload=47611]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 15:10:00.268407329 (45h43m40.999674979s) [upload=47611]: Done uploading segments...
Aug 10 15:10:00.268427305 (45h43m40.999694966s) [upload=47611]: Upload finished. err: <nil>
Duration: 732.88238ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....................X..........X....X......................] duration:
154.723675ms
FAIL (2025-08-10 15:50:52 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 15:37:14.062718051 (46h10m54.793985702s) [upload=48086]: Starting upload Aug 10 15:37:14.062837083 (46h10m54.794104734s) [upload=48086]: Done starting upload Aug 10 15:37:14.062979950 (46h10m54.794247601s) [upload=48086]: Uploading segments... Aug 10 15:37:14.063042687 (46h10m54.794310417s) [upload=48086]: Got next segment. Inline: true Aug 10 15:37:14.063052335 (46h10m54.794319985s) [upload=48086]: Waiting for error group managing segments... Aug 10 15:37:14.063101798 (46h10m54.794369448s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 15:37:14.063107228 (46h10m54.794374878s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 15:37:14.063110825 (46h10m54.794378475s) [upload=48086]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 15:37:14.065912845 (46h10m54.797180506s) [upload=48086]: Done uploading segments... Aug 10 15:37:14.065928184 (46h10m54.797195834s) [upload=48086]: Upload finished. err: metaclient: Too Many Requests
Duration: 154.747949ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
484.402147ms
FAIL (2025-08-10 15:50:39 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 10 15:09:59.787351700 (45h43m40.518619349s) [upload=47611]: Starting upload
Aug 10 15:09:59.787411981 (45h43m40.518679632s) [upload=47611]: Done starting upload
Aug 10 15:09:59.787658021 (45h43m40.518925681s) [upload=47611]: Uploading segments...
Aug 10 15:09:59.788012333 (45h43m40.519279982s) [upload=47611]: Got next segment. Inline: false
Aug 10 15:09:59.788100537 (45h43m40.519368187s) [upload=47611]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 15:09:59.788109734 (45h43m40.519377394s) [upload=47611]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 15:09:59.818839786 (45h43m40.550107435s) [seg_pos={0 0}, upload=47611]: Begin upload segment...
Aug 10 15:09:59.818880411 (45h43m40.550148062s) [seg_pos={0 0}, upload=47611]: Done begin upload segment.
Aug 10 15:09:59.818939441 (45h43m40.550207091s) [noise=true , address=104.36.82.3:4784 , piece_id=M3O5MSFKJR6JV7WNZFVBYIUANN7C4CJ6HOFFHK3MCAUC3KBFXJZA, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.818961633 (45h43m40.550229283s) [noise=true , address=104.36.82.9:4035 , piece_id=FG6PDKDR7JL4JVZQIBQ4L75Y7WGJIYYLGXOEOAIBMVXNZN67CI5Q, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.819429006 (45h43m40.550696655s) [noise=true , address=104.36.82.37:4661 , piece_id=25FX3LY55YQNXAOXOSCNWNPANDP2TBKDK26IFXLGFLDMQWPWOSOQ, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.819461846 (45h43m40.550729496s) [noise=true , address=104.36.82.62:4435 , piece_id=B5MPTEKOAB3QENCP5KOY5VOMEBNHQLBFNY25V4G7YN75YHVGLTUA, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.819818021 (45h43m40.551085681s) [noise=true , address=104.36.82.41:4771 , piece_id=AYOBEAFPCAOUTTBFFHBI4TY27YM6QR6H7RVDB7G5G4PSQW3P3DWA, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.819865650 (45h43m40.551133301s) [noise=true , address=104.36.82.58:4268 , piece_id=JJN3LQBXJKEGV2HIC4VVWKBN6MAECNABHQCM7GBDKATXZKXRD5OA, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.820243354 (45h43m40.551511005s) [noise=true , address=104.36.82.44:4876 , piece_id=RUKE6OD5LYA4YNMRUJCJOEXX77PQ4DUIZWWTCQYLXCB42VY732BA, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.820372275 (45h43m40.551639926s) [noise=true , address=104.36.82.43:4864 , piece_id=W3QY4CMQHRNFJFC6FC3GGGPY2G3EAYRYXUWA6TO57EXALJGKTIDQ, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.820667828 (45h43m40.551935478s) [noise=true , address=104.36.82.60:4358 , piece_id=XZDJXSAJ2MZM7RIKQZLCIWAINBYXPI6ZWXK7BFMTA5NLND2ZMKJQ, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.820804262 (45h43m40.552071912s) [noise=true , address=104.36.82.62:4422 , piece_id=4IAGLHJZ4J43DKP43PEQFGBKV225NGMCSNLYTTYTZGW7FB7HN23Q, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.821082061 (45h43m40.552349711s) [noise=true , address=104.36.82.46:4491 , piece_id=VZXBE2ECF4IBUKOZ6SY7P4DE3CYISEWOW73OIG6RRCS5WZWOAXOA, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.821217544 (45h43m40.552485194s) [noise=true , address=64.49.13.26:4945 , piece_id=TUGINSBWLBR53QZQ6UWI7KELNW6PFQVSOKU4N3SURLRKAXLYO24A, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.821448986 (45h43m40.552716636s) [noise=true , address=104.36.82.45:4919 , piece_id=3JU4456N26HY7ESXJLYCO57L7CI5X7OUB3IKFFTFMUHSGTCEFYYA, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.821577575 (45h43m40.552845225s) [noise=true , address=104.36.82.16:4299 , piece_id=O3UULS4AO5ZBITQ6JHR2OHCRTR35XIJP4BX467RJTP3AP63DPGIA, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.821955511 (45h43m40.553223161s) [noise=true , address=104.36.82.14:4249 , piece_id=ASCWPLO4VIJLAEOJMBJER3JCZ2PHU6V6HT6GT4WJLBS2TOHIY4XQ, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.822413426 (45h43m40.553681076s) [noise=true , address=45.91.116.9:4287 , piece_id=VZVV2UM5PGMQ57Q4ZA5FNVBV5WMRVSFXNKG7LACMFIRIK2TU23JA, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.822804857 (45h43m40.554072507s) [noise=true , address=77.90.31.19:4849 , piece_id=HV7U2FY6PULU2NTDL3J6Q4UZO22PVJOMBECTF5DZOKMODIC53E6Q, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.823192029 (45h43m40.554459679s) [noise=true , address=104.36.82.38:4697 , piece_id=MSEIITRWMQUQSN5UXTNWCB5OXHIDJLEUAMAO5AEWHZI66QR2JT3Q, seg_pos={0 0}, upload=47611]: Uploading piece...
Aug 10 15:09:59.984896781 (45h43m40.716164432s) [upload=47611]: Next returned nil segment
Aug 10 15:09:59.984932287 (45h43m40.716199928s) [upload=47611]: Waiting for error group managing segments...
Aug 10 15:09:59.997630360 (45h43m40.72889801s) [noise=true , address=104.36.82.14:4249 , piece_id=ASCWPLO4VIJLAEOJMBJER3JCZ2PHU6V6HT6GT4WJLBS2TOHIY4XQ, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.001635787 (45h43m40.732903427s) [noise=true , address=104.36.82.46:4491 , piece_id=VZXBE2ECF4IBUKOZ6SY7P4DE3CYISEWOW73OIG6RRCS5WZWOAXOA, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.003020712 (45h43m40.734288352s) [noise=true , address=104.36.82.62:4422 , piece_id=4IAGLHJZ4J43DKP43PEQFGBKV225NGMCSNLYTTYTZGW7FB7HN23Q, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.003308269 (45h43m40.734575909s) [noise=true , address=104.36.82.44:4876 , piece_id=RUKE6OD5LYA4YNMRUJCJOEXX77PQ4DUIZWWTCQYLXCB42VY732BA, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.004821423 (45h43m40.736089063s) [noise=true , address=104.36.82.58:4268 , piece_id=JJN3LQBXJKEGV2HIC4VVWKBN6MAECNABHQCM7GBDKATXZKXRD5OA, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.011997037 (45h43m40.743264667s) [noise=true , address=104.36.82.37:4661 , piece_id=25FX3LY55YQNXAOXOSCNWNPANDP2TBKDK26IFXLGFLDMQWPWOSOQ, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.015508351 (45h43m40.746775972s) [noise=true , address=104.36.82.38:4697 , piece_id=MSEIITRWMQUQSN5UXTNWCB5OXHIDJLEUAMAO5AEWHZI66QR2JT3Q, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.018242986 (45h43m40.749510606s) [noise=true , address=104.36.82.62:4435 , piece_id=B5MPTEKOAB3QENCP5KOY5VOMEBNHQLBFNY25V4G7YN75YHVGLTUA, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.020890178 (45h43m40.752157808s) [noise=true , address=104.36.82.43:4864 , piece_id=W3QY4CMQHRNFJFC6FC3GGGPY2G3EAYRYXUWA6TO57EXALJGKTIDQ, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.028680359 (45h43m40.759947979s) [noise=true , address=104.36.82.45:4919 , piece_id=3JU4456N26HY7ESXJLYCO57L7CI5X7OUB3IKFFTFMUHSGTCEFYYA, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.029973602 (45h43m40.761241232s) [noise=true , address=104.36.82.60:4358 , piece_id=XZDJXSAJ2MZM7RIKQZLCIWAINBYXPI6ZWXK7BFMTA5NLND2ZMKJQ, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.037480355 (45h43m40.768747985s) [noise=true , address=104.36.82.3:4784 , piece_id=M3O5MSFKJR6JV7WNZFVBYIUANN7C4CJ6HOFFHK3MCAUC3KBFXJZA, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.037755499 (45h43m40.769023118s) [noise=true , address=104.36.82.9:4035 , piece_id=FG6PDKDR7JL4JVZQIBQ4L75Y7WGJIYYLGXOEOAIBMVXNZN67CI5Q, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.043057886 (45h43m40.774325517s) [noise=true , address=104.36.82.16:4299 , piece_id=O3UULS4AO5ZBITQ6JHR2OHCRTR35XIJP4BX467RJTP3AP63DPGIA, seg_pos={0 0}, upload=47611]: Done uploading piece. err: <nil>
Aug 10 15:10:00.043074908 (45h43m40.774342538s) [seg_pos={0 0}, upload=47611]: Segment reached optimal threshold of 14 pieces.
Aug 10 15:10:00.043189661 (45h43m40.774457282s) [noise=true , address=77.90.31.19:4849 , piece_id=HV7U2FY6PULU2NTDL3J6Q4UZO22PVJOMBECTF5DZOKMODIC53E6Q, seg_pos={0 0}, upload=47611]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12F8hBt2nRQBHGzba5pPKyYJF37b7gRUnmBoZfDAYZAkYaUfk2V): protocol: expected piece hash; context canceled; EOF
Aug 10 15:10:00.043245917 (45h43m40.774513547s) [noise=true , address=104.36.82.41:4771 , piece_id=AYOBEAFPCAOUTTBFFHBI4TY27YM6QR6H7RVDB7G5G4PSQW3P3DWA, seg_pos={0 0}, upload=47611]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PggYtrfQ5ozsJL1HeAVJWc4jLvf5jiHspX3CgFY89swMimWto): protocol: expected piece hash; context canceled; EOF
Aug 10 15:10:00.043256808 (45h43m40.774524438s) [noise=true , address=45.91.116.9:4287 , piece_id=VZVV2UM5PGMQ57Q4ZA5FNVBV5WMRVSFXNKG7LACMFIRIK2TU23JA, seg_pos={0 0}, upload=47611]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cNuooGmeprkK8fRRBY5ZSAbWda7fdfPbYwbg3fV2TKGsYikwf): protocol: expected piece hash; context canceled; EOF
Aug 10 15:10:00.043367594 (45h43m40.774635224s) [noise=true , address=64.49.13.26:4945 , piece_id=TUGINSBWLBR53QZQ6UWI7KELNW6PFQVSOKU4N3SURLRKAXLYO24A, seg_pos={0 0}, upload=47611]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aPQ1AM7icmWJDhLQtS8pu3FCnun1peLjUdKZ7uBpAQ9yYrsYx): protocol: context canceled; context canceled
Aug 10 15:10:00.043377403 (45h43m40.774645033s) [seg_pos={0 0}, upload=47611]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 15:10:00.043428868 (45h43m40.774696498s) [upload=47611]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 15:10:00.043432135 (45h43m40.774699765s) [upload=47611]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 15:10:00.268407329 (45h43m40.999674979s) [upload=47611]: Done uploading segments...
Aug 10 15:10:00.268427305 (45h43m40.999694966s) [upload=47611]: Upload finished. err: <nil>
Duration: 484.426761ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|