Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............X.............X................................] duration:
842.858361ms
FAIL (2025-08-16 16:44:54 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 16:21:19.736330105 (190h55m0.467597755s) [upload=198661]: Starting upload Aug 16 16:21:19.736403663 (190h55m0.467671313s) [upload=198661]: Done starting upload Aug 16 16:21:19.736486540 (190h55m0.467754189s) [upload=198661]: Uploading segments... Aug 16 16:21:19.736523800 (190h55m0.467791449s) [upload=198661]: Got next segment. Inline: true Aug 16 16:21:19.736529099 (190h55m0.467796749s) [upload=198661]: Waiting for error group managing segments... Aug 16 16:21:19.736572000 (190h55m0.467839651s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 16:21:19.736577090 (190h55m0.467844741s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 16:21:19.736580446 (190h55m0.467848097s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 16:21:19.820858302 (190h55m0.552125953s) [upload=198661]: Done uploading segments... Aug 16 16:21:19.820875544 (190h55m0.552143195s) [upload=198661]: Upload finished. err: metaclient: Too Many Requests
Duration: 842.885442ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................................X...........X.............] duration:
1.906762973s
FAIL (2025-08-16 16:44:43 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 16:34:51.979160810 (191h8m32.71042844s) [upload=198890]: Starting upload Aug 16 16:34:51.979207778 (191h8m32.710475398s) [upload=198890]: Done starting upload Aug 16 16:34:51.979295684 (191h8m32.710563334s) [upload=198890]: Uploading segments... Aug 16 16:34:51.979544794 (191h8m32.710812453s) [upload=198890]: Got next segment. Inline: false Aug 16 16:34:51.979588906 (191h8m32.710856556s) [upload=198890]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 16:34:51.979594416 (191h8m32.710862066s) [upload=198890]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 16:34:51.984510412 (191h8m32.715778062s) [upload=198890]: Next segment err: metaclient: Too Many Requests Aug 16 16:34:51.984539697 (191h8m32.715807357s) [upload=198890]: Done uploading segments... Aug 16 16:34:51.984555236 (191h8m32.715822886s) [upload=198890]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.906779855s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............X.............X...............................] duration:
2.402530678s
FAIL (2025-08-16 16:44:04 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 16:21:19.736330105 (190h55m0.467597755s) [upload=198661]: Starting upload Aug 16 16:21:19.736403663 (190h55m0.467671313s) [upload=198661]: Done starting upload Aug 16 16:21:19.736486540 (190h55m0.467754189s) [upload=198661]: Uploading segments... Aug 16 16:21:19.736523800 (190h55m0.467791449s) [upload=198661]: Got next segment. Inline: true Aug 16 16:21:19.736529099 (190h55m0.467796749s) [upload=198661]: Waiting for error group managing segments... Aug 16 16:21:19.736572000 (190h55m0.467839651s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 16:21:19.736577090 (190h55m0.467844741s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 16:21:19.736580446 (190h55m0.467848097s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 16:21:19.820858302 (190h55m0.552125953s) [upload=198661]: Done uploading segments... Aug 16 16:21:19.820875544 (190h55m0.552143195s) [upload=198661]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.402558812s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................................X...........X............] duration:
2.727221208s
FAIL (2025-08-16 16:44:00 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 16:34:51.979160810 (191h8m32.71042844s) [upload=198890]: Starting upload Aug 16 16:34:51.979207778 (191h8m32.710475398s) [upload=198890]: Done starting upload Aug 16 16:34:51.979295684 (191h8m32.710563334s) [upload=198890]: Uploading segments... Aug 16 16:34:51.979544794 (191h8m32.710812453s) [upload=198890]: Got next segment. Inline: false Aug 16 16:34:51.979588906 (191h8m32.710856556s) [upload=198890]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 16:34:51.979594416 (191h8m32.710862066s) [upload=198890]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 16:34:51.984510412 (191h8m32.715778062s) [upload=198890]: Next segment err: metaclient: Too Many Requests Aug 16 16:34:51.984539697 (191h8m32.715807357s) [upload=198890]: Done uploading segments... Aug 16 16:34:51.984555236 (191h8m32.715822886s) [upload=198890]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.727240896s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............X.............X..............................] duration:
5.841890656s
FAIL (2025-08-16 16:43:31 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 16:21:19.736330105 (190h55m0.467597755s) [upload=198661]: Starting upload Aug 16 16:21:19.736403663 (190h55m0.467671313s) [upload=198661]: Done starting upload Aug 16 16:21:19.736486540 (190h55m0.467754189s) [upload=198661]: Uploading segments... Aug 16 16:21:19.736523800 (190h55m0.467791449s) [upload=198661]: Got next segment. Inline: true Aug 16 16:21:19.736529099 (190h55m0.467796749s) [upload=198661]: Waiting for error group managing segments... Aug 16 16:21:19.736572000 (190h55m0.467839651s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 16:21:19.736577090 (190h55m0.467844741s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 16:21:19.736580446 (190h55m0.467848097s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 16:21:19.820858302 (190h55m0.552125953s) [upload=198661]: Done uploading segments... Aug 16 16:21:19.820875544 (190h55m0.552143195s) [upload=198661]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.841913158s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [................X.............X.............................] duration:
1.935475623s
FAIL (2025-08-16 16:43:06 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 16:21:19.736330105 (190h55m0.467597755s) [upload=198661]: Starting upload Aug 16 16:21:19.736403663 (190h55m0.467671313s) [upload=198661]: Done starting upload Aug 16 16:21:19.736486540 (190h55m0.467754189s) [upload=198661]: Uploading segments... Aug 16 16:21:19.736523800 (190h55m0.467791449s) [upload=198661]: Got next segment. Inline: true Aug 16 16:21:19.736529099 (190h55m0.467796749s) [upload=198661]: Waiting for error group managing segments... Aug 16 16:21:19.736572000 (190h55m0.467839651s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 16:21:19.736577090 (190h55m0.467844741s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 16:21:19.736580446 (190h55m0.467848097s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 16:21:19.820858302 (190h55m0.552125953s) [upload=198661]: Done uploading segments... Aug 16 16:21:19.820875544 (190h55m0.552143195s) [upload=198661]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.935497414s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....................................X...........X...........] duration:
1.66712988s
FAIL (2025-08-16 16:42:59 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 16:34:51.979160810 (191h8m32.71042844s) [upload=198890]: Starting upload Aug 16 16:34:51.979207778 (191h8m32.710475398s) [upload=198890]: Done starting upload Aug 16 16:34:51.979295684 (191h8m32.710563334s) [upload=198890]: Uploading segments... Aug 16 16:34:51.979544794 (191h8m32.710812453s) [upload=198890]: Got next segment. Inline: false Aug 16 16:34:51.979588906 (191h8m32.710856556s) [upload=198890]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 16:34:51.979594416 (191h8m32.710862066s) [upload=198890]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 16:34:51.984510412 (191h8m32.715778062s) [upload=198890]: Next segment err: metaclient: Too Many Requests Aug 16 16:34:51.984539697 (191h8m32.715807357s) [upload=198890]: Done uploading segments... Aug 16 16:34:51.984555236 (191h8m32.715822886s) [upload=198890]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.667153334s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....................................X...........X..........] duration:
3.859444486s
FAIL (2025-08-16 16:42:44 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 16:34:51.979160810 (191h8m32.71042844s) [upload=198890]: Starting upload Aug 16 16:34:51.979207778 (191h8m32.710475398s) [upload=198890]: Done starting upload Aug 16 16:34:51.979295684 (191h8m32.710563334s) [upload=198890]: Uploading segments... Aug 16 16:34:51.979544794 (191h8m32.710812453s) [upload=198890]: Got next segment. Inline: false Aug 16 16:34:51.979588906 (191h8m32.710856556s) [upload=198890]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 16:34:51.979594416 (191h8m32.710862066s) [upload=198890]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 16:34:51.984510412 (191h8m32.715778062s) [upload=198890]: Next segment err: metaclient: Too Many Requests Aug 16 16:34:51.984539697 (191h8m32.715807357s) [upload=198890]: Done uploading segments... Aug 16 16:34:51.984555236 (191h8m32.715822886s) [upload=198890]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.859472128s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......................................X...........X.........] duration:
3.306905505s
FAIL (2025-08-16 16:42:22 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 16:34:51.979160810 (191h8m32.71042844s) [upload=198890]: Starting upload Aug 16 16:34:51.979207778 (191h8m32.710475398s) [upload=198890]: Done starting upload Aug 16 16:34:51.979295684 (191h8m32.710563334s) [upload=198890]: Uploading segments... Aug 16 16:34:51.979544794 (191h8m32.710812453s) [upload=198890]: Got next segment. Inline: false Aug 16 16:34:51.979588906 (191h8m32.710856556s) [upload=198890]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 16:34:51.979594416 (191h8m32.710862066s) [upload=198890]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 16:34:51.984510412 (191h8m32.715778062s) [upload=198890]: Next segment err: metaclient: Too Many Requests Aug 16 16:34:51.984539697 (191h8m32.715807357s) [upload=198890]: Done uploading segments... Aug 16 16:34:51.984555236 (191h8m32.715822886s) [upload=198890]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.306937556s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................X.............X............................] duration:
4.33081718s
FAIL (2025-08-16 16:42:16 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 16:21:19.736330105 (190h55m0.467597755s) [upload=198661]: Starting upload Aug 16 16:21:19.736403663 (190h55m0.467671313s) [upload=198661]: Done starting upload Aug 16 16:21:19.736486540 (190h55m0.467754189s) [upload=198661]: Uploading segments... Aug 16 16:21:19.736523800 (190h55m0.467791449s) [upload=198661]: Got next segment. Inline: true Aug 16 16:21:19.736529099 (190h55m0.467796749s) [upload=198661]: Waiting for error group managing segments... Aug 16 16:21:19.736572000 (190h55m0.467839651s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 16:21:19.736577090 (190h55m0.467844741s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 16:21:19.736580446 (190h55m0.467848097s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 16:21:19.820858302 (190h55m0.552125953s) [upload=198661]: Done uploading segments... Aug 16 16:21:19.820875544 (190h55m0.552143195s) [upload=198661]: Upload finished. err: metaclient: Too Many Requests
Duration: 4.330845172s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................X.............X...........................] duration:
755.544262ms
FAIL (2025-08-16 16:41:45 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 16:21:19.736330105 (190h55m0.467597755s) [upload=198661]: Starting upload Aug 16 16:21:19.736403663 (190h55m0.467671313s) [upload=198661]: Done starting upload Aug 16 16:21:19.736486540 (190h55m0.467754189s) [upload=198661]: Uploading segments... Aug 16 16:21:19.736523800 (190h55m0.467791449s) [upload=198661]: Got next segment. Inline: true Aug 16 16:21:19.736529099 (190h55m0.467796749s) [upload=198661]: Waiting for error group managing segments... Aug 16 16:21:19.736572000 (190h55m0.467839651s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 16:21:19.736577090 (190h55m0.467844741s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 16:21:19.736580446 (190h55m0.467848097s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 16:21:19.820858302 (190h55m0.552125953s) [upload=198661]: Done uploading segments... Aug 16 16:21:19.820875544 (190h55m0.552143195s) [upload=198661]: Upload finished. err: metaclient: Too Many Requests
Duration: 755.597763ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......................................X...........X........] duration:
4.107062584s
FAIL (2025-08-16 16:41:09 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 16:34:51.979160810 (191h8m32.71042844s) [upload=198890]: Starting upload Aug 16 16:34:51.979207778 (191h8m32.710475398s) [upload=198890]: Done starting upload Aug 16 16:34:51.979295684 (191h8m32.710563334s) [upload=198890]: Uploading segments... Aug 16 16:34:51.979544794 (191h8m32.710812453s) [upload=198890]: Got next segment. Inline: false Aug 16 16:34:51.979588906 (191h8m32.710856556s) [upload=198890]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 16:34:51.979594416 (191h8m32.710862066s) [upload=198890]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 16:34:51.984510412 (191h8m32.715778062s) [upload=198890]: Next segment err: metaclient: Too Many Requests Aug 16 16:34:51.984539697 (191h8m32.715807357s) [upload=198890]: Done uploading segments... Aug 16 16:34:51.984555236 (191h8m32.715822886s) [upload=198890]: Upload finished. err: metaclient: Too Many Requests
Duration: 4.107078023s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...................X.............X..........................] duration:
2.27055676s
FAIL (2025-08-16 16:41:00 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 16:21:19.736330105 (190h55m0.467597755s) [upload=198661]: Starting upload Aug 16 16:21:19.736403663 (190h55m0.467671313s) [upload=198661]: Done starting upload Aug 16 16:21:19.736486540 (190h55m0.467754189s) [upload=198661]: Uploading segments... Aug 16 16:21:19.736523800 (190h55m0.467791449s) [upload=198661]: Got next segment. Inline: true Aug 16 16:21:19.736529099 (190h55m0.467796749s) [upload=198661]: Waiting for error group managing segments... Aug 16 16:21:19.736572000 (190h55m0.467839651s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 16:21:19.736577090 (190h55m0.467844741s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 16:21:19.736580446 (190h55m0.467848097s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 16:21:19.820858302 (190h55m0.552125953s) [upload=198661]: Done uploading segments... Aug 16 16:21:19.820875544 (190h55m0.552143195s) [upload=198661]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.270577639s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....................X.............X.........................] duration:
1.288261012s
FAIL (2025-08-16 16:40:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 16:21:19.736330105 (190h55m0.467597755s) [upload=198661]: Starting upload Aug 16 16:21:19.736403663 (190h55m0.467671313s) [upload=198661]: Done starting upload Aug 16 16:21:19.736486540 (190h55m0.467754189s) [upload=198661]: Uploading segments... Aug 16 16:21:19.736523800 (190h55m0.467791449s) [upload=198661]: Got next segment. Inline: true Aug 16 16:21:19.736529099 (190h55m0.467796749s) [upload=198661]: Waiting for error group managing segments... Aug 16 16:21:19.736572000 (190h55m0.467839651s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 16:21:19.736577090 (190h55m0.467844741s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 16:21:19.736580446 (190h55m0.467848097s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 16:21:19.820858302 (190h55m0.552125953s) [upload=198661]: Done uploading segments... Aug 16 16:21:19.820875544 (190h55m0.552143195s) [upload=198661]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.288289345s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........................................X...........X.......] duration:
1.233756018s
FAIL (2025-08-16 16:40:28 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 16:34:51.979160810 (191h8m32.71042844s) [upload=198890]: Starting upload Aug 16 16:34:51.979207778 (191h8m32.710475398s) [upload=198890]: Done starting upload Aug 16 16:34:51.979295684 (191h8m32.710563334s) [upload=198890]: Uploading segments... Aug 16 16:34:51.979544794 (191h8m32.710812453s) [upload=198890]: Got next segment. Inline: false Aug 16 16:34:51.979588906 (191h8m32.710856556s) [upload=198890]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 16:34:51.979594416 (191h8m32.710862066s) [upload=198890]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 16:34:51.984510412 (191h8m32.715778062s) [upload=198890]: Next segment err: metaclient: Too Many Requests Aug 16 16:34:51.984539697 (191h8m32.715807357s) [upload=198890]: Done uploading segments... Aug 16 16:34:51.984555236 (191h8m32.715822886s) [upload=198890]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.233783161s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........................................X...........X......] duration:
949.695967ms
FAIL (2025-08-16 16:39:25 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 16:34:51.979160810 (191h8m32.71042844s) [upload=198890]: Starting upload Aug 16 16:34:51.979207778 (191h8m32.710475398s) [upload=198890]: Done starting upload Aug 16 16:34:51.979295684 (191h8m32.710563334s) [upload=198890]: Uploading segments... Aug 16 16:34:51.979544794 (191h8m32.710812453s) [upload=198890]: Got next segment. Inline: false Aug 16 16:34:51.979588906 (191h8m32.710856556s) [upload=198890]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 16:34:51.979594416 (191h8m32.710862066s) [upload=198890]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 16:34:51.984510412 (191h8m32.715778062s) [upload=198890]: Next segment err: metaclient: Too Many Requests Aug 16 16:34:51.984539697 (191h8m32.715807357s) [upload=198890]: Done uploading segments... Aug 16 16:34:51.984555236 (191h8m32.715822886s) [upload=198890]: Upload finished. err: metaclient: Too Many Requests
Duration: 949.717739ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....................X.............X........................] duration:
579.382927ms
FAIL (2025-08-16 16:39:25 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 16:21:19.736330105 (190h55m0.467597755s) [upload=198661]: Starting upload Aug 16 16:21:19.736403663 (190h55m0.467671313s) [upload=198661]: Done starting upload Aug 16 16:21:19.736486540 (190h55m0.467754189s) [upload=198661]: Uploading segments... Aug 16 16:21:19.736523800 (190h55m0.467791449s) [upload=198661]: Got next segment. Inline: true Aug 16 16:21:19.736529099 (190h55m0.467796749s) [upload=198661]: Waiting for error group managing segments... Aug 16 16:21:19.736572000 (190h55m0.467839651s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 16:21:19.736577090 (190h55m0.467844741s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 16:21:19.736580446 (190h55m0.467848097s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 16:21:19.820858302 (190h55m0.552125953s) [upload=198661]: Done uploading segments... Aug 16 16:21:19.820875544 (190h55m0.552143195s) [upload=198661]: Upload finished. err: metaclient: Too Many Requests
Duration: 579.406271ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......................X.............X.......................] duration:
2.542121302s
FAIL (2025-08-16 16:38:36 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 16:21:19.736330105 (190h55m0.467597755s) [upload=198661]: Starting upload Aug 16 16:21:19.736403663 (190h55m0.467671313s) [upload=198661]: Done starting upload Aug 16 16:21:19.736486540 (190h55m0.467754189s) [upload=198661]: Uploading segments... Aug 16 16:21:19.736523800 (190h55m0.467791449s) [upload=198661]: Got next segment. Inline: true Aug 16 16:21:19.736529099 (190h55m0.467796749s) [upload=198661]: Waiting for error group managing segments... Aug 16 16:21:19.736572000 (190h55m0.467839651s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 16:21:19.736577090 (190h55m0.467844741s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 16:21:19.736580446 (190h55m0.467848097s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 16:21:19.820858302 (190h55m0.552125953s) [upload=198661]: Done uploading segments... Aug 16 16:21:19.820875544 (190h55m0.552143195s) [upload=198661]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.542138765s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........................................X...........X.....] duration:
4.739078749s
FAIL (2025-08-16 16:38:18 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 16:34:51.979160810 (191h8m32.71042844s) [upload=198890]: Starting upload Aug 16 16:34:51.979207778 (191h8m32.710475398s) [upload=198890]: Done starting upload Aug 16 16:34:51.979295684 (191h8m32.710563334s) [upload=198890]: Uploading segments... Aug 16 16:34:51.979544794 (191h8m32.710812453s) [upload=198890]: Got next segment. Inline: false Aug 16 16:34:51.979588906 (191h8m32.710856556s) [upload=198890]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 16:34:51.979594416 (191h8m32.710862066s) [upload=198890]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 16:34:51.984510412 (191h8m32.715778062s) [upload=198890]: Next segment err: metaclient: Too Many Requests Aug 16 16:34:51.984539697 (191h8m32.715807357s) [upload=198890]: Done uploading segments... Aug 16 16:34:51.984555236 (191h8m32.715822886s) [upload=198890]: Upload finished. err: metaclient: Too Many Requests
Duration: 4.739097504s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........................................X...........X....] duration:
4.758614008s
FAIL (2025-08-16 16:37:54 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 16:34:51.979160810 (191h8m32.71042844s) [upload=198890]: Starting upload Aug 16 16:34:51.979207778 (191h8m32.710475398s) [upload=198890]: Done starting upload Aug 16 16:34:51.979295684 (191h8m32.710563334s) [upload=198890]: Uploading segments... Aug 16 16:34:51.979544794 (191h8m32.710812453s) [upload=198890]: Got next segment. Inline: false Aug 16 16:34:51.979588906 (191h8m32.710856556s) [upload=198890]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 16:34:51.979594416 (191h8m32.710862066s) [upload=198890]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 16:34:51.984510412 (191h8m32.715778062s) [upload=198890]: Next segment err: metaclient: Too Many Requests Aug 16 16:34:51.984539697 (191h8m32.715807357s) [upload=198890]: Done uploading segments... Aug 16 16:34:51.984555236 (191h8m32.715822886s) [upload=198890]: Upload finished. err: metaclient: Too Many Requests
Duration: 4.758643534s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......................X.............X......................] duration:
3.91151942s
FAIL (2025-08-16 16:37:38 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 16:21:19.736330105 (190h55m0.467597755s) [upload=198661]: Starting upload Aug 16 16:21:19.736403663 (190h55m0.467671313s) [upload=198661]: Done starting upload Aug 16 16:21:19.736486540 (190h55m0.467754189s) [upload=198661]: Uploading segments... Aug 16 16:21:19.736523800 (190h55m0.467791449s) [upload=198661]: Got next segment. Inline: true Aug 16 16:21:19.736529099 (190h55m0.467796749s) [upload=198661]: Waiting for error group managing segments... Aug 16 16:21:19.736572000 (190h55m0.467839651s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 16:21:19.736577090 (190h55m0.467844741s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 16:21:19.736580446 (190h55m0.467848097s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 16:21:19.820858302 (190h55m0.552125953s) [upload=198661]: Done uploading segments... Aug 16 16:21:19.820875544 (190h55m0.552143195s) [upload=198661]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.911541984s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [............................................X...........X...] duration:
3.755422046s
FAIL (2025-08-16 16:37:25 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 16:34:51.979160810 (191h8m32.71042844s) [upload=198890]: Starting upload Aug 16 16:34:51.979207778 (191h8m32.710475398s) [upload=198890]: Done starting upload Aug 16 16:34:51.979295684 (191h8m32.710563334s) [upload=198890]: Uploading segments... Aug 16 16:34:51.979544794 (191h8m32.710812453s) [upload=198890]: Got next segment. Inline: false Aug 16 16:34:51.979588906 (191h8m32.710856556s) [upload=198890]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 16:34:51.979594416 (191h8m32.710862066s) [upload=198890]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 16:34:51.984510412 (191h8m32.715778062s) [upload=198890]: Next segment err: metaclient: Too Many Requests Aug 16 16:34:51.984539697 (191h8m32.715807357s) [upload=198890]: Done uploading segments... Aug 16 16:34:51.984555236 (191h8m32.715822886s) [upload=198890]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.755477501s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........................X.............X.....................] duration:
4.607344176s
FAIL (2025-08-16 16:37:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 16:21:19.736330105 (190h55m0.467597755s) [upload=198661]: Starting upload Aug 16 16:21:19.736403663 (190h55m0.467671313s) [upload=198661]: Done starting upload Aug 16 16:21:19.736486540 (190h55m0.467754189s) [upload=198661]: Uploading segments... Aug 16 16:21:19.736523800 (190h55m0.467791449s) [upload=198661]: Got next segment. Inline: true Aug 16 16:21:19.736529099 (190h55m0.467796749s) [upload=198661]: Waiting for error group managing segments... Aug 16 16:21:19.736572000 (190h55m0.467839651s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 16:21:19.736577090 (190h55m0.467844741s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 16:21:19.736580446 (190h55m0.467848097s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 16:21:19.820858302 (190h55m0.552125953s) [upload=198661]: Done uploading segments... Aug 16 16:21:19.820875544 (190h55m0.552143195s) [upload=198661]: Upload finished. err: metaclient: Too Many Requests
Duration: 4.607371656s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............................................X...........X..] duration:
2.721389017s
FAIL (2025-08-16 16:36:42 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 16:34:51.979160810 (191h8m32.71042844s) [upload=198890]: Starting upload Aug 16 16:34:51.979207778 (191h8m32.710475398s) [upload=198890]: Done starting upload Aug 16 16:34:51.979295684 (191h8m32.710563334s) [upload=198890]: Uploading segments... Aug 16 16:34:51.979544794 (191h8m32.710812453s) [upload=198890]: Got next segment. Inline: false Aug 16 16:34:51.979588906 (191h8m32.710856556s) [upload=198890]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 16:34:51.979594416 (191h8m32.710862066s) [upload=198890]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 16:34:51.984510412 (191h8m32.715778062s) [upload=198890]: Next segment err: metaclient: Too Many Requests Aug 16 16:34:51.984539697 (191h8m32.715807357s) [upload=198890]: Done uploading segments... Aug 16 16:34:51.984555236 (191h8m32.715822886s) [upload=198890]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.721430035s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........................X.............X....................] duration:
1.361318498s
FAIL (2025-08-16 16:36:24 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 16:21:19.736330105 (190h55m0.467597755s) [upload=198661]: Starting upload Aug 16 16:21:19.736403663 (190h55m0.467671313s) [upload=198661]: Done starting upload Aug 16 16:21:19.736486540 (190h55m0.467754189s) [upload=198661]: Uploading segments... Aug 16 16:21:19.736523800 (190h55m0.467791449s) [upload=198661]: Got next segment. Inline: true Aug 16 16:21:19.736529099 (190h55m0.467796749s) [upload=198661]: Waiting for error group managing segments... Aug 16 16:21:19.736572000 (190h55m0.467839651s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 16:21:19.736577090 (190h55m0.467844741s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 16:21:19.736580446 (190h55m0.467848097s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 16:21:19.820858302 (190h55m0.552125953s) [upload=198661]: Done uploading segments... Aug 16 16:21:19.820875544 (190h55m0.552143195s) [upload=198661]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.361379653s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............................................X...........X.] duration:
1.679650811s
FAIL (2025-08-16 16:35:39 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 16:34:51.979160810 (191h8m32.71042844s) [upload=198890]: Starting upload Aug 16 16:34:51.979207778 (191h8m32.710475398s) [upload=198890]: Done starting upload Aug 16 16:34:51.979295684 (191h8m32.710563334s) [upload=198890]: Uploading segments... Aug 16 16:34:51.979544794 (191h8m32.710812453s) [upload=198890]: Got next segment. Inline: false Aug 16 16:34:51.979588906 (191h8m32.710856556s) [upload=198890]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 16:34:51.979594416 (191h8m32.710862066s) [upload=198890]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 16:34:51.984510412 (191h8m32.715778062s) [upload=198890]: Next segment err: metaclient: Too Many Requests Aug 16 16:34:51.984539697 (191h8m32.715807357s) [upload=198890]: Done uploading segments... Aug 16 16:34:51.984555236 (191h8m32.715822886s) [upload=198890]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.679678163s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........................X.............X...................] duration:
624.027225ms
FAIL (2025-08-16 16:35:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 16:21:19.736330105 (190h55m0.467597755s) [upload=198661]: Starting upload Aug 16 16:21:19.736403663 (190h55m0.467671313s) [upload=198661]: Done starting upload Aug 16 16:21:19.736486540 (190h55m0.467754189s) [upload=198661]: Uploading segments... Aug 16 16:21:19.736523800 (190h55m0.467791449s) [upload=198661]: Got next segment. Inline: true Aug 16 16:21:19.736529099 (190h55m0.467796749s) [upload=198661]: Waiting for error group managing segments... Aug 16 16:21:19.736572000 (190h55m0.467839651s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 16:21:19.736577090 (190h55m0.467844741s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 16:21:19.736580446 (190h55m0.467848097s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 16:21:19.820858302 (190h55m0.552125953s) [upload=198661]: Done uploading segments... Aug 16 16:21:19.820875544 (190h55m0.552143195s) [upload=198661]: Upload finished. err: metaclient: Too Many Requests
Duration: 624.054687ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............................................X...........X] duration:
19.007208ms
FAIL (2025-08-16 16:34:51 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 16:34:51.979160810 (191h8m32.71042844s) [upload=198890]: Starting upload Aug 16 16:34:51.979207778 (191h8m32.710475398s) [upload=198890]: Done starting upload Aug 16 16:34:51.979295684 (191h8m32.710563334s) [upload=198890]: Uploading segments... Aug 16 16:34:51.979544794 (191h8m32.710812453s) [upload=198890]: Got next segment. Inline: false Aug 16 16:34:51.979588906 (191h8m32.710856556s) [upload=198890]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 16:34:51.979594416 (191h8m32.710862066s) [upload=198890]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 16:34:51.984510412 (191h8m32.715778062s) [upload=198890]: Next segment err: metaclient: Too Many Requests Aug 16 16:34:51.984539697 (191h8m32.715807357s) [upload=198890]: Done uploading segments... Aug 16 16:34:51.984555236 (191h8m32.715822886s) [upload=198890]: Upload finished. err: metaclient: Too Many Requests
Duration: 19.024882ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........................X.............X..................] duration:
809.668909ms
FAIL (2025-08-16 16:34:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 16:21:19.736330105 (190h55m0.467597755s) [upload=198661]: Starting upload Aug 16 16:21:19.736403663 (190h55m0.467671313s) [upload=198661]: Done starting upload Aug 16 16:21:19.736486540 (190h55m0.467754189s) [upload=198661]: Uploading segments... Aug 16 16:21:19.736523800 (190h55m0.467791449s) [upload=198661]: Got next segment. Inline: true Aug 16 16:21:19.736529099 (190h55m0.467796749s) [upload=198661]: Waiting for error group managing segments... Aug 16 16:21:19.736572000 (190h55m0.467839651s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 16:21:19.736577090 (190h55m0.467844741s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 16:21:19.736580446 (190h55m0.467848097s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 16:21:19.820858302 (190h55m0.552125953s) [upload=198661]: Done uploading segments... Aug 16 16:21:19.820875544 (190h55m0.552143195s) [upload=198661]: Upload finished. err: metaclient: Too Many Requests
Duration: 809.693595ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [............................X.............X.................] duration:
1.211422132s
FAIL (2025-08-16 16:34:20 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 16:21:19.736330105 (190h55m0.467597755s) [upload=198661]: Starting upload Aug 16 16:21:19.736403663 (190h55m0.467671313s) [upload=198661]: Done starting upload Aug 16 16:21:19.736486540 (190h55m0.467754189s) [upload=198661]: Uploading segments... Aug 16 16:21:19.736523800 (190h55m0.467791449s) [upload=198661]: Got next segment. Inline: true Aug 16 16:21:19.736529099 (190h55m0.467796749s) [upload=198661]: Waiting for error group managing segments... Aug 16 16:21:19.736572000 (190h55m0.467839651s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 16:21:19.736577090 (190h55m0.467844741s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 16:21:19.736580446 (190h55m0.467848097s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 16:21:19.820858302 (190h55m0.552125953s) [upload=198661]: Done uploading segments... Aug 16 16:21:19.820875544 (190h55m0.552143195s) [upload=198661]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.211444904s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
922.927837ms
FAIL (2025-08-16 16:33:59 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 16 16:25:38.589284525 (190h59m19.320552175s) [upload=198736]: Starting upload
Aug 16 16:25:38.589354917 (190h59m19.320622567s) [upload=198736]: Done starting upload
Aug 16 16:25:38.589422014 (190h59m19.320689664s) [upload=198736]: Uploading segments...
Aug 16 16:25:38.589832156 (190h59m19.321099816s) [upload=198736]: Got next segment. Inline: false
Aug 16 16:25:38.589885355 (190h59m19.321153006s) [upload=198736]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 16:25:38.589890937 (190h59m19.321158586s) [upload=198736]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 16:25:38.636921366 (190h59m19.368189006s) [seg_pos={0 0}, upload=198736]: Begin upload segment...
Aug 16 16:25:38.636952475 (190h59m19.368220105s) [seg_pos={0 0}, upload=198736]: Done begin upload segment.
Aug 16 16:25:38.636977401 (190h59m19.368245042s) [noise=true , address=104.36.82.37:4666 , piece_id=BOYG2Y63SKP77WWO3L3S4UT5CZ6S6ONXK2STIMSZ5O5OH3X7X4HQ, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.636991899 (190h59m19.368259529s) [noise=true , address=104.36.82.39:4753 , piece_id=Z5Z7NKHWB2JE33YSE6WQ4OZCATGA2V2FSDQBV52WTSUUNX5ZKTYA, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.637330737 (190h59m19.368598367s) [noise=true , address=104.36.82.58:4300 , piece_id=A64SYLHGFDQHRQVHCIUFXH4Y6EZGNFOO4GBGTY255IK3BZ4KNYAA, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.637399417 (190h59m19.368667057s) [noise=true , address=104.36.82.8:4981 , piece_id=WEG75O6JVV5NWY67IAWPJOJF5PHKJVR5HXN5HLP7PF4ZTESOYEWQ, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.637607759 (190h59m19.368875399s) [noise=true , address=45.91.116.13:4163 , piece_id=FYAB6ZWS2J45DCQDRQ3SHVGAJO4OYOPQIIIMRLCQBJQWDJ2L6PSQ, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.637772890 (190h59m19.36904054s) [noise=true , address=104.36.82.51:4083 , piece_id=7JS5X6FXOGG5LQ43FACBEQALYNPW6IXISBUTJYGBEX4YTRL45YWQ, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.637905380 (190h59m19.36917302s) [noise=true , address=45.91.116.7:4020 , piece_id=VU55DFYKGU3BKD26KBZ5RZBFLVGUC36SHCYOX6QT4MZJ32IHMU6Q, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.638112299 (190h59m19.369379949s) [noise=true , address=77.90.31.15:4706 , piece_id=22BB34RWLRZR3ME4HBGE7AJOAQUOUMT77CSWZCI5HUWNIF5NRG5A, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.638170219 (190h59m19.369437849s) [noise=true , address=77.90.31.12:4604 , piece_id=UQGOMGKXYVDFLW2JASS25GY2MF46OKJ27DODTWVJAIXBKKKPZL7A, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.638434356 (190h59m19.369701996s) [noise=true , address=104.36.82.38:4721 , piece_id=SZPHPJRSRSCCGGLA3EDDW3CH7FOJSMFFUUEMVCDFGK7USDYKPYIA, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.638487185 (190h59m19.369754835s) [noise=true , address=104.36.82.60:4339 , piece_id=PUIGSSRRS2G676MUKTKDAN4MDPU6ECV622WR6OCARTMNCYID2NIA, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.638723089 (190h59m19.36999073s) [noise=true , address=104.36.82.34:4561 , piece_id=64MOM5364NEFB45EP6PM6SKFJ7ZMXZXX5K5HN5VGLJSXYDSIFSWQ, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.638994480 (190h59m19.37026211s) [noise=true , address=77.90.31.19:4869 , piece_id=YVDEI2QSS5XDVFQZEHM6OFMFHRWOCK2L5636B623XG5ZSM2R7S3Q, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.639260581 (190h59m19.370528222s) [noise=true , address=77.90.31.12:4609 , piece_id=SQ7KFJRSFNJMSWLXSGZPWKZEH35WG3LLNCDMYWE352JFQC7VWSVQ, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.639524278 (190h59m19.370791919s) [noise=true , address=77.90.31.21:4912 , piece_id=7SR22XNESBXX2D3D3VFIHXIJJNFVTMQTW7N7T66GZN5KSD6UDYMA, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.639802412 (190h59m19.371070052s) [noise=true , address=104.36.82.44:4892 , piece_id=HCSMK323IRGKZHKCAUTPZGXFNG224OIOGBF7XPKD3UK6RBBELTWA, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.640090955 (190h59m19.371358595s) [noise=true , address=45.91.116.8:4074 , piece_id=22EVTJBLCMFIK2BTIXOYJA7O4WJ7DMG4G27X7AJAHCO42XGPUXFA, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.642267764 (190h59m19.373535405s) [noise=true , address=104.36.82.17:4333 , piece_id=MLH7DNUZWAJWCTT3BTXQIFUMUPCTMIY6VMSM22DLC3QB3XXNUURQ, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.756745546 (190h59m19.488013197s) [upload=198736]: Next returned nil segment
Aug 16 16:25:38.756760494 (190h59m19.488028145s) [upload=198736]: Waiting for error group managing segments...
Aug 16 16:25:38.771172176 (190h59m19.502439835s) [noise=true , address=104.36.82.17:4333 , piece_id=MLH7DNUZWAJWCTT3BTXQIFUMUPCTMIY6VMSM22DLC3QB3XXNUURQ, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.795367041 (190h59m19.526634691s) [noise=true , address=45.91.116.13:4163 , piece_id=FYAB6ZWS2J45DCQDRQ3SHVGAJO4OYOPQIIIMRLCQBJQWDJ2L6PSQ, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.801599668 (190h59m19.532867328s) [noise=true , address=77.90.31.12:4609 , piece_id=SQ7KFJRSFNJMSWLXSGZPWKZEH35WG3LLNCDMYWE352JFQC7VWSVQ, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.815582041 (190h59m19.546849691s) [noise=true , address=104.36.82.38:4721 , piece_id=SZPHPJRSRSCCGGLA3EDDW3CH7FOJSMFFUUEMVCDFGK7USDYKPYIA, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.821600254 (190h59m19.552867914s) [noise=true , address=104.36.82.51:4083 , piece_id=7JS5X6FXOGG5LQ43FACBEQALYNPW6IXISBUTJYGBEX4YTRL45YWQ, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.844363363 (190h59m19.575631023s) [noise=true , address=104.36.82.58:4300 , piece_id=A64SYLHGFDQHRQVHCIUFXH4Y6EZGNFOO4GBGTY255IK3BZ4KNYAA, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.847794134 (190h59m19.579061785s) [noise=true , address=45.91.116.8:4074 , piece_id=22EVTJBLCMFIK2BTIXOYJA7O4WJ7DMG4G27X7AJAHCO42XGPUXFA, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.849919236 (190h59m19.581186886s) [noise=true , address=45.91.116.7:4020 , piece_id=VU55DFYKGU3BKD26KBZ5RZBFLVGUC36SHCYOX6QT4MZJ32IHMU6Q, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.854844502 (190h59m19.586112162s) [noise=true , address=104.36.82.8:4981 , piece_id=WEG75O6JVV5NWY67IAWPJOJF5PHKJVR5HXN5HLP7PF4ZTESOYEWQ, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.857740616 (190h59m19.589008266s) [noise=true , address=77.90.31.12:4604 , piece_id=UQGOMGKXYVDFLW2JASS25GY2MF46OKJ27DODTWVJAIXBKKKPZL7A, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.858644869 (190h59m19.589912529s) [noise=true , address=104.36.82.37:4666 , piece_id=BOYG2Y63SKP77WWO3L3S4UT5CZ6S6ONXK2STIMSZ5O5OH3X7X4HQ, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.930113343 (190h59m19.661380993s) [noise=true , address=104.36.82.44:4892 , piece_id=HCSMK323IRGKZHKCAUTPZGXFNG224OIOGBF7XPKD3UK6RBBELTWA, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.930599448 (190h59m19.661867099s) [noise=true , address=104.36.82.34:4561 , piece_id=64MOM5364NEFB45EP6PM6SKFJ7ZMXZXX5K5HN5VGLJSXYDSIFSWQ, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.934160795 (190h59m19.665428445s) [noise=true , address=104.36.82.39:4753 , piece_id=Z5Z7NKHWB2JE33YSE6WQ4OZCATGA2V2FSDQBV52WTSUUNX5ZKTYA, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.934194257 (190h59m19.665461908s) [seg_pos={0 0}, upload=198736]: Segment reached optimal threshold of 14 pieces.
Aug 16 16:25:38.934403091 (190h59m19.665670741s) [noise=true , address=77.90.31.21:4912 , piece_id=7SR22XNESBXX2D3D3VFIHXIJJNFVTMQTW7N7T66GZN5KSD6UDYMA, seg_pos={0 0}, upload=198736]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SFktrdgGxzEZue49XWkNxVZfrpHA73M2H3hRX7NXnvwVnvbv1): protocol: expected piece hash; write tcp 5.161.89.252:28854->77.90.31.21:4912: use of closed network connection; write tcp 5.161.89.252:28854->77.90.31.21:4912: use of closed network connection; EOF
Aug 16 16:25:38.934585955 (190h59m19.665853615s) [noise=true , address=104.36.82.60:4339 , piece_id=PUIGSSRRS2G676MUKTKDAN4MDPU6ECV622WR6OCARTMNCYID2NIA, seg_pos={0 0}, upload=198736]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R): protocol: expected piece hash; context canceled; EOF
Aug 16 16:25:38.934641310 (190h59m19.66590896s) [noise=true , address=77.90.31.19:4869 , piece_id=YVDEI2QSS5XDVFQZEHM6OFMFHRWOCK2L5636B623XG5ZSM2R7S3Q, seg_pos={0 0}, upload=198736]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129refeNg3BsDCThccHdMUJgitGM942qREieZCP2UYoicRAtFN8): protocol: expected piece hash; context canceled; EOF
Aug 16 16:25:38.934752820 (190h59m19.666020471s) [noise=true , address=77.90.31.15:4706 , piece_id=22BB34RWLRZR3ME4HBGE7AJOAQUOUMT77CSWZCI5HUWNIF5NRG5A, seg_pos={0 0}, upload=198736]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YZZnCo54XknuvoBoVtRudXSnoWdNdrn23Lp6Gou3g451BzUwG): protocol: rpc: dial tcp 77.90.31.15:4706: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 16:25:38.934767497 (190h59m19.666035148s) [seg_pos={0 0}, upload=198736]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 16:25:38.934860734 (190h59m19.666128383s) [upload=198736]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 16:25:38.934866775 (190h59m19.666134425s) [upload=198736]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 16:25:39.330832871 (190h59m20.062100501s) [upload=198736]: Done uploading segments...
Aug 16 16:25:39.330845816 (190h59m20.062113446s) [upload=198736]: Upload finished. err: <nil>
Duration: 922.956992ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............................X.............X................] duration:
635.174715ms
FAIL (2025-08-16 16:33:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 16:21:19.736330105 (190h55m0.467597755s) [upload=198661]: Starting upload Aug 16 16:21:19.736403663 (190h55m0.467671313s) [upload=198661]: Done starting upload Aug 16 16:21:19.736486540 (190h55m0.467754189s) [upload=198661]: Uploading segments... Aug 16 16:21:19.736523800 (190h55m0.467791449s) [upload=198661]: Got next segment. Inline: true Aug 16 16:21:19.736529099 (190h55m0.467796749s) [upload=198661]: Waiting for error group managing segments... Aug 16 16:21:19.736572000 (190h55m0.467839651s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 16:21:19.736577090 (190h55m0.467844741s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 16:21:19.736580446 (190h55m0.467848097s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 16:21:19.820858302 (190h55m0.552125953s) [upload=198661]: Done uploading segments... Aug 16 16:21:19.820875544 (190h55m0.552143195s) [upload=198661]: Upload finished. err: metaclient: Too Many Requests
Duration: 635.199171ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............................X.............X...............] duration:
756.606995ms
FAIL (2025-08-16 16:32:52 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 16:21:19.736330105 (190h55m0.467597755s) [upload=198661]: Starting upload Aug 16 16:21:19.736403663 (190h55m0.467671313s) [upload=198661]: Done starting upload Aug 16 16:21:19.736486540 (190h55m0.467754189s) [upload=198661]: Uploading segments... Aug 16 16:21:19.736523800 (190h55m0.467791449s) [upload=198661]: Got next segment. Inline: true Aug 16 16:21:19.736529099 (190h55m0.467796749s) [upload=198661]: Waiting for error group managing segments... Aug 16 16:21:19.736572000 (190h55m0.467839651s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 16:21:19.736577090 (190h55m0.467844741s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 16:21:19.736580446 (190h55m0.467848097s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 16:21:19.820858302 (190h55m0.552125953s) [upload=198661]: Done uploading segments... Aug 16 16:21:19.820875544 (190h55m0.552143195s) [upload=198661]: Upload finished. err: metaclient: Too Many Requests
Duration: 756.670144ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
1.006693554s
FAIL (2025-08-16 16:32:48 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 16 16:25:38.589284525 (190h59m19.320552175s) [upload=198736]: Starting upload
Aug 16 16:25:38.589354917 (190h59m19.320622567s) [upload=198736]: Done starting upload
Aug 16 16:25:38.589422014 (190h59m19.320689664s) [upload=198736]: Uploading segments...
Aug 16 16:25:38.589832156 (190h59m19.321099816s) [upload=198736]: Got next segment. Inline: false
Aug 16 16:25:38.589885355 (190h59m19.321153006s) [upload=198736]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 16:25:38.589890937 (190h59m19.321158586s) [upload=198736]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 16:25:38.636921366 (190h59m19.368189006s) [seg_pos={0 0}, upload=198736]: Begin upload segment...
Aug 16 16:25:38.636952475 (190h59m19.368220105s) [seg_pos={0 0}, upload=198736]: Done begin upload segment.
Aug 16 16:25:38.636977401 (190h59m19.368245042s) [noise=true , address=104.36.82.37:4666 , piece_id=BOYG2Y63SKP77WWO3L3S4UT5CZ6S6ONXK2STIMSZ5O5OH3X7X4HQ, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.636991899 (190h59m19.368259529s) [noise=true , address=104.36.82.39:4753 , piece_id=Z5Z7NKHWB2JE33YSE6WQ4OZCATGA2V2FSDQBV52WTSUUNX5ZKTYA, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.637330737 (190h59m19.368598367s) [noise=true , address=104.36.82.58:4300 , piece_id=A64SYLHGFDQHRQVHCIUFXH4Y6EZGNFOO4GBGTY255IK3BZ4KNYAA, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.637399417 (190h59m19.368667057s) [noise=true , address=104.36.82.8:4981 , piece_id=WEG75O6JVV5NWY67IAWPJOJF5PHKJVR5HXN5HLP7PF4ZTESOYEWQ, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.637607759 (190h59m19.368875399s) [noise=true , address=45.91.116.13:4163 , piece_id=FYAB6ZWS2J45DCQDRQ3SHVGAJO4OYOPQIIIMRLCQBJQWDJ2L6PSQ, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.637772890 (190h59m19.36904054s) [noise=true , address=104.36.82.51:4083 , piece_id=7JS5X6FXOGG5LQ43FACBEQALYNPW6IXISBUTJYGBEX4YTRL45YWQ, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.637905380 (190h59m19.36917302s) [noise=true , address=45.91.116.7:4020 , piece_id=VU55DFYKGU3BKD26KBZ5RZBFLVGUC36SHCYOX6QT4MZJ32IHMU6Q, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.638112299 (190h59m19.369379949s) [noise=true , address=77.90.31.15:4706 , piece_id=22BB34RWLRZR3ME4HBGE7AJOAQUOUMT77CSWZCI5HUWNIF5NRG5A, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.638170219 (190h59m19.369437849s) [noise=true , address=77.90.31.12:4604 , piece_id=UQGOMGKXYVDFLW2JASS25GY2MF46OKJ27DODTWVJAIXBKKKPZL7A, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.638434356 (190h59m19.369701996s) [noise=true , address=104.36.82.38:4721 , piece_id=SZPHPJRSRSCCGGLA3EDDW3CH7FOJSMFFUUEMVCDFGK7USDYKPYIA, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.638487185 (190h59m19.369754835s) [noise=true , address=104.36.82.60:4339 , piece_id=PUIGSSRRS2G676MUKTKDAN4MDPU6ECV622WR6OCARTMNCYID2NIA, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.638723089 (190h59m19.36999073s) [noise=true , address=104.36.82.34:4561 , piece_id=64MOM5364NEFB45EP6PM6SKFJ7ZMXZXX5K5HN5VGLJSXYDSIFSWQ, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.638994480 (190h59m19.37026211s) [noise=true , address=77.90.31.19:4869 , piece_id=YVDEI2QSS5XDVFQZEHM6OFMFHRWOCK2L5636B623XG5ZSM2R7S3Q, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.639260581 (190h59m19.370528222s) [noise=true , address=77.90.31.12:4609 , piece_id=SQ7KFJRSFNJMSWLXSGZPWKZEH35WG3LLNCDMYWE352JFQC7VWSVQ, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.639524278 (190h59m19.370791919s) [noise=true , address=77.90.31.21:4912 , piece_id=7SR22XNESBXX2D3D3VFIHXIJJNFVTMQTW7N7T66GZN5KSD6UDYMA, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.639802412 (190h59m19.371070052s) [noise=true , address=104.36.82.44:4892 , piece_id=HCSMK323IRGKZHKCAUTPZGXFNG224OIOGBF7XPKD3UK6RBBELTWA, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.640090955 (190h59m19.371358595s) [noise=true , address=45.91.116.8:4074 , piece_id=22EVTJBLCMFIK2BTIXOYJA7O4WJ7DMG4G27X7AJAHCO42XGPUXFA, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.642267764 (190h59m19.373535405s) [noise=true , address=104.36.82.17:4333 , piece_id=MLH7DNUZWAJWCTT3BTXQIFUMUPCTMIY6VMSM22DLC3QB3XXNUURQ, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.756745546 (190h59m19.488013197s) [upload=198736]: Next returned nil segment
Aug 16 16:25:38.756760494 (190h59m19.488028145s) [upload=198736]: Waiting for error group managing segments...
Aug 16 16:25:38.771172176 (190h59m19.502439835s) [noise=true , address=104.36.82.17:4333 , piece_id=MLH7DNUZWAJWCTT3BTXQIFUMUPCTMIY6VMSM22DLC3QB3XXNUURQ, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.795367041 (190h59m19.526634691s) [noise=true , address=45.91.116.13:4163 , piece_id=FYAB6ZWS2J45DCQDRQ3SHVGAJO4OYOPQIIIMRLCQBJQWDJ2L6PSQ, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.801599668 (190h59m19.532867328s) [noise=true , address=77.90.31.12:4609 , piece_id=SQ7KFJRSFNJMSWLXSGZPWKZEH35WG3LLNCDMYWE352JFQC7VWSVQ, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.815582041 (190h59m19.546849691s) [noise=true , address=104.36.82.38:4721 , piece_id=SZPHPJRSRSCCGGLA3EDDW3CH7FOJSMFFUUEMVCDFGK7USDYKPYIA, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.821600254 (190h59m19.552867914s) [noise=true , address=104.36.82.51:4083 , piece_id=7JS5X6FXOGG5LQ43FACBEQALYNPW6IXISBUTJYGBEX4YTRL45YWQ, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.844363363 (190h59m19.575631023s) [noise=true , address=104.36.82.58:4300 , piece_id=A64SYLHGFDQHRQVHCIUFXH4Y6EZGNFOO4GBGTY255IK3BZ4KNYAA, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.847794134 (190h59m19.579061785s) [noise=true , address=45.91.116.8:4074 , piece_id=22EVTJBLCMFIK2BTIXOYJA7O4WJ7DMG4G27X7AJAHCO42XGPUXFA, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.849919236 (190h59m19.581186886s) [noise=true , address=45.91.116.7:4020 , piece_id=VU55DFYKGU3BKD26KBZ5RZBFLVGUC36SHCYOX6QT4MZJ32IHMU6Q, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.854844502 (190h59m19.586112162s) [noise=true , address=104.36.82.8:4981 , piece_id=WEG75O6JVV5NWY67IAWPJOJF5PHKJVR5HXN5HLP7PF4ZTESOYEWQ, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.857740616 (190h59m19.589008266s) [noise=true , address=77.90.31.12:4604 , piece_id=UQGOMGKXYVDFLW2JASS25GY2MF46OKJ27DODTWVJAIXBKKKPZL7A, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.858644869 (190h59m19.589912529s) [noise=true , address=104.36.82.37:4666 , piece_id=BOYG2Y63SKP77WWO3L3S4UT5CZ6S6ONXK2STIMSZ5O5OH3X7X4HQ, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.930113343 (190h59m19.661380993s) [noise=true , address=104.36.82.44:4892 , piece_id=HCSMK323IRGKZHKCAUTPZGXFNG224OIOGBF7XPKD3UK6RBBELTWA, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.930599448 (190h59m19.661867099s) [noise=true , address=104.36.82.34:4561 , piece_id=64MOM5364NEFB45EP6PM6SKFJ7ZMXZXX5K5HN5VGLJSXYDSIFSWQ, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.934160795 (190h59m19.665428445s) [noise=true , address=104.36.82.39:4753 , piece_id=Z5Z7NKHWB2JE33YSE6WQ4OZCATGA2V2FSDQBV52WTSUUNX5ZKTYA, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.934194257 (190h59m19.665461908s) [seg_pos={0 0}, upload=198736]: Segment reached optimal threshold of 14 pieces.
Aug 16 16:25:38.934403091 (190h59m19.665670741s) [noise=true , address=77.90.31.21:4912 , piece_id=7SR22XNESBXX2D3D3VFIHXIJJNFVTMQTW7N7T66GZN5KSD6UDYMA, seg_pos={0 0}, upload=198736]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SFktrdgGxzEZue49XWkNxVZfrpHA73M2H3hRX7NXnvwVnvbv1): protocol: expected piece hash; write tcp 5.161.89.252:28854->77.90.31.21:4912: use of closed network connection; write tcp 5.161.89.252:28854->77.90.31.21:4912: use of closed network connection; EOF
Aug 16 16:25:38.934585955 (190h59m19.665853615s) [noise=true , address=104.36.82.60:4339 , piece_id=PUIGSSRRS2G676MUKTKDAN4MDPU6ECV622WR6OCARTMNCYID2NIA, seg_pos={0 0}, upload=198736]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R): protocol: expected piece hash; context canceled; EOF
Aug 16 16:25:38.934641310 (190h59m19.66590896s) [noise=true , address=77.90.31.19:4869 , piece_id=YVDEI2QSS5XDVFQZEHM6OFMFHRWOCK2L5636B623XG5ZSM2R7S3Q, seg_pos={0 0}, upload=198736]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129refeNg3BsDCThccHdMUJgitGM942qREieZCP2UYoicRAtFN8): protocol: expected piece hash; context canceled; EOF
Aug 16 16:25:38.934752820 (190h59m19.666020471s) [noise=true , address=77.90.31.15:4706 , piece_id=22BB34RWLRZR3ME4HBGE7AJOAQUOUMT77CSWZCI5HUWNIF5NRG5A, seg_pos={0 0}, upload=198736]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YZZnCo54XknuvoBoVtRudXSnoWdNdrn23Lp6Gou3g451BzUwG): protocol: rpc: dial tcp 77.90.31.15:4706: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 16:25:38.934767497 (190h59m19.666035148s) [seg_pos={0 0}, upload=198736]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 16:25:38.934860734 (190h59m19.666128383s) [upload=198736]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 16:25:38.934866775 (190h59m19.666134425s) [upload=198736]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 16:25:39.330832871 (190h59m20.062100501s) [upload=198736]: Done uploading segments...
Aug 16 16:25:39.330845816 (190h59m20.062113446s) [upload=198736]: Upload finished. err: <nil>
Duration: 1.006715446s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............................X.............X..............] duration:
674.054428ms
FAIL (2025-08-16 16:32:15 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 16:21:19.736330105 (190h55m0.467597755s) [upload=198661]: Starting upload Aug 16 16:21:19.736403663 (190h55m0.467671313s) [upload=198661]: Done starting upload Aug 16 16:21:19.736486540 (190h55m0.467754189s) [upload=198661]: Uploading segments... Aug 16 16:21:19.736523800 (190h55m0.467791449s) [upload=198661]: Got next segment. Inline: true Aug 16 16:21:19.736529099 (190h55m0.467796749s) [upload=198661]: Waiting for error group managing segments... Aug 16 16:21:19.736572000 (190h55m0.467839651s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 16:21:19.736577090 (190h55m0.467844741s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 16:21:19.736580446 (190h55m0.467848097s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 16:21:19.820858302 (190h55m0.552125953s) [upload=198661]: Done uploading segments... Aug 16 16:21:19.820875544 (190h55m0.552143195s) [upload=198661]: Upload finished. err: metaclient: Too Many Requests
Duration: 674.073163ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
920.303088ms
FAIL (2025-08-16 16:32:03 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 16 16:25:38.589284525 (190h59m19.320552175s) [upload=198736]: Starting upload
Aug 16 16:25:38.589354917 (190h59m19.320622567s) [upload=198736]: Done starting upload
Aug 16 16:25:38.589422014 (190h59m19.320689664s) [upload=198736]: Uploading segments...
Aug 16 16:25:38.589832156 (190h59m19.321099816s) [upload=198736]: Got next segment. Inline: false
Aug 16 16:25:38.589885355 (190h59m19.321153006s) [upload=198736]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 16:25:38.589890937 (190h59m19.321158586s) [upload=198736]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 16:25:38.636921366 (190h59m19.368189006s) [seg_pos={0 0}, upload=198736]: Begin upload segment...
Aug 16 16:25:38.636952475 (190h59m19.368220105s) [seg_pos={0 0}, upload=198736]: Done begin upload segment.
Aug 16 16:25:38.636977401 (190h59m19.368245042s) [noise=true , address=104.36.82.37:4666 , piece_id=BOYG2Y63SKP77WWO3L3S4UT5CZ6S6ONXK2STIMSZ5O5OH3X7X4HQ, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.636991899 (190h59m19.368259529s) [noise=true , address=104.36.82.39:4753 , piece_id=Z5Z7NKHWB2JE33YSE6WQ4OZCATGA2V2FSDQBV52WTSUUNX5ZKTYA, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.637330737 (190h59m19.368598367s) [noise=true , address=104.36.82.58:4300 , piece_id=A64SYLHGFDQHRQVHCIUFXH4Y6EZGNFOO4GBGTY255IK3BZ4KNYAA, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.637399417 (190h59m19.368667057s) [noise=true , address=104.36.82.8:4981 , piece_id=WEG75O6JVV5NWY67IAWPJOJF5PHKJVR5HXN5HLP7PF4ZTESOYEWQ, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.637607759 (190h59m19.368875399s) [noise=true , address=45.91.116.13:4163 , piece_id=FYAB6ZWS2J45DCQDRQ3SHVGAJO4OYOPQIIIMRLCQBJQWDJ2L6PSQ, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.637772890 (190h59m19.36904054s) [noise=true , address=104.36.82.51:4083 , piece_id=7JS5X6FXOGG5LQ43FACBEQALYNPW6IXISBUTJYGBEX4YTRL45YWQ, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.637905380 (190h59m19.36917302s) [noise=true , address=45.91.116.7:4020 , piece_id=VU55DFYKGU3BKD26KBZ5RZBFLVGUC36SHCYOX6QT4MZJ32IHMU6Q, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.638112299 (190h59m19.369379949s) [noise=true , address=77.90.31.15:4706 , piece_id=22BB34RWLRZR3ME4HBGE7AJOAQUOUMT77CSWZCI5HUWNIF5NRG5A, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.638170219 (190h59m19.369437849s) [noise=true , address=77.90.31.12:4604 , piece_id=UQGOMGKXYVDFLW2JASS25GY2MF46OKJ27DODTWVJAIXBKKKPZL7A, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.638434356 (190h59m19.369701996s) [noise=true , address=104.36.82.38:4721 , piece_id=SZPHPJRSRSCCGGLA3EDDW3CH7FOJSMFFUUEMVCDFGK7USDYKPYIA, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.638487185 (190h59m19.369754835s) [noise=true , address=104.36.82.60:4339 , piece_id=PUIGSSRRS2G676MUKTKDAN4MDPU6ECV622WR6OCARTMNCYID2NIA, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.638723089 (190h59m19.36999073s) [noise=true , address=104.36.82.34:4561 , piece_id=64MOM5364NEFB45EP6PM6SKFJ7ZMXZXX5K5HN5VGLJSXYDSIFSWQ, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.638994480 (190h59m19.37026211s) [noise=true , address=77.90.31.19:4869 , piece_id=YVDEI2QSS5XDVFQZEHM6OFMFHRWOCK2L5636B623XG5ZSM2R7S3Q, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.639260581 (190h59m19.370528222s) [noise=true , address=77.90.31.12:4609 , piece_id=SQ7KFJRSFNJMSWLXSGZPWKZEH35WG3LLNCDMYWE352JFQC7VWSVQ, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.639524278 (190h59m19.370791919s) [noise=true , address=77.90.31.21:4912 , piece_id=7SR22XNESBXX2D3D3VFIHXIJJNFVTMQTW7N7T66GZN5KSD6UDYMA, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.639802412 (190h59m19.371070052s) [noise=true , address=104.36.82.44:4892 , piece_id=HCSMK323IRGKZHKCAUTPZGXFNG224OIOGBF7XPKD3UK6RBBELTWA, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.640090955 (190h59m19.371358595s) [noise=true , address=45.91.116.8:4074 , piece_id=22EVTJBLCMFIK2BTIXOYJA7O4WJ7DMG4G27X7AJAHCO42XGPUXFA, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.642267764 (190h59m19.373535405s) [noise=true , address=104.36.82.17:4333 , piece_id=MLH7DNUZWAJWCTT3BTXQIFUMUPCTMIY6VMSM22DLC3QB3XXNUURQ, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.756745546 (190h59m19.488013197s) [upload=198736]: Next returned nil segment
Aug 16 16:25:38.756760494 (190h59m19.488028145s) [upload=198736]: Waiting for error group managing segments...
Aug 16 16:25:38.771172176 (190h59m19.502439835s) [noise=true , address=104.36.82.17:4333 , piece_id=MLH7DNUZWAJWCTT3BTXQIFUMUPCTMIY6VMSM22DLC3QB3XXNUURQ, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.795367041 (190h59m19.526634691s) [noise=true , address=45.91.116.13:4163 , piece_id=FYAB6ZWS2J45DCQDRQ3SHVGAJO4OYOPQIIIMRLCQBJQWDJ2L6PSQ, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.801599668 (190h59m19.532867328s) [noise=true , address=77.90.31.12:4609 , piece_id=SQ7KFJRSFNJMSWLXSGZPWKZEH35WG3LLNCDMYWE352JFQC7VWSVQ, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.815582041 (190h59m19.546849691s) [noise=true , address=104.36.82.38:4721 , piece_id=SZPHPJRSRSCCGGLA3EDDW3CH7FOJSMFFUUEMVCDFGK7USDYKPYIA, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.821600254 (190h59m19.552867914s) [noise=true , address=104.36.82.51:4083 , piece_id=7JS5X6FXOGG5LQ43FACBEQALYNPW6IXISBUTJYGBEX4YTRL45YWQ, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.844363363 (190h59m19.575631023s) [noise=true , address=104.36.82.58:4300 , piece_id=A64SYLHGFDQHRQVHCIUFXH4Y6EZGNFOO4GBGTY255IK3BZ4KNYAA, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.847794134 (190h59m19.579061785s) [noise=true , address=45.91.116.8:4074 , piece_id=22EVTJBLCMFIK2BTIXOYJA7O4WJ7DMG4G27X7AJAHCO42XGPUXFA, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.849919236 (190h59m19.581186886s) [noise=true , address=45.91.116.7:4020 , piece_id=VU55DFYKGU3BKD26KBZ5RZBFLVGUC36SHCYOX6QT4MZJ32IHMU6Q, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.854844502 (190h59m19.586112162s) [noise=true , address=104.36.82.8:4981 , piece_id=WEG75O6JVV5NWY67IAWPJOJF5PHKJVR5HXN5HLP7PF4ZTESOYEWQ, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.857740616 (190h59m19.589008266s) [noise=true , address=77.90.31.12:4604 , piece_id=UQGOMGKXYVDFLW2JASS25GY2MF46OKJ27DODTWVJAIXBKKKPZL7A, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.858644869 (190h59m19.589912529s) [noise=true , address=104.36.82.37:4666 , piece_id=BOYG2Y63SKP77WWO3L3S4UT5CZ6S6ONXK2STIMSZ5O5OH3X7X4HQ, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.930113343 (190h59m19.661380993s) [noise=true , address=104.36.82.44:4892 , piece_id=HCSMK323IRGKZHKCAUTPZGXFNG224OIOGBF7XPKD3UK6RBBELTWA, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.930599448 (190h59m19.661867099s) [noise=true , address=104.36.82.34:4561 , piece_id=64MOM5364NEFB45EP6PM6SKFJ7ZMXZXX5K5HN5VGLJSXYDSIFSWQ, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.934160795 (190h59m19.665428445s) [noise=true , address=104.36.82.39:4753 , piece_id=Z5Z7NKHWB2JE33YSE6WQ4OZCATGA2V2FSDQBV52WTSUUNX5ZKTYA, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.934194257 (190h59m19.665461908s) [seg_pos={0 0}, upload=198736]: Segment reached optimal threshold of 14 pieces.
Aug 16 16:25:38.934403091 (190h59m19.665670741s) [noise=true , address=77.90.31.21:4912 , piece_id=7SR22XNESBXX2D3D3VFIHXIJJNFVTMQTW7N7T66GZN5KSD6UDYMA, seg_pos={0 0}, upload=198736]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SFktrdgGxzEZue49XWkNxVZfrpHA73M2H3hRX7NXnvwVnvbv1): protocol: expected piece hash; write tcp 5.161.89.252:28854->77.90.31.21:4912: use of closed network connection; write tcp 5.161.89.252:28854->77.90.31.21:4912: use of closed network connection; EOF
Aug 16 16:25:38.934585955 (190h59m19.665853615s) [noise=true , address=104.36.82.60:4339 , piece_id=PUIGSSRRS2G676MUKTKDAN4MDPU6ECV622WR6OCARTMNCYID2NIA, seg_pos={0 0}, upload=198736]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R): protocol: expected piece hash; context canceled; EOF
Aug 16 16:25:38.934641310 (190h59m19.66590896s) [noise=true , address=77.90.31.19:4869 , piece_id=YVDEI2QSS5XDVFQZEHM6OFMFHRWOCK2L5636B623XG5ZSM2R7S3Q, seg_pos={0 0}, upload=198736]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129refeNg3BsDCThccHdMUJgitGM942qREieZCP2UYoicRAtFN8): protocol: expected piece hash; context canceled; EOF
Aug 16 16:25:38.934752820 (190h59m19.666020471s) [noise=true , address=77.90.31.15:4706 , piece_id=22BB34RWLRZR3ME4HBGE7AJOAQUOUMT77CSWZCI5HUWNIF5NRG5A, seg_pos={0 0}, upload=198736]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YZZnCo54XknuvoBoVtRudXSnoWdNdrn23Lp6Gou3g451BzUwG): protocol: rpc: dial tcp 77.90.31.15:4706: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 16:25:38.934767497 (190h59m19.666035148s) [seg_pos={0 0}, upload=198736]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 16:25:38.934860734 (190h59m19.666128383s) [upload=198736]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 16:25:38.934866775 (190h59m19.666134425s) [upload=198736]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 16:25:39.330832871 (190h59m20.062100501s) [upload=198736]: Done uploading segments...
Aug 16 16:25:39.330845816 (190h59m20.062113446s) [upload=198736]: Upload finished. err: <nil>
Duration: 920.328185ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [................................X.............X.............] duration:
486.455771ms
FAIL (2025-08-16 16:31:34 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 16:21:19.736330105 (190h55m0.467597755s) [upload=198661]: Starting upload Aug 16 16:21:19.736403663 (190h55m0.467671313s) [upload=198661]: Done starting upload Aug 16 16:21:19.736486540 (190h55m0.467754189s) [upload=198661]: Uploading segments... Aug 16 16:21:19.736523800 (190h55m0.467791449s) [upload=198661]: Got next segment. Inline: true Aug 16 16:21:19.736529099 (190h55m0.467796749s) [upload=198661]: Waiting for error group managing segments... Aug 16 16:21:19.736572000 (190h55m0.467839651s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 16:21:19.736577090 (190h55m0.467844741s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 16:21:19.736580446 (190h55m0.467848097s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 16:21:19.820858302 (190h55m0.552125953s) [upload=198661]: Done uploading segments... Aug 16 16:21:19.820875544 (190h55m0.552143195s) [upload=198661]: Upload finished. err: metaclient: Too Many Requests
Duration: 486.521185ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
1.009598441s
FAIL (2025-08-16 16:31:00 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 16 16:25:38.589284525 (190h59m19.320552175s) [upload=198736]: Starting upload
Aug 16 16:25:38.589354917 (190h59m19.320622567s) [upload=198736]: Done starting upload
Aug 16 16:25:38.589422014 (190h59m19.320689664s) [upload=198736]: Uploading segments...
Aug 16 16:25:38.589832156 (190h59m19.321099816s) [upload=198736]: Got next segment. Inline: false
Aug 16 16:25:38.589885355 (190h59m19.321153006s) [upload=198736]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 16:25:38.589890937 (190h59m19.321158586s) [upload=198736]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 16:25:38.636921366 (190h59m19.368189006s) [seg_pos={0 0}, upload=198736]: Begin upload segment...
Aug 16 16:25:38.636952475 (190h59m19.368220105s) [seg_pos={0 0}, upload=198736]: Done begin upload segment.
Aug 16 16:25:38.636977401 (190h59m19.368245042s) [noise=true , address=104.36.82.37:4666 , piece_id=BOYG2Y63SKP77WWO3L3S4UT5CZ6S6ONXK2STIMSZ5O5OH3X7X4HQ, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.636991899 (190h59m19.368259529s) [noise=true , address=104.36.82.39:4753 , piece_id=Z5Z7NKHWB2JE33YSE6WQ4OZCATGA2V2FSDQBV52WTSUUNX5ZKTYA, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.637330737 (190h59m19.368598367s) [noise=true , address=104.36.82.58:4300 , piece_id=A64SYLHGFDQHRQVHCIUFXH4Y6EZGNFOO4GBGTY255IK3BZ4KNYAA, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.637399417 (190h59m19.368667057s) [noise=true , address=104.36.82.8:4981 , piece_id=WEG75O6JVV5NWY67IAWPJOJF5PHKJVR5HXN5HLP7PF4ZTESOYEWQ, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.637607759 (190h59m19.368875399s) [noise=true , address=45.91.116.13:4163 , piece_id=FYAB6ZWS2J45DCQDRQ3SHVGAJO4OYOPQIIIMRLCQBJQWDJ2L6PSQ, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.637772890 (190h59m19.36904054s) [noise=true , address=104.36.82.51:4083 , piece_id=7JS5X6FXOGG5LQ43FACBEQALYNPW6IXISBUTJYGBEX4YTRL45YWQ, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.637905380 (190h59m19.36917302s) [noise=true , address=45.91.116.7:4020 , piece_id=VU55DFYKGU3BKD26KBZ5RZBFLVGUC36SHCYOX6QT4MZJ32IHMU6Q, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.638112299 (190h59m19.369379949s) [noise=true , address=77.90.31.15:4706 , piece_id=22BB34RWLRZR3ME4HBGE7AJOAQUOUMT77CSWZCI5HUWNIF5NRG5A, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.638170219 (190h59m19.369437849s) [noise=true , address=77.90.31.12:4604 , piece_id=UQGOMGKXYVDFLW2JASS25GY2MF46OKJ27DODTWVJAIXBKKKPZL7A, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.638434356 (190h59m19.369701996s) [noise=true , address=104.36.82.38:4721 , piece_id=SZPHPJRSRSCCGGLA3EDDW3CH7FOJSMFFUUEMVCDFGK7USDYKPYIA, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.638487185 (190h59m19.369754835s) [noise=true , address=104.36.82.60:4339 , piece_id=PUIGSSRRS2G676MUKTKDAN4MDPU6ECV622WR6OCARTMNCYID2NIA, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.638723089 (190h59m19.36999073s) [noise=true , address=104.36.82.34:4561 , piece_id=64MOM5364NEFB45EP6PM6SKFJ7ZMXZXX5K5HN5VGLJSXYDSIFSWQ, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.638994480 (190h59m19.37026211s) [noise=true , address=77.90.31.19:4869 , piece_id=YVDEI2QSS5XDVFQZEHM6OFMFHRWOCK2L5636B623XG5ZSM2R7S3Q, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.639260581 (190h59m19.370528222s) [noise=true , address=77.90.31.12:4609 , piece_id=SQ7KFJRSFNJMSWLXSGZPWKZEH35WG3LLNCDMYWE352JFQC7VWSVQ, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.639524278 (190h59m19.370791919s) [noise=true , address=77.90.31.21:4912 , piece_id=7SR22XNESBXX2D3D3VFIHXIJJNFVTMQTW7N7T66GZN5KSD6UDYMA, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.639802412 (190h59m19.371070052s) [noise=true , address=104.36.82.44:4892 , piece_id=HCSMK323IRGKZHKCAUTPZGXFNG224OIOGBF7XPKD3UK6RBBELTWA, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.640090955 (190h59m19.371358595s) [noise=true , address=45.91.116.8:4074 , piece_id=22EVTJBLCMFIK2BTIXOYJA7O4WJ7DMG4G27X7AJAHCO42XGPUXFA, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.642267764 (190h59m19.373535405s) [noise=true , address=104.36.82.17:4333 , piece_id=MLH7DNUZWAJWCTT3BTXQIFUMUPCTMIY6VMSM22DLC3QB3XXNUURQ, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.756745546 (190h59m19.488013197s) [upload=198736]: Next returned nil segment
Aug 16 16:25:38.756760494 (190h59m19.488028145s) [upload=198736]: Waiting for error group managing segments...
Aug 16 16:25:38.771172176 (190h59m19.502439835s) [noise=true , address=104.36.82.17:4333 , piece_id=MLH7DNUZWAJWCTT3BTXQIFUMUPCTMIY6VMSM22DLC3QB3XXNUURQ, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.795367041 (190h59m19.526634691s) [noise=true , address=45.91.116.13:4163 , piece_id=FYAB6ZWS2J45DCQDRQ3SHVGAJO4OYOPQIIIMRLCQBJQWDJ2L6PSQ, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.801599668 (190h59m19.532867328s) [noise=true , address=77.90.31.12:4609 , piece_id=SQ7KFJRSFNJMSWLXSGZPWKZEH35WG3LLNCDMYWE352JFQC7VWSVQ, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.815582041 (190h59m19.546849691s) [noise=true , address=104.36.82.38:4721 , piece_id=SZPHPJRSRSCCGGLA3EDDW3CH7FOJSMFFUUEMVCDFGK7USDYKPYIA, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.821600254 (190h59m19.552867914s) [noise=true , address=104.36.82.51:4083 , piece_id=7JS5X6FXOGG5LQ43FACBEQALYNPW6IXISBUTJYGBEX4YTRL45YWQ, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.844363363 (190h59m19.575631023s) [noise=true , address=104.36.82.58:4300 , piece_id=A64SYLHGFDQHRQVHCIUFXH4Y6EZGNFOO4GBGTY255IK3BZ4KNYAA, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.847794134 (190h59m19.579061785s) [noise=true , address=45.91.116.8:4074 , piece_id=22EVTJBLCMFIK2BTIXOYJA7O4WJ7DMG4G27X7AJAHCO42XGPUXFA, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.849919236 (190h59m19.581186886s) [noise=true , address=45.91.116.7:4020 , piece_id=VU55DFYKGU3BKD26KBZ5RZBFLVGUC36SHCYOX6QT4MZJ32IHMU6Q, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.854844502 (190h59m19.586112162s) [noise=true , address=104.36.82.8:4981 , piece_id=WEG75O6JVV5NWY67IAWPJOJF5PHKJVR5HXN5HLP7PF4ZTESOYEWQ, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.857740616 (190h59m19.589008266s) [noise=true , address=77.90.31.12:4604 , piece_id=UQGOMGKXYVDFLW2JASS25GY2MF46OKJ27DODTWVJAIXBKKKPZL7A, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.858644869 (190h59m19.589912529s) [noise=true , address=104.36.82.37:4666 , piece_id=BOYG2Y63SKP77WWO3L3S4UT5CZ6S6ONXK2STIMSZ5O5OH3X7X4HQ, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.930113343 (190h59m19.661380993s) [noise=true , address=104.36.82.44:4892 , piece_id=HCSMK323IRGKZHKCAUTPZGXFNG224OIOGBF7XPKD3UK6RBBELTWA, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.930599448 (190h59m19.661867099s) [noise=true , address=104.36.82.34:4561 , piece_id=64MOM5364NEFB45EP6PM6SKFJ7ZMXZXX5K5HN5VGLJSXYDSIFSWQ, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.934160795 (190h59m19.665428445s) [noise=true , address=104.36.82.39:4753 , piece_id=Z5Z7NKHWB2JE33YSE6WQ4OZCATGA2V2FSDQBV52WTSUUNX5ZKTYA, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.934194257 (190h59m19.665461908s) [seg_pos={0 0}, upload=198736]: Segment reached optimal threshold of 14 pieces.
Aug 16 16:25:38.934403091 (190h59m19.665670741s) [noise=true , address=77.90.31.21:4912 , piece_id=7SR22XNESBXX2D3D3VFIHXIJJNFVTMQTW7N7T66GZN5KSD6UDYMA, seg_pos={0 0}, upload=198736]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SFktrdgGxzEZue49XWkNxVZfrpHA73M2H3hRX7NXnvwVnvbv1): protocol: expected piece hash; write tcp 5.161.89.252:28854->77.90.31.21:4912: use of closed network connection; write tcp 5.161.89.252:28854->77.90.31.21:4912: use of closed network connection; EOF
Aug 16 16:25:38.934585955 (190h59m19.665853615s) [noise=true , address=104.36.82.60:4339 , piece_id=PUIGSSRRS2G676MUKTKDAN4MDPU6ECV622WR6OCARTMNCYID2NIA, seg_pos={0 0}, upload=198736]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R): protocol: expected piece hash; context canceled; EOF
Aug 16 16:25:38.934641310 (190h59m19.66590896s) [noise=true , address=77.90.31.19:4869 , piece_id=YVDEI2QSS5XDVFQZEHM6OFMFHRWOCK2L5636B623XG5ZSM2R7S3Q, seg_pos={0 0}, upload=198736]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129refeNg3BsDCThccHdMUJgitGM942qREieZCP2UYoicRAtFN8): protocol: expected piece hash; context canceled; EOF
Aug 16 16:25:38.934752820 (190h59m19.666020471s) [noise=true , address=77.90.31.15:4706 , piece_id=22BB34RWLRZR3ME4HBGE7AJOAQUOUMT77CSWZCI5HUWNIF5NRG5A, seg_pos={0 0}, upload=198736]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YZZnCo54XknuvoBoVtRudXSnoWdNdrn23Lp6Gou3g451BzUwG): protocol: rpc: dial tcp 77.90.31.15:4706: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 16:25:38.934767497 (190h59m19.666035148s) [seg_pos={0 0}, upload=198736]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 16:25:38.934860734 (190h59m19.666128383s) [upload=198736]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 16:25:38.934866775 (190h59m19.666134425s) [upload=198736]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 16:25:39.330832871 (190h59m20.062100501s) [upload=198736]: Done uploading segments...
Aug 16 16:25:39.330845816 (190h59m20.062113446s) [upload=198736]: Upload finished. err: <nil>
Duration: 1.009618509s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
1.869125151s
FAIL (2025-08-16 16:30:30 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 16 16:25:38.589284525 (190h59m19.320552175s) [upload=198736]: Starting upload
Aug 16 16:25:38.589354917 (190h59m19.320622567s) [upload=198736]: Done starting upload
Aug 16 16:25:38.589422014 (190h59m19.320689664s) [upload=198736]: Uploading segments...
Aug 16 16:25:38.589832156 (190h59m19.321099816s) [upload=198736]: Got next segment. Inline: false
Aug 16 16:25:38.589885355 (190h59m19.321153006s) [upload=198736]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 16:25:38.589890937 (190h59m19.321158586s) [upload=198736]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 16:25:38.636921366 (190h59m19.368189006s) [seg_pos={0 0}, upload=198736]: Begin upload segment...
Aug 16 16:25:38.636952475 (190h59m19.368220105s) [seg_pos={0 0}, upload=198736]: Done begin upload segment.
Aug 16 16:25:38.636977401 (190h59m19.368245042s) [noise=true , address=104.36.82.37:4666 , piece_id=BOYG2Y63SKP77WWO3L3S4UT5CZ6S6ONXK2STIMSZ5O5OH3X7X4HQ, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.636991899 (190h59m19.368259529s) [noise=true , address=104.36.82.39:4753 , piece_id=Z5Z7NKHWB2JE33YSE6WQ4OZCATGA2V2FSDQBV52WTSUUNX5ZKTYA, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.637330737 (190h59m19.368598367s) [noise=true , address=104.36.82.58:4300 , piece_id=A64SYLHGFDQHRQVHCIUFXH4Y6EZGNFOO4GBGTY255IK3BZ4KNYAA, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.637399417 (190h59m19.368667057s) [noise=true , address=104.36.82.8:4981 , piece_id=WEG75O6JVV5NWY67IAWPJOJF5PHKJVR5HXN5HLP7PF4ZTESOYEWQ, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.637607759 (190h59m19.368875399s) [noise=true , address=45.91.116.13:4163 , piece_id=FYAB6ZWS2J45DCQDRQ3SHVGAJO4OYOPQIIIMRLCQBJQWDJ2L6PSQ, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.637772890 (190h59m19.36904054s) [noise=true , address=104.36.82.51:4083 , piece_id=7JS5X6FXOGG5LQ43FACBEQALYNPW6IXISBUTJYGBEX4YTRL45YWQ, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.637905380 (190h59m19.36917302s) [noise=true , address=45.91.116.7:4020 , piece_id=VU55DFYKGU3BKD26KBZ5RZBFLVGUC36SHCYOX6QT4MZJ32IHMU6Q, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.638112299 (190h59m19.369379949s) [noise=true , address=77.90.31.15:4706 , piece_id=22BB34RWLRZR3ME4HBGE7AJOAQUOUMT77CSWZCI5HUWNIF5NRG5A, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.638170219 (190h59m19.369437849s) [noise=true , address=77.90.31.12:4604 , piece_id=UQGOMGKXYVDFLW2JASS25GY2MF46OKJ27DODTWVJAIXBKKKPZL7A, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.638434356 (190h59m19.369701996s) [noise=true , address=104.36.82.38:4721 , piece_id=SZPHPJRSRSCCGGLA3EDDW3CH7FOJSMFFUUEMVCDFGK7USDYKPYIA, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.638487185 (190h59m19.369754835s) [noise=true , address=104.36.82.60:4339 , piece_id=PUIGSSRRS2G676MUKTKDAN4MDPU6ECV622WR6OCARTMNCYID2NIA, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.638723089 (190h59m19.36999073s) [noise=true , address=104.36.82.34:4561 , piece_id=64MOM5364NEFB45EP6PM6SKFJ7ZMXZXX5K5HN5VGLJSXYDSIFSWQ, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.638994480 (190h59m19.37026211s) [noise=true , address=77.90.31.19:4869 , piece_id=YVDEI2QSS5XDVFQZEHM6OFMFHRWOCK2L5636B623XG5ZSM2R7S3Q, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.639260581 (190h59m19.370528222s) [noise=true , address=77.90.31.12:4609 , piece_id=SQ7KFJRSFNJMSWLXSGZPWKZEH35WG3LLNCDMYWE352JFQC7VWSVQ, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.639524278 (190h59m19.370791919s) [noise=true , address=77.90.31.21:4912 , piece_id=7SR22XNESBXX2D3D3VFIHXIJJNFVTMQTW7N7T66GZN5KSD6UDYMA, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.639802412 (190h59m19.371070052s) [noise=true , address=104.36.82.44:4892 , piece_id=HCSMK323IRGKZHKCAUTPZGXFNG224OIOGBF7XPKD3UK6RBBELTWA, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.640090955 (190h59m19.371358595s) [noise=true , address=45.91.116.8:4074 , piece_id=22EVTJBLCMFIK2BTIXOYJA7O4WJ7DMG4G27X7AJAHCO42XGPUXFA, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.642267764 (190h59m19.373535405s) [noise=true , address=104.36.82.17:4333 , piece_id=MLH7DNUZWAJWCTT3BTXQIFUMUPCTMIY6VMSM22DLC3QB3XXNUURQ, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.756745546 (190h59m19.488013197s) [upload=198736]: Next returned nil segment
Aug 16 16:25:38.756760494 (190h59m19.488028145s) [upload=198736]: Waiting for error group managing segments...
Aug 16 16:25:38.771172176 (190h59m19.502439835s) [noise=true , address=104.36.82.17:4333 , piece_id=MLH7DNUZWAJWCTT3BTXQIFUMUPCTMIY6VMSM22DLC3QB3XXNUURQ, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.795367041 (190h59m19.526634691s) [noise=true , address=45.91.116.13:4163 , piece_id=FYAB6ZWS2J45DCQDRQ3SHVGAJO4OYOPQIIIMRLCQBJQWDJ2L6PSQ, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.801599668 (190h59m19.532867328s) [noise=true , address=77.90.31.12:4609 , piece_id=SQ7KFJRSFNJMSWLXSGZPWKZEH35WG3LLNCDMYWE352JFQC7VWSVQ, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.815582041 (190h59m19.546849691s) [noise=true , address=104.36.82.38:4721 , piece_id=SZPHPJRSRSCCGGLA3EDDW3CH7FOJSMFFUUEMVCDFGK7USDYKPYIA, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.821600254 (190h59m19.552867914s) [noise=true , address=104.36.82.51:4083 , piece_id=7JS5X6FXOGG5LQ43FACBEQALYNPW6IXISBUTJYGBEX4YTRL45YWQ, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.844363363 (190h59m19.575631023s) [noise=true , address=104.36.82.58:4300 , piece_id=A64SYLHGFDQHRQVHCIUFXH4Y6EZGNFOO4GBGTY255IK3BZ4KNYAA, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.847794134 (190h59m19.579061785s) [noise=true , address=45.91.116.8:4074 , piece_id=22EVTJBLCMFIK2BTIXOYJA7O4WJ7DMG4G27X7AJAHCO42XGPUXFA, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.849919236 (190h59m19.581186886s) [noise=true , address=45.91.116.7:4020 , piece_id=VU55DFYKGU3BKD26KBZ5RZBFLVGUC36SHCYOX6QT4MZJ32IHMU6Q, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.854844502 (190h59m19.586112162s) [noise=true , address=104.36.82.8:4981 , piece_id=WEG75O6JVV5NWY67IAWPJOJF5PHKJVR5HXN5HLP7PF4ZTESOYEWQ, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.857740616 (190h59m19.589008266s) [noise=true , address=77.90.31.12:4604 , piece_id=UQGOMGKXYVDFLW2JASS25GY2MF46OKJ27DODTWVJAIXBKKKPZL7A, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.858644869 (190h59m19.589912529s) [noise=true , address=104.36.82.37:4666 , piece_id=BOYG2Y63SKP77WWO3L3S4UT5CZ6S6ONXK2STIMSZ5O5OH3X7X4HQ, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.930113343 (190h59m19.661380993s) [noise=true , address=104.36.82.44:4892 , piece_id=HCSMK323IRGKZHKCAUTPZGXFNG224OIOGBF7XPKD3UK6RBBELTWA, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.930599448 (190h59m19.661867099s) [noise=true , address=104.36.82.34:4561 , piece_id=64MOM5364NEFB45EP6PM6SKFJ7ZMXZXX5K5HN5VGLJSXYDSIFSWQ, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.934160795 (190h59m19.665428445s) [noise=true , address=104.36.82.39:4753 , piece_id=Z5Z7NKHWB2JE33YSE6WQ4OZCATGA2V2FSDQBV52WTSUUNX5ZKTYA, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.934194257 (190h59m19.665461908s) [seg_pos={0 0}, upload=198736]: Segment reached optimal threshold of 14 pieces.
Aug 16 16:25:38.934403091 (190h59m19.665670741s) [noise=true , address=77.90.31.21:4912 , piece_id=7SR22XNESBXX2D3D3VFIHXIJJNFVTMQTW7N7T66GZN5KSD6UDYMA, seg_pos={0 0}, upload=198736]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SFktrdgGxzEZue49XWkNxVZfrpHA73M2H3hRX7NXnvwVnvbv1): protocol: expected piece hash; write tcp 5.161.89.252:28854->77.90.31.21:4912: use of closed network connection; write tcp 5.161.89.252:28854->77.90.31.21:4912: use of closed network connection; EOF
Aug 16 16:25:38.934585955 (190h59m19.665853615s) [noise=true , address=104.36.82.60:4339 , piece_id=PUIGSSRRS2G676MUKTKDAN4MDPU6ECV622WR6OCARTMNCYID2NIA, seg_pos={0 0}, upload=198736]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R): protocol: expected piece hash; context canceled; EOF
Aug 16 16:25:38.934641310 (190h59m19.66590896s) [noise=true , address=77.90.31.19:4869 , piece_id=YVDEI2QSS5XDVFQZEHM6OFMFHRWOCK2L5636B623XG5ZSM2R7S3Q, seg_pos={0 0}, upload=198736]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129refeNg3BsDCThccHdMUJgitGM942qREieZCP2UYoicRAtFN8): protocol: expected piece hash; context canceled; EOF
Aug 16 16:25:38.934752820 (190h59m19.666020471s) [noise=true , address=77.90.31.15:4706 , piece_id=22BB34RWLRZR3ME4HBGE7AJOAQUOUMT77CSWZCI5HUWNIF5NRG5A, seg_pos={0 0}, upload=198736]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YZZnCo54XknuvoBoVtRudXSnoWdNdrn23Lp6Gou3g451BzUwG): protocol: rpc: dial tcp 77.90.31.15:4706: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 16:25:38.934767497 (190h59m19.666035148s) [seg_pos={0 0}, upload=198736]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 16:25:38.934860734 (190h59m19.666128383s) [upload=198736]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 16:25:38.934866775 (190h59m19.666134425s) [upload=198736]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 16:25:39.330832871 (190h59m20.062100501s) [upload=198736]: Done uploading segments...
Aug 16 16:25:39.330845816 (190h59m20.062113446s) [upload=198736]: Upload finished. err: <nil>
Duration: 1.869157361s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................................X.............X............] duration:
1.404083851s
FAIL (2025-08-16 16:30:20 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 16:21:19.736330105 (190h55m0.467597755s) [upload=198661]: Starting upload Aug 16 16:21:19.736403663 (190h55m0.467671313s) [upload=198661]: Done starting upload Aug 16 16:21:19.736486540 (190h55m0.467754189s) [upload=198661]: Uploading segments... Aug 16 16:21:19.736523800 (190h55m0.467791449s) [upload=198661]: Got next segment. Inline: true Aug 16 16:21:19.736529099 (190h55m0.467796749s) [upload=198661]: Waiting for error group managing segments... Aug 16 16:21:19.736572000 (190h55m0.467839651s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 16:21:19.736577090 (190h55m0.467844741s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 16:21:19.736580446 (190h55m0.467848097s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 16:21:19.820858302 (190h55m0.552125953s) [upload=198661]: Done uploading segments... Aug 16 16:21:19.820875544 (190h55m0.552143195s) [upload=198661]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.404113387s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
588.763764ms
FAIL (2025-08-16 16:30:12 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 16 16:25:38.589284525 (190h59m19.320552175s) [upload=198736]: Starting upload
Aug 16 16:25:38.589354917 (190h59m19.320622567s) [upload=198736]: Done starting upload
Aug 16 16:25:38.589422014 (190h59m19.320689664s) [upload=198736]: Uploading segments...
Aug 16 16:25:38.589832156 (190h59m19.321099816s) [upload=198736]: Got next segment. Inline: false
Aug 16 16:25:38.589885355 (190h59m19.321153006s) [upload=198736]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 16:25:38.589890937 (190h59m19.321158586s) [upload=198736]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 16:25:38.636921366 (190h59m19.368189006s) [seg_pos={0 0}, upload=198736]: Begin upload segment...
Aug 16 16:25:38.636952475 (190h59m19.368220105s) [seg_pos={0 0}, upload=198736]: Done begin upload segment.
Aug 16 16:25:38.636977401 (190h59m19.368245042s) [noise=true , address=104.36.82.37:4666 , piece_id=BOYG2Y63SKP77WWO3L3S4UT5CZ6S6ONXK2STIMSZ5O5OH3X7X4HQ, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.636991899 (190h59m19.368259529s) [noise=true , address=104.36.82.39:4753 , piece_id=Z5Z7NKHWB2JE33YSE6WQ4OZCATGA2V2FSDQBV52WTSUUNX5ZKTYA, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.637330737 (190h59m19.368598367s) [noise=true , address=104.36.82.58:4300 , piece_id=A64SYLHGFDQHRQVHCIUFXH4Y6EZGNFOO4GBGTY255IK3BZ4KNYAA, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.637399417 (190h59m19.368667057s) [noise=true , address=104.36.82.8:4981 , piece_id=WEG75O6JVV5NWY67IAWPJOJF5PHKJVR5HXN5HLP7PF4ZTESOYEWQ, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.637607759 (190h59m19.368875399s) [noise=true , address=45.91.116.13:4163 , piece_id=FYAB6ZWS2J45DCQDRQ3SHVGAJO4OYOPQIIIMRLCQBJQWDJ2L6PSQ, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.637772890 (190h59m19.36904054s) [noise=true , address=104.36.82.51:4083 , piece_id=7JS5X6FXOGG5LQ43FACBEQALYNPW6IXISBUTJYGBEX4YTRL45YWQ, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.637905380 (190h59m19.36917302s) [noise=true , address=45.91.116.7:4020 , piece_id=VU55DFYKGU3BKD26KBZ5RZBFLVGUC36SHCYOX6QT4MZJ32IHMU6Q, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.638112299 (190h59m19.369379949s) [noise=true , address=77.90.31.15:4706 , piece_id=22BB34RWLRZR3ME4HBGE7AJOAQUOUMT77CSWZCI5HUWNIF5NRG5A, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.638170219 (190h59m19.369437849s) [noise=true , address=77.90.31.12:4604 , piece_id=UQGOMGKXYVDFLW2JASS25GY2MF46OKJ27DODTWVJAIXBKKKPZL7A, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.638434356 (190h59m19.369701996s) [noise=true , address=104.36.82.38:4721 , piece_id=SZPHPJRSRSCCGGLA3EDDW3CH7FOJSMFFUUEMVCDFGK7USDYKPYIA, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.638487185 (190h59m19.369754835s) [noise=true , address=104.36.82.60:4339 , piece_id=PUIGSSRRS2G676MUKTKDAN4MDPU6ECV622WR6OCARTMNCYID2NIA, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.638723089 (190h59m19.36999073s) [noise=true , address=104.36.82.34:4561 , piece_id=64MOM5364NEFB45EP6PM6SKFJ7ZMXZXX5K5HN5VGLJSXYDSIFSWQ, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.638994480 (190h59m19.37026211s) [noise=true , address=77.90.31.19:4869 , piece_id=YVDEI2QSS5XDVFQZEHM6OFMFHRWOCK2L5636B623XG5ZSM2R7S3Q, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.639260581 (190h59m19.370528222s) [noise=true , address=77.90.31.12:4609 , piece_id=SQ7KFJRSFNJMSWLXSGZPWKZEH35WG3LLNCDMYWE352JFQC7VWSVQ, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.639524278 (190h59m19.370791919s) [noise=true , address=77.90.31.21:4912 , piece_id=7SR22XNESBXX2D3D3VFIHXIJJNFVTMQTW7N7T66GZN5KSD6UDYMA, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.639802412 (190h59m19.371070052s) [noise=true , address=104.36.82.44:4892 , piece_id=HCSMK323IRGKZHKCAUTPZGXFNG224OIOGBF7XPKD3UK6RBBELTWA, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.640090955 (190h59m19.371358595s) [noise=true , address=45.91.116.8:4074 , piece_id=22EVTJBLCMFIK2BTIXOYJA7O4WJ7DMG4G27X7AJAHCO42XGPUXFA, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.642267764 (190h59m19.373535405s) [noise=true , address=104.36.82.17:4333 , piece_id=MLH7DNUZWAJWCTT3BTXQIFUMUPCTMIY6VMSM22DLC3QB3XXNUURQ, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.756745546 (190h59m19.488013197s) [upload=198736]: Next returned nil segment
Aug 16 16:25:38.756760494 (190h59m19.488028145s) [upload=198736]: Waiting for error group managing segments...
Aug 16 16:25:38.771172176 (190h59m19.502439835s) [noise=true , address=104.36.82.17:4333 , piece_id=MLH7DNUZWAJWCTT3BTXQIFUMUPCTMIY6VMSM22DLC3QB3XXNUURQ, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.795367041 (190h59m19.526634691s) [noise=true , address=45.91.116.13:4163 , piece_id=FYAB6ZWS2J45DCQDRQ3SHVGAJO4OYOPQIIIMRLCQBJQWDJ2L6PSQ, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.801599668 (190h59m19.532867328s) [noise=true , address=77.90.31.12:4609 , piece_id=SQ7KFJRSFNJMSWLXSGZPWKZEH35WG3LLNCDMYWE352JFQC7VWSVQ, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.815582041 (190h59m19.546849691s) [noise=true , address=104.36.82.38:4721 , piece_id=SZPHPJRSRSCCGGLA3EDDW3CH7FOJSMFFUUEMVCDFGK7USDYKPYIA, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.821600254 (190h59m19.552867914s) [noise=true , address=104.36.82.51:4083 , piece_id=7JS5X6FXOGG5LQ43FACBEQALYNPW6IXISBUTJYGBEX4YTRL45YWQ, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.844363363 (190h59m19.575631023s) [noise=true , address=104.36.82.58:4300 , piece_id=A64SYLHGFDQHRQVHCIUFXH4Y6EZGNFOO4GBGTY255IK3BZ4KNYAA, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.847794134 (190h59m19.579061785s) [noise=true , address=45.91.116.8:4074 , piece_id=22EVTJBLCMFIK2BTIXOYJA7O4WJ7DMG4G27X7AJAHCO42XGPUXFA, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.849919236 (190h59m19.581186886s) [noise=true , address=45.91.116.7:4020 , piece_id=VU55DFYKGU3BKD26KBZ5RZBFLVGUC36SHCYOX6QT4MZJ32IHMU6Q, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.854844502 (190h59m19.586112162s) [noise=true , address=104.36.82.8:4981 , piece_id=WEG75O6JVV5NWY67IAWPJOJF5PHKJVR5HXN5HLP7PF4ZTESOYEWQ, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.857740616 (190h59m19.589008266s) [noise=true , address=77.90.31.12:4604 , piece_id=UQGOMGKXYVDFLW2JASS25GY2MF46OKJ27DODTWVJAIXBKKKPZL7A, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.858644869 (190h59m19.589912529s) [noise=true , address=104.36.82.37:4666 , piece_id=BOYG2Y63SKP77WWO3L3S4UT5CZ6S6ONXK2STIMSZ5O5OH3X7X4HQ, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.930113343 (190h59m19.661380993s) [noise=true , address=104.36.82.44:4892 , piece_id=HCSMK323IRGKZHKCAUTPZGXFNG224OIOGBF7XPKD3UK6RBBELTWA, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.930599448 (190h59m19.661867099s) [noise=true , address=104.36.82.34:4561 , piece_id=64MOM5364NEFB45EP6PM6SKFJ7ZMXZXX5K5HN5VGLJSXYDSIFSWQ, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.934160795 (190h59m19.665428445s) [noise=true , address=104.36.82.39:4753 , piece_id=Z5Z7NKHWB2JE33YSE6WQ4OZCATGA2V2FSDQBV52WTSUUNX5ZKTYA, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.934194257 (190h59m19.665461908s) [seg_pos={0 0}, upload=198736]: Segment reached optimal threshold of 14 pieces.
Aug 16 16:25:38.934403091 (190h59m19.665670741s) [noise=true , address=77.90.31.21:4912 , piece_id=7SR22XNESBXX2D3D3VFIHXIJJNFVTMQTW7N7T66GZN5KSD6UDYMA, seg_pos={0 0}, upload=198736]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SFktrdgGxzEZue49XWkNxVZfrpHA73M2H3hRX7NXnvwVnvbv1): protocol: expected piece hash; write tcp 5.161.89.252:28854->77.90.31.21:4912: use of closed network connection; write tcp 5.161.89.252:28854->77.90.31.21:4912: use of closed network connection; EOF
Aug 16 16:25:38.934585955 (190h59m19.665853615s) [noise=true , address=104.36.82.60:4339 , piece_id=PUIGSSRRS2G676MUKTKDAN4MDPU6ECV622WR6OCARTMNCYID2NIA, seg_pos={0 0}, upload=198736]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R): protocol: expected piece hash; context canceled; EOF
Aug 16 16:25:38.934641310 (190h59m19.66590896s) [noise=true , address=77.90.31.19:4869 , piece_id=YVDEI2QSS5XDVFQZEHM6OFMFHRWOCK2L5636B623XG5ZSM2R7S3Q, seg_pos={0 0}, upload=198736]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129refeNg3BsDCThccHdMUJgitGM942qREieZCP2UYoicRAtFN8): protocol: expected piece hash; context canceled; EOF
Aug 16 16:25:38.934752820 (190h59m19.666020471s) [noise=true , address=77.90.31.15:4706 , piece_id=22BB34RWLRZR3ME4HBGE7AJOAQUOUMT77CSWZCI5HUWNIF5NRG5A, seg_pos={0 0}, upload=198736]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YZZnCo54XknuvoBoVtRudXSnoWdNdrn23Lp6Gou3g451BzUwG): protocol: rpc: dial tcp 77.90.31.15:4706: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 16:25:38.934767497 (190h59m19.666035148s) [seg_pos={0 0}, upload=198736]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 16:25:38.934860734 (190h59m19.666128383s) [upload=198736]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 16:25:38.934866775 (190h59m19.666134425s) [upload=198736]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 16:25:39.330832871 (190h59m20.062100501s) [upload=198736]: Done uploading segments...
Aug 16 16:25:39.330845816 (190h59m20.062113446s) [upload=198736]: Upload finished. err: <nil>
Duration: 588.780695ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................................X.............X...........] duration:
575.83274ms
FAIL (2025-08-16 16:29:20 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 16:21:19.736330105 (190h55m0.467597755s) [upload=198661]: Starting upload Aug 16 16:21:19.736403663 (190h55m0.467671313s) [upload=198661]: Done starting upload Aug 16 16:21:19.736486540 (190h55m0.467754189s) [upload=198661]: Uploading segments... Aug 16 16:21:19.736523800 (190h55m0.467791449s) [upload=198661]: Got next segment. Inline: true Aug 16 16:21:19.736529099 (190h55m0.467796749s) [upload=198661]: Waiting for error group managing segments... Aug 16 16:21:19.736572000 (190h55m0.467839651s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 16:21:19.736577090 (190h55m0.467844741s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 16:21:19.736580446 (190h55m0.467848097s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 16:21:19.820858302 (190h55m0.552125953s) [upload=198661]: Done uploading segments... Aug 16 16:21:19.820875544 (190h55m0.552143195s) [upload=198661]: Upload finished. err: metaclient: Too Many Requests
Duration: 575.850005ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
1.434131186s
FAIL (2025-08-16 16:29:05 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 16 16:25:38.589284525 (190h59m19.320552175s) [upload=198736]: Starting upload
Aug 16 16:25:38.589354917 (190h59m19.320622567s) [upload=198736]: Done starting upload
Aug 16 16:25:38.589422014 (190h59m19.320689664s) [upload=198736]: Uploading segments...
Aug 16 16:25:38.589832156 (190h59m19.321099816s) [upload=198736]: Got next segment. Inline: false
Aug 16 16:25:38.589885355 (190h59m19.321153006s) [upload=198736]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 16:25:38.589890937 (190h59m19.321158586s) [upload=198736]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 16:25:38.636921366 (190h59m19.368189006s) [seg_pos={0 0}, upload=198736]: Begin upload segment...
Aug 16 16:25:38.636952475 (190h59m19.368220105s) [seg_pos={0 0}, upload=198736]: Done begin upload segment.
Aug 16 16:25:38.636977401 (190h59m19.368245042s) [noise=true , address=104.36.82.37:4666 , piece_id=BOYG2Y63SKP77WWO3L3S4UT5CZ6S6ONXK2STIMSZ5O5OH3X7X4HQ, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.636991899 (190h59m19.368259529s) [noise=true , address=104.36.82.39:4753 , piece_id=Z5Z7NKHWB2JE33YSE6WQ4OZCATGA2V2FSDQBV52WTSUUNX5ZKTYA, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.637330737 (190h59m19.368598367s) [noise=true , address=104.36.82.58:4300 , piece_id=A64SYLHGFDQHRQVHCIUFXH4Y6EZGNFOO4GBGTY255IK3BZ4KNYAA, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.637399417 (190h59m19.368667057s) [noise=true , address=104.36.82.8:4981 , piece_id=WEG75O6JVV5NWY67IAWPJOJF5PHKJVR5HXN5HLP7PF4ZTESOYEWQ, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.637607759 (190h59m19.368875399s) [noise=true , address=45.91.116.13:4163 , piece_id=FYAB6ZWS2J45DCQDRQ3SHVGAJO4OYOPQIIIMRLCQBJQWDJ2L6PSQ, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.637772890 (190h59m19.36904054s) [noise=true , address=104.36.82.51:4083 , piece_id=7JS5X6FXOGG5LQ43FACBEQALYNPW6IXISBUTJYGBEX4YTRL45YWQ, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.637905380 (190h59m19.36917302s) [noise=true , address=45.91.116.7:4020 , piece_id=VU55DFYKGU3BKD26KBZ5RZBFLVGUC36SHCYOX6QT4MZJ32IHMU6Q, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.638112299 (190h59m19.369379949s) [noise=true , address=77.90.31.15:4706 , piece_id=22BB34RWLRZR3ME4HBGE7AJOAQUOUMT77CSWZCI5HUWNIF5NRG5A, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.638170219 (190h59m19.369437849s) [noise=true , address=77.90.31.12:4604 , piece_id=UQGOMGKXYVDFLW2JASS25GY2MF46OKJ27DODTWVJAIXBKKKPZL7A, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.638434356 (190h59m19.369701996s) [noise=true , address=104.36.82.38:4721 , piece_id=SZPHPJRSRSCCGGLA3EDDW3CH7FOJSMFFUUEMVCDFGK7USDYKPYIA, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.638487185 (190h59m19.369754835s) [noise=true , address=104.36.82.60:4339 , piece_id=PUIGSSRRS2G676MUKTKDAN4MDPU6ECV622WR6OCARTMNCYID2NIA, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.638723089 (190h59m19.36999073s) [noise=true , address=104.36.82.34:4561 , piece_id=64MOM5364NEFB45EP6PM6SKFJ7ZMXZXX5K5HN5VGLJSXYDSIFSWQ, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.638994480 (190h59m19.37026211s) [noise=true , address=77.90.31.19:4869 , piece_id=YVDEI2QSS5XDVFQZEHM6OFMFHRWOCK2L5636B623XG5ZSM2R7S3Q, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.639260581 (190h59m19.370528222s) [noise=true , address=77.90.31.12:4609 , piece_id=SQ7KFJRSFNJMSWLXSGZPWKZEH35WG3LLNCDMYWE352JFQC7VWSVQ, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.639524278 (190h59m19.370791919s) [noise=true , address=77.90.31.21:4912 , piece_id=7SR22XNESBXX2D3D3VFIHXIJJNFVTMQTW7N7T66GZN5KSD6UDYMA, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.639802412 (190h59m19.371070052s) [noise=true , address=104.36.82.44:4892 , piece_id=HCSMK323IRGKZHKCAUTPZGXFNG224OIOGBF7XPKD3UK6RBBELTWA, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.640090955 (190h59m19.371358595s) [noise=true , address=45.91.116.8:4074 , piece_id=22EVTJBLCMFIK2BTIXOYJA7O4WJ7DMG4G27X7AJAHCO42XGPUXFA, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.642267764 (190h59m19.373535405s) [noise=true , address=104.36.82.17:4333 , piece_id=MLH7DNUZWAJWCTT3BTXQIFUMUPCTMIY6VMSM22DLC3QB3XXNUURQ, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.756745546 (190h59m19.488013197s) [upload=198736]: Next returned nil segment
Aug 16 16:25:38.756760494 (190h59m19.488028145s) [upload=198736]: Waiting for error group managing segments...
Aug 16 16:25:38.771172176 (190h59m19.502439835s) [noise=true , address=104.36.82.17:4333 , piece_id=MLH7DNUZWAJWCTT3BTXQIFUMUPCTMIY6VMSM22DLC3QB3XXNUURQ, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.795367041 (190h59m19.526634691s) [noise=true , address=45.91.116.13:4163 , piece_id=FYAB6ZWS2J45DCQDRQ3SHVGAJO4OYOPQIIIMRLCQBJQWDJ2L6PSQ, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.801599668 (190h59m19.532867328s) [noise=true , address=77.90.31.12:4609 , piece_id=SQ7KFJRSFNJMSWLXSGZPWKZEH35WG3LLNCDMYWE352JFQC7VWSVQ, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.815582041 (190h59m19.546849691s) [noise=true , address=104.36.82.38:4721 , piece_id=SZPHPJRSRSCCGGLA3EDDW3CH7FOJSMFFUUEMVCDFGK7USDYKPYIA, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.821600254 (190h59m19.552867914s) [noise=true , address=104.36.82.51:4083 , piece_id=7JS5X6FXOGG5LQ43FACBEQALYNPW6IXISBUTJYGBEX4YTRL45YWQ, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.844363363 (190h59m19.575631023s) [noise=true , address=104.36.82.58:4300 , piece_id=A64SYLHGFDQHRQVHCIUFXH4Y6EZGNFOO4GBGTY255IK3BZ4KNYAA, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.847794134 (190h59m19.579061785s) [noise=true , address=45.91.116.8:4074 , piece_id=22EVTJBLCMFIK2BTIXOYJA7O4WJ7DMG4G27X7AJAHCO42XGPUXFA, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.849919236 (190h59m19.581186886s) [noise=true , address=45.91.116.7:4020 , piece_id=VU55DFYKGU3BKD26KBZ5RZBFLVGUC36SHCYOX6QT4MZJ32IHMU6Q, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.854844502 (190h59m19.586112162s) [noise=true , address=104.36.82.8:4981 , piece_id=WEG75O6JVV5NWY67IAWPJOJF5PHKJVR5HXN5HLP7PF4ZTESOYEWQ, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.857740616 (190h59m19.589008266s) [noise=true , address=77.90.31.12:4604 , piece_id=UQGOMGKXYVDFLW2JASS25GY2MF46OKJ27DODTWVJAIXBKKKPZL7A, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.858644869 (190h59m19.589912529s) [noise=true , address=104.36.82.37:4666 , piece_id=BOYG2Y63SKP77WWO3L3S4UT5CZ6S6ONXK2STIMSZ5O5OH3X7X4HQ, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.930113343 (190h59m19.661380993s) [noise=true , address=104.36.82.44:4892 , piece_id=HCSMK323IRGKZHKCAUTPZGXFNG224OIOGBF7XPKD3UK6RBBELTWA, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.930599448 (190h59m19.661867099s) [noise=true , address=104.36.82.34:4561 , piece_id=64MOM5364NEFB45EP6PM6SKFJ7ZMXZXX5K5HN5VGLJSXYDSIFSWQ, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.934160795 (190h59m19.665428445s) [noise=true , address=104.36.82.39:4753 , piece_id=Z5Z7NKHWB2JE33YSE6WQ4OZCATGA2V2FSDQBV52WTSUUNX5ZKTYA, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.934194257 (190h59m19.665461908s) [seg_pos={0 0}, upload=198736]: Segment reached optimal threshold of 14 pieces.
Aug 16 16:25:38.934403091 (190h59m19.665670741s) [noise=true , address=77.90.31.21:4912 , piece_id=7SR22XNESBXX2D3D3VFIHXIJJNFVTMQTW7N7T66GZN5KSD6UDYMA, seg_pos={0 0}, upload=198736]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SFktrdgGxzEZue49XWkNxVZfrpHA73M2H3hRX7NXnvwVnvbv1): protocol: expected piece hash; write tcp 5.161.89.252:28854->77.90.31.21:4912: use of closed network connection; write tcp 5.161.89.252:28854->77.90.31.21:4912: use of closed network connection; EOF
Aug 16 16:25:38.934585955 (190h59m19.665853615s) [noise=true , address=104.36.82.60:4339 , piece_id=PUIGSSRRS2G676MUKTKDAN4MDPU6ECV622WR6OCARTMNCYID2NIA, seg_pos={0 0}, upload=198736]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R): protocol: expected piece hash; context canceled; EOF
Aug 16 16:25:38.934641310 (190h59m19.66590896s) [noise=true , address=77.90.31.19:4869 , piece_id=YVDEI2QSS5XDVFQZEHM6OFMFHRWOCK2L5636B623XG5ZSM2R7S3Q, seg_pos={0 0}, upload=198736]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129refeNg3BsDCThccHdMUJgitGM942qREieZCP2UYoicRAtFN8): protocol: expected piece hash; context canceled; EOF
Aug 16 16:25:38.934752820 (190h59m19.666020471s) [noise=true , address=77.90.31.15:4706 , piece_id=22BB34RWLRZR3ME4HBGE7AJOAQUOUMT77CSWZCI5HUWNIF5NRG5A, seg_pos={0 0}, upload=198736]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YZZnCo54XknuvoBoVtRudXSnoWdNdrn23Lp6Gou3g451BzUwG): protocol: rpc: dial tcp 77.90.31.15:4706: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 16:25:38.934767497 (190h59m19.666035148s) [seg_pos={0 0}, upload=198736]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 16:25:38.934860734 (190h59m19.666128383s) [upload=198736]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 16:25:38.934866775 (190h59m19.666134425s) [upload=198736]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 16:25:39.330832871 (190h59m20.062100501s) [upload=198736]: Done uploading segments...
Aug 16 16:25:39.330845816 (190h59m20.062113446s) [upload=198736]: Upload finished. err: <nil>
Duration: 1.434159539s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...................................X.............X..........] duration:
1.099952423s
FAIL (2025-08-16 16:29:03 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 16:21:19.736330105 (190h55m0.467597755s) [upload=198661]: Starting upload Aug 16 16:21:19.736403663 (190h55m0.467671313s) [upload=198661]: Done starting upload Aug 16 16:21:19.736486540 (190h55m0.467754189s) [upload=198661]: Uploading segments... Aug 16 16:21:19.736523800 (190h55m0.467791449s) [upload=198661]: Got next segment. Inline: true Aug 16 16:21:19.736529099 (190h55m0.467796749s) [upload=198661]: Waiting for error group managing segments... Aug 16 16:21:19.736572000 (190h55m0.467839651s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 16:21:19.736577090 (190h55m0.467844741s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 16:21:19.736580446 (190h55m0.467848097s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 16:21:19.820858302 (190h55m0.552125953s) [upload=198661]: Done uploading segments... Aug 16 16:21:19.820875544 (190h55m0.552143195s) [upload=198661]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.099972881s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
988.330821ms
FAIL (2025-08-16 16:28:43 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 16 16:25:38.589284525 (190h59m19.320552175s) [upload=198736]: Starting upload
Aug 16 16:25:38.589354917 (190h59m19.320622567s) [upload=198736]: Done starting upload
Aug 16 16:25:38.589422014 (190h59m19.320689664s) [upload=198736]: Uploading segments...
Aug 16 16:25:38.589832156 (190h59m19.321099816s) [upload=198736]: Got next segment. Inline: false
Aug 16 16:25:38.589885355 (190h59m19.321153006s) [upload=198736]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 16:25:38.589890937 (190h59m19.321158586s) [upload=198736]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 16:25:38.636921366 (190h59m19.368189006s) [seg_pos={0 0}, upload=198736]: Begin upload segment...
Aug 16 16:25:38.636952475 (190h59m19.368220105s) [seg_pos={0 0}, upload=198736]: Done begin upload segment.
Aug 16 16:25:38.636977401 (190h59m19.368245042s) [noise=true , address=104.36.82.37:4666 , piece_id=BOYG2Y63SKP77WWO3L3S4UT5CZ6S6ONXK2STIMSZ5O5OH3X7X4HQ, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.636991899 (190h59m19.368259529s) [noise=true , address=104.36.82.39:4753 , piece_id=Z5Z7NKHWB2JE33YSE6WQ4OZCATGA2V2FSDQBV52WTSUUNX5ZKTYA, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.637330737 (190h59m19.368598367s) [noise=true , address=104.36.82.58:4300 , piece_id=A64SYLHGFDQHRQVHCIUFXH4Y6EZGNFOO4GBGTY255IK3BZ4KNYAA, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.637399417 (190h59m19.368667057s) [noise=true , address=104.36.82.8:4981 , piece_id=WEG75O6JVV5NWY67IAWPJOJF5PHKJVR5HXN5HLP7PF4ZTESOYEWQ, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.637607759 (190h59m19.368875399s) [noise=true , address=45.91.116.13:4163 , piece_id=FYAB6ZWS2J45DCQDRQ3SHVGAJO4OYOPQIIIMRLCQBJQWDJ2L6PSQ, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.637772890 (190h59m19.36904054s) [noise=true , address=104.36.82.51:4083 , piece_id=7JS5X6FXOGG5LQ43FACBEQALYNPW6IXISBUTJYGBEX4YTRL45YWQ, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.637905380 (190h59m19.36917302s) [noise=true , address=45.91.116.7:4020 , piece_id=VU55DFYKGU3BKD26KBZ5RZBFLVGUC36SHCYOX6QT4MZJ32IHMU6Q, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.638112299 (190h59m19.369379949s) [noise=true , address=77.90.31.15:4706 , piece_id=22BB34RWLRZR3ME4HBGE7AJOAQUOUMT77CSWZCI5HUWNIF5NRG5A, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.638170219 (190h59m19.369437849s) [noise=true , address=77.90.31.12:4604 , piece_id=UQGOMGKXYVDFLW2JASS25GY2MF46OKJ27DODTWVJAIXBKKKPZL7A, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.638434356 (190h59m19.369701996s) [noise=true , address=104.36.82.38:4721 , piece_id=SZPHPJRSRSCCGGLA3EDDW3CH7FOJSMFFUUEMVCDFGK7USDYKPYIA, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.638487185 (190h59m19.369754835s) [noise=true , address=104.36.82.60:4339 , piece_id=PUIGSSRRS2G676MUKTKDAN4MDPU6ECV622WR6OCARTMNCYID2NIA, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.638723089 (190h59m19.36999073s) [noise=true , address=104.36.82.34:4561 , piece_id=64MOM5364NEFB45EP6PM6SKFJ7ZMXZXX5K5HN5VGLJSXYDSIFSWQ, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.638994480 (190h59m19.37026211s) [noise=true , address=77.90.31.19:4869 , piece_id=YVDEI2QSS5XDVFQZEHM6OFMFHRWOCK2L5636B623XG5ZSM2R7S3Q, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.639260581 (190h59m19.370528222s) [noise=true , address=77.90.31.12:4609 , piece_id=SQ7KFJRSFNJMSWLXSGZPWKZEH35WG3LLNCDMYWE352JFQC7VWSVQ, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.639524278 (190h59m19.370791919s) [noise=true , address=77.90.31.21:4912 , piece_id=7SR22XNESBXX2D3D3VFIHXIJJNFVTMQTW7N7T66GZN5KSD6UDYMA, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.639802412 (190h59m19.371070052s) [noise=true , address=104.36.82.44:4892 , piece_id=HCSMK323IRGKZHKCAUTPZGXFNG224OIOGBF7XPKD3UK6RBBELTWA, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.640090955 (190h59m19.371358595s) [noise=true , address=45.91.116.8:4074 , piece_id=22EVTJBLCMFIK2BTIXOYJA7O4WJ7DMG4G27X7AJAHCO42XGPUXFA, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.642267764 (190h59m19.373535405s) [noise=true , address=104.36.82.17:4333 , piece_id=MLH7DNUZWAJWCTT3BTXQIFUMUPCTMIY6VMSM22DLC3QB3XXNUURQ, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.756745546 (190h59m19.488013197s) [upload=198736]: Next returned nil segment
Aug 16 16:25:38.756760494 (190h59m19.488028145s) [upload=198736]: Waiting for error group managing segments...
Aug 16 16:25:38.771172176 (190h59m19.502439835s) [noise=true , address=104.36.82.17:4333 , piece_id=MLH7DNUZWAJWCTT3BTXQIFUMUPCTMIY6VMSM22DLC3QB3XXNUURQ, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.795367041 (190h59m19.526634691s) [noise=true , address=45.91.116.13:4163 , piece_id=FYAB6ZWS2J45DCQDRQ3SHVGAJO4OYOPQIIIMRLCQBJQWDJ2L6PSQ, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.801599668 (190h59m19.532867328s) [noise=true , address=77.90.31.12:4609 , piece_id=SQ7KFJRSFNJMSWLXSGZPWKZEH35WG3LLNCDMYWE352JFQC7VWSVQ, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.815582041 (190h59m19.546849691s) [noise=true , address=104.36.82.38:4721 , piece_id=SZPHPJRSRSCCGGLA3EDDW3CH7FOJSMFFUUEMVCDFGK7USDYKPYIA, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.821600254 (190h59m19.552867914s) [noise=true , address=104.36.82.51:4083 , piece_id=7JS5X6FXOGG5LQ43FACBEQALYNPW6IXISBUTJYGBEX4YTRL45YWQ, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.844363363 (190h59m19.575631023s) [noise=true , address=104.36.82.58:4300 , piece_id=A64SYLHGFDQHRQVHCIUFXH4Y6EZGNFOO4GBGTY255IK3BZ4KNYAA, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.847794134 (190h59m19.579061785s) [noise=true , address=45.91.116.8:4074 , piece_id=22EVTJBLCMFIK2BTIXOYJA7O4WJ7DMG4G27X7AJAHCO42XGPUXFA, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.849919236 (190h59m19.581186886s) [noise=true , address=45.91.116.7:4020 , piece_id=VU55DFYKGU3BKD26KBZ5RZBFLVGUC36SHCYOX6QT4MZJ32IHMU6Q, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.854844502 (190h59m19.586112162s) [noise=true , address=104.36.82.8:4981 , piece_id=WEG75O6JVV5NWY67IAWPJOJF5PHKJVR5HXN5HLP7PF4ZTESOYEWQ, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.857740616 (190h59m19.589008266s) [noise=true , address=77.90.31.12:4604 , piece_id=UQGOMGKXYVDFLW2JASS25GY2MF46OKJ27DODTWVJAIXBKKKPZL7A, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.858644869 (190h59m19.589912529s) [noise=true , address=104.36.82.37:4666 , piece_id=BOYG2Y63SKP77WWO3L3S4UT5CZ6S6ONXK2STIMSZ5O5OH3X7X4HQ, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.930113343 (190h59m19.661380993s) [noise=true , address=104.36.82.44:4892 , piece_id=HCSMK323IRGKZHKCAUTPZGXFNG224OIOGBF7XPKD3UK6RBBELTWA, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.930599448 (190h59m19.661867099s) [noise=true , address=104.36.82.34:4561 , piece_id=64MOM5364NEFB45EP6PM6SKFJ7ZMXZXX5K5HN5VGLJSXYDSIFSWQ, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.934160795 (190h59m19.665428445s) [noise=true , address=104.36.82.39:4753 , piece_id=Z5Z7NKHWB2JE33YSE6WQ4OZCATGA2V2FSDQBV52WTSUUNX5ZKTYA, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.934194257 (190h59m19.665461908s) [seg_pos={0 0}, upload=198736]: Segment reached optimal threshold of 14 pieces.
Aug 16 16:25:38.934403091 (190h59m19.665670741s) [noise=true , address=77.90.31.21:4912 , piece_id=7SR22XNESBXX2D3D3VFIHXIJJNFVTMQTW7N7T66GZN5KSD6UDYMA, seg_pos={0 0}, upload=198736]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SFktrdgGxzEZue49XWkNxVZfrpHA73M2H3hRX7NXnvwVnvbv1): protocol: expected piece hash; write tcp 5.161.89.252:28854->77.90.31.21:4912: use of closed network connection; write tcp 5.161.89.252:28854->77.90.31.21:4912: use of closed network connection; EOF
Aug 16 16:25:38.934585955 (190h59m19.665853615s) [noise=true , address=104.36.82.60:4339 , piece_id=PUIGSSRRS2G676MUKTKDAN4MDPU6ECV622WR6OCARTMNCYID2NIA, seg_pos={0 0}, upload=198736]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R): protocol: expected piece hash; context canceled; EOF
Aug 16 16:25:38.934641310 (190h59m19.66590896s) [noise=true , address=77.90.31.19:4869 , piece_id=YVDEI2QSS5XDVFQZEHM6OFMFHRWOCK2L5636B623XG5ZSM2R7S3Q, seg_pos={0 0}, upload=198736]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129refeNg3BsDCThccHdMUJgitGM942qREieZCP2UYoicRAtFN8): protocol: expected piece hash; context canceled; EOF
Aug 16 16:25:38.934752820 (190h59m19.666020471s) [noise=true , address=77.90.31.15:4706 , piece_id=22BB34RWLRZR3ME4HBGE7AJOAQUOUMT77CSWZCI5HUWNIF5NRG5A, seg_pos={0 0}, upload=198736]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YZZnCo54XknuvoBoVtRudXSnoWdNdrn23Lp6Gou3g451BzUwG): protocol: rpc: dial tcp 77.90.31.15:4706: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 16:25:38.934767497 (190h59m19.666035148s) [seg_pos={0 0}, upload=198736]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 16:25:38.934860734 (190h59m19.666128383s) [upload=198736]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 16:25:38.934866775 (190h59m19.666134425s) [upload=198736]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 16:25:39.330832871 (190h59m20.062100501s) [upload=198736]: Done uploading segments...
Aug 16 16:25:39.330845816 (190h59m20.062113446s) [upload=198736]: Upload finished. err: <nil>
Duration: 988.363681ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....................................X.............X.........] duration:
1.724901745s
FAIL (2025-08-16 16:28:30 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 16:21:19.736330105 (190h55m0.467597755s) [upload=198661]: Starting upload Aug 16 16:21:19.736403663 (190h55m0.467671313s) [upload=198661]: Done starting upload Aug 16 16:21:19.736486540 (190h55m0.467754189s) [upload=198661]: Uploading segments... Aug 16 16:21:19.736523800 (190h55m0.467791449s) [upload=198661]: Got next segment. Inline: true Aug 16 16:21:19.736529099 (190h55m0.467796749s) [upload=198661]: Waiting for error group managing segments... Aug 16 16:21:19.736572000 (190h55m0.467839651s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 16:21:19.736577090 (190h55m0.467844741s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 16:21:19.736580446 (190h55m0.467848097s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 16:21:19.820858302 (190h55m0.552125953s) [upload=198661]: Done uploading segments... Aug 16 16:21:19.820875544 (190h55m0.552143195s) [upload=198661]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.724921101s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....................................X.............X........] duration:
872.559514ms
FAIL (2025-08-16 16:27:58 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 16:21:19.736330105 (190h55m0.467597755s) [upload=198661]: Starting upload Aug 16 16:21:19.736403663 (190h55m0.467671313s) [upload=198661]: Done starting upload Aug 16 16:21:19.736486540 (190h55m0.467754189s) [upload=198661]: Uploading segments... Aug 16 16:21:19.736523800 (190h55m0.467791449s) [upload=198661]: Got next segment. Inline: true Aug 16 16:21:19.736529099 (190h55m0.467796749s) [upload=198661]: Waiting for error group managing segments... Aug 16 16:21:19.736572000 (190h55m0.467839651s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 16:21:19.736577090 (190h55m0.467844741s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 16:21:19.736580446 (190h55m0.467848097s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 16:21:19.820858302 (190h55m0.552125953s) [upload=198661]: Done uploading segments... Aug 16 16:21:19.820875544 (190h55m0.552143195s) [upload=198661]: Upload finished. err: metaclient: Too Many Requests
Duration: 872.587616ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
1.516597611s
FAIL (2025-08-16 16:27:56 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 16 16:25:38.589284525 (190h59m19.320552175s) [upload=198736]: Starting upload
Aug 16 16:25:38.589354917 (190h59m19.320622567s) [upload=198736]: Done starting upload
Aug 16 16:25:38.589422014 (190h59m19.320689664s) [upload=198736]: Uploading segments...
Aug 16 16:25:38.589832156 (190h59m19.321099816s) [upload=198736]: Got next segment. Inline: false
Aug 16 16:25:38.589885355 (190h59m19.321153006s) [upload=198736]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 16:25:38.589890937 (190h59m19.321158586s) [upload=198736]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 16:25:38.636921366 (190h59m19.368189006s) [seg_pos={0 0}, upload=198736]: Begin upload segment...
Aug 16 16:25:38.636952475 (190h59m19.368220105s) [seg_pos={0 0}, upload=198736]: Done begin upload segment.
Aug 16 16:25:38.636977401 (190h59m19.368245042s) [noise=true , address=104.36.82.37:4666 , piece_id=BOYG2Y63SKP77WWO3L3S4UT5CZ6S6ONXK2STIMSZ5O5OH3X7X4HQ, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.636991899 (190h59m19.368259529s) [noise=true , address=104.36.82.39:4753 , piece_id=Z5Z7NKHWB2JE33YSE6WQ4OZCATGA2V2FSDQBV52WTSUUNX5ZKTYA, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.637330737 (190h59m19.368598367s) [noise=true , address=104.36.82.58:4300 , piece_id=A64SYLHGFDQHRQVHCIUFXH4Y6EZGNFOO4GBGTY255IK3BZ4KNYAA, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.637399417 (190h59m19.368667057s) [noise=true , address=104.36.82.8:4981 , piece_id=WEG75O6JVV5NWY67IAWPJOJF5PHKJVR5HXN5HLP7PF4ZTESOYEWQ, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.637607759 (190h59m19.368875399s) [noise=true , address=45.91.116.13:4163 , piece_id=FYAB6ZWS2J45DCQDRQ3SHVGAJO4OYOPQIIIMRLCQBJQWDJ2L6PSQ, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.637772890 (190h59m19.36904054s) [noise=true , address=104.36.82.51:4083 , piece_id=7JS5X6FXOGG5LQ43FACBEQALYNPW6IXISBUTJYGBEX4YTRL45YWQ, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.637905380 (190h59m19.36917302s) [noise=true , address=45.91.116.7:4020 , piece_id=VU55DFYKGU3BKD26KBZ5RZBFLVGUC36SHCYOX6QT4MZJ32IHMU6Q, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.638112299 (190h59m19.369379949s) [noise=true , address=77.90.31.15:4706 , piece_id=22BB34RWLRZR3ME4HBGE7AJOAQUOUMT77CSWZCI5HUWNIF5NRG5A, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.638170219 (190h59m19.369437849s) [noise=true , address=77.90.31.12:4604 , piece_id=UQGOMGKXYVDFLW2JASS25GY2MF46OKJ27DODTWVJAIXBKKKPZL7A, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.638434356 (190h59m19.369701996s) [noise=true , address=104.36.82.38:4721 , piece_id=SZPHPJRSRSCCGGLA3EDDW3CH7FOJSMFFUUEMVCDFGK7USDYKPYIA, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.638487185 (190h59m19.369754835s) [noise=true , address=104.36.82.60:4339 , piece_id=PUIGSSRRS2G676MUKTKDAN4MDPU6ECV622WR6OCARTMNCYID2NIA, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.638723089 (190h59m19.36999073s) [noise=true , address=104.36.82.34:4561 , piece_id=64MOM5364NEFB45EP6PM6SKFJ7ZMXZXX5K5HN5VGLJSXYDSIFSWQ, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.638994480 (190h59m19.37026211s) [noise=true , address=77.90.31.19:4869 , piece_id=YVDEI2QSS5XDVFQZEHM6OFMFHRWOCK2L5636B623XG5ZSM2R7S3Q, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.639260581 (190h59m19.370528222s) [noise=true , address=77.90.31.12:4609 , piece_id=SQ7KFJRSFNJMSWLXSGZPWKZEH35WG3LLNCDMYWE352JFQC7VWSVQ, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.639524278 (190h59m19.370791919s) [noise=true , address=77.90.31.21:4912 , piece_id=7SR22XNESBXX2D3D3VFIHXIJJNFVTMQTW7N7T66GZN5KSD6UDYMA, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.639802412 (190h59m19.371070052s) [noise=true , address=104.36.82.44:4892 , piece_id=HCSMK323IRGKZHKCAUTPZGXFNG224OIOGBF7XPKD3UK6RBBELTWA, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.640090955 (190h59m19.371358595s) [noise=true , address=45.91.116.8:4074 , piece_id=22EVTJBLCMFIK2BTIXOYJA7O4WJ7DMG4G27X7AJAHCO42XGPUXFA, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.642267764 (190h59m19.373535405s) [noise=true , address=104.36.82.17:4333 , piece_id=MLH7DNUZWAJWCTT3BTXQIFUMUPCTMIY6VMSM22DLC3QB3XXNUURQ, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.756745546 (190h59m19.488013197s) [upload=198736]: Next returned nil segment
Aug 16 16:25:38.756760494 (190h59m19.488028145s) [upload=198736]: Waiting for error group managing segments...
Aug 16 16:25:38.771172176 (190h59m19.502439835s) [noise=true , address=104.36.82.17:4333 , piece_id=MLH7DNUZWAJWCTT3BTXQIFUMUPCTMIY6VMSM22DLC3QB3XXNUURQ, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.795367041 (190h59m19.526634691s) [noise=true , address=45.91.116.13:4163 , piece_id=FYAB6ZWS2J45DCQDRQ3SHVGAJO4OYOPQIIIMRLCQBJQWDJ2L6PSQ, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.801599668 (190h59m19.532867328s) [noise=true , address=77.90.31.12:4609 , piece_id=SQ7KFJRSFNJMSWLXSGZPWKZEH35WG3LLNCDMYWE352JFQC7VWSVQ, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.815582041 (190h59m19.546849691s) [noise=true , address=104.36.82.38:4721 , piece_id=SZPHPJRSRSCCGGLA3EDDW3CH7FOJSMFFUUEMVCDFGK7USDYKPYIA, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.821600254 (190h59m19.552867914s) [noise=true , address=104.36.82.51:4083 , piece_id=7JS5X6FXOGG5LQ43FACBEQALYNPW6IXISBUTJYGBEX4YTRL45YWQ, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.844363363 (190h59m19.575631023s) [noise=true , address=104.36.82.58:4300 , piece_id=A64SYLHGFDQHRQVHCIUFXH4Y6EZGNFOO4GBGTY255IK3BZ4KNYAA, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.847794134 (190h59m19.579061785s) [noise=true , address=45.91.116.8:4074 , piece_id=22EVTJBLCMFIK2BTIXOYJA7O4WJ7DMG4G27X7AJAHCO42XGPUXFA, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.849919236 (190h59m19.581186886s) [noise=true , address=45.91.116.7:4020 , piece_id=VU55DFYKGU3BKD26KBZ5RZBFLVGUC36SHCYOX6QT4MZJ32IHMU6Q, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.854844502 (190h59m19.586112162s) [noise=true , address=104.36.82.8:4981 , piece_id=WEG75O6JVV5NWY67IAWPJOJF5PHKJVR5HXN5HLP7PF4ZTESOYEWQ, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.857740616 (190h59m19.589008266s) [noise=true , address=77.90.31.12:4604 , piece_id=UQGOMGKXYVDFLW2JASS25GY2MF46OKJ27DODTWVJAIXBKKKPZL7A, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.858644869 (190h59m19.589912529s) [noise=true , address=104.36.82.37:4666 , piece_id=BOYG2Y63SKP77WWO3L3S4UT5CZ6S6ONXK2STIMSZ5O5OH3X7X4HQ, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.930113343 (190h59m19.661380993s) [noise=true , address=104.36.82.44:4892 , piece_id=HCSMK323IRGKZHKCAUTPZGXFNG224OIOGBF7XPKD3UK6RBBELTWA, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.930599448 (190h59m19.661867099s) [noise=true , address=104.36.82.34:4561 , piece_id=64MOM5364NEFB45EP6PM6SKFJ7ZMXZXX5K5HN5VGLJSXYDSIFSWQ, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.934160795 (190h59m19.665428445s) [noise=true , address=104.36.82.39:4753 , piece_id=Z5Z7NKHWB2JE33YSE6WQ4OZCATGA2V2FSDQBV52WTSUUNX5ZKTYA, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.934194257 (190h59m19.665461908s) [seg_pos={0 0}, upload=198736]: Segment reached optimal threshold of 14 pieces.
Aug 16 16:25:38.934403091 (190h59m19.665670741s) [noise=true , address=77.90.31.21:4912 , piece_id=7SR22XNESBXX2D3D3VFIHXIJJNFVTMQTW7N7T66GZN5KSD6UDYMA, seg_pos={0 0}, upload=198736]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SFktrdgGxzEZue49XWkNxVZfrpHA73M2H3hRX7NXnvwVnvbv1): protocol: expected piece hash; write tcp 5.161.89.252:28854->77.90.31.21:4912: use of closed network connection; write tcp 5.161.89.252:28854->77.90.31.21:4912: use of closed network connection; EOF
Aug 16 16:25:38.934585955 (190h59m19.665853615s) [noise=true , address=104.36.82.60:4339 , piece_id=PUIGSSRRS2G676MUKTKDAN4MDPU6ECV622WR6OCARTMNCYID2NIA, seg_pos={0 0}, upload=198736]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R): protocol: expected piece hash; context canceled; EOF
Aug 16 16:25:38.934641310 (190h59m19.66590896s) [noise=true , address=77.90.31.19:4869 , piece_id=YVDEI2QSS5XDVFQZEHM6OFMFHRWOCK2L5636B623XG5ZSM2R7S3Q, seg_pos={0 0}, upload=198736]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129refeNg3BsDCThccHdMUJgitGM942qREieZCP2UYoicRAtFN8): protocol: expected piece hash; context canceled; EOF
Aug 16 16:25:38.934752820 (190h59m19.666020471s) [noise=true , address=77.90.31.15:4706 , piece_id=22BB34RWLRZR3ME4HBGE7AJOAQUOUMT77CSWZCI5HUWNIF5NRG5A, seg_pos={0 0}, upload=198736]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YZZnCo54XknuvoBoVtRudXSnoWdNdrn23Lp6Gou3g451BzUwG): protocol: rpc: dial tcp 77.90.31.15:4706: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 16:25:38.934767497 (190h59m19.666035148s) [seg_pos={0 0}, upload=198736]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 16:25:38.934860734 (190h59m19.666128383s) [upload=198736]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 16:25:38.934866775 (190h59m19.666134425s) [upload=198736]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 16:25:39.330832871 (190h59m20.062100501s) [upload=198736]: Done uploading segments...
Aug 16 16:25:39.330845816 (190h59m20.062113446s) [upload=198736]: Upload finished. err: <nil>
Duration: 1.516623911s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
1.385374897s
FAIL (2025-08-16 16:26:48 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 16 16:25:38.589284525 (190h59m19.320552175s) [upload=198736]: Starting upload
Aug 16 16:25:38.589354917 (190h59m19.320622567s) [upload=198736]: Done starting upload
Aug 16 16:25:38.589422014 (190h59m19.320689664s) [upload=198736]: Uploading segments...
Aug 16 16:25:38.589832156 (190h59m19.321099816s) [upload=198736]: Got next segment. Inline: false
Aug 16 16:25:38.589885355 (190h59m19.321153006s) [upload=198736]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 16:25:38.589890937 (190h59m19.321158586s) [upload=198736]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 16:25:38.636921366 (190h59m19.368189006s) [seg_pos={0 0}, upload=198736]: Begin upload segment...
Aug 16 16:25:38.636952475 (190h59m19.368220105s) [seg_pos={0 0}, upload=198736]: Done begin upload segment.
Aug 16 16:25:38.636977401 (190h59m19.368245042s) [noise=true , address=104.36.82.37:4666 , piece_id=BOYG2Y63SKP77WWO3L3S4UT5CZ6S6ONXK2STIMSZ5O5OH3X7X4HQ, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.636991899 (190h59m19.368259529s) [noise=true , address=104.36.82.39:4753 , piece_id=Z5Z7NKHWB2JE33YSE6WQ4OZCATGA2V2FSDQBV52WTSUUNX5ZKTYA, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.637330737 (190h59m19.368598367s) [noise=true , address=104.36.82.58:4300 , piece_id=A64SYLHGFDQHRQVHCIUFXH4Y6EZGNFOO4GBGTY255IK3BZ4KNYAA, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.637399417 (190h59m19.368667057s) [noise=true , address=104.36.82.8:4981 , piece_id=WEG75O6JVV5NWY67IAWPJOJF5PHKJVR5HXN5HLP7PF4ZTESOYEWQ, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.637607759 (190h59m19.368875399s) [noise=true , address=45.91.116.13:4163 , piece_id=FYAB6ZWS2J45DCQDRQ3SHVGAJO4OYOPQIIIMRLCQBJQWDJ2L6PSQ, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.637772890 (190h59m19.36904054s) [noise=true , address=104.36.82.51:4083 , piece_id=7JS5X6FXOGG5LQ43FACBEQALYNPW6IXISBUTJYGBEX4YTRL45YWQ, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.637905380 (190h59m19.36917302s) [noise=true , address=45.91.116.7:4020 , piece_id=VU55DFYKGU3BKD26KBZ5RZBFLVGUC36SHCYOX6QT4MZJ32IHMU6Q, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.638112299 (190h59m19.369379949s) [noise=true , address=77.90.31.15:4706 , piece_id=22BB34RWLRZR3ME4HBGE7AJOAQUOUMT77CSWZCI5HUWNIF5NRG5A, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.638170219 (190h59m19.369437849s) [noise=true , address=77.90.31.12:4604 , piece_id=UQGOMGKXYVDFLW2JASS25GY2MF46OKJ27DODTWVJAIXBKKKPZL7A, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.638434356 (190h59m19.369701996s) [noise=true , address=104.36.82.38:4721 , piece_id=SZPHPJRSRSCCGGLA3EDDW3CH7FOJSMFFUUEMVCDFGK7USDYKPYIA, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.638487185 (190h59m19.369754835s) [noise=true , address=104.36.82.60:4339 , piece_id=PUIGSSRRS2G676MUKTKDAN4MDPU6ECV622WR6OCARTMNCYID2NIA, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.638723089 (190h59m19.36999073s) [noise=true , address=104.36.82.34:4561 , piece_id=64MOM5364NEFB45EP6PM6SKFJ7ZMXZXX5K5HN5VGLJSXYDSIFSWQ, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.638994480 (190h59m19.37026211s) [noise=true , address=77.90.31.19:4869 , piece_id=YVDEI2QSS5XDVFQZEHM6OFMFHRWOCK2L5636B623XG5ZSM2R7S3Q, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.639260581 (190h59m19.370528222s) [noise=true , address=77.90.31.12:4609 , piece_id=SQ7KFJRSFNJMSWLXSGZPWKZEH35WG3LLNCDMYWE352JFQC7VWSVQ, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.639524278 (190h59m19.370791919s) [noise=true , address=77.90.31.21:4912 , piece_id=7SR22XNESBXX2D3D3VFIHXIJJNFVTMQTW7N7T66GZN5KSD6UDYMA, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.639802412 (190h59m19.371070052s) [noise=true , address=104.36.82.44:4892 , piece_id=HCSMK323IRGKZHKCAUTPZGXFNG224OIOGBF7XPKD3UK6RBBELTWA, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.640090955 (190h59m19.371358595s) [noise=true , address=45.91.116.8:4074 , piece_id=22EVTJBLCMFIK2BTIXOYJA7O4WJ7DMG4G27X7AJAHCO42XGPUXFA, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.642267764 (190h59m19.373535405s) [noise=true , address=104.36.82.17:4333 , piece_id=MLH7DNUZWAJWCTT3BTXQIFUMUPCTMIY6VMSM22DLC3QB3XXNUURQ, seg_pos={0 0}, upload=198736]: Uploading piece...
Aug 16 16:25:38.756745546 (190h59m19.488013197s) [upload=198736]: Next returned nil segment
Aug 16 16:25:38.756760494 (190h59m19.488028145s) [upload=198736]: Waiting for error group managing segments...
Aug 16 16:25:38.771172176 (190h59m19.502439835s) [noise=true , address=104.36.82.17:4333 , piece_id=MLH7DNUZWAJWCTT3BTXQIFUMUPCTMIY6VMSM22DLC3QB3XXNUURQ, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.795367041 (190h59m19.526634691s) [noise=true , address=45.91.116.13:4163 , piece_id=FYAB6ZWS2J45DCQDRQ3SHVGAJO4OYOPQIIIMRLCQBJQWDJ2L6PSQ, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.801599668 (190h59m19.532867328s) [noise=true , address=77.90.31.12:4609 , piece_id=SQ7KFJRSFNJMSWLXSGZPWKZEH35WG3LLNCDMYWE352JFQC7VWSVQ, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.815582041 (190h59m19.546849691s) [noise=true , address=104.36.82.38:4721 , piece_id=SZPHPJRSRSCCGGLA3EDDW3CH7FOJSMFFUUEMVCDFGK7USDYKPYIA, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.821600254 (190h59m19.552867914s) [noise=true , address=104.36.82.51:4083 , piece_id=7JS5X6FXOGG5LQ43FACBEQALYNPW6IXISBUTJYGBEX4YTRL45YWQ, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.844363363 (190h59m19.575631023s) [noise=true , address=104.36.82.58:4300 , piece_id=A64SYLHGFDQHRQVHCIUFXH4Y6EZGNFOO4GBGTY255IK3BZ4KNYAA, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.847794134 (190h59m19.579061785s) [noise=true , address=45.91.116.8:4074 , piece_id=22EVTJBLCMFIK2BTIXOYJA7O4WJ7DMG4G27X7AJAHCO42XGPUXFA, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.849919236 (190h59m19.581186886s) [noise=true , address=45.91.116.7:4020 , piece_id=VU55DFYKGU3BKD26KBZ5RZBFLVGUC36SHCYOX6QT4MZJ32IHMU6Q, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.854844502 (190h59m19.586112162s) [noise=true , address=104.36.82.8:4981 , piece_id=WEG75O6JVV5NWY67IAWPJOJF5PHKJVR5HXN5HLP7PF4ZTESOYEWQ, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.857740616 (190h59m19.589008266s) [noise=true , address=77.90.31.12:4604 , piece_id=UQGOMGKXYVDFLW2JASS25GY2MF46OKJ27DODTWVJAIXBKKKPZL7A, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.858644869 (190h59m19.589912529s) [noise=true , address=104.36.82.37:4666 , piece_id=BOYG2Y63SKP77WWO3L3S4UT5CZ6S6ONXK2STIMSZ5O5OH3X7X4HQ, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.930113343 (190h59m19.661380993s) [noise=true , address=104.36.82.44:4892 , piece_id=HCSMK323IRGKZHKCAUTPZGXFNG224OIOGBF7XPKD3UK6RBBELTWA, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.930599448 (190h59m19.661867099s) [noise=true , address=104.36.82.34:4561 , piece_id=64MOM5364NEFB45EP6PM6SKFJ7ZMXZXX5K5HN5VGLJSXYDSIFSWQ, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.934160795 (190h59m19.665428445s) [noise=true , address=104.36.82.39:4753 , piece_id=Z5Z7NKHWB2JE33YSE6WQ4OZCATGA2V2FSDQBV52WTSUUNX5ZKTYA, seg_pos={0 0}, upload=198736]: Done uploading piece. err: <nil>
Aug 16 16:25:38.934194257 (190h59m19.665461908s) [seg_pos={0 0}, upload=198736]: Segment reached optimal threshold of 14 pieces.
Aug 16 16:25:38.934403091 (190h59m19.665670741s) [noise=true , address=77.90.31.21:4912 , piece_id=7SR22XNESBXX2D3D3VFIHXIJJNFVTMQTW7N7T66GZN5KSD6UDYMA, seg_pos={0 0}, upload=198736]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SFktrdgGxzEZue49XWkNxVZfrpHA73M2H3hRX7NXnvwVnvbv1): protocol: expected piece hash; write tcp 5.161.89.252:28854->77.90.31.21:4912: use of closed network connection; write tcp 5.161.89.252:28854->77.90.31.21:4912: use of closed network connection; EOF
Aug 16 16:25:38.934585955 (190h59m19.665853615s) [noise=true , address=104.36.82.60:4339 , piece_id=PUIGSSRRS2G676MUKTKDAN4MDPU6ECV622WR6OCARTMNCYID2NIA, seg_pos={0 0}, upload=198736]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R): protocol: expected piece hash; context canceled; EOF
Aug 16 16:25:38.934641310 (190h59m19.66590896s) [noise=true , address=77.90.31.19:4869 , piece_id=YVDEI2QSS5XDVFQZEHM6OFMFHRWOCK2L5636B623XG5ZSM2R7S3Q, seg_pos={0 0}, upload=198736]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129refeNg3BsDCThccHdMUJgitGM942qREieZCP2UYoicRAtFN8): protocol: expected piece hash; context canceled; EOF
Aug 16 16:25:38.934752820 (190h59m19.666020471s) [noise=true , address=77.90.31.15:4706 , piece_id=22BB34RWLRZR3ME4HBGE7AJOAQUOUMT77CSWZCI5HUWNIF5NRG5A, seg_pos={0 0}, upload=198736]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YZZnCo54XknuvoBoVtRudXSnoWdNdrn23Lp6Gou3g451BzUwG): protocol: rpc: dial tcp 77.90.31.15:4706: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 16:25:38.934767497 (190h59m19.666035148s) [seg_pos={0 0}, upload=198736]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 16:25:38.934860734 (190h59m19.666128383s) [upload=198736]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 16:25:38.934866775 (190h59m19.666134425s) [upload=198736]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 16:25:39.330832871 (190h59m20.062100501s) [upload=198736]: Done uploading segments...
Aug 16 16:25:39.330845816 (190h59m20.062113446s) [upload=198736]: Upload finished. err: <nil>
Duration: 1.385399092s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......................................X.............X.......] duration:
220.074988ms
FAIL (2025-08-16 16:26:48 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 16:21:19.736330105 (190h55m0.467597755s) [upload=198661]: Starting upload Aug 16 16:21:19.736403663 (190h55m0.467671313s) [upload=198661]: Done starting upload Aug 16 16:21:19.736486540 (190h55m0.467754189s) [upload=198661]: Uploading segments... Aug 16 16:21:19.736523800 (190h55m0.467791449s) [upload=198661]: Got next segment. Inline: true Aug 16 16:21:19.736529099 (190h55m0.467796749s) [upload=198661]: Waiting for error group managing segments... Aug 16 16:21:19.736572000 (190h55m0.467839651s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 16:21:19.736577090 (190h55m0.467844741s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 16:21:19.736580446 (190h55m0.467848097s) [upload=198661]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 16:21:19.820858302 (190h55m0.552125953s) [upload=198661]: Done uploading segments... Aug 16 16:21:19.820875544 (190h55m0.552143195s) [upload=198661]: Upload finished. err: metaclient: Too Many Requests
Duration: 220.088573ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|