Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
453.477378ms
FAIL (2025-08-19 22:58:50 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 22:15:42.218339822 (268h49m22.949607473s) [upload=279554]: Starting upload Aug 19 22:15:42.218408332 (268h49m22.949675982s) [upload=279554]: Done starting upload Aug 19 22:15:42.218514822 (268h49m22.949782472s) [upload=279554]: Uploading segments... Aug 19 22:15:42.218750686 (268h49m22.950018335s) [upload=279554]: Got next segment. Inline: false Aug 19 22:15:42.218800368 (268h49m22.950068019s) [upload=279554]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 22:15:42.218805549 (268h49m22.950073198s) [upload=279554]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 22:15:42.221682937 (268h49m22.952950587s) [upload=279554]: Next segment err: metaclient: Too Many Requests Aug 19 22:15:42.221698135 (268h49m22.952965776s) [upload=279554]: Done uploading segments... Aug 19 22:15:42.221711130 (268h49m22.95297878s) [upload=279554]: Upload finished. err: metaclient: Too Many Requests
Duration: 453.498818ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........................X.............X...................] duration:
161.990136ms
FAIL (2025-08-19 22:58:42 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 19 22:45:14.819588870 (269h18m55.55085652s) [upload=280067]: Starting upload
Aug 19 22:45:14.819661807 (269h18m55.550929467s) [upload=280067]: Done starting upload
Aug 19 22:45:14.819740915 (269h18m55.551008565s) [upload=280067]: Uploading segments...
Aug 19 22:45:14.819784607 (269h18m55.551052267s) [upload=280067]: Got next segment. Inline: true
Aug 19 22:45:14.819790357 (269h18m55.551058008s) [upload=280067]: Waiting for error group managing segments...
Aug 19 22:45:14.819835173 (269h18m55.551102823s) [upload=280067]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 22:45:14.819840543 (269h18m55.551108193s) [upload=280067]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 22:45:14.819844431 (269h18m55.55111208s) [upload=280067]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 22:45:14.985140076 (269h18m55.716407697s) [upload=280067]: Done uploading segments...
Aug 19 22:45:14.985159974 (269h18m55.716427594s) [upload=280067]: Upload finished. err: <nil>
Duration: 162.038589ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
844.006599ms
FAIL (2025-08-19 22:58:26 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 22:15:42.218339822 (268h49m22.949607473s) [upload=279554]: Starting upload Aug 19 22:15:42.218408332 (268h49m22.949675982s) [upload=279554]: Done starting upload Aug 19 22:15:42.218514822 (268h49m22.949782472s) [upload=279554]: Uploading segments... Aug 19 22:15:42.218750686 (268h49m22.950018335s) [upload=279554]: Got next segment. Inline: false Aug 19 22:15:42.218800368 (268h49m22.950068019s) [upload=279554]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 22:15:42.218805549 (268h49m22.950073198s) [upload=279554]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 22:15:42.221682937 (268h49m22.952950587s) [upload=279554]: Next segment err: metaclient: Too Many Requests Aug 19 22:15:42.221698135 (268h49m22.952965776s) [upload=279554]: Done uploading segments... Aug 19 22:15:42.221711130 (268h49m22.95297878s) [upload=279554]: Upload finished. err: metaclient: Too Many Requests
Duration: 844.04414ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........................X.............X..................] duration:
326.231935ms
FAIL (2025-08-19 22:58:11 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 19 22:45:14.819588870 (269h18m55.55085652s) [upload=280067]: Starting upload
Aug 19 22:45:14.819661807 (269h18m55.550929467s) [upload=280067]: Done starting upload
Aug 19 22:45:14.819740915 (269h18m55.551008565s) [upload=280067]: Uploading segments...
Aug 19 22:45:14.819784607 (269h18m55.551052267s) [upload=280067]: Got next segment. Inline: true
Aug 19 22:45:14.819790357 (269h18m55.551058008s) [upload=280067]: Waiting for error group managing segments...
Aug 19 22:45:14.819835173 (269h18m55.551102823s) [upload=280067]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 22:45:14.819840543 (269h18m55.551108193s) [upload=280067]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 22:45:14.819844431 (269h18m55.55111208s) [upload=280067]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 22:45:14.985140076 (269h18m55.716407697s) [upload=280067]: Done uploading segments...
Aug 19 22:45:14.985159974 (269h18m55.716427594s) [upload=280067]: Upload finished. err: <nil>
Duration: 326.25553ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
570.567584ms
FAIL (2025-08-19 22:57:26 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 22:15:42.218339822 (268h49m22.949607473s) [upload=279554]: Starting upload Aug 19 22:15:42.218408332 (268h49m22.949675982s) [upload=279554]: Done starting upload Aug 19 22:15:42.218514822 (268h49m22.949782472s) [upload=279554]: Uploading segments... Aug 19 22:15:42.218750686 (268h49m22.950018335s) [upload=279554]: Got next segment. Inline: false Aug 19 22:15:42.218800368 (268h49m22.950068019s) [upload=279554]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 22:15:42.218805549 (268h49m22.950073198s) [upload=279554]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 22:15:42.221682937 (268h49m22.952950587s) [upload=279554]: Next segment err: metaclient: Too Many Requests Aug 19 22:15:42.221698135 (268h49m22.952965776s) [upload=279554]: Done uploading segments... Aug 19 22:15:42.221711130 (268h49m22.95297878s) [upload=279554]: Upload finished. err: metaclient: Too Many Requests
Duration: 570.596678ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [............................X.............X.................] duration:
243.702634ms
FAIL (2025-08-19 22:57:02 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 19 22:45:14.819588870 (269h18m55.55085652s) [upload=280067]: Starting upload
Aug 19 22:45:14.819661807 (269h18m55.550929467s) [upload=280067]: Done starting upload
Aug 19 22:45:14.819740915 (269h18m55.551008565s) [upload=280067]: Uploading segments...
Aug 19 22:45:14.819784607 (269h18m55.551052267s) [upload=280067]: Got next segment. Inline: true
Aug 19 22:45:14.819790357 (269h18m55.551058008s) [upload=280067]: Waiting for error group managing segments...
Aug 19 22:45:14.819835173 (269h18m55.551102823s) [upload=280067]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 22:45:14.819840543 (269h18m55.551108193s) [upload=280067]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 22:45:14.819844431 (269h18m55.55111208s) [upload=280067]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 22:45:14.985140076 (269h18m55.716407697s) [upload=280067]: Done uploading segments...
Aug 19 22:45:14.985159974 (269h18m55.716427594s) [upload=280067]: Upload finished. err: <nil>
Duration: 243.726458ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
693.168722ms
FAIL (2025-08-19 22:56:39 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 22:15:42.218339822 (268h49m22.949607473s) [upload=279554]: Starting upload Aug 19 22:15:42.218408332 (268h49m22.949675982s) [upload=279554]: Done starting upload Aug 19 22:15:42.218514822 (268h49m22.949782472s) [upload=279554]: Uploading segments... Aug 19 22:15:42.218750686 (268h49m22.950018335s) [upload=279554]: Got next segment. Inline: false Aug 19 22:15:42.218800368 (268h49m22.950068019s) [upload=279554]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 22:15:42.218805549 (268h49m22.950073198s) [upload=279554]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 22:15:42.221682937 (268h49m22.952950587s) [upload=279554]: Next segment err: metaclient: Too Many Requests Aug 19 22:15:42.221698135 (268h49m22.952965776s) [upload=279554]: Done uploading segments... Aug 19 22:15:42.221711130 (268h49m22.95297878s) [upload=279554]: Upload finished. err: metaclient: Too Many Requests
Duration: 693.205892ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............................X.............X................] duration:
354.654897ms
FAIL (2025-08-19 22:56:11 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 19 22:45:14.819588870 (269h18m55.55085652s) [upload=280067]: Starting upload
Aug 19 22:45:14.819661807 (269h18m55.550929467s) [upload=280067]: Done starting upload
Aug 19 22:45:14.819740915 (269h18m55.551008565s) [upload=280067]: Uploading segments...
Aug 19 22:45:14.819784607 (269h18m55.551052267s) [upload=280067]: Got next segment. Inline: true
Aug 19 22:45:14.819790357 (269h18m55.551058008s) [upload=280067]: Waiting for error group managing segments...
Aug 19 22:45:14.819835173 (269h18m55.551102823s) [upload=280067]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 22:45:14.819840543 (269h18m55.551108193s) [upload=280067]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 22:45:14.819844431 (269h18m55.55111208s) [upload=280067]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 22:45:14.985140076 (269h18m55.716407697s) [upload=280067]: Done uploading segments...
Aug 19 22:45:14.985159974 (269h18m55.716427594s) [upload=280067]: Upload finished. err: <nil>
Duration: 354.686747ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............................X.............X...............] duration:
452.489857ms
FAIL (2025-08-19 22:55:51 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 19 22:45:14.819588870 (269h18m55.55085652s) [upload=280067]: Starting upload
Aug 19 22:45:14.819661807 (269h18m55.550929467s) [upload=280067]: Done starting upload
Aug 19 22:45:14.819740915 (269h18m55.551008565s) [upload=280067]: Uploading segments...
Aug 19 22:45:14.819784607 (269h18m55.551052267s) [upload=280067]: Got next segment. Inline: true
Aug 19 22:45:14.819790357 (269h18m55.551058008s) [upload=280067]: Waiting for error group managing segments...
Aug 19 22:45:14.819835173 (269h18m55.551102823s) [upload=280067]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 22:45:14.819840543 (269h18m55.551108193s) [upload=280067]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 22:45:14.819844431 (269h18m55.55111208s) [upload=280067]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 22:45:14.985140076 (269h18m55.716407697s) [upload=280067]: Done uploading segments...
Aug 19 22:45:14.985159974 (269h18m55.716427594s) [upload=280067]: Upload finished. err: <nil>
Duration: 452.517227ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
1.034378931s
FAIL (2025-08-19 22:55:50 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 22:15:42.218339822 (268h49m22.949607473s) [upload=279554]: Starting upload Aug 19 22:15:42.218408332 (268h49m22.949675982s) [upload=279554]: Done starting upload Aug 19 22:15:42.218514822 (268h49m22.949782472s) [upload=279554]: Uploading segments... Aug 19 22:15:42.218750686 (268h49m22.950018335s) [upload=279554]: Got next segment. Inline: false Aug 19 22:15:42.218800368 (268h49m22.950068019s) [upload=279554]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 22:15:42.218805549 (268h49m22.950073198s) [upload=279554]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 22:15:42.221682937 (268h49m22.952950587s) [upload=279554]: Next segment err: metaclient: Too Many Requests Aug 19 22:15:42.221698135 (268h49m22.952965776s) [upload=279554]: Done uploading segments... Aug 19 22:15:42.221711130 (268h49m22.95297878s) [upload=279554]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.034401293s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [X..............................X.............X..............] duration:
258.072911ms
FAIL (2025-08-19 22:55:13 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 19 22:45:14.819588870 (269h18m55.55085652s) [upload=280067]: Starting upload
Aug 19 22:45:14.819661807 (269h18m55.550929467s) [upload=280067]: Done starting upload
Aug 19 22:45:14.819740915 (269h18m55.551008565s) [upload=280067]: Uploading segments...
Aug 19 22:45:14.819784607 (269h18m55.551052267s) [upload=280067]: Got next segment. Inline: true
Aug 19 22:45:14.819790357 (269h18m55.551058008s) [upload=280067]: Waiting for error group managing segments...
Aug 19 22:45:14.819835173 (269h18m55.551102823s) [upload=280067]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 22:45:14.819840543 (269h18m55.551108193s) [upload=280067]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 22:45:14.819844431 (269h18m55.55111208s) [upload=280067]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 22:45:14.985140076 (269h18m55.716407697s) [upload=280067]: Done uploading segments...
Aug 19 22:45:14.985159974 (269h18m55.716427594s) [upload=280067]: Upload finished. err: <nil>
Duration: 258.102466ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
928.390271ms
FAIL (2025-08-19 22:54:41 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 22:15:42.218339822 (268h49m22.949607473s) [upload=279554]: Starting upload Aug 19 22:15:42.218408332 (268h49m22.949675982s) [upload=279554]: Done starting upload Aug 19 22:15:42.218514822 (268h49m22.949782472s) [upload=279554]: Uploading segments... Aug 19 22:15:42.218750686 (268h49m22.950018335s) [upload=279554]: Got next segment. Inline: false Aug 19 22:15:42.218800368 (268h49m22.950068019s) [upload=279554]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 22:15:42.218805549 (268h49m22.950073198s) [upload=279554]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 22:15:42.221682937 (268h49m22.952950587s) [upload=279554]: Next segment err: metaclient: Too Many Requests Aug 19 22:15:42.221698135 (268h49m22.952965776s) [upload=279554]: Done uploading segments... Aug 19 22:15:42.221711130 (268h49m22.95297878s) [upload=279554]: Upload finished. err: metaclient: Too Many Requests
Duration: 928.413304ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.X..............................X.............X.............] duration:
389.819896ms
FAIL (2025-08-19 22:54:29 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 19 22:45:14.819588870 (269h18m55.55085652s) [upload=280067]: Starting upload
Aug 19 22:45:14.819661807 (269h18m55.550929467s) [upload=280067]: Done starting upload
Aug 19 22:45:14.819740915 (269h18m55.551008565s) [upload=280067]: Uploading segments...
Aug 19 22:45:14.819784607 (269h18m55.551052267s) [upload=280067]: Got next segment. Inline: true
Aug 19 22:45:14.819790357 (269h18m55.551058008s) [upload=280067]: Waiting for error group managing segments...
Aug 19 22:45:14.819835173 (269h18m55.551102823s) [upload=280067]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 22:45:14.819840543 (269h18m55.551108193s) [upload=280067]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 22:45:14.819844431 (269h18m55.55111208s) [upload=280067]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 22:45:14.985140076 (269h18m55.716407697s) [upload=280067]: Done uploading segments...
Aug 19 22:45:14.985159974 (269h18m55.716427594s) [upload=280067]: Upload finished. err: <nil>
Duration: 389.845324ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
621.069913ms
FAIL (2025-08-19 22:54:04 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 22:15:42.218339822 (268h49m22.949607473s) [upload=279554]: Starting upload Aug 19 22:15:42.218408332 (268h49m22.949675982s) [upload=279554]: Done starting upload Aug 19 22:15:42.218514822 (268h49m22.949782472s) [upload=279554]: Uploading segments... Aug 19 22:15:42.218750686 (268h49m22.950018335s) [upload=279554]: Got next segment. Inline: false Aug 19 22:15:42.218800368 (268h49m22.950068019s) [upload=279554]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 22:15:42.218805549 (268h49m22.950073198s) [upload=279554]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 22:15:42.221682937 (268h49m22.952950587s) [upload=279554]: Next segment err: metaclient: Too Many Requests Aug 19 22:15:42.221698135 (268h49m22.952965776s) [upload=279554]: Done uploading segments... Aug 19 22:15:42.221711130 (268h49m22.95297878s) [upload=279554]: Upload finished. err: metaclient: Too Many Requests
Duration: 621.090792ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
608.761944ms
FAIL (2025-08-19 22:53:33 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 22:15:42.218339822 (268h49m22.949607473s) [upload=279554]: Starting upload Aug 19 22:15:42.218408332 (268h49m22.949675982s) [upload=279554]: Done starting upload Aug 19 22:15:42.218514822 (268h49m22.949782472s) [upload=279554]: Uploading segments... Aug 19 22:15:42.218750686 (268h49m22.950018335s) [upload=279554]: Got next segment. Inline: false Aug 19 22:15:42.218800368 (268h49m22.950068019s) [upload=279554]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 22:15:42.218805549 (268h49m22.950073198s) [upload=279554]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 22:15:42.221682937 (268h49m22.952950587s) [upload=279554]: Next segment err: metaclient: Too Many Requests Aug 19 22:15:42.221698135 (268h49m22.952965776s) [upload=279554]: Done uploading segments... Aug 19 22:15:42.221711130 (268h49m22.95297878s) [upload=279554]: Upload finished. err: metaclient: Too Many Requests
Duration: 608.785428ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..X..............................X.............X............] duration:
434.693621ms
FAIL (2025-08-19 22:53:24 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 19 22:45:14.819588870 (269h18m55.55085652s) [upload=280067]: Starting upload
Aug 19 22:45:14.819661807 (269h18m55.550929467s) [upload=280067]: Done starting upload
Aug 19 22:45:14.819740915 (269h18m55.551008565s) [upload=280067]: Uploading segments...
Aug 19 22:45:14.819784607 (269h18m55.551052267s) [upload=280067]: Got next segment. Inline: true
Aug 19 22:45:14.819790357 (269h18m55.551058008s) [upload=280067]: Waiting for error group managing segments...
Aug 19 22:45:14.819835173 (269h18m55.551102823s) [upload=280067]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 22:45:14.819840543 (269h18m55.551108193s) [upload=280067]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 22:45:14.819844431 (269h18m55.55111208s) [upload=280067]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 22:45:14.985140076 (269h18m55.716407697s) [upload=280067]: Done uploading segments...
Aug 19 22:45:14.985159974 (269h18m55.716427594s) [upload=280067]: Upload finished. err: <nil>
Duration: 434.725841ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...X..............................X.............X...........] duration:
281.180621ms
FAIL (2025-08-19 22:52:52 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 19 22:45:14.819588870 (269h18m55.55085652s) [upload=280067]: Starting upload
Aug 19 22:45:14.819661807 (269h18m55.550929467s) [upload=280067]: Done starting upload
Aug 19 22:45:14.819740915 (269h18m55.551008565s) [upload=280067]: Uploading segments...
Aug 19 22:45:14.819784607 (269h18m55.551052267s) [upload=280067]: Got next segment. Inline: true
Aug 19 22:45:14.819790357 (269h18m55.551058008s) [upload=280067]: Waiting for error group managing segments...
Aug 19 22:45:14.819835173 (269h18m55.551102823s) [upload=280067]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 22:45:14.819840543 (269h18m55.551108193s) [upload=280067]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 22:45:14.819844431 (269h18m55.55111208s) [upload=280067]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 22:45:14.985140076 (269h18m55.716407697s) [upload=280067]: Done uploading segments...
Aug 19 22:45:14.985159974 (269h18m55.716427594s) [upload=280067]: Upload finished. err: <nil>
Duration: 281.213092ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....X..............................X.............X..........] duration:
530.177503ms
FAIL (2025-08-19 22:52:35 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 19 22:45:14.819588870 (269h18m55.55085652s) [upload=280067]: Starting upload
Aug 19 22:45:14.819661807 (269h18m55.550929467s) [upload=280067]: Done starting upload
Aug 19 22:45:14.819740915 (269h18m55.551008565s) [upload=280067]: Uploading segments...
Aug 19 22:45:14.819784607 (269h18m55.551052267s) [upload=280067]: Got next segment. Inline: true
Aug 19 22:45:14.819790357 (269h18m55.551058008s) [upload=280067]: Waiting for error group managing segments...
Aug 19 22:45:14.819835173 (269h18m55.551102823s) [upload=280067]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 22:45:14.819840543 (269h18m55.551108193s) [upload=280067]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 22:45:14.819844431 (269h18m55.55111208s) [upload=280067]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 22:45:14.985140076 (269h18m55.716407697s) [upload=280067]: Done uploading segments...
Aug 19 22:45:14.985159974 (269h18m55.716427594s) [upload=280067]: Upload finished. err: <nil>
Duration: 530.220484ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
758.092665ms
FAIL (2025-08-19 22:52:31 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 22:15:42.218339822 (268h49m22.949607473s) [upload=279554]: Starting upload Aug 19 22:15:42.218408332 (268h49m22.949675982s) [upload=279554]: Done starting upload Aug 19 22:15:42.218514822 (268h49m22.949782472s) [upload=279554]: Uploading segments... Aug 19 22:15:42.218750686 (268h49m22.950018335s) [upload=279554]: Got next segment. Inline: false Aug 19 22:15:42.218800368 (268h49m22.950068019s) [upload=279554]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 22:15:42.218805549 (268h49m22.950073198s) [upload=279554]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 22:15:42.221682937 (268h49m22.952950587s) [upload=279554]: Next segment err: metaclient: Too Many Requests Aug 19 22:15:42.221698135 (268h49m22.952965776s) [upload=279554]: Done uploading segments... Aug 19 22:15:42.221711130 (268h49m22.95297878s) [upload=279554]: Upload finished. err: metaclient: Too Many Requests
Duration: 758.11683ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....X..............................X.............X.........] duration:
229.319972ms
FAIL (2025-08-19 22:51:57 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 19 22:45:14.819588870 (269h18m55.55085652s) [upload=280067]: Starting upload
Aug 19 22:45:14.819661807 (269h18m55.550929467s) [upload=280067]: Done starting upload
Aug 19 22:45:14.819740915 (269h18m55.551008565s) [upload=280067]: Uploading segments...
Aug 19 22:45:14.819784607 (269h18m55.551052267s) [upload=280067]: Got next segment. Inline: true
Aug 19 22:45:14.819790357 (269h18m55.551058008s) [upload=280067]: Waiting for error group managing segments...
Aug 19 22:45:14.819835173 (269h18m55.551102823s) [upload=280067]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 22:45:14.819840543 (269h18m55.551108193s) [upload=280067]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 22:45:14.819844431 (269h18m55.55111208s) [upload=280067]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 22:45:14.985140076 (269h18m55.716407697s) [upload=280067]: Done uploading segments...
Aug 19 22:45:14.985159974 (269h18m55.716427594s) [upload=280067]: Upload finished. err: <nil>
Duration: 229.345781ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
507.64576ms
FAIL (2025-08-19 22:51:22 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 22:15:42.218339822 (268h49m22.949607473s) [upload=279554]: Starting upload Aug 19 22:15:42.218408332 (268h49m22.949675982s) [upload=279554]: Done starting upload Aug 19 22:15:42.218514822 (268h49m22.949782472s) [upload=279554]: Uploading segments... Aug 19 22:15:42.218750686 (268h49m22.950018335s) [upload=279554]: Got next segment. Inline: false Aug 19 22:15:42.218800368 (268h49m22.950068019s) [upload=279554]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 22:15:42.218805549 (268h49m22.950073198s) [upload=279554]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 22:15:42.221682937 (268h49m22.952950587s) [upload=279554]: Next segment err: metaclient: Too Many Requests Aug 19 22:15:42.221698135 (268h49m22.952965776s) [upload=279554]: Done uploading segments... Aug 19 22:15:42.221711130 (268h49m22.95297878s) [upload=279554]: Upload finished. err: metaclient: Too Many Requests
Duration: 507.669014ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [......X..............................X.............X........] duration:
448.421931ms
FAIL (2025-08-19 22:50:50 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 19 22:45:14.819588870 (269h18m55.55085652s) [upload=280067]: Starting upload
Aug 19 22:45:14.819661807 (269h18m55.550929467s) [upload=280067]: Done starting upload
Aug 19 22:45:14.819740915 (269h18m55.551008565s) [upload=280067]: Uploading segments...
Aug 19 22:45:14.819784607 (269h18m55.551052267s) [upload=280067]: Got next segment. Inline: true
Aug 19 22:45:14.819790357 (269h18m55.551058008s) [upload=280067]: Waiting for error group managing segments...
Aug 19 22:45:14.819835173 (269h18m55.551102823s) [upload=280067]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 22:45:14.819840543 (269h18m55.551108193s) [upload=280067]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 22:45:14.819844431 (269h18m55.55111208s) [upload=280067]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 22:45:14.985140076 (269h18m55.716407697s) [upload=280067]: Done uploading segments...
Aug 19 22:45:14.985159974 (269h18m55.716427594s) [upload=280067]: Upload finished. err: <nil>
Duration: 448.443513ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
953.326454ms
FAIL (2025-08-19 22:50:18 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 22:15:42.218339822 (268h49m22.949607473s) [upload=279554]: Starting upload Aug 19 22:15:42.218408332 (268h49m22.949675982s) [upload=279554]: Done starting upload Aug 19 22:15:42.218514822 (268h49m22.949782472s) [upload=279554]: Uploading segments... Aug 19 22:15:42.218750686 (268h49m22.950018335s) [upload=279554]: Got next segment. Inline: false Aug 19 22:15:42.218800368 (268h49m22.950068019s) [upload=279554]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 22:15:42.218805549 (268h49m22.950073198s) [upload=279554]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 22:15:42.221682937 (268h49m22.952950587s) [upload=279554]: Next segment err: metaclient: Too Many Requests Aug 19 22:15:42.221698135 (268h49m22.952965776s) [upload=279554]: Done uploading segments... Aug 19 22:15:42.221711130 (268h49m22.95297878s) [upload=279554]: Upload finished. err: metaclient: Too Many Requests
Duration: 953.347722ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.......X..............................X.............X.......] duration:
188.345893ms
FAIL (2025-08-19 22:49:40 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 19 22:45:14.819588870 (269h18m55.55085652s) [upload=280067]: Starting upload
Aug 19 22:45:14.819661807 (269h18m55.550929467s) [upload=280067]: Done starting upload
Aug 19 22:45:14.819740915 (269h18m55.551008565s) [upload=280067]: Uploading segments...
Aug 19 22:45:14.819784607 (269h18m55.551052267s) [upload=280067]: Got next segment. Inline: true
Aug 19 22:45:14.819790357 (269h18m55.551058008s) [upload=280067]: Waiting for error group managing segments...
Aug 19 22:45:14.819835173 (269h18m55.551102823s) [upload=280067]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 22:45:14.819840543 (269h18m55.551108193s) [upload=280067]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 22:45:14.819844431 (269h18m55.55111208s) [upload=280067]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 22:45:14.985140076 (269h18m55.716407697s) [upload=280067]: Done uploading segments...
Aug 19 22:45:14.985159974 (269h18m55.716427594s) [upload=280067]: Upload finished. err: <nil>
Duration: 188.36579ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [........X..............................X.............X......] duration:
551.40795ms
FAIL (2025-08-19 22:49:22 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 19 22:45:14.819588870 (269h18m55.55085652s) [upload=280067]: Starting upload
Aug 19 22:45:14.819661807 (269h18m55.550929467s) [upload=280067]: Done starting upload
Aug 19 22:45:14.819740915 (269h18m55.551008565s) [upload=280067]: Uploading segments...
Aug 19 22:45:14.819784607 (269h18m55.551052267s) [upload=280067]: Got next segment. Inline: true
Aug 19 22:45:14.819790357 (269h18m55.551058008s) [upload=280067]: Waiting for error group managing segments...
Aug 19 22:45:14.819835173 (269h18m55.551102823s) [upload=280067]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 22:45:14.819840543 (269h18m55.551108193s) [upload=280067]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 22:45:14.819844431 (269h18m55.55111208s) [upload=280067]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 22:45:14.985140076 (269h18m55.716407697s) [upload=280067]: Done uploading segments...
Aug 19 22:45:14.985159974 (269h18m55.716427594s) [upload=280067]: Upload finished. err: <nil>
Duration: 551.429932ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
765.709592ms
FAIL (2025-08-19 22:49:08 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 22:15:42.218339822 (268h49m22.949607473s) [upload=279554]: Starting upload Aug 19 22:15:42.218408332 (268h49m22.949675982s) [upload=279554]: Done starting upload Aug 19 22:15:42.218514822 (268h49m22.949782472s) [upload=279554]: Uploading segments... Aug 19 22:15:42.218750686 (268h49m22.950018335s) [upload=279554]: Got next segment. Inline: false Aug 19 22:15:42.218800368 (268h49m22.950068019s) [upload=279554]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 22:15:42.218805549 (268h49m22.950073198s) [upload=279554]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 22:15:42.221682937 (268h49m22.952950587s) [upload=279554]: Next segment err: metaclient: Too Many Requests Aug 19 22:15:42.221698135 (268h49m22.952965776s) [upload=279554]: Done uploading segments... Aug 19 22:15:42.221711130 (268h49m22.95297878s) [upload=279554]: Upload finished. err: metaclient: Too Many Requests
Duration: 765.73465ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
724.786419ms
FAIL (2025-08-19 22:48:30 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 22:15:42.218339822 (268h49m22.949607473s) [upload=279554]: Starting upload Aug 19 22:15:42.218408332 (268h49m22.949675982s) [upload=279554]: Done starting upload Aug 19 22:15:42.218514822 (268h49m22.949782472s) [upload=279554]: Uploading segments... Aug 19 22:15:42.218750686 (268h49m22.950018335s) [upload=279554]: Got next segment. Inline: false Aug 19 22:15:42.218800368 (268h49m22.950068019s) [upload=279554]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 22:15:42.218805549 (268h49m22.950073198s) [upload=279554]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 22:15:42.221682937 (268h49m22.952950587s) [upload=279554]: Next segment err: metaclient: Too Many Requests Aug 19 22:15:42.221698135 (268h49m22.952965776s) [upload=279554]: Done uploading segments... Aug 19 22:15:42.221711130 (268h49m22.95297878s) [upload=279554]: Upload finished. err: metaclient: Too Many Requests
Duration: 724.807047ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.........X..............................X.............X.....] duration:
217.79752ms
FAIL (2025-08-19 22:48:07 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 19 22:45:14.819588870 (269h18m55.55085652s) [upload=280067]: Starting upload
Aug 19 22:45:14.819661807 (269h18m55.550929467s) [upload=280067]: Done starting upload
Aug 19 22:45:14.819740915 (269h18m55.551008565s) [upload=280067]: Uploading segments...
Aug 19 22:45:14.819784607 (269h18m55.551052267s) [upload=280067]: Got next segment. Inline: true
Aug 19 22:45:14.819790357 (269h18m55.551058008s) [upload=280067]: Waiting for error group managing segments...
Aug 19 22:45:14.819835173 (269h18m55.551102823s) [upload=280067]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 22:45:14.819840543 (269h18m55.551108193s) [upload=280067]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 22:45:14.819844431 (269h18m55.55111208s) [upload=280067]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 22:45:14.985140076 (269h18m55.716407697s) [upload=280067]: Done uploading segments...
Aug 19 22:45:14.985159974 (269h18m55.716427594s) [upload=280067]: Upload finished. err: <nil>
Duration: 217.827094ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
1.228076791s
FAIL (2025-08-19 22:47:28 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 22:15:42.218339822 (268h49m22.949607473s) [upload=279554]: Starting upload Aug 19 22:15:42.218408332 (268h49m22.949675982s) [upload=279554]: Done starting upload Aug 19 22:15:42.218514822 (268h49m22.949782472s) [upload=279554]: Uploading segments... Aug 19 22:15:42.218750686 (268h49m22.950018335s) [upload=279554]: Got next segment. Inline: false Aug 19 22:15:42.218800368 (268h49m22.950068019s) [upload=279554]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 22:15:42.218805549 (268h49m22.950073198s) [upload=279554]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 22:15:42.221682937 (268h49m22.952950587s) [upload=279554]: Next segment err: metaclient: Too Many Requests Aug 19 22:15:42.221698135 (268h49m22.952965776s) [upload=279554]: Done uploading segments... Aug 19 22:15:42.221711130 (268h49m22.95297878s) [upload=279554]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.22810287s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..........X..............................X.............X....] duration:
169.882947ms
FAIL (2025-08-19 22:47:24 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 19 22:45:14.819588870 (269h18m55.55085652s) [upload=280067]: Starting upload
Aug 19 22:45:14.819661807 (269h18m55.550929467s) [upload=280067]: Done starting upload
Aug 19 22:45:14.819740915 (269h18m55.551008565s) [upload=280067]: Uploading segments...
Aug 19 22:45:14.819784607 (269h18m55.551052267s) [upload=280067]: Got next segment. Inline: true
Aug 19 22:45:14.819790357 (269h18m55.551058008s) [upload=280067]: Waiting for error group managing segments...
Aug 19 22:45:14.819835173 (269h18m55.551102823s) [upload=280067]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 22:45:14.819840543 (269h18m55.551108193s) [upload=280067]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 22:45:14.819844431 (269h18m55.55111208s) [upload=280067]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 22:45:14.985140076 (269h18m55.716407697s) [upload=280067]: Done uploading segments...
Aug 19 22:45:14.985159974 (269h18m55.716427594s) [upload=280067]: Upload finished. err: <nil>
Duration: 169.907022ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
737.354215ms
FAIL (2025-08-19 22:47:04 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 22:15:42.218339822 (268h49m22.949607473s) [upload=279554]: Starting upload Aug 19 22:15:42.218408332 (268h49m22.949675982s) [upload=279554]: Done starting upload Aug 19 22:15:42.218514822 (268h49m22.949782472s) [upload=279554]: Uploading segments... Aug 19 22:15:42.218750686 (268h49m22.950018335s) [upload=279554]: Got next segment. Inline: false Aug 19 22:15:42.218800368 (268h49m22.950068019s) [upload=279554]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 22:15:42.218805549 (268h49m22.950073198s) [upload=279554]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 22:15:42.221682937 (268h49m22.952950587s) [upload=279554]: Next segment err: metaclient: Too Many Requests Aug 19 22:15:42.221698135 (268h49m22.952965776s) [upload=279554]: Done uploading segments... Aug 19 22:15:42.221711130 (268h49m22.95297878s) [upload=279554]: Upload finished. err: metaclient: Too Many Requests
Duration: 737.382346ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...........X..............................X.............X...] duration:
409.498694ms
FAIL (2025-08-19 22:46:41 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 19 22:45:14.819588870 (269h18m55.55085652s) [upload=280067]: Starting upload
Aug 19 22:45:14.819661807 (269h18m55.550929467s) [upload=280067]: Done starting upload
Aug 19 22:45:14.819740915 (269h18m55.551008565s) [upload=280067]: Uploading segments...
Aug 19 22:45:14.819784607 (269h18m55.551052267s) [upload=280067]: Got next segment. Inline: true
Aug 19 22:45:14.819790357 (269h18m55.551058008s) [upload=280067]: Waiting for error group managing segments...
Aug 19 22:45:14.819835173 (269h18m55.551102823s) [upload=280067]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 22:45:14.819840543 (269h18m55.551108193s) [upload=280067]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 22:45:14.819844431 (269h18m55.55111208s) [upload=280067]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 22:45:14.985140076 (269h18m55.716407697s) [upload=280067]: Done uploading segments...
Aug 19 22:45:14.985159974 (269h18m55.716427594s) [upload=280067]: Upload finished. err: <nil>
Duration: 409.521226ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [............X..............................X.............X..] duration:
747.242351ms
FAIL (2025-08-19 22:46:25 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 19 22:45:14.819588870 (269h18m55.55085652s) [upload=280067]: Starting upload
Aug 19 22:45:14.819661807 (269h18m55.550929467s) [upload=280067]: Done starting upload
Aug 19 22:45:14.819740915 (269h18m55.551008565s) [upload=280067]: Uploading segments...
Aug 19 22:45:14.819784607 (269h18m55.551052267s) [upload=280067]: Got next segment. Inline: true
Aug 19 22:45:14.819790357 (269h18m55.551058008s) [upload=280067]: Waiting for error group managing segments...
Aug 19 22:45:14.819835173 (269h18m55.551102823s) [upload=280067]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 22:45:14.819840543 (269h18m55.551108193s) [upload=280067]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 22:45:14.819844431 (269h18m55.55111208s) [upload=280067]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 22:45:14.985140076 (269h18m55.716407697s) [upload=280067]: Done uploading segments...
Aug 19 22:45:14.985159974 (269h18m55.716427594s) [upload=280067]: Upload finished. err: <nil>
Duration: 747.265635ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
615.531993ms
FAIL (2025-08-19 22:46:01 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 22:15:42.218339822 (268h49m22.949607473s) [upload=279554]: Starting upload Aug 19 22:15:42.218408332 (268h49m22.949675982s) [upload=279554]: Done starting upload Aug 19 22:15:42.218514822 (268h49m22.949782472s) [upload=279554]: Uploading segments... Aug 19 22:15:42.218750686 (268h49m22.950018335s) [upload=279554]: Got next segment. Inline: false Aug 19 22:15:42.218800368 (268h49m22.950068019s) [upload=279554]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 22:15:42.218805549 (268h49m22.950073198s) [upload=279554]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 22:15:42.221682937 (268h49m22.952950587s) [upload=279554]: Next segment err: metaclient: Too Many Requests Aug 19 22:15:42.221698135 (268h49m22.952965776s) [upload=279554]: Done uploading segments... Aug 19 22:15:42.221711130 (268h49m22.95297878s) [upload=279554]: Upload finished. err: metaclient: Too Many Requests
Duration: 615.553423ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.............X..............................X.............X.] duration:
294.834217ms
FAIL (2025-08-19 22:45:42 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 19 22:45:14.819588870 (269h18m55.55085652s) [upload=280067]: Starting upload
Aug 19 22:45:14.819661807 (269h18m55.550929467s) [upload=280067]: Done starting upload
Aug 19 22:45:14.819740915 (269h18m55.551008565s) [upload=280067]: Uploading segments...
Aug 19 22:45:14.819784607 (269h18m55.551052267s) [upload=280067]: Got next segment. Inline: true
Aug 19 22:45:14.819790357 (269h18m55.551058008s) [upload=280067]: Waiting for error group managing segments...
Aug 19 22:45:14.819835173 (269h18m55.551102823s) [upload=280067]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 22:45:14.819840543 (269h18m55.551108193s) [upload=280067]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 22:45:14.819844431 (269h18m55.55111208s) [upload=280067]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 22:45:14.985140076 (269h18m55.716407697s) [upload=280067]: Done uploading segments...
Aug 19 22:45:14.985159974 (269h18m55.716427594s) [upload=280067]: Upload finished. err: <nil>
Duration: 294.856328ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
950.06866ms
FAIL (2025-08-19 22:45:36 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 22:15:42.218339822 (268h49m22.949607473s) [upload=279554]: Starting upload Aug 19 22:15:42.218408332 (268h49m22.949675982s) [upload=279554]: Done starting upload Aug 19 22:15:42.218514822 (268h49m22.949782472s) [upload=279554]: Uploading segments... Aug 19 22:15:42.218750686 (268h49m22.950018335s) [upload=279554]: Got next segment. Inline: false Aug 19 22:15:42.218800368 (268h49m22.950068019s) [upload=279554]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 22:15:42.218805549 (268h49m22.950073198s) [upload=279554]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 22:15:42.221682937 (268h49m22.952950587s) [upload=279554]: Next segment err: metaclient: Too Many Requests Aug 19 22:15:42.221698135 (268h49m22.952965776s) [upload=279554]: Done uploading segments... Aug 19 22:15:42.221711130 (268h49m22.95297878s) [upload=279554]: Upload finished. err: metaclient: Too Many Requests
Duration: 950.102443ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..............X..............................X.............X] duration:
235.952097ms
FAIL (2025-08-19 22:45:15 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 19 22:45:14.819588870 (269h18m55.55085652s) [upload=280067]: Starting upload
Aug 19 22:45:14.819661807 (269h18m55.550929467s) [upload=280067]: Done starting upload
Aug 19 22:45:14.819740915 (269h18m55.551008565s) [upload=280067]: Uploading segments...
Aug 19 22:45:14.819784607 (269h18m55.551052267s) [upload=280067]: Got next segment. Inline: true
Aug 19 22:45:14.819790357 (269h18m55.551058008s) [upload=280067]: Waiting for error group managing segments...
Aug 19 22:45:14.819835173 (269h18m55.551102823s) [upload=280067]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 22:45:14.819840543 (269h18m55.551108193s) [upload=280067]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 22:45:14.819844431 (269h18m55.55111208s) [upload=280067]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 22:45:14.985140076 (269h18m55.716407697s) [upload=280067]: Done uploading segments...
Aug 19 22:45:14.985159974 (269h18m55.716427594s) [upload=280067]: Upload finished. err: <nil>
Duration: 235.975101ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
510.453869ms
FAIL (2025-08-19 22:44:30 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 22:15:42.218339822 (268h49m22.949607473s) [upload=279554]: Starting upload Aug 19 22:15:42.218408332 (268h49m22.949675982s) [upload=279554]: Done starting upload Aug 19 22:15:42.218514822 (268h49m22.949782472s) [upload=279554]: Uploading segments... Aug 19 22:15:42.218750686 (268h49m22.950018335s) [upload=279554]: Got next segment. Inline: false Aug 19 22:15:42.218800368 (268h49m22.950068019s) [upload=279554]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 22:15:42.218805549 (268h49m22.950073198s) [upload=279554]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 22:15:42.221682937 (268h49m22.952950587s) [upload=279554]: Next segment err: metaclient: Too Many Requests Aug 19 22:15:42.221698135 (268h49m22.952965776s) [upload=279554]: Done uploading segments... Aug 19 22:15:42.221711130 (268h49m22.95297878s) [upload=279554]: Upload finished. err: metaclient: Too Many Requests
Duration: 510.472092ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............X..............................X.............] duration:
230.656034ms
FAIL (2025-08-19 22:44:21 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after a9620b49cdd597344e0febf5d606c1d8c4152f47d4e0e1716379e4c4937dffdc != before 2e4fa2467f9e1979432ecfca22d31443eb226f2d20f6929446fae259ec5526b8 ======LOGS====== Aug 19 22:35:49.831487265 (269h9m30.562754885s) [upload=279905]: Starting upload Aug 19 22:35:49.831542218 (269h9m30.562809838s) [upload=279905]: Done starting upload Aug 19 22:35:49.831592632 (269h9m30.562860262s) [upload=279905]: Uploading segments... Aug 19 22:35:49.831625404 (269h9m30.562893034s) [upload=279905]: Got next segment. Inline: true Aug 19 22:35:49.831629101 (269h9m30.562896731s) [upload=279905]: Waiting for error group managing segments... Aug 19 22:35:49.831661612 (269h9m30.562929232s) [upload=279905]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 22:35:49.831665168 (269h9m30.562932789s) [upload=279905]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 22:35:49.831667954 (269h9m30.562935574s) [upload=279905]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 22:35:50.908583059 (269h9m31.639850678s) [upload=279905]: Done uploading segments... Aug 19 22:35:50.908597406 (269h9m31.639865025s) [upload=279905]: Upload finished. err: <nil>
Duration: 230.676593ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [................X..............................X............] duration:
167.36712ms
FAIL (2025-08-19 22:43:55 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after a9620b49cdd597344e0febf5d606c1d8c4152f47d4e0e1716379e4c4937dffdc != before 2e4fa2467f9e1979432ecfca22d31443eb226f2d20f6929446fae259ec5526b8 ======LOGS====== Aug 19 22:35:49.831487265 (269h9m30.562754885s) [upload=279905]: Starting upload Aug 19 22:35:49.831542218 (269h9m30.562809838s) [upload=279905]: Done starting upload Aug 19 22:35:49.831592632 (269h9m30.562860262s) [upload=279905]: Uploading segments... Aug 19 22:35:49.831625404 (269h9m30.562893034s) [upload=279905]: Got next segment. Inline: true Aug 19 22:35:49.831629101 (269h9m30.562896731s) [upload=279905]: Waiting for error group managing segments... Aug 19 22:35:49.831661612 (269h9m30.562929232s) [upload=279905]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 22:35:49.831665168 (269h9m30.562932789s) [upload=279905]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 22:35:49.831667954 (269h9m30.562935574s) [upload=279905]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 22:35:50.908583059 (269h9m31.639850678s) [upload=279905]: Done uploading segments... Aug 19 22:35:50.908597406 (269h9m31.639865025s) [upload=279905]: Upload finished. err: <nil>
Duration: 167.397727ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
976.722692ms
FAIL (2025-08-19 22:43:16 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 22:15:42.218339822 (268h49m22.949607473s) [upload=279554]: Starting upload Aug 19 22:15:42.218408332 (268h49m22.949675982s) [upload=279554]: Done starting upload Aug 19 22:15:42.218514822 (268h49m22.949782472s) [upload=279554]: Uploading segments... Aug 19 22:15:42.218750686 (268h49m22.950018335s) [upload=279554]: Got next segment. Inline: false Aug 19 22:15:42.218800368 (268h49m22.950068019s) [upload=279554]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 22:15:42.218805549 (268h49m22.950073198s) [upload=279554]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 22:15:42.221682937 (268h49m22.952950587s) [upload=279554]: Next segment err: metaclient: Too Many Requests Aug 19 22:15:42.221698135 (268h49m22.952965776s) [upload=279554]: Done uploading segments... Aug 19 22:15:42.221711130 (268h49m22.95297878s) [upload=279554]: Upload finished. err: metaclient: Too Many Requests
Duration: 976.744232ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
878.933549ms
FAIL (2025-08-19 22:42:50 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 22:15:42.218339822 (268h49m22.949607473s) [upload=279554]: Starting upload Aug 19 22:15:42.218408332 (268h49m22.949675982s) [upload=279554]: Done starting upload Aug 19 22:15:42.218514822 (268h49m22.949782472s) [upload=279554]: Uploading segments... Aug 19 22:15:42.218750686 (268h49m22.950018335s) [upload=279554]: Got next segment. Inline: false Aug 19 22:15:42.218800368 (268h49m22.950068019s) [upload=279554]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 22:15:42.218805549 (268h49m22.950073198s) [upload=279554]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 22:15:42.221682937 (268h49m22.952950587s) [upload=279554]: Next segment err: metaclient: Too Many Requests Aug 19 22:15:42.221698135 (268h49m22.952965776s) [upload=279554]: Done uploading segments... Aug 19 22:15:42.221711130 (268h49m22.95297878s) [upload=279554]: Upload finished. err: metaclient: Too Many Requests
Duration: 878.959368ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................X..............................X...........] duration:
164.381609ms
FAIL (2025-08-19 22:42:46 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after a9620b49cdd597344e0febf5d606c1d8c4152f47d4e0e1716379e4c4937dffdc != before 2e4fa2467f9e1979432ecfca22d31443eb226f2d20f6929446fae259ec5526b8 ======LOGS====== Aug 19 22:35:49.831487265 (269h9m30.562754885s) [upload=279905]: Starting upload Aug 19 22:35:49.831542218 (269h9m30.562809838s) [upload=279905]: Done starting upload Aug 19 22:35:49.831592632 (269h9m30.562860262s) [upload=279905]: Uploading segments... Aug 19 22:35:49.831625404 (269h9m30.562893034s) [upload=279905]: Got next segment. Inline: true Aug 19 22:35:49.831629101 (269h9m30.562896731s) [upload=279905]: Waiting for error group managing segments... Aug 19 22:35:49.831661612 (269h9m30.562929232s) [upload=279905]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 22:35:49.831665168 (269h9m30.562932789s) [upload=279905]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 22:35:49.831667954 (269h9m30.562935574s) [upload=279905]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 22:35:50.908583059 (269h9m31.639850678s) [upload=279905]: Done uploading segments... Aug 19 22:35:50.908597406 (269h9m31.639865025s) [upload=279905]: Upload finished. err: <nil>
Duration: 164.400755ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................X..............................X..........] duration:
815.301629ms
FAIL (2025-08-19 22:42:12 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after a9620b49cdd597344e0febf5d606c1d8c4152f47d4e0e1716379e4c4937dffdc != before 2e4fa2467f9e1979432ecfca22d31443eb226f2d20f6929446fae259ec5526b8 ======LOGS====== Aug 19 22:35:49.831487265 (269h9m30.562754885s) [upload=279905]: Starting upload Aug 19 22:35:49.831542218 (269h9m30.562809838s) [upload=279905]: Done starting upload Aug 19 22:35:49.831592632 (269h9m30.562860262s) [upload=279905]: Uploading segments... Aug 19 22:35:49.831625404 (269h9m30.562893034s) [upload=279905]: Got next segment. Inline: true Aug 19 22:35:49.831629101 (269h9m30.562896731s) [upload=279905]: Waiting for error group managing segments... Aug 19 22:35:49.831661612 (269h9m30.562929232s) [upload=279905]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 22:35:49.831665168 (269h9m30.562932789s) [upload=279905]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 22:35:49.831667954 (269h9m30.562935574s) [upload=279905]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 22:35:50.908583059 (269h9m31.639850678s) [upload=279905]: Done uploading segments... Aug 19 22:35:50.908597406 (269h9m31.639865025s) [upload=279905]: Upload finished. err: <nil>
Duration: 815.323129ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
939.448898ms
FAIL (2025-08-19 22:42:10 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 22:15:42.218339822 (268h49m22.949607473s) [upload=279554]: Starting upload Aug 19 22:15:42.218408332 (268h49m22.949675982s) [upload=279554]: Done starting upload Aug 19 22:15:42.218514822 (268h49m22.949782472s) [upload=279554]: Uploading segments... Aug 19 22:15:42.218750686 (268h49m22.950018335s) [upload=279554]: Got next segment. Inline: false Aug 19 22:15:42.218800368 (268h49m22.950068019s) [upload=279554]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 22:15:42.218805549 (268h49m22.950073198s) [upload=279554]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 22:15:42.221682937 (268h49m22.952950587s) [upload=279554]: Next segment err: metaclient: Too Many Requests Aug 19 22:15:42.221698135 (268h49m22.952965776s) [upload=279554]: Done uploading segments... Aug 19 22:15:42.221711130 (268h49m22.95297878s) [upload=279554]: Upload finished. err: metaclient: Too Many Requests
Duration: 939.472042ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...................X..............................X.........] duration:
237.509971ms
FAIL (2025-08-19 22:41:42 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after a9620b49cdd597344e0febf5d606c1d8c4152f47d4e0e1716379e4c4937dffdc != before 2e4fa2467f9e1979432ecfca22d31443eb226f2d20f6929446fae259ec5526b8 ======LOGS====== Aug 19 22:35:49.831487265 (269h9m30.562754885s) [upload=279905]: Starting upload Aug 19 22:35:49.831542218 (269h9m30.562809838s) [upload=279905]: Done starting upload Aug 19 22:35:49.831592632 (269h9m30.562860262s) [upload=279905]: Uploading segments... Aug 19 22:35:49.831625404 (269h9m30.562893034s) [upload=279905]: Got next segment. Inline: true Aug 19 22:35:49.831629101 (269h9m30.562896731s) [upload=279905]: Waiting for error group managing segments... Aug 19 22:35:49.831661612 (269h9m30.562929232s) [upload=279905]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 22:35:49.831665168 (269h9m30.562932789s) [upload=279905]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 22:35:49.831667954 (269h9m30.562935574s) [upload=279905]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 22:35:50.908583059 (269h9m31.639850678s) [upload=279905]: Done uploading segments... Aug 19 22:35:50.908597406 (269h9m31.639865025s) [upload=279905]: Upload finished. err: <nil>
Duration: 237.529037ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
759.133481ms
FAIL (2025-08-19 22:41:17 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 22:15:42.218339822 (268h49m22.949607473s) [upload=279554]: Starting upload Aug 19 22:15:42.218408332 (268h49m22.949675982s) [upload=279554]: Done starting upload Aug 19 22:15:42.218514822 (268h49m22.949782472s) [upload=279554]: Uploading segments... Aug 19 22:15:42.218750686 (268h49m22.950018335s) [upload=279554]: Got next segment. Inline: false Aug 19 22:15:42.218800368 (268h49m22.950068019s) [upload=279554]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 22:15:42.218805549 (268h49m22.950073198s) [upload=279554]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 22:15:42.221682937 (268h49m22.952950587s) [upload=279554]: Next segment err: metaclient: Too Many Requests Aug 19 22:15:42.221698135 (268h49m22.952965776s) [upload=279554]: Done uploading segments... Aug 19 22:15:42.221711130 (268h49m22.95297878s) [upload=279554]: Upload finished. err: metaclient: Too Many Requests
Duration: 759.158909ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....................X..............................X........] duration:
563.821041ms
FAIL (2025-08-19 22:40:42 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after a9620b49cdd597344e0febf5d606c1d8c4152f47d4e0e1716379e4c4937dffdc != before 2e4fa2467f9e1979432ecfca22d31443eb226f2d20f6929446fae259ec5526b8 ======LOGS====== Aug 19 22:35:49.831487265 (269h9m30.562754885s) [upload=279905]: Starting upload Aug 19 22:35:49.831542218 (269h9m30.562809838s) [upload=279905]: Done starting upload Aug 19 22:35:49.831592632 (269h9m30.562860262s) [upload=279905]: Uploading segments... Aug 19 22:35:49.831625404 (269h9m30.562893034s) [upload=279905]: Got next segment. Inline: true Aug 19 22:35:49.831629101 (269h9m30.562896731s) [upload=279905]: Waiting for error group managing segments... Aug 19 22:35:49.831661612 (269h9m30.562929232s) [upload=279905]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 22:35:49.831665168 (269h9m30.562932789s) [upload=279905]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 22:35:49.831667954 (269h9m30.562935574s) [upload=279905]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 22:35:50.908583059 (269h9m31.639850678s) [upload=279905]: Done uploading segments... Aug 19 22:35:50.908597406 (269h9m31.639865025s) [upload=279905]: Upload finished. err: <nil>
Duration: 563.846619ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
1.744595691s
FAIL (2025-08-19 22:40:41 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 22:15:42.218339822 (268h49m22.949607473s) [upload=279554]: Starting upload Aug 19 22:15:42.218408332 (268h49m22.949675982s) [upload=279554]: Done starting upload Aug 19 22:15:42.218514822 (268h49m22.949782472s) [upload=279554]: Uploading segments... Aug 19 22:15:42.218750686 (268h49m22.950018335s) [upload=279554]: Got next segment. Inline: false Aug 19 22:15:42.218800368 (268h49m22.950068019s) [upload=279554]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 22:15:42.218805549 (268h49m22.950073198s) [upload=279554]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 22:15:42.221682937 (268h49m22.952950587s) [upload=279554]: Next segment err: metaclient: Too Many Requests Aug 19 22:15:42.221698135 (268h49m22.952965776s) [upload=279554]: Done uploading segments... Aug 19 22:15:42.221711130 (268h49m22.95297878s) [upload=279554]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.744618824s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....................X..............................X.......] duration:
727.628361ms
FAIL (2025-08-19 22:40:13 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after a9620b49cdd597344e0febf5d606c1d8c4152f47d4e0e1716379e4c4937dffdc != before 2e4fa2467f9e1979432ecfca22d31443eb226f2d20f6929446fae259ec5526b8 ======LOGS====== Aug 19 22:35:49.831487265 (269h9m30.562754885s) [upload=279905]: Starting upload Aug 19 22:35:49.831542218 (269h9m30.562809838s) [upload=279905]: Done starting upload Aug 19 22:35:49.831592632 (269h9m30.562860262s) [upload=279905]: Uploading segments... Aug 19 22:35:49.831625404 (269h9m30.562893034s) [upload=279905]: Got next segment. Inline: true Aug 19 22:35:49.831629101 (269h9m30.562896731s) [upload=279905]: Waiting for error group managing segments... Aug 19 22:35:49.831661612 (269h9m30.562929232s) [upload=279905]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 22:35:49.831665168 (269h9m30.562932789s) [upload=279905]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 22:35:49.831667954 (269h9m30.562935574s) [upload=279905]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 22:35:50.908583059 (269h9m31.639850678s) [upload=279905]: Done uploading segments... Aug 19 22:35:50.908597406 (269h9m31.639865025s) [upload=279905]: Upload finished. err: <nil>
Duration: 727.657475ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|