Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
828.10378ms
FAIL (2025-08-19 05:37:53 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 05:15:42.950619396 (251h49m23.681887026s) [upload=261914]: Starting upload Aug 19 05:15:42.950659280 (251h49m23.68192691s) [upload=261914]: Done starting upload Aug 19 05:15:42.950696701 (251h49m23.68196432s) [upload=261914]: Uploading segments... Aug 19 05:15:42.950723471 (251h49m23.681991101s) [upload=261914]: Got next segment. Inline: true Aug 19 05:15:42.950727057 (251h49m23.681994677s) [upload=261914]: Waiting for error group managing segments... Aug 19 05:15:42.950754749 (251h49m23.682022369s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 05:15:42.950758136 (251h49m23.682025755s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 05:15:42.950760279 (251h49m23.682027909s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 05:15:42.953451979 (251h49m23.684719599s) [upload=261914]: Done uploading segments... Aug 19 05:15:42.953459052 (251h49m23.684726672s) [upload=261914]: Upload finished. err: metaclient: Too Many Requests
Duration: 828.126412ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
134.617036ms
FAIL (2025-08-19 05:37:31 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 05:15:42.950619396 (251h49m23.681887026s) [upload=261914]: Starting upload Aug 19 05:15:42.950659280 (251h49m23.68192691s) [upload=261914]: Done starting upload Aug 19 05:15:42.950696701 (251h49m23.68196432s) [upload=261914]: Uploading segments... Aug 19 05:15:42.950723471 (251h49m23.681991101s) [upload=261914]: Got next segment. Inline: true Aug 19 05:15:42.950727057 (251h49m23.681994677s) [upload=261914]: Waiting for error group managing segments... Aug 19 05:15:42.950754749 (251h49m23.682022369s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 05:15:42.950758136 (251h49m23.682025755s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 05:15:42.950760279 (251h49m23.682027909s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 05:15:42.953451979 (251h49m23.684719599s) [upload=261914]: Done uploading segments... Aug 19 05:15:42.953459052 (251h49m23.684726672s) [upload=261914]: Upload finished. err: metaclient: Too Many Requests
Duration: 134.639158ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................................X..........X.............] duration:
1.247656091s
FAIL (2025-08-19 05:37:23 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 05:27:39.202294579 (252h1m19.933562209s) [upload=262114]: Starting upload Aug 19 05:27:39.202333842 (252h1m19.933601473s) [upload=262114]: Done starting upload Aug 19 05:27:39.202368839 (252h1m19.933636469s) [upload=262114]: Uploading segments... Aug 19 05:27:39.202612797 (252h1m19.933880427s) [upload=262114]: Got next segment. Inline: false Aug 19 05:27:39.202645719 (252h1m19.933913349s) [upload=262114]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 05:27:39.202650087 (252h1m19.933917707s) [upload=262114]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 05:27:39.205550238 (252h1m19.936817868s) [upload=262114]: Next segment err: metaclient: Too Many Requests Aug 19 05:27:39.205560367 (252h1m19.936827997s) [upload=262114]: Done uploading segments... Aug 19 05:27:39.205567861 (252h1m19.936835482s) [upload=262114]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.24771453s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
568.956145ms
FAIL (2025-08-19 05:36:56 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 05:15:42.950619396 (251h49m23.681887026s) [upload=261914]: Starting upload Aug 19 05:15:42.950659280 (251h49m23.68192691s) [upload=261914]: Done starting upload Aug 19 05:15:42.950696701 (251h49m23.68196432s) [upload=261914]: Uploading segments... Aug 19 05:15:42.950723471 (251h49m23.681991101s) [upload=261914]: Got next segment. Inline: true Aug 19 05:15:42.950727057 (251h49m23.681994677s) [upload=261914]: Waiting for error group managing segments... Aug 19 05:15:42.950754749 (251h49m23.682022369s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 05:15:42.950758136 (251h49m23.682025755s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 05:15:42.950760279 (251h49m23.682027909s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 05:15:42.953451979 (251h49m23.684719599s) [upload=261914]: Done uploading segments... Aug 19 05:15:42.953459052 (251h49m23.684726672s) [upload=261914]: Upload finished. err: metaclient: Too Many Requests
Duration: 568.981663ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....................................X..........X............] duration:
512.331153ms
FAIL (2025-08-19 05:36:39 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 05:27:39.202294579 (252h1m19.933562209s) [upload=262114]: Starting upload Aug 19 05:27:39.202333842 (252h1m19.933601473s) [upload=262114]: Done starting upload Aug 19 05:27:39.202368839 (252h1m19.933636469s) [upload=262114]: Uploading segments... Aug 19 05:27:39.202612797 (252h1m19.933880427s) [upload=262114]: Got next segment. Inline: false Aug 19 05:27:39.202645719 (252h1m19.933913349s) [upload=262114]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 05:27:39.202650087 (252h1m19.933917707s) [upload=262114]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 05:27:39.205550238 (252h1m19.936817868s) [upload=262114]: Next segment err: metaclient: Too Many Requests Aug 19 05:27:39.205560367 (252h1m19.936827997s) [upload=262114]: Done uploading segments... Aug 19 05:27:39.205567861 (252h1m19.936835482s) [upload=262114]: Upload finished. err: metaclient: Too Many Requests
Duration: 512.352404ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
535.54245ms
FAIL (2025-08-19 05:36:36 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 05:15:42.950619396 (251h49m23.681887026s) [upload=261914]: Starting upload Aug 19 05:15:42.950659280 (251h49m23.68192691s) [upload=261914]: Done starting upload Aug 19 05:15:42.950696701 (251h49m23.68196432s) [upload=261914]: Uploading segments... Aug 19 05:15:42.950723471 (251h49m23.681991101s) [upload=261914]: Got next segment. Inline: true Aug 19 05:15:42.950727057 (251h49m23.681994677s) [upload=261914]: Waiting for error group managing segments... Aug 19 05:15:42.950754749 (251h49m23.682022369s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 05:15:42.950758136 (251h49m23.682025755s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 05:15:42.950760279 (251h49m23.682027909s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 05:15:42.953451979 (251h49m23.684719599s) [upload=261914]: Done uploading segments... Aug 19 05:15:42.953459052 (251h49m23.684726672s) [upload=261914]: Upload finished. err: metaclient: Too Many Requests
Duration: 535.559943ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....................................X..........X...........] duration:
915.348044ms
FAIL (2025-08-19 05:36:23 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 05:27:39.202294579 (252h1m19.933562209s) [upload=262114]: Starting upload Aug 19 05:27:39.202333842 (252h1m19.933601473s) [upload=262114]: Done starting upload Aug 19 05:27:39.202368839 (252h1m19.933636469s) [upload=262114]: Uploading segments... Aug 19 05:27:39.202612797 (252h1m19.933880427s) [upload=262114]: Got next segment. Inline: false Aug 19 05:27:39.202645719 (252h1m19.933913349s) [upload=262114]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 05:27:39.202650087 (252h1m19.933917707s) [upload=262114]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 05:27:39.205550238 (252h1m19.936817868s) [upload=262114]: Next segment err: metaclient: Too Many Requests Aug 19 05:27:39.205560367 (252h1m19.936827997s) [upload=262114]: Done uploading segments... Aug 19 05:27:39.205567861 (252h1m19.936835482s) [upload=262114]: Upload finished. err: metaclient: Too Many Requests
Duration: 915.371578ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
152.762612ms
FAIL (2025-08-19 05:36:07 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 05:15:42.950619396 (251h49m23.681887026s) [upload=261914]: Starting upload Aug 19 05:15:42.950659280 (251h49m23.68192691s) [upload=261914]: Done starting upload Aug 19 05:15:42.950696701 (251h49m23.68196432s) [upload=261914]: Uploading segments... Aug 19 05:15:42.950723471 (251h49m23.681991101s) [upload=261914]: Got next segment. Inline: true Aug 19 05:15:42.950727057 (251h49m23.681994677s) [upload=261914]: Waiting for error group managing segments... Aug 19 05:15:42.950754749 (251h49m23.682022369s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 05:15:42.950758136 (251h49m23.682025755s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 05:15:42.950760279 (251h49m23.682027909s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 05:15:42.953451979 (251h49m23.684719599s) [upload=261914]: Done uploading segments... Aug 19 05:15:42.953459052 (251h49m23.684726672s) [upload=261914]: Upload finished. err: metaclient: Too Many Requests
Duration: 152.788561ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
140.043721ms
FAIL (2025-08-19 05:35:34 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 05:15:42.950619396 (251h49m23.681887026s) [upload=261914]: Starting upload Aug 19 05:15:42.950659280 (251h49m23.68192691s) [upload=261914]: Done starting upload Aug 19 05:15:42.950696701 (251h49m23.68196432s) [upload=261914]: Uploading segments... Aug 19 05:15:42.950723471 (251h49m23.681991101s) [upload=261914]: Got next segment. Inline: true Aug 19 05:15:42.950727057 (251h49m23.681994677s) [upload=261914]: Waiting for error group managing segments... Aug 19 05:15:42.950754749 (251h49m23.682022369s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 05:15:42.950758136 (251h49m23.682025755s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 05:15:42.950760279 (251h49m23.682027909s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 05:15:42.953451979 (251h49m23.684719599s) [upload=261914]: Done uploading segments... Aug 19 05:15:42.953459052 (251h49m23.684726672s) [upload=261914]: Upload finished. err: metaclient: Too Many Requests
Duration: 140.062627ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......................................X..........X..........] duration:
2.08606285s
FAIL (2025-08-19 05:35:14 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 05:27:39.202294579 (252h1m19.933562209s) [upload=262114]: Starting upload Aug 19 05:27:39.202333842 (252h1m19.933601473s) [upload=262114]: Done starting upload Aug 19 05:27:39.202368839 (252h1m19.933636469s) [upload=262114]: Uploading segments... Aug 19 05:27:39.202612797 (252h1m19.933880427s) [upload=262114]: Got next segment. Inline: false Aug 19 05:27:39.202645719 (252h1m19.933913349s) [upload=262114]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 05:27:39.202650087 (252h1m19.933917707s) [upload=262114]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 05:27:39.205550238 (252h1m19.936817868s) [upload=262114]: Next segment err: metaclient: Too Many Requests Aug 19 05:27:39.205560367 (252h1m19.936827997s) [upload=262114]: Done uploading segments... Aug 19 05:27:39.205567861 (252h1m19.936835482s) [upload=262114]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.086141998s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
120.940386ms
FAIL (2025-08-19 05:34:59 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 05:15:42.950619396 (251h49m23.681887026s) [upload=261914]: Starting upload Aug 19 05:15:42.950659280 (251h49m23.68192691s) [upload=261914]: Done starting upload Aug 19 05:15:42.950696701 (251h49m23.68196432s) [upload=261914]: Uploading segments... Aug 19 05:15:42.950723471 (251h49m23.681991101s) [upload=261914]: Got next segment. Inline: true Aug 19 05:15:42.950727057 (251h49m23.681994677s) [upload=261914]: Waiting for error group managing segments... Aug 19 05:15:42.950754749 (251h49m23.682022369s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 05:15:42.950758136 (251h49m23.682025755s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 05:15:42.950760279 (251h49m23.682027909s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 05:15:42.953451979 (251h49m23.684719599s) [upload=261914]: Done uploading segments... Aug 19 05:15:42.953459052 (251h49m23.684726672s) [upload=261914]: Upload finished. err: metaclient: Too Many Requests
Duration: 120.958209ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......................................X..........X.........] duration:
818.095966ms
FAIL (2025-08-19 05:34:52 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 05:27:39.202294579 (252h1m19.933562209s) [upload=262114]: Starting upload Aug 19 05:27:39.202333842 (252h1m19.933601473s) [upload=262114]: Done starting upload Aug 19 05:27:39.202368839 (252h1m19.933636469s) [upload=262114]: Uploading segments... Aug 19 05:27:39.202612797 (252h1m19.933880427s) [upload=262114]: Got next segment. Inline: false Aug 19 05:27:39.202645719 (252h1m19.933913349s) [upload=262114]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 05:27:39.202650087 (252h1m19.933917707s) [upload=262114]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 05:27:39.205550238 (252h1m19.936817868s) [upload=262114]: Next segment err: metaclient: Too Many Requests Aug 19 05:27:39.205560367 (252h1m19.936827997s) [upload=262114]: Done uploading segments... Aug 19 05:27:39.205567861 (252h1m19.936835482s) [upload=262114]: Upload finished. err: metaclient: Too Many Requests
Duration: 818.121985ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
128.268501ms
FAIL (2025-08-19 05:34:38 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 05:15:42.950619396 (251h49m23.681887026s) [upload=261914]: Starting upload Aug 19 05:15:42.950659280 (251h49m23.68192691s) [upload=261914]: Done starting upload Aug 19 05:15:42.950696701 (251h49m23.68196432s) [upload=261914]: Uploading segments... Aug 19 05:15:42.950723471 (251h49m23.681991101s) [upload=261914]: Got next segment. Inline: true Aug 19 05:15:42.950727057 (251h49m23.681994677s) [upload=261914]: Waiting for error group managing segments... Aug 19 05:15:42.950754749 (251h49m23.682022369s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 05:15:42.950758136 (251h49m23.682025755s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 05:15:42.950760279 (251h49m23.682027909s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 05:15:42.953451979 (251h49m23.684719599s) [upload=261914]: Done uploading segments... Aug 19 05:15:42.953459052 (251h49m23.684726672s) [upload=261914]: Upload finished. err: metaclient: Too Many Requests
Duration: 128.293478ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........................................X..........X........] duration:
805.053797ms
FAIL (2025-08-19 05:34:00 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 05:27:39.202294579 (252h1m19.933562209s) [upload=262114]: Starting upload Aug 19 05:27:39.202333842 (252h1m19.933601473s) [upload=262114]: Done starting upload Aug 19 05:27:39.202368839 (252h1m19.933636469s) [upload=262114]: Uploading segments... Aug 19 05:27:39.202612797 (252h1m19.933880427s) [upload=262114]: Got next segment. Inline: false Aug 19 05:27:39.202645719 (252h1m19.933913349s) [upload=262114]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 05:27:39.202650087 (252h1m19.933917707s) [upload=262114]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 05:27:39.205550238 (252h1m19.936817868s) [upload=262114]: Next segment err: metaclient: Too Many Requests Aug 19 05:27:39.205560367 (252h1m19.936827997s) [upload=262114]: Done uploading segments... Aug 19 05:27:39.205567861 (252h1m19.936835482s) [upload=262114]: Upload finished. err: metaclient: Too Many Requests
Duration: 805.078636ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
454.095432ms
FAIL (2025-08-19 05:33:55 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 05:15:42.950619396 (251h49m23.681887026s) [upload=261914]: Starting upload Aug 19 05:15:42.950659280 (251h49m23.68192691s) [upload=261914]: Done starting upload Aug 19 05:15:42.950696701 (251h49m23.68196432s) [upload=261914]: Uploading segments... Aug 19 05:15:42.950723471 (251h49m23.681991101s) [upload=261914]: Got next segment. Inline: true Aug 19 05:15:42.950727057 (251h49m23.681994677s) [upload=261914]: Waiting for error group managing segments... Aug 19 05:15:42.950754749 (251h49m23.682022369s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 05:15:42.950758136 (251h49m23.682025755s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 05:15:42.950760279 (251h49m23.682027909s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 05:15:42.953451979 (251h49m23.684719599s) [upload=261914]: Done uploading segments... Aug 19 05:15:42.953459052 (251h49m23.684726672s) [upload=261914]: Upload finished. err: metaclient: Too Many Requests
Duration: 454.117903ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
131.191218ms
FAIL (2025-08-19 05:33:28 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 05:15:42.950619396 (251h49m23.681887026s) [upload=261914]: Starting upload Aug 19 05:15:42.950659280 (251h49m23.68192691s) [upload=261914]: Done starting upload Aug 19 05:15:42.950696701 (251h49m23.68196432s) [upload=261914]: Uploading segments... Aug 19 05:15:42.950723471 (251h49m23.681991101s) [upload=261914]: Got next segment. Inline: true Aug 19 05:15:42.950727057 (251h49m23.681994677s) [upload=261914]: Waiting for error group managing segments... Aug 19 05:15:42.950754749 (251h49m23.682022369s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 05:15:42.950758136 (251h49m23.682025755s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 05:15:42.950760279 (251h49m23.682027909s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 05:15:42.953451979 (251h49m23.684719599s) [upload=261914]: Done uploading segments... Aug 19 05:15:42.953459052 (251h49m23.684726672s) [upload=261914]: Upload finished. err: metaclient: Too Many Requests
Duration: 131.214521ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........................................X..........X.......] duration:
760.006887ms
FAIL (2025-08-19 05:33:10 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 05:27:39.202294579 (252h1m19.933562209s) [upload=262114]: Starting upload Aug 19 05:27:39.202333842 (252h1m19.933601473s) [upload=262114]: Done starting upload Aug 19 05:27:39.202368839 (252h1m19.933636469s) [upload=262114]: Uploading segments... Aug 19 05:27:39.202612797 (252h1m19.933880427s) [upload=262114]: Got next segment. Inline: false Aug 19 05:27:39.202645719 (252h1m19.933913349s) [upload=262114]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 05:27:39.202650087 (252h1m19.933917707s) [upload=262114]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 05:27:39.205550238 (252h1m19.936817868s) [upload=262114]: Next segment err: metaclient: Too Many Requests Aug 19 05:27:39.205560367 (252h1m19.936827997s) [upload=262114]: Done uploading segments... Aug 19 05:27:39.205567861 (252h1m19.936835482s) [upload=262114]: Upload finished. err: metaclient: Too Many Requests
Duration: 760.025273ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
127.832042ms
FAIL (2025-08-19 05:32:57 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 05:15:42.950619396 (251h49m23.681887026s) [upload=261914]: Starting upload Aug 19 05:15:42.950659280 (251h49m23.68192691s) [upload=261914]: Done starting upload Aug 19 05:15:42.950696701 (251h49m23.68196432s) [upload=261914]: Uploading segments... Aug 19 05:15:42.950723471 (251h49m23.681991101s) [upload=261914]: Got next segment. Inline: true Aug 19 05:15:42.950727057 (251h49m23.681994677s) [upload=261914]: Waiting for error group managing segments... Aug 19 05:15:42.950754749 (251h49m23.682022369s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 05:15:42.950758136 (251h49m23.682025755s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 05:15:42.950760279 (251h49m23.682027909s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 05:15:42.953451979 (251h49m23.684719599s) [upload=261914]: Done uploading segments... Aug 19 05:15:42.953459052 (251h49m23.684726672s) [upload=261914]: Upload finished. err: metaclient: Too Many Requests
Duration: 127.859063ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........................................X..........X......] duration:
952.921854ms
FAIL (2025-08-19 05:32:31 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 05:27:39.202294579 (252h1m19.933562209s) [upload=262114]: Starting upload Aug 19 05:27:39.202333842 (252h1m19.933601473s) [upload=262114]: Done starting upload Aug 19 05:27:39.202368839 (252h1m19.933636469s) [upload=262114]: Uploading segments... Aug 19 05:27:39.202612797 (252h1m19.933880427s) [upload=262114]: Got next segment. Inline: false Aug 19 05:27:39.202645719 (252h1m19.933913349s) [upload=262114]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 05:27:39.202650087 (252h1m19.933917707s) [upload=262114]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 05:27:39.205550238 (252h1m19.936817868s) [upload=262114]: Next segment err: metaclient: Too Many Requests Aug 19 05:27:39.205560367 (252h1m19.936827997s) [upload=262114]: Done uploading segments... Aug 19 05:27:39.205567861 (252h1m19.936835482s) [upload=262114]: Upload finished. err: metaclient: Too Many Requests
Duration: 952.943016ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........................................X..........X.....] duration:
982.288502ms
FAIL (2025-08-19 05:32:13 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 05:27:39.202294579 (252h1m19.933562209s) [upload=262114]: Starting upload Aug 19 05:27:39.202333842 (252h1m19.933601473s) [upload=262114]: Done starting upload Aug 19 05:27:39.202368839 (252h1m19.933636469s) [upload=262114]: Uploading segments... Aug 19 05:27:39.202612797 (252h1m19.933880427s) [upload=262114]: Got next segment. Inline: false Aug 19 05:27:39.202645719 (252h1m19.933913349s) [upload=262114]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 05:27:39.202650087 (252h1m19.933917707s) [upload=262114]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 05:27:39.205550238 (252h1m19.936817868s) [upload=262114]: Next segment err: metaclient: Too Many Requests Aug 19 05:27:39.205560367 (252h1m19.936827997s) [upload=262114]: Done uploading segments... Aug 19 05:27:39.205567861 (252h1m19.936835482s) [upload=262114]: Upload finished. err: metaclient: Too Many Requests
Duration: 982.359777ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
123.366197ms
FAIL (2025-08-19 05:31:56 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 05:15:42.950619396 (251h49m23.681887026s) [upload=261914]: Starting upload Aug 19 05:15:42.950659280 (251h49m23.68192691s) [upload=261914]: Done starting upload Aug 19 05:15:42.950696701 (251h49m23.68196432s) [upload=261914]: Uploading segments... Aug 19 05:15:42.950723471 (251h49m23.681991101s) [upload=261914]: Got next segment. Inline: true Aug 19 05:15:42.950727057 (251h49m23.681994677s) [upload=261914]: Waiting for error group managing segments... Aug 19 05:15:42.950754749 (251h49m23.682022369s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 05:15:42.950758136 (251h49m23.682025755s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 05:15:42.950760279 (251h49m23.682027909s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 05:15:42.953451979 (251h49m23.684719599s) [upload=261914]: Done uploading segments... Aug 19 05:15:42.953459052 (251h49m23.684726672s) [upload=261914]: Upload finished. err: metaclient: Too Many Requests
Duration: 123.393849ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [............................................X..........X....] duration:
631.885795ms
FAIL (2025-08-19 05:31:37 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 05:27:39.202294579 (252h1m19.933562209s) [upload=262114]: Starting upload Aug 19 05:27:39.202333842 (252h1m19.933601473s) [upload=262114]: Done starting upload Aug 19 05:27:39.202368839 (252h1m19.933636469s) [upload=262114]: Uploading segments... Aug 19 05:27:39.202612797 (252h1m19.933880427s) [upload=262114]: Got next segment. Inline: false Aug 19 05:27:39.202645719 (252h1m19.933913349s) [upload=262114]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 05:27:39.202650087 (252h1m19.933917707s) [upload=262114]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 05:27:39.205550238 (252h1m19.936817868s) [upload=262114]: Next segment err: metaclient: Too Many Requests Aug 19 05:27:39.205560367 (252h1m19.936827997s) [upload=262114]: Done uploading segments... Aug 19 05:27:39.205567861 (252h1m19.936835482s) [upload=262114]: Upload finished. err: metaclient: Too Many Requests
Duration: 631.911824ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
419.507567ms
FAIL (2025-08-19 05:31:30 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 05:15:42.950619396 (251h49m23.681887026s) [upload=261914]: Starting upload Aug 19 05:15:42.950659280 (251h49m23.68192691s) [upload=261914]: Done starting upload Aug 19 05:15:42.950696701 (251h49m23.68196432s) [upload=261914]: Uploading segments... Aug 19 05:15:42.950723471 (251h49m23.681991101s) [upload=261914]: Got next segment. Inline: true Aug 19 05:15:42.950727057 (251h49m23.681994677s) [upload=261914]: Waiting for error group managing segments... Aug 19 05:15:42.950754749 (251h49m23.682022369s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 05:15:42.950758136 (251h49m23.682025755s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 05:15:42.950760279 (251h49m23.682027909s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 05:15:42.953451979 (251h49m23.684719599s) [upload=261914]: Done uploading segments... Aug 19 05:15:42.953459052 (251h49m23.684726672s) [upload=261914]: Upload finished. err: metaclient: Too Many Requests
Duration: 419.528857ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
134.8421ms
FAIL (2025-08-19 05:31:14 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 05:15:42.950619396 (251h49m23.681887026s) [upload=261914]: Starting upload Aug 19 05:15:42.950659280 (251h49m23.68192691s) [upload=261914]: Done starting upload Aug 19 05:15:42.950696701 (251h49m23.68196432s) [upload=261914]: Uploading segments... Aug 19 05:15:42.950723471 (251h49m23.681991101s) [upload=261914]: Got next segment. Inline: true Aug 19 05:15:42.950727057 (251h49m23.681994677s) [upload=261914]: Waiting for error group managing segments... Aug 19 05:15:42.950754749 (251h49m23.682022369s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 05:15:42.950758136 (251h49m23.682025755s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 05:15:42.950760279 (251h49m23.682027909s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 05:15:42.953451979 (251h49m23.684719599s) [upload=261914]: Done uploading segments... Aug 19 05:15:42.953459052 (251h49m23.684726672s) [upload=261914]: Upload finished. err: metaclient: Too Many Requests
Duration: 134.867398ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............................................X..........X...] duration:
675.237905ms
FAIL (2025-08-19 05:30:46 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 05:27:39.202294579 (252h1m19.933562209s) [upload=262114]: Starting upload Aug 19 05:27:39.202333842 (252h1m19.933601473s) [upload=262114]: Done starting upload Aug 19 05:27:39.202368839 (252h1m19.933636469s) [upload=262114]: Uploading segments... Aug 19 05:27:39.202612797 (252h1m19.933880427s) [upload=262114]: Got next segment. Inline: false Aug 19 05:27:39.202645719 (252h1m19.933913349s) [upload=262114]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 05:27:39.202650087 (252h1m19.933917707s) [upload=262114]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 05:27:39.205550238 (252h1m19.936817868s) [upload=262114]: Next segment err: metaclient: Too Many Requests Aug 19 05:27:39.205560367 (252h1m19.936827997s) [upload=262114]: Done uploading segments... Aug 19 05:27:39.205567861 (252h1m19.936835482s) [upload=262114]: Upload finished. err: metaclient: Too Many Requests
Duration: 675.266949ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
166.09299ms
FAIL (2025-08-19 05:30:01 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 05:15:42.950619396 (251h49m23.681887026s) [upload=261914]: Starting upload Aug 19 05:15:42.950659280 (251h49m23.68192691s) [upload=261914]: Done starting upload Aug 19 05:15:42.950696701 (251h49m23.68196432s) [upload=261914]: Uploading segments... Aug 19 05:15:42.950723471 (251h49m23.681991101s) [upload=261914]: Got next segment. Inline: true Aug 19 05:15:42.950727057 (251h49m23.681994677s) [upload=261914]: Waiting for error group managing segments... Aug 19 05:15:42.950754749 (251h49m23.682022369s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 05:15:42.950758136 (251h49m23.682025755s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 05:15:42.950760279 (251h49m23.682027909s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 05:15:42.953451979 (251h49m23.684719599s) [upload=261914]: Done uploading segments... Aug 19 05:15:42.953459052 (251h49m23.684726672s) [upload=261914]: Upload finished. err: metaclient: Too Many Requests
Duration: 166.112608ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............................................X..........X..] duration:
629.366719ms
FAIL (2025-08-19 05:29:41 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 05:27:39.202294579 (252h1m19.933562209s) [upload=262114]: Starting upload Aug 19 05:27:39.202333842 (252h1m19.933601473s) [upload=262114]: Done starting upload Aug 19 05:27:39.202368839 (252h1m19.933636469s) [upload=262114]: Uploading segments... Aug 19 05:27:39.202612797 (252h1m19.933880427s) [upload=262114]: Got next segment. Inline: false Aug 19 05:27:39.202645719 (252h1m19.933913349s) [upload=262114]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 05:27:39.202650087 (252h1m19.933917707s) [upload=262114]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 05:27:39.205550238 (252h1m19.936817868s) [upload=262114]: Next segment err: metaclient: Too Many Requests Aug 19 05:27:39.205560367 (252h1m19.936827997s) [upload=262114]: Done uploading segments... Aug 19 05:27:39.205567861 (252h1m19.936835482s) [upload=262114]: Upload finished. err: metaclient: Too Many Requests
Duration: 629.396334ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
160.957416ms
FAIL (2025-08-19 05:28:49 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 05:15:42.950619396 (251h49m23.681887026s) [upload=261914]: Starting upload Aug 19 05:15:42.950659280 (251h49m23.68192691s) [upload=261914]: Done starting upload Aug 19 05:15:42.950696701 (251h49m23.68196432s) [upload=261914]: Uploading segments... Aug 19 05:15:42.950723471 (251h49m23.681991101s) [upload=261914]: Got next segment. Inline: true Aug 19 05:15:42.950727057 (251h49m23.681994677s) [upload=261914]: Waiting for error group managing segments... Aug 19 05:15:42.950754749 (251h49m23.682022369s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 05:15:42.950758136 (251h49m23.682025755s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 05:15:42.950760279 (251h49m23.682027909s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 05:15:42.953451979 (251h49m23.684719599s) [upload=261914]: Done uploading segments... Aug 19 05:15:42.953459052 (251h49m23.684726672s) [upload=261914]: Upload finished. err: metaclient: Too Many Requests
Duration: 160.9808ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [X..............................................X..........X.] duration:
533.90996ms
FAIL (2025-08-19 05:28:29 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 05:27:39.202294579 (252h1m19.933562209s) [upload=262114]: Starting upload Aug 19 05:27:39.202333842 (252h1m19.933601473s) [upload=262114]: Done starting upload Aug 19 05:27:39.202368839 (252h1m19.933636469s) [upload=262114]: Uploading segments... Aug 19 05:27:39.202612797 (252h1m19.933880427s) [upload=262114]: Got next segment. Inline: false Aug 19 05:27:39.202645719 (252h1m19.933913349s) [upload=262114]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 05:27:39.202650087 (252h1m19.933917707s) [upload=262114]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 05:27:39.205550238 (252h1m19.936817868s) [upload=262114]: Next segment err: metaclient: Too Many Requests Aug 19 05:27:39.205560367 (252h1m19.936827997s) [upload=262114]: Done uploading segments... Aug 19 05:27:39.205567861 (252h1m19.936835482s) [upload=262114]: Upload finished. err: metaclient: Too Many Requests
Duration: 533.93149ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
232.201033ms
FAIL (2025-08-19 05:28:05 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 05:15:42.950619396 (251h49m23.681887026s) [upload=261914]: Starting upload Aug 19 05:15:42.950659280 (251h49m23.68192691s) [upload=261914]: Done starting upload Aug 19 05:15:42.950696701 (251h49m23.68196432s) [upload=261914]: Uploading segments... Aug 19 05:15:42.950723471 (251h49m23.681991101s) [upload=261914]: Got next segment. Inline: true Aug 19 05:15:42.950727057 (251h49m23.681994677s) [upload=261914]: Waiting for error group managing segments... Aug 19 05:15:42.950754749 (251h49m23.682022369s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 05:15:42.950758136 (251h49m23.682025755s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 05:15:42.950760279 (251h49m23.682027909s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 05:15:42.953451979 (251h49m23.684719599s) [upload=261914]: Done uploading segments... Aug 19 05:15:42.953459052 (251h49m23.684726672s) [upload=261914]: Upload finished. err: metaclient: Too Many Requests
Duration: 232.223345ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
133.827663ms
FAIL (2025-08-19 05:27:44 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 05:15:42.950619396 (251h49m23.681887026s) [upload=261914]: Starting upload Aug 19 05:15:42.950659280 (251h49m23.68192691s) [upload=261914]: Done starting upload Aug 19 05:15:42.950696701 (251h49m23.68196432s) [upload=261914]: Uploading segments... Aug 19 05:15:42.950723471 (251h49m23.681991101s) [upload=261914]: Got next segment. Inline: true Aug 19 05:15:42.950727057 (251h49m23.681994677s) [upload=261914]: Waiting for error group managing segments... Aug 19 05:15:42.950754749 (251h49m23.682022369s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 05:15:42.950758136 (251h49m23.682025755s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 05:15:42.950760279 (251h49m23.682027909s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 05:15:42.953451979 (251h49m23.684719599s) [upload=261914]: Done uploading segments... Aug 19 05:15:42.953459052 (251h49m23.684726672s) [upload=261914]: Upload finished. err: metaclient: Too Many Requests
Duration: 133.892145ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.X..............................................X..........X] duration:
18.305957ms
FAIL (2025-08-19 05:27:39 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 05:27:39.202294579 (252h1m19.933562209s) [upload=262114]: Starting upload Aug 19 05:27:39.202333842 (252h1m19.933601473s) [upload=262114]: Done starting upload Aug 19 05:27:39.202368839 (252h1m19.933636469s) [upload=262114]: Uploading segments... Aug 19 05:27:39.202612797 (252h1m19.933880427s) [upload=262114]: Got next segment. Inline: false Aug 19 05:27:39.202645719 (252h1m19.933913349s) [upload=262114]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 05:27:39.202650087 (252h1m19.933917707s) [upload=262114]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 05:27:39.205550238 (252h1m19.936817868s) [upload=262114]: Next segment err: metaclient: Too Many Requests Aug 19 05:27:39.205560367 (252h1m19.936827997s) [upload=262114]: Done uploading segments... Aug 19 05:27:39.205567861 (252h1m19.936835482s) [upload=262114]: Upload finished. err: metaclient: Too Many Requests
Duration: 18.321065ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
111.363923ms
FAIL (2025-08-19 05:26:52 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 05:15:42.950619396 (251h49m23.681887026s) [upload=261914]: Starting upload Aug 19 05:15:42.950659280 (251h49m23.68192691s) [upload=261914]: Done starting upload Aug 19 05:15:42.950696701 (251h49m23.68196432s) [upload=261914]: Uploading segments... Aug 19 05:15:42.950723471 (251h49m23.681991101s) [upload=261914]: Got next segment. Inline: true Aug 19 05:15:42.950727057 (251h49m23.681994677s) [upload=261914]: Waiting for error group managing segments... Aug 19 05:15:42.950754749 (251h49m23.682022369s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 05:15:42.950758136 (251h49m23.682025755s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 05:15:42.950760279 (251h49m23.682027909s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 05:15:42.953451979 (251h49m23.684719599s) [upload=261914]: Done uploading segments... Aug 19 05:15:42.953459052 (251h49m23.684726672s) [upload=261914]: Upload finished. err: metaclient: Too Many Requests
Duration: 111.3883ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..X..............................................X..........] duration:
638.842986ms
FAIL (2025-08-19 05:26:47 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 19 05:18:45.789559792 (251h52m26.520827441s) [upload=261964]: Starting upload
Aug 19 05:18:45.789620084 (251h52m26.520887745s) [upload=261964]: Done starting upload
Aug 19 05:18:45.789757363 (251h52m26.521025023s) [upload=261964]: Uploading segments...
Aug 19 05:18:45.790009878 (251h52m26.521277527s) [upload=261964]: Got next segment. Inline: false
Aug 19 05:18:45.790064680 (251h52m26.521332331s) [upload=261964]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 05:18:45.790070992 (251h52m26.521338642s) [upload=261964]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:18:45.815063657 (251h52m26.546331327s) [seg_pos={0 0}, upload=261964]: Begin upload segment...
Aug 19 05:18:45.815120123 (251h52m26.546387783s) [seg_pos={0 0}, upload=261964]: Done begin upload segment.
Aug 19 05:18:45.815135172 (251h52m26.546402822s) [noise=true , address=79.127.205.233:4654 , piece_id=5V5ZA3PQ5VEBVJJLVOJRRQZ2CEYMRZGB4WXI7JNCMZ3DPC2WOOKA, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.815147224 (251h52m26.546414875s) [noise=true , address=77.90.31.19:4862 , piece_id=ZOZTQMXHBIGCJKOHCVTSEQJH5XDGS7CVHFJXYH7MIQEUDNYFLZZQ, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.815251620 (251h52m26.546519271s) [noise=true , address=104.36.82.60:4339 , piece_id=BXBAVZZ4NILTU2G3Y2THA7YHFNYHYP3C2TAG6XEWLL25F4RK657Q, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.815718588 (251h52m26.546986238s) [noise=true , address=77.90.31.11:4561 , piece_id=A4YHL3TXQKVEXWL4IN6IM3HDPJWRTQ2OCGRMUK7GRGX4DQ7ZCNUQ, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.816298257 (251h52m26.547565918s) [noise=true , address=79.127.201.215:4356 , piece_id=W4ACVXXL6XPP27HTAOF3S7LUSL2GKA3VJZ35SLWPIV423NE4K7HQ, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.816860774 (251h52m26.548128424s) [noise=true , address=77.90.31.15:4714 , piece_id=AIFPKUXL4OW3FMGFKQZH22Q3TFD6HI7MCMGQAYT5FOA2HPEVVI2Q, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.817508322 (251h52m26.548776032s) [noise=true , address=104.36.82.23:4476 , piece_id=PQJIUPB6MWNXM6BD3IF6BZYQCERCBWJ6Q3AMRJKXCQAGLLHSEAOA, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.818079004 (251h52m26.549346654s) [noise=true , address=45.91.116.6:4988 , piece_id=LIXV5NLQJCOI6YPSRKJVHKM6HXGESZODCFSVLQWELWOLDSAQGUAA, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.818501528 (251h52m26.549769179s) [noise=true , address=79.127.219.51:4205 , piece_id=OBW3ZAQE25CKKJF6E3JQ76CAKS35L6GRVNZ6CQZAXMFWA6RIC6NQ, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.819038087 (251h52m26.550305747s) [noise=true , address=104.36.82.44:4888 , piece_id=UDJDNGE2I3K4CME5JEKQMBTFIPJWM67WJDMZQMNTTNGMK5ZYKK4A, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.819510014 (251h52m26.550777664s) [noise=true , address=79.127.219.48:4085 , piece_id=FGJO2ZTYAN4WR4ZMZXU2SALJNLYL3Y4WPVBRYLT3NMLWHMS7FLWQ, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.820065197 (251h52m26.551332857s) [noise=true , address=77.90.31.14:4687 , piece_id=2YYS4OPFWGEK62N42P22S7Q5K5DYDMLYYU5Z5NKCO4MJ6PL3NQ5Q, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.820553455 (251h52m26.551821115s) [noise=true , address=77.90.31.17:4796 , piece_id=GTUBHDLN56RTXMF3JDA4CBE2PFNUNDQODUZ7PHFY3BH2RRNOPBSA, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.821108177 (251h52m26.552375838s) [noise=true , address=45.91.116.4:4970 , piece_id=GCRF42CNAEML3QDKVLE3GWUIMEQ2ZBG7LM5FA4UR3DRCVAGXD4MQ, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.821675584 (251h52m26.552943244s) [noise=true , address=77.90.31.21:4884 , piece_id=YURRGVPDQCJJFKZJOGDTZKCZHYMUWJJA3OYHNQFUE5BJHLTXPFPQ, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.822228784 (251h52m26.553496434s) [noise=true , address=45.91.116.9:4271 , piece_id=VVRPQ3ZKOEX4ANJFO2DGOYJD5SGCDECP7OH2ZTOI7VJ3KRRQ5JJA, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.823577548 (251h52m26.554845199s) [noise=true , address=79.127.219.47:4062 , piece_id=T5XXU7QTR7V6XKBDSN3LBNQXGMBQFPY72VECY7PK7XWIXOXJRVSA, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.824835683 (251h52m26.556103333s) [noise=true , address=77.90.31.18:4838 , piece_id=AP7T734AGCYXVKAGGCJ5MG6SMC6K7H7ZGL772K3L6XPTQJRXIMVA, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.934772154 (251h52m26.666039805s) [upload=261964]: Next returned nil segment
Aug 19 05:18:45.934786632 (251h52m26.666054282s) [upload=261964]: Waiting for error group managing segments...
Aug 19 05:18:45.943751541 (251h52m26.675019192s) [noise=true , address=79.127.219.47:4062 , piece_id=T5XXU7QTR7V6XKBDSN3LBNQXGMBQFPY72VECY7PK7XWIXOXJRVSA, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:45.944650221 (251h52m26.675917871s) [noise=true , address=79.127.219.48:4085 , piece_id=FGJO2ZTYAN4WR4ZMZXU2SALJNLYL3Y4WPVBRYLT3NMLWHMS7FLWQ, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:45.945600968 (251h52m26.676868618s) [noise=true , address=79.127.219.51:4205 , piece_id=OBW3ZAQE25CKKJF6E3JQ76CAKS35L6GRVNZ6CQZAXMFWA6RIC6NQ, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.019064917 (251h52m26.750332567s) [noise=true , address=45.91.116.6:4988 , piece_id=LIXV5NLQJCOI6YPSRKJVHKM6HXGESZODCFSVLQWELWOLDSAQGUAA, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.030693834 (251h52m26.761961484s) [noise=true , address=77.90.31.19:4862 , piece_id=ZOZTQMXHBIGCJKOHCVTSEQJH5XDGS7CVHFJXYH7MIQEUDNYFLZZQ, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.031047147 (251h52m26.762314798s) [noise=true , address=45.91.116.9:4271 , piece_id=VVRPQ3ZKOEX4ANJFO2DGOYJD5SGCDECP7OH2ZTOI7VJ3KRRQ5JJA, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.032353223 (251h52m26.763620873s) [noise=true , address=77.90.31.17:4796 , piece_id=GTUBHDLN56RTXMF3JDA4CBE2PFNUNDQODUZ7PHFY3BH2RRNOPBSA, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.033056985 (251h52m26.764324635s) [noise=true , address=77.90.31.11:4561 , piece_id=A4YHL3TXQKVEXWL4IN6IM3HDPJWRTQ2OCGRMUK7GRGX4DQ7ZCNUQ, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.033135343 (251h52m26.764402993s) [noise=true , address=77.90.31.15:4714 , piece_id=AIFPKUXL4OW3FMGFKQZH22Q3TFD6HI7MCMGQAYT5FOA2HPEVVI2Q, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.041772277 (251h52m26.773039926s) [noise=true , address=77.90.31.14:4687 , piece_id=2YYS4OPFWGEK62N42P22S7Q5K5DYDMLYYU5Z5NKCO4MJ6PL3NQ5Q, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.042572200 (251h52m26.77383986s) [noise=true , address=45.91.116.4:4970 , piece_id=GCRF42CNAEML3QDKVLE3GWUIMEQ2ZBG7LM5FA4UR3DRCVAGXD4MQ, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.044576828 (251h52m26.775844487s) [noise=true , address=104.36.82.60:4339 , piece_id=BXBAVZZ4NILTU2G3Y2THA7YHFNYHYP3C2TAG6XEWLL25F4RK657Q, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.057100085 (251h52m26.788367735s) [noise=true , address=104.36.82.23:4476 , piece_id=PQJIUPB6MWNXM6BD3IF6BZYQCERCBWJ6Q3AMRJKXCQAGLLHSEAOA, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.058633368 (251h52m26.789901017s) [noise=true , address=104.36.82.44:4888 , piece_id=UDJDNGE2I3K4CME5JEKQMBTFIPJWM67WJDMZQMNTTNGMK5ZYKK4A, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.058668493 (251h52m26.789936144s) [seg_pos={0 0}, upload=261964]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:18:46.058836578 (251h52m26.790104229s) [noise=true , address=77.90.31.21:4884 , piece_id=YURRGVPDQCJJFKZJOGDTZKCZHYMUWJJA3OYHNQFUE5BJHLTXPFPQ, seg_pos={0 0}, upload=261964]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aqgkDxFY3xZa9s2vq1DdCFFX2725aDicrxfvoYuXPfe4ozkHV): protocol: expected piece hash; context canceled; EOF
Aug 19 05:18:46.058945163 (251h52m26.790212813s) [noise=true , address=79.127.201.215:4356 , piece_id=W4ACVXXL6XPP27HTAOF3S7LUSL2GKA3VJZ35SLWPIV423NE4K7HQ, seg_pos={0 0}, upload=261964]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 19 05:18:46.059098361 (251h52m26.79036602s) [noise=true , address=77.90.31.18:4838 , piece_id=AP7T734AGCYXVKAGGCJ5MG6SMC6K7H7ZGL772K3L6XPTQJRXIMVA, seg_pos={0 0}, upload=261964]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1if7vf1cNTBwAhb6owi6tuGLYqSfa3feWhsvGSevwuwykhz2RY): protocol: expected piece hash; context canceled; EOF
Aug 19 05:18:46.059433802 (251h52m26.790701451s) [noise=true , address=79.127.205.233:4654 , piece_id=5V5ZA3PQ5VEBVJJLVOJRRQZ2CEYMRZGB4WXI7JNCMZ3DPC2WOOKA, seg_pos={0 0}, upload=261964]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jh6NFSjhYdd9w3yCf9a4t8TBH2UGXcN3TjzEJkvf173hGnXY8): protocol: context canceled; context canceled
Aug 19 05:18:46.059504244 (251h52m26.790771894s) [seg_pos={0 0}, upload=261964]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:18:46.059644538 (251h52m26.790912198s) [upload=261964]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:18:46.059654156 (251h52m26.790921816s) [upload=261964]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:18:46.247069599 (251h52m26.978337249s) [upload=261964]: Done uploading segments...
Aug 19 05:18:46.247089045 (251h52m26.978356696s) [upload=261964]: Upload finished. err: <nil>
Duration: 638.868424ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
146.086028ms
FAIL (2025-08-19 05:26:28 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 05:15:42.950619396 (251h49m23.681887026s) [upload=261914]: Starting upload Aug 19 05:15:42.950659280 (251h49m23.68192691s) [upload=261914]: Done starting upload Aug 19 05:15:42.950696701 (251h49m23.68196432s) [upload=261914]: Uploading segments... Aug 19 05:15:42.950723471 (251h49m23.681991101s) [upload=261914]: Got next segment. Inline: true Aug 19 05:15:42.950727057 (251h49m23.681994677s) [upload=261914]: Waiting for error group managing segments... Aug 19 05:15:42.950754749 (251h49m23.682022369s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 05:15:42.950758136 (251h49m23.682025755s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 05:15:42.950760279 (251h49m23.682027909s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 05:15:42.953451979 (251h49m23.684719599s) [upload=261914]: Done uploading segments... Aug 19 05:15:42.953459052 (251h49m23.684726672s) [upload=261914]: Upload finished. err: metaclient: Too Many Requests
Duration: 146.115992ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...X..............................................X.........] duration:
574.140814ms
FAIL (2025-08-19 05:25:57 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 19 05:18:45.789559792 (251h52m26.520827441s) [upload=261964]: Starting upload
Aug 19 05:18:45.789620084 (251h52m26.520887745s) [upload=261964]: Done starting upload
Aug 19 05:18:45.789757363 (251h52m26.521025023s) [upload=261964]: Uploading segments...
Aug 19 05:18:45.790009878 (251h52m26.521277527s) [upload=261964]: Got next segment. Inline: false
Aug 19 05:18:45.790064680 (251h52m26.521332331s) [upload=261964]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 05:18:45.790070992 (251h52m26.521338642s) [upload=261964]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:18:45.815063657 (251h52m26.546331327s) [seg_pos={0 0}, upload=261964]: Begin upload segment...
Aug 19 05:18:45.815120123 (251h52m26.546387783s) [seg_pos={0 0}, upload=261964]: Done begin upload segment.
Aug 19 05:18:45.815135172 (251h52m26.546402822s) [noise=true , address=79.127.205.233:4654 , piece_id=5V5ZA3PQ5VEBVJJLVOJRRQZ2CEYMRZGB4WXI7JNCMZ3DPC2WOOKA, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.815147224 (251h52m26.546414875s) [noise=true , address=77.90.31.19:4862 , piece_id=ZOZTQMXHBIGCJKOHCVTSEQJH5XDGS7CVHFJXYH7MIQEUDNYFLZZQ, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.815251620 (251h52m26.546519271s) [noise=true , address=104.36.82.60:4339 , piece_id=BXBAVZZ4NILTU2G3Y2THA7YHFNYHYP3C2TAG6XEWLL25F4RK657Q, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.815718588 (251h52m26.546986238s) [noise=true , address=77.90.31.11:4561 , piece_id=A4YHL3TXQKVEXWL4IN6IM3HDPJWRTQ2OCGRMUK7GRGX4DQ7ZCNUQ, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.816298257 (251h52m26.547565918s) [noise=true , address=79.127.201.215:4356 , piece_id=W4ACVXXL6XPP27HTAOF3S7LUSL2GKA3VJZ35SLWPIV423NE4K7HQ, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.816860774 (251h52m26.548128424s) [noise=true , address=77.90.31.15:4714 , piece_id=AIFPKUXL4OW3FMGFKQZH22Q3TFD6HI7MCMGQAYT5FOA2HPEVVI2Q, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.817508322 (251h52m26.548776032s) [noise=true , address=104.36.82.23:4476 , piece_id=PQJIUPB6MWNXM6BD3IF6BZYQCERCBWJ6Q3AMRJKXCQAGLLHSEAOA, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.818079004 (251h52m26.549346654s) [noise=true , address=45.91.116.6:4988 , piece_id=LIXV5NLQJCOI6YPSRKJVHKM6HXGESZODCFSVLQWELWOLDSAQGUAA, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.818501528 (251h52m26.549769179s) [noise=true , address=79.127.219.51:4205 , piece_id=OBW3ZAQE25CKKJF6E3JQ76CAKS35L6GRVNZ6CQZAXMFWA6RIC6NQ, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.819038087 (251h52m26.550305747s) [noise=true , address=104.36.82.44:4888 , piece_id=UDJDNGE2I3K4CME5JEKQMBTFIPJWM67WJDMZQMNTTNGMK5ZYKK4A, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.819510014 (251h52m26.550777664s) [noise=true , address=79.127.219.48:4085 , piece_id=FGJO2ZTYAN4WR4ZMZXU2SALJNLYL3Y4WPVBRYLT3NMLWHMS7FLWQ, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.820065197 (251h52m26.551332857s) [noise=true , address=77.90.31.14:4687 , piece_id=2YYS4OPFWGEK62N42P22S7Q5K5DYDMLYYU5Z5NKCO4MJ6PL3NQ5Q, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.820553455 (251h52m26.551821115s) [noise=true , address=77.90.31.17:4796 , piece_id=GTUBHDLN56RTXMF3JDA4CBE2PFNUNDQODUZ7PHFY3BH2RRNOPBSA, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.821108177 (251h52m26.552375838s) [noise=true , address=45.91.116.4:4970 , piece_id=GCRF42CNAEML3QDKVLE3GWUIMEQ2ZBG7LM5FA4UR3DRCVAGXD4MQ, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.821675584 (251h52m26.552943244s) [noise=true , address=77.90.31.21:4884 , piece_id=YURRGVPDQCJJFKZJOGDTZKCZHYMUWJJA3OYHNQFUE5BJHLTXPFPQ, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.822228784 (251h52m26.553496434s) [noise=true , address=45.91.116.9:4271 , piece_id=VVRPQ3ZKOEX4ANJFO2DGOYJD5SGCDECP7OH2ZTOI7VJ3KRRQ5JJA, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.823577548 (251h52m26.554845199s) [noise=true , address=79.127.219.47:4062 , piece_id=T5XXU7QTR7V6XKBDSN3LBNQXGMBQFPY72VECY7PK7XWIXOXJRVSA, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.824835683 (251h52m26.556103333s) [noise=true , address=77.90.31.18:4838 , piece_id=AP7T734AGCYXVKAGGCJ5MG6SMC6K7H7ZGL772K3L6XPTQJRXIMVA, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.934772154 (251h52m26.666039805s) [upload=261964]: Next returned nil segment
Aug 19 05:18:45.934786632 (251h52m26.666054282s) [upload=261964]: Waiting for error group managing segments...
Aug 19 05:18:45.943751541 (251h52m26.675019192s) [noise=true , address=79.127.219.47:4062 , piece_id=T5XXU7QTR7V6XKBDSN3LBNQXGMBQFPY72VECY7PK7XWIXOXJRVSA, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:45.944650221 (251h52m26.675917871s) [noise=true , address=79.127.219.48:4085 , piece_id=FGJO2ZTYAN4WR4ZMZXU2SALJNLYL3Y4WPVBRYLT3NMLWHMS7FLWQ, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:45.945600968 (251h52m26.676868618s) [noise=true , address=79.127.219.51:4205 , piece_id=OBW3ZAQE25CKKJF6E3JQ76CAKS35L6GRVNZ6CQZAXMFWA6RIC6NQ, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.019064917 (251h52m26.750332567s) [noise=true , address=45.91.116.6:4988 , piece_id=LIXV5NLQJCOI6YPSRKJVHKM6HXGESZODCFSVLQWELWOLDSAQGUAA, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.030693834 (251h52m26.761961484s) [noise=true , address=77.90.31.19:4862 , piece_id=ZOZTQMXHBIGCJKOHCVTSEQJH5XDGS7CVHFJXYH7MIQEUDNYFLZZQ, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.031047147 (251h52m26.762314798s) [noise=true , address=45.91.116.9:4271 , piece_id=VVRPQ3ZKOEX4ANJFO2DGOYJD5SGCDECP7OH2ZTOI7VJ3KRRQ5JJA, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.032353223 (251h52m26.763620873s) [noise=true , address=77.90.31.17:4796 , piece_id=GTUBHDLN56RTXMF3JDA4CBE2PFNUNDQODUZ7PHFY3BH2RRNOPBSA, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.033056985 (251h52m26.764324635s) [noise=true , address=77.90.31.11:4561 , piece_id=A4YHL3TXQKVEXWL4IN6IM3HDPJWRTQ2OCGRMUK7GRGX4DQ7ZCNUQ, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.033135343 (251h52m26.764402993s) [noise=true , address=77.90.31.15:4714 , piece_id=AIFPKUXL4OW3FMGFKQZH22Q3TFD6HI7MCMGQAYT5FOA2HPEVVI2Q, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.041772277 (251h52m26.773039926s) [noise=true , address=77.90.31.14:4687 , piece_id=2YYS4OPFWGEK62N42P22S7Q5K5DYDMLYYU5Z5NKCO4MJ6PL3NQ5Q, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.042572200 (251h52m26.77383986s) [noise=true , address=45.91.116.4:4970 , piece_id=GCRF42CNAEML3QDKVLE3GWUIMEQ2ZBG7LM5FA4UR3DRCVAGXD4MQ, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.044576828 (251h52m26.775844487s) [noise=true , address=104.36.82.60:4339 , piece_id=BXBAVZZ4NILTU2G3Y2THA7YHFNYHYP3C2TAG6XEWLL25F4RK657Q, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.057100085 (251h52m26.788367735s) [noise=true , address=104.36.82.23:4476 , piece_id=PQJIUPB6MWNXM6BD3IF6BZYQCERCBWJ6Q3AMRJKXCQAGLLHSEAOA, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.058633368 (251h52m26.789901017s) [noise=true , address=104.36.82.44:4888 , piece_id=UDJDNGE2I3K4CME5JEKQMBTFIPJWM67WJDMZQMNTTNGMK5ZYKK4A, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.058668493 (251h52m26.789936144s) [seg_pos={0 0}, upload=261964]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:18:46.058836578 (251h52m26.790104229s) [noise=true , address=77.90.31.21:4884 , piece_id=YURRGVPDQCJJFKZJOGDTZKCZHYMUWJJA3OYHNQFUE5BJHLTXPFPQ, seg_pos={0 0}, upload=261964]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aqgkDxFY3xZa9s2vq1DdCFFX2725aDicrxfvoYuXPfe4ozkHV): protocol: expected piece hash; context canceled; EOF
Aug 19 05:18:46.058945163 (251h52m26.790212813s) [noise=true , address=79.127.201.215:4356 , piece_id=W4ACVXXL6XPP27HTAOF3S7LUSL2GKA3VJZ35SLWPIV423NE4K7HQ, seg_pos={0 0}, upload=261964]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 19 05:18:46.059098361 (251h52m26.79036602s) [noise=true , address=77.90.31.18:4838 , piece_id=AP7T734AGCYXVKAGGCJ5MG6SMC6K7H7ZGL772K3L6XPTQJRXIMVA, seg_pos={0 0}, upload=261964]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1if7vf1cNTBwAhb6owi6tuGLYqSfa3feWhsvGSevwuwykhz2RY): protocol: expected piece hash; context canceled; EOF
Aug 19 05:18:46.059433802 (251h52m26.790701451s) [noise=true , address=79.127.205.233:4654 , piece_id=5V5ZA3PQ5VEBVJJLVOJRRQZ2CEYMRZGB4WXI7JNCMZ3DPC2WOOKA, seg_pos={0 0}, upload=261964]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jh6NFSjhYdd9w3yCf9a4t8TBH2UGXcN3TjzEJkvf173hGnXY8): protocol: context canceled; context canceled
Aug 19 05:18:46.059504244 (251h52m26.790771894s) [seg_pos={0 0}, upload=261964]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:18:46.059644538 (251h52m26.790912198s) [upload=261964]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:18:46.059654156 (251h52m26.790921816s) [upload=261964]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:18:46.247069599 (251h52m26.978337249s) [upload=261964]: Done uploading segments...
Aug 19 05:18:46.247089045 (251h52m26.978356696s) [upload=261964]: Upload finished. err: <nil>
Duration: 574.168507ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
149.958706ms
FAIL (2025-08-19 05:25:28 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 05:15:42.950619396 (251h49m23.681887026s) [upload=261914]: Starting upload Aug 19 05:15:42.950659280 (251h49m23.68192691s) [upload=261914]: Done starting upload Aug 19 05:15:42.950696701 (251h49m23.68196432s) [upload=261914]: Uploading segments... Aug 19 05:15:42.950723471 (251h49m23.681991101s) [upload=261914]: Got next segment. Inline: true Aug 19 05:15:42.950727057 (251h49m23.681994677s) [upload=261914]: Waiting for error group managing segments... Aug 19 05:15:42.950754749 (251h49m23.682022369s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 05:15:42.950758136 (251h49m23.682025755s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 05:15:42.950760279 (251h49m23.682027909s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 05:15:42.953451979 (251h49m23.684719599s) [upload=261914]: Done uploading segments... Aug 19 05:15:42.953459052 (251h49m23.684726672s) [upload=261914]: Upload finished. err: metaclient: Too Many Requests
Duration: 149.975377ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....X..............................................X........] duration:
600.259976ms
FAIL (2025-08-19 05:24:59 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 19 05:18:45.789559792 (251h52m26.520827441s) [upload=261964]: Starting upload
Aug 19 05:18:45.789620084 (251h52m26.520887745s) [upload=261964]: Done starting upload
Aug 19 05:18:45.789757363 (251h52m26.521025023s) [upload=261964]: Uploading segments...
Aug 19 05:18:45.790009878 (251h52m26.521277527s) [upload=261964]: Got next segment. Inline: false
Aug 19 05:18:45.790064680 (251h52m26.521332331s) [upload=261964]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 05:18:45.790070992 (251h52m26.521338642s) [upload=261964]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:18:45.815063657 (251h52m26.546331327s) [seg_pos={0 0}, upload=261964]: Begin upload segment...
Aug 19 05:18:45.815120123 (251h52m26.546387783s) [seg_pos={0 0}, upload=261964]: Done begin upload segment.
Aug 19 05:18:45.815135172 (251h52m26.546402822s) [noise=true , address=79.127.205.233:4654 , piece_id=5V5ZA3PQ5VEBVJJLVOJRRQZ2CEYMRZGB4WXI7JNCMZ3DPC2WOOKA, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.815147224 (251h52m26.546414875s) [noise=true , address=77.90.31.19:4862 , piece_id=ZOZTQMXHBIGCJKOHCVTSEQJH5XDGS7CVHFJXYH7MIQEUDNYFLZZQ, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.815251620 (251h52m26.546519271s) [noise=true , address=104.36.82.60:4339 , piece_id=BXBAVZZ4NILTU2G3Y2THA7YHFNYHYP3C2TAG6XEWLL25F4RK657Q, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.815718588 (251h52m26.546986238s) [noise=true , address=77.90.31.11:4561 , piece_id=A4YHL3TXQKVEXWL4IN6IM3HDPJWRTQ2OCGRMUK7GRGX4DQ7ZCNUQ, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.816298257 (251h52m26.547565918s) [noise=true , address=79.127.201.215:4356 , piece_id=W4ACVXXL6XPP27HTAOF3S7LUSL2GKA3VJZ35SLWPIV423NE4K7HQ, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.816860774 (251h52m26.548128424s) [noise=true , address=77.90.31.15:4714 , piece_id=AIFPKUXL4OW3FMGFKQZH22Q3TFD6HI7MCMGQAYT5FOA2HPEVVI2Q, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.817508322 (251h52m26.548776032s) [noise=true , address=104.36.82.23:4476 , piece_id=PQJIUPB6MWNXM6BD3IF6BZYQCERCBWJ6Q3AMRJKXCQAGLLHSEAOA, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.818079004 (251h52m26.549346654s) [noise=true , address=45.91.116.6:4988 , piece_id=LIXV5NLQJCOI6YPSRKJVHKM6HXGESZODCFSVLQWELWOLDSAQGUAA, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.818501528 (251h52m26.549769179s) [noise=true , address=79.127.219.51:4205 , piece_id=OBW3ZAQE25CKKJF6E3JQ76CAKS35L6GRVNZ6CQZAXMFWA6RIC6NQ, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.819038087 (251h52m26.550305747s) [noise=true , address=104.36.82.44:4888 , piece_id=UDJDNGE2I3K4CME5JEKQMBTFIPJWM67WJDMZQMNTTNGMK5ZYKK4A, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.819510014 (251h52m26.550777664s) [noise=true , address=79.127.219.48:4085 , piece_id=FGJO2ZTYAN4WR4ZMZXU2SALJNLYL3Y4WPVBRYLT3NMLWHMS7FLWQ, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.820065197 (251h52m26.551332857s) [noise=true , address=77.90.31.14:4687 , piece_id=2YYS4OPFWGEK62N42P22S7Q5K5DYDMLYYU5Z5NKCO4MJ6PL3NQ5Q, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.820553455 (251h52m26.551821115s) [noise=true , address=77.90.31.17:4796 , piece_id=GTUBHDLN56RTXMF3JDA4CBE2PFNUNDQODUZ7PHFY3BH2RRNOPBSA, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.821108177 (251h52m26.552375838s) [noise=true , address=45.91.116.4:4970 , piece_id=GCRF42CNAEML3QDKVLE3GWUIMEQ2ZBG7LM5FA4UR3DRCVAGXD4MQ, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.821675584 (251h52m26.552943244s) [noise=true , address=77.90.31.21:4884 , piece_id=YURRGVPDQCJJFKZJOGDTZKCZHYMUWJJA3OYHNQFUE5BJHLTXPFPQ, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.822228784 (251h52m26.553496434s) [noise=true , address=45.91.116.9:4271 , piece_id=VVRPQ3ZKOEX4ANJFO2DGOYJD5SGCDECP7OH2ZTOI7VJ3KRRQ5JJA, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.823577548 (251h52m26.554845199s) [noise=true , address=79.127.219.47:4062 , piece_id=T5XXU7QTR7V6XKBDSN3LBNQXGMBQFPY72VECY7PK7XWIXOXJRVSA, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.824835683 (251h52m26.556103333s) [noise=true , address=77.90.31.18:4838 , piece_id=AP7T734AGCYXVKAGGCJ5MG6SMC6K7H7ZGL772K3L6XPTQJRXIMVA, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.934772154 (251h52m26.666039805s) [upload=261964]: Next returned nil segment
Aug 19 05:18:45.934786632 (251h52m26.666054282s) [upload=261964]: Waiting for error group managing segments...
Aug 19 05:18:45.943751541 (251h52m26.675019192s) [noise=true , address=79.127.219.47:4062 , piece_id=T5XXU7QTR7V6XKBDSN3LBNQXGMBQFPY72VECY7PK7XWIXOXJRVSA, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:45.944650221 (251h52m26.675917871s) [noise=true , address=79.127.219.48:4085 , piece_id=FGJO2ZTYAN4WR4ZMZXU2SALJNLYL3Y4WPVBRYLT3NMLWHMS7FLWQ, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:45.945600968 (251h52m26.676868618s) [noise=true , address=79.127.219.51:4205 , piece_id=OBW3ZAQE25CKKJF6E3JQ76CAKS35L6GRVNZ6CQZAXMFWA6RIC6NQ, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.019064917 (251h52m26.750332567s) [noise=true , address=45.91.116.6:4988 , piece_id=LIXV5NLQJCOI6YPSRKJVHKM6HXGESZODCFSVLQWELWOLDSAQGUAA, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.030693834 (251h52m26.761961484s) [noise=true , address=77.90.31.19:4862 , piece_id=ZOZTQMXHBIGCJKOHCVTSEQJH5XDGS7CVHFJXYH7MIQEUDNYFLZZQ, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.031047147 (251h52m26.762314798s) [noise=true , address=45.91.116.9:4271 , piece_id=VVRPQ3ZKOEX4ANJFO2DGOYJD5SGCDECP7OH2ZTOI7VJ3KRRQ5JJA, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.032353223 (251h52m26.763620873s) [noise=true , address=77.90.31.17:4796 , piece_id=GTUBHDLN56RTXMF3JDA4CBE2PFNUNDQODUZ7PHFY3BH2RRNOPBSA, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.033056985 (251h52m26.764324635s) [noise=true , address=77.90.31.11:4561 , piece_id=A4YHL3TXQKVEXWL4IN6IM3HDPJWRTQ2OCGRMUK7GRGX4DQ7ZCNUQ, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.033135343 (251h52m26.764402993s) [noise=true , address=77.90.31.15:4714 , piece_id=AIFPKUXL4OW3FMGFKQZH22Q3TFD6HI7MCMGQAYT5FOA2HPEVVI2Q, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.041772277 (251h52m26.773039926s) [noise=true , address=77.90.31.14:4687 , piece_id=2YYS4OPFWGEK62N42P22S7Q5K5DYDMLYYU5Z5NKCO4MJ6PL3NQ5Q, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.042572200 (251h52m26.77383986s) [noise=true , address=45.91.116.4:4970 , piece_id=GCRF42CNAEML3QDKVLE3GWUIMEQ2ZBG7LM5FA4UR3DRCVAGXD4MQ, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.044576828 (251h52m26.775844487s) [noise=true , address=104.36.82.60:4339 , piece_id=BXBAVZZ4NILTU2G3Y2THA7YHFNYHYP3C2TAG6XEWLL25F4RK657Q, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.057100085 (251h52m26.788367735s) [noise=true , address=104.36.82.23:4476 , piece_id=PQJIUPB6MWNXM6BD3IF6BZYQCERCBWJ6Q3AMRJKXCQAGLLHSEAOA, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.058633368 (251h52m26.789901017s) [noise=true , address=104.36.82.44:4888 , piece_id=UDJDNGE2I3K4CME5JEKQMBTFIPJWM67WJDMZQMNTTNGMK5ZYKK4A, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.058668493 (251h52m26.789936144s) [seg_pos={0 0}, upload=261964]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:18:46.058836578 (251h52m26.790104229s) [noise=true , address=77.90.31.21:4884 , piece_id=YURRGVPDQCJJFKZJOGDTZKCZHYMUWJJA3OYHNQFUE5BJHLTXPFPQ, seg_pos={0 0}, upload=261964]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aqgkDxFY3xZa9s2vq1DdCFFX2725aDicrxfvoYuXPfe4ozkHV): protocol: expected piece hash; context canceled; EOF
Aug 19 05:18:46.058945163 (251h52m26.790212813s) [noise=true , address=79.127.201.215:4356 , piece_id=W4ACVXXL6XPP27HTAOF3S7LUSL2GKA3VJZ35SLWPIV423NE4K7HQ, seg_pos={0 0}, upload=261964]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 19 05:18:46.059098361 (251h52m26.79036602s) [noise=true , address=77.90.31.18:4838 , piece_id=AP7T734AGCYXVKAGGCJ5MG6SMC6K7H7ZGL772K3L6XPTQJRXIMVA, seg_pos={0 0}, upload=261964]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1if7vf1cNTBwAhb6owi6tuGLYqSfa3feWhsvGSevwuwykhz2RY): protocol: expected piece hash; context canceled; EOF
Aug 19 05:18:46.059433802 (251h52m26.790701451s) [noise=true , address=79.127.205.233:4654 , piece_id=5V5ZA3PQ5VEBVJJLVOJRRQZ2CEYMRZGB4WXI7JNCMZ3DPC2WOOKA, seg_pos={0 0}, upload=261964]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jh6NFSjhYdd9w3yCf9a4t8TBH2UGXcN3TjzEJkvf173hGnXY8): protocol: context canceled; context canceled
Aug 19 05:18:46.059504244 (251h52m26.790771894s) [seg_pos={0 0}, upload=261964]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:18:46.059644538 (251h52m26.790912198s) [upload=261964]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:18:46.059654156 (251h52m26.790921816s) [upload=261964]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:18:46.247069599 (251h52m26.978337249s) [upload=261964]: Done uploading segments...
Aug 19 05:18:46.247089045 (251h52m26.978356696s) [upload=261964]: Upload finished. err: <nil>
Duration: 600.282388ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
135.421011ms
FAIL (2025-08-19 05:24:41 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 05:15:42.950619396 (251h49m23.681887026s) [upload=261914]: Starting upload Aug 19 05:15:42.950659280 (251h49m23.68192691s) [upload=261914]: Done starting upload Aug 19 05:15:42.950696701 (251h49m23.68196432s) [upload=261914]: Uploading segments... Aug 19 05:15:42.950723471 (251h49m23.681991101s) [upload=261914]: Got next segment. Inline: true Aug 19 05:15:42.950727057 (251h49m23.681994677s) [upload=261914]: Waiting for error group managing segments... Aug 19 05:15:42.950754749 (251h49m23.682022369s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 05:15:42.950758136 (251h49m23.682025755s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 05:15:42.950760279 (251h49m23.682027909s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 05:15:42.953451979 (251h49m23.684719599s) [upload=261914]: Done uploading segments... Aug 19 05:15:42.953459052 (251h49m23.684726672s) [upload=261914]: Upload finished. err: metaclient: Too Many Requests
Duration: 135.44719ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....X..............................................X.......] duration:
516.394817ms
FAIL (2025-08-19 05:24:12 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 19 05:18:45.789559792 (251h52m26.520827441s) [upload=261964]: Starting upload
Aug 19 05:18:45.789620084 (251h52m26.520887745s) [upload=261964]: Done starting upload
Aug 19 05:18:45.789757363 (251h52m26.521025023s) [upload=261964]: Uploading segments...
Aug 19 05:18:45.790009878 (251h52m26.521277527s) [upload=261964]: Got next segment. Inline: false
Aug 19 05:18:45.790064680 (251h52m26.521332331s) [upload=261964]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 05:18:45.790070992 (251h52m26.521338642s) [upload=261964]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:18:45.815063657 (251h52m26.546331327s) [seg_pos={0 0}, upload=261964]: Begin upload segment...
Aug 19 05:18:45.815120123 (251h52m26.546387783s) [seg_pos={0 0}, upload=261964]: Done begin upload segment.
Aug 19 05:18:45.815135172 (251h52m26.546402822s) [noise=true , address=79.127.205.233:4654 , piece_id=5V5ZA3PQ5VEBVJJLVOJRRQZ2CEYMRZGB4WXI7JNCMZ3DPC2WOOKA, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.815147224 (251h52m26.546414875s) [noise=true , address=77.90.31.19:4862 , piece_id=ZOZTQMXHBIGCJKOHCVTSEQJH5XDGS7CVHFJXYH7MIQEUDNYFLZZQ, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.815251620 (251h52m26.546519271s) [noise=true , address=104.36.82.60:4339 , piece_id=BXBAVZZ4NILTU2G3Y2THA7YHFNYHYP3C2TAG6XEWLL25F4RK657Q, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.815718588 (251h52m26.546986238s) [noise=true , address=77.90.31.11:4561 , piece_id=A4YHL3TXQKVEXWL4IN6IM3HDPJWRTQ2OCGRMUK7GRGX4DQ7ZCNUQ, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.816298257 (251h52m26.547565918s) [noise=true , address=79.127.201.215:4356 , piece_id=W4ACVXXL6XPP27HTAOF3S7LUSL2GKA3VJZ35SLWPIV423NE4K7HQ, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.816860774 (251h52m26.548128424s) [noise=true , address=77.90.31.15:4714 , piece_id=AIFPKUXL4OW3FMGFKQZH22Q3TFD6HI7MCMGQAYT5FOA2HPEVVI2Q, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.817508322 (251h52m26.548776032s) [noise=true , address=104.36.82.23:4476 , piece_id=PQJIUPB6MWNXM6BD3IF6BZYQCERCBWJ6Q3AMRJKXCQAGLLHSEAOA, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.818079004 (251h52m26.549346654s) [noise=true , address=45.91.116.6:4988 , piece_id=LIXV5NLQJCOI6YPSRKJVHKM6HXGESZODCFSVLQWELWOLDSAQGUAA, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.818501528 (251h52m26.549769179s) [noise=true , address=79.127.219.51:4205 , piece_id=OBW3ZAQE25CKKJF6E3JQ76CAKS35L6GRVNZ6CQZAXMFWA6RIC6NQ, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.819038087 (251h52m26.550305747s) [noise=true , address=104.36.82.44:4888 , piece_id=UDJDNGE2I3K4CME5JEKQMBTFIPJWM67WJDMZQMNTTNGMK5ZYKK4A, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.819510014 (251h52m26.550777664s) [noise=true , address=79.127.219.48:4085 , piece_id=FGJO2ZTYAN4WR4ZMZXU2SALJNLYL3Y4WPVBRYLT3NMLWHMS7FLWQ, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.820065197 (251h52m26.551332857s) [noise=true , address=77.90.31.14:4687 , piece_id=2YYS4OPFWGEK62N42P22S7Q5K5DYDMLYYU5Z5NKCO4MJ6PL3NQ5Q, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.820553455 (251h52m26.551821115s) [noise=true , address=77.90.31.17:4796 , piece_id=GTUBHDLN56RTXMF3JDA4CBE2PFNUNDQODUZ7PHFY3BH2RRNOPBSA, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.821108177 (251h52m26.552375838s) [noise=true , address=45.91.116.4:4970 , piece_id=GCRF42CNAEML3QDKVLE3GWUIMEQ2ZBG7LM5FA4UR3DRCVAGXD4MQ, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.821675584 (251h52m26.552943244s) [noise=true , address=77.90.31.21:4884 , piece_id=YURRGVPDQCJJFKZJOGDTZKCZHYMUWJJA3OYHNQFUE5BJHLTXPFPQ, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.822228784 (251h52m26.553496434s) [noise=true , address=45.91.116.9:4271 , piece_id=VVRPQ3ZKOEX4ANJFO2DGOYJD5SGCDECP7OH2ZTOI7VJ3KRRQ5JJA, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.823577548 (251h52m26.554845199s) [noise=true , address=79.127.219.47:4062 , piece_id=T5XXU7QTR7V6XKBDSN3LBNQXGMBQFPY72VECY7PK7XWIXOXJRVSA, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.824835683 (251h52m26.556103333s) [noise=true , address=77.90.31.18:4838 , piece_id=AP7T734AGCYXVKAGGCJ5MG6SMC6K7H7ZGL772K3L6XPTQJRXIMVA, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.934772154 (251h52m26.666039805s) [upload=261964]: Next returned nil segment
Aug 19 05:18:45.934786632 (251h52m26.666054282s) [upload=261964]: Waiting for error group managing segments...
Aug 19 05:18:45.943751541 (251h52m26.675019192s) [noise=true , address=79.127.219.47:4062 , piece_id=T5XXU7QTR7V6XKBDSN3LBNQXGMBQFPY72VECY7PK7XWIXOXJRVSA, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:45.944650221 (251h52m26.675917871s) [noise=true , address=79.127.219.48:4085 , piece_id=FGJO2ZTYAN4WR4ZMZXU2SALJNLYL3Y4WPVBRYLT3NMLWHMS7FLWQ, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:45.945600968 (251h52m26.676868618s) [noise=true , address=79.127.219.51:4205 , piece_id=OBW3ZAQE25CKKJF6E3JQ76CAKS35L6GRVNZ6CQZAXMFWA6RIC6NQ, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.019064917 (251h52m26.750332567s) [noise=true , address=45.91.116.6:4988 , piece_id=LIXV5NLQJCOI6YPSRKJVHKM6HXGESZODCFSVLQWELWOLDSAQGUAA, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.030693834 (251h52m26.761961484s) [noise=true , address=77.90.31.19:4862 , piece_id=ZOZTQMXHBIGCJKOHCVTSEQJH5XDGS7CVHFJXYH7MIQEUDNYFLZZQ, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.031047147 (251h52m26.762314798s) [noise=true , address=45.91.116.9:4271 , piece_id=VVRPQ3ZKOEX4ANJFO2DGOYJD5SGCDECP7OH2ZTOI7VJ3KRRQ5JJA, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.032353223 (251h52m26.763620873s) [noise=true , address=77.90.31.17:4796 , piece_id=GTUBHDLN56RTXMF3JDA4CBE2PFNUNDQODUZ7PHFY3BH2RRNOPBSA, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.033056985 (251h52m26.764324635s) [noise=true , address=77.90.31.11:4561 , piece_id=A4YHL3TXQKVEXWL4IN6IM3HDPJWRTQ2OCGRMUK7GRGX4DQ7ZCNUQ, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.033135343 (251h52m26.764402993s) [noise=true , address=77.90.31.15:4714 , piece_id=AIFPKUXL4OW3FMGFKQZH22Q3TFD6HI7MCMGQAYT5FOA2HPEVVI2Q, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.041772277 (251h52m26.773039926s) [noise=true , address=77.90.31.14:4687 , piece_id=2YYS4OPFWGEK62N42P22S7Q5K5DYDMLYYU5Z5NKCO4MJ6PL3NQ5Q, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.042572200 (251h52m26.77383986s) [noise=true , address=45.91.116.4:4970 , piece_id=GCRF42CNAEML3QDKVLE3GWUIMEQ2ZBG7LM5FA4UR3DRCVAGXD4MQ, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.044576828 (251h52m26.775844487s) [noise=true , address=104.36.82.60:4339 , piece_id=BXBAVZZ4NILTU2G3Y2THA7YHFNYHYP3C2TAG6XEWLL25F4RK657Q, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.057100085 (251h52m26.788367735s) [noise=true , address=104.36.82.23:4476 , piece_id=PQJIUPB6MWNXM6BD3IF6BZYQCERCBWJ6Q3AMRJKXCQAGLLHSEAOA, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.058633368 (251h52m26.789901017s) [noise=true , address=104.36.82.44:4888 , piece_id=UDJDNGE2I3K4CME5JEKQMBTFIPJWM67WJDMZQMNTTNGMK5ZYKK4A, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.058668493 (251h52m26.789936144s) [seg_pos={0 0}, upload=261964]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:18:46.058836578 (251h52m26.790104229s) [noise=true , address=77.90.31.21:4884 , piece_id=YURRGVPDQCJJFKZJOGDTZKCZHYMUWJJA3OYHNQFUE5BJHLTXPFPQ, seg_pos={0 0}, upload=261964]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aqgkDxFY3xZa9s2vq1DdCFFX2725aDicrxfvoYuXPfe4ozkHV): protocol: expected piece hash; context canceled; EOF
Aug 19 05:18:46.058945163 (251h52m26.790212813s) [noise=true , address=79.127.201.215:4356 , piece_id=W4ACVXXL6XPP27HTAOF3S7LUSL2GKA3VJZ35SLWPIV423NE4K7HQ, seg_pos={0 0}, upload=261964]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 19 05:18:46.059098361 (251h52m26.79036602s) [noise=true , address=77.90.31.18:4838 , piece_id=AP7T734AGCYXVKAGGCJ5MG6SMC6K7H7ZGL772K3L6XPTQJRXIMVA, seg_pos={0 0}, upload=261964]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1if7vf1cNTBwAhb6owi6tuGLYqSfa3feWhsvGSevwuwykhz2RY): protocol: expected piece hash; context canceled; EOF
Aug 19 05:18:46.059433802 (251h52m26.790701451s) [noise=true , address=79.127.205.233:4654 , piece_id=5V5ZA3PQ5VEBVJJLVOJRRQZ2CEYMRZGB4WXI7JNCMZ3DPC2WOOKA, seg_pos={0 0}, upload=261964]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jh6NFSjhYdd9w3yCf9a4t8TBH2UGXcN3TjzEJkvf173hGnXY8): protocol: context canceled; context canceled
Aug 19 05:18:46.059504244 (251h52m26.790771894s) [seg_pos={0 0}, upload=261964]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:18:46.059644538 (251h52m26.790912198s) [upload=261964]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:18:46.059654156 (251h52m26.790921816s) [upload=261964]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:18:46.247069599 (251h52m26.978337249s) [upload=261964]: Done uploading segments...
Aug 19 05:18:46.247089045 (251h52m26.978356696s) [upload=261964]: Upload finished. err: <nil>
Duration: 516.418783ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
132.080734ms
FAIL (2025-08-19 05:23:38 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 05:15:42.950619396 (251h49m23.681887026s) [upload=261914]: Starting upload Aug 19 05:15:42.950659280 (251h49m23.68192691s) [upload=261914]: Done starting upload Aug 19 05:15:42.950696701 (251h49m23.68196432s) [upload=261914]: Uploading segments... Aug 19 05:15:42.950723471 (251h49m23.681991101s) [upload=261914]: Got next segment. Inline: true Aug 19 05:15:42.950727057 (251h49m23.681994677s) [upload=261914]: Waiting for error group managing segments... Aug 19 05:15:42.950754749 (251h49m23.682022369s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 05:15:42.950758136 (251h49m23.682025755s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 05:15:42.950760279 (251h49m23.682027909s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 05:15:42.953451979 (251h49m23.684719599s) [upload=261914]: Done uploading segments... Aug 19 05:15:42.953459052 (251h49m23.684726672s) [upload=261914]: Upload finished. err: metaclient: Too Many Requests
Duration: 132.096334ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......X..............................................X......] duration:
528.287821ms
FAIL (2025-08-19 05:23:09 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 19 05:18:45.789559792 (251h52m26.520827441s) [upload=261964]: Starting upload
Aug 19 05:18:45.789620084 (251h52m26.520887745s) [upload=261964]: Done starting upload
Aug 19 05:18:45.789757363 (251h52m26.521025023s) [upload=261964]: Uploading segments...
Aug 19 05:18:45.790009878 (251h52m26.521277527s) [upload=261964]: Got next segment. Inline: false
Aug 19 05:18:45.790064680 (251h52m26.521332331s) [upload=261964]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 05:18:45.790070992 (251h52m26.521338642s) [upload=261964]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:18:45.815063657 (251h52m26.546331327s) [seg_pos={0 0}, upload=261964]: Begin upload segment...
Aug 19 05:18:45.815120123 (251h52m26.546387783s) [seg_pos={0 0}, upload=261964]: Done begin upload segment.
Aug 19 05:18:45.815135172 (251h52m26.546402822s) [noise=true , address=79.127.205.233:4654 , piece_id=5V5ZA3PQ5VEBVJJLVOJRRQZ2CEYMRZGB4WXI7JNCMZ3DPC2WOOKA, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.815147224 (251h52m26.546414875s) [noise=true , address=77.90.31.19:4862 , piece_id=ZOZTQMXHBIGCJKOHCVTSEQJH5XDGS7CVHFJXYH7MIQEUDNYFLZZQ, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.815251620 (251h52m26.546519271s) [noise=true , address=104.36.82.60:4339 , piece_id=BXBAVZZ4NILTU2G3Y2THA7YHFNYHYP3C2TAG6XEWLL25F4RK657Q, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.815718588 (251h52m26.546986238s) [noise=true , address=77.90.31.11:4561 , piece_id=A4YHL3TXQKVEXWL4IN6IM3HDPJWRTQ2OCGRMUK7GRGX4DQ7ZCNUQ, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.816298257 (251h52m26.547565918s) [noise=true , address=79.127.201.215:4356 , piece_id=W4ACVXXL6XPP27HTAOF3S7LUSL2GKA3VJZ35SLWPIV423NE4K7HQ, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.816860774 (251h52m26.548128424s) [noise=true , address=77.90.31.15:4714 , piece_id=AIFPKUXL4OW3FMGFKQZH22Q3TFD6HI7MCMGQAYT5FOA2HPEVVI2Q, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.817508322 (251h52m26.548776032s) [noise=true , address=104.36.82.23:4476 , piece_id=PQJIUPB6MWNXM6BD3IF6BZYQCERCBWJ6Q3AMRJKXCQAGLLHSEAOA, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.818079004 (251h52m26.549346654s) [noise=true , address=45.91.116.6:4988 , piece_id=LIXV5NLQJCOI6YPSRKJVHKM6HXGESZODCFSVLQWELWOLDSAQGUAA, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.818501528 (251h52m26.549769179s) [noise=true , address=79.127.219.51:4205 , piece_id=OBW3ZAQE25CKKJF6E3JQ76CAKS35L6GRVNZ6CQZAXMFWA6RIC6NQ, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.819038087 (251h52m26.550305747s) [noise=true , address=104.36.82.44:4888 , piece_id=UDJDNGE2I3K4CME5JEKQMBTFIPJWM67WJDMZQMNTTNGMK5ZYKK4A, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.819510014 (251h52m26.550777664s) [noise=true , address=79.127.219.48:4085 , piece_id=FGJO2ZTYAN4WR4ZMZXU2SALJNLYL3Y4WPVBRYLT3NMLWHMS7FLWQ, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.820065197 (251h52m26.551332857s) [noise=true , address=77.90.31.14:4687 , piece_id=2YYS4OPFWGEK62N42P22S7Q5K5DYDMLYYU5Z5NKCO4MJ6PL3NQ5Q, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.820553455 (251h52m26.551821115s) [noise=true , address=77.90.31.17:4796 , piece_id=GTUBHDLN56RTXMF3JDA4CBE2PFNUNDQODUZ7PHFY3BH2RRNOPBSA, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.821108177 (251h52m26.552375838s) [noise=true , address=45.91.116.4:4970 , piece_id=GCRF42CNAEML3QDKVLE3GWUIMEQ2ZBG7LM5FA4UR3DRCVAGXD4MQ, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.821675584 (251h52m26.552943244s) [noise=true , address=77.90.31.21:4884 , piece_id=YURRGVPDQCJJFKZJOGDTZKCZHYMUWJJA3OYHNQFUE5BJHLTXPFPQ, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.822228784 (251h52m26.553496434s) [noise=true , address=45.91.116.9:4271 , piece_id=VVRPQ3ZKOEX4ANJFO2DGOYJD5SGCDECP7OH2ZTOI7VJ3KRRQ5JJA, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.823577548 (251h52m26.554845199s) [noise=true , address=79.127.219.47:4062 , piece_id=T5XXU7QTR7V6XKBDSN3LBNQXGMBQFPY72VECY7PK7XWIXOXJRVSA, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.824835683 (251h52m26.556103333s) [noise=true , address=77.90.31.18:4838 , piece_id=AP7T734AGCYXVKAGGCJ5MG6SMC6K7H7ZGL772K3L6XPTQJRXIMVA, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.934772154 (251h52m26.666039805s) [upload=261964]: Next returned nil segment
Aug 19 05:18:45.934786632 (251h52m26.666054282s) [upload=261964]: Waiting for error group managing segments...
Aug 19 05:18:45.943751541 (251h52m26.675019192s) [noise=true , address=79.127.219.47:4062 , piece_id=T5XXU7QTR7V6XKBDSN3LBNQXGMBQFPY72VECY7PK7XWIXOXJRVSA, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:45.944650221 (251h52m26.675917871s) [noise=true , address=79.127.219.48:4085 , piece_id=FGJO2ZTYAN4WR4ZMZXU2SALJNLYL3Y4WPVBRYLT3NMLWHMS7FLWQ, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:45.945600968 (251h52m26.676868618s) [noise=true , address=79.127.219.51:4205 , piece_id=OBW3ZAQE25CKKJF6E3JQ76CAKS35L6GRVNZ6CQZAXMFWA6RIC6NQ, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.019064917 (251h52m26.750332567s) [noise=true , address=45.91.116.6:4988 , piece_id=LIXV5NLQJCOI6YPSRKJVHKM6HXGESZODCFSVLQWELWOLDSAQGUAA, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.030693834 (251h52m26.761961484s) [noise=true , address=77.90.31.19:4862 , piece_id=ZOZTQMXHBIGCJKOHCVTSEQJH5XDGS7CVHFJXYH7MIQEUDNYFLZZQ, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.031047147 (251h52m26.762314798s) [noise=true , address=45.91.116.9:4271 , piece_id=VVRPQ3ZKOEX4ANJFO2DGOYJD5SGCDECP7OH2ZTOI7VJ3KRRQ5JJA, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.032353223 (251h52m26.763620873s) [noise=true , address=77.90.31.17:4796 , piece_id=GTUBHDLN56RTXMF3JDA4CBE2PFNUNDQODUZ7PHFY3BH2RRNOPBSA, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.033056985 (251h52m26.764324635s) [noise=true , address=77.90.31.11:4561 , piece_id=A4YHL3TXQKVEXWL4IN6IM3HDPJWRTQ2OCGRMUK7GRGX4DQ7ZCNUQ, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.033135343 (251h52m26.764402993s) [noise=true , address=77.90.31.15:4714 , piece_id=AIFPKUXL4OW3FMGFKQZH22Q3TFD6HI7MCMGQAYT5FOA2HPEVVI2Q, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.041772277 (251h52m26.773039926s) [noise=true , address=77.90.31.14:4687 , piece_id=2YYS4OPFWGEK62N42P22S7Q5K5DYDMLYYU5Z5NKCO4MJ6PL3NQ5Q, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.042572200 (251h52m26.77383986s) [noise=true , address=45.91.116.4:4970 , piece_id=GCRF42CNAEML3QDKVLE3GWUIMEQ2ZBG7LM5FA4UR3DRCVAGXD4MQ, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.044576828 (251h52m26.775844487s) [noise=true , address=104.36.82.60:4339 , piece_id=BXBAVZZ4NILTU2G3Y2THA7YHFNYHYP3C2TAG6XEWLL25F4RK657Q, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.057100085 (251h52m26.788367735s) [noise=true , address=104.36.82.23:4476 , piece_id=PQJIUPB6MWNXM6BD3IF6BZYQCERCBWJ6Q3AMRJKXCQAGLLHSEAOA, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.058633368 (251h52m26.789901017s) [noise=true , address=104.36.82.44:4888 , piece_id=UDJDNGE2I3K4CME5JEKQMBTFIPJWM67WJDMZQMNTTNGMK5ZYKK4A, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.058668493 (251h52m26.789936144s) [seg_pos={0 0}, upload=261964]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:18:46.058836578 (251h52m26.790104229s) [noise=true , address=77.90.31.21:4884 , piece_id=YURRGVPDQCJJFKZJOGDTZKCZHYMUWJJA3OYHNQFUE5BJHLTXPFPQ, seg_pos={0 0}, upload=261964]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aqgkDxFY3xZa9s2vq1DdCFFX2725aDicrxfvoYuXPfe4ozkHV): protocol: expected piece hash; context canceled; EOF
Aug 19 05:18:46.058945163 (251h52m26.790212813s) [noise=true , address=79.127.201.215:4356 , piece_id=W4ACVXXL6XPP27HTAOF3S7LUSL2GKA3VJZ35SLWPIV423NE4K7HQ, seg_pos={0 0}, upload=261964]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 19 05:18:46.059098361 (251h52m26.79036602s) [noise=true , address=77.90.31.18:4838 , piece_id=AP7T734AGCYXVKAGGCJ5MG6SMC6K7H7ZGL772K3L6XPTQJRXIMVA, seg_pos={0 0}, upload=261964]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1if7vf1cNTBwAhb6owi6tuGLYqSfa3feWhsvGSevwuwykhz2RY): protocol: expected piece hash; context canceled; EOF
Aug 19 05:18:46.059433802 (251h52m26.790701451s) [noise=true , address=79.127.205.233:4654 , piece_id=5V5ZA3PQ5VEBVJJLVOJRRQZ2CEYMRZGB4WXI7JNCMZ3DPC2WOOKA, seg_pos={0 0}, upload=261964]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jh6NFSjhYdd9w3yCf9a4t8TBH2UGXcN3TjzEJkvf173hGnXY8): protocol: context canceled; context canceled
Aug 19 05:18:46.059504244 (251h52m26.790771894s) [seg_pos={0 0}, upload=261964]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:18:46.059644538 (251h52m26.790912198s) [upload=261964]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:18:46.059654156 (251h52m26.790921816s) [upload=261964]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:18:46.247069599 (251h52m26.978337249s) [upload=261964]: Done uploading segments...
Aug 19 05:18:46.247089045 (251h52m26.978356696s) [upload=261964]: Upload finished. err: <nil>
Duration: 528.310053ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
133.15917ms
FAIL (2025-08-19 05:22:34 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 05:15:42.950619396 (251h49m23.681887026s) [upload=261914]: Starting upload Aug 19 05:15:42.950659280 (251h49m23.68192691s) [upload=261914]: Done starting upload Aug 19 05:15:42.950696701 (251h49m23.68196432s) [upload=261914]: Uploading segments... Aug 19 05:15:42.950723471 (251h49m23.681991101s) [upload=261914]: Got next segment. Inline: true Aug 19 05:15:42.950727057 (251h49m23.681994677s) [upload=261914]: Waiting for error group managing segments... Aug 19 05:15:42.950754749 (251h49m23.682022369s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 05:15:42.950758136 (251h49m23.682025755s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 05:15:42.950760279 (251h49m23.682027909s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 05:15:42.953451979 (251h49m23.684719599s) [upload=261914]: Done uploading segments... Aug 19 05:15:42.953459052 (251h49m23.684726672s) [upload=261914]: Upload finished. err: metaclient: Too Many Requests
Duration: 133.231906ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......X..............................................X.....] duration:
1.071238882s
FAIL (2025-08-19 05:22:14 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 19 05:18:45.789559792 (251h52m26.520827441s) [upload=261964]: Starting upload
Aug 19 05:18:45.789620084 (251h52m26.520887745s) [upload=261964]: Done starting upload
Aug 19 05:18:45.789757363 (251h52m26.521025023s) [upload=261964]: Uploading segments...
Aug 19 05:18:45.790009878 (251h52m26.521277527s) [upload=261964]: Got next segment. Inline: false
Aug 19 05:18:45.790064680 (251h52m26.521332331s) [upload=261964]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 05:18:45.790070992 (251h52m26.521338642s) [upload=261964]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:18:45.815063657 (251h52m26.546331327s) [seg_pos={0 0}, upload=261964]: Begin upload segment...
Aug 19 05:18:45.815120123 (251h52m26.546387783s) [seg_pos={0 0}, upload=261964]: Done begin upload segment.
Aug 19 05:18:45.815135172 (251h52m26.546402822s) [noise=true , address=79.127.205.233:4654 , piece_id=5V5ZA3PQ5VEBVJJLVOJRRQZ2CEYMRZGB4WXI7JNCMZ3DPC2WOOKA, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.815147224 (251h52m26.546414875s) [noise=true , address=77.90.31.19:4862 , piece_id=ZOZTQMXHBIGCJKOHCVTSEQJH5XDGS7CVHFJXYH7MIQEUDNYFLZZQ, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.815251620 (251h52m26.546519271s) [noise=true , address=104.36.82.60:4339 , piece_id=BXBAVZZ4NILTU2G3Y2THA7YHFNYHYP3C2TAG6XEWLL25F4RK657Q, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.815718588 (251h52m26.546986238s) [noise=true , address=77.90.31.11:4561 , piece_id=A4YHL3TXQKVEXWL4IN6IM3HDPJWRTQ2OCGRMUK7GRGX4DQ7ZCNUQ, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.816298257 (251h52m26.547565918s) [noise=true , address=79.127.201.215:4356 , piece_id=W4ACVXXL6XPP27HTAOF3S7LUSL2GKA3VJZ35SLWPIV423NE4K7HQ, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.816860774 (251h52m26.548128424s) [noise=true , address=77.90.31.15:4714 , piece_id=AIFPKUXL4OW3FMGFKQZH22Q3TFD6HI7MCMGQAYT5FOA2HPEVVI2Q, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.817508322 (251h52m26.548776032s) [noise=true , address=104.36.82.23:4476 , piece_id=PQJIUPB6MWNXM6BD3IF6BZYQCERCBWJ6Q3AMRJKXCQAGLLHSEAOA, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.818079004 (251h52m26.549346654s) [noise=true , address=45.91.116.6:4988 , piece_id=LIXV5NLQJCOI6YPSRKJVHKM6HXGESZODCFSVLQWELWOLDSAQGUAA, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.818501528 (251h52m26.549769179s) [noise=true , address=79.127.219.51:4205 , piece_id=OBW3ZAQE25CKKJF6E3JQ76CAKS35L6GRVNZ6CQZAXMFWA6RIC6NQ, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.819038087 (251h52m26.550305747s) [noise=true , address=104.36.82.44:4888 , piece_id=UDJDNGE2I3K4CME5JEKQMBTFIPJWM67WJDMZQMNTTNGMK5ZYKK4A, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.819510014 (251h52m26.550777664s) [noise=true , address=79.127.219.48:4085 , piece_id=FGJO2ZTYAN4WR4ZMZXU2SALJNLYL3Y4WPVBRYLT3NMLWHMS7FLWQ, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.820065197 (251h52m26.551332857s) [noise=true , address=77.90.31.14:4687 , piece_id=2YYS4OPFWGEK62N42P22S7Q5K5DYDMLYYU5Z5NKCO4MJ6PL3NQ5Q, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.820553455 (251h52m26.551821115s) [noise=true , address=77.90.31.17:4796 , piece_id=GTUBHDLN56RTXMF3JDA4CBE2PFNUNDQODUZ7PHFY3BH2RRNOPBSA, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.821108177 (251h52m26.552375838s) [noise=true , address=45.91.116.4:4970 , piece_id=GCRF42CNAEML3QDKVLE3GWUIMEQ2ZBG7LM5FA4UR3DRCVAGXD4MQ, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.821675584 (251h52m26.552943244s) [noise=true , address=77.90.31.21:4884 , piece_id=YURRGVPDQCJJFKZJOGDTZKCZHYMUWJJA3OYHNQFUE5BJHLTXPFPQ, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.822228784 (251h52m26.553496434s) [noise=true , address=45.91.116.9:4271 , piece_id=VVRPQ3ZKOEX4ANJFO2DGOYJD5SGCDECP7OH2ZTOI7VJ3KRRQ5JJA, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.823577548 (251h52m26.554845199s) [noise=true , address=79.127.219.47:4062 , piece_id=T5XXU7QTR7V6XKBDSN3LBNQXGMBQFPY72VECY7PK7XWIXOXJRVSA, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.824835683 (251h52m26.556103333s) [noise=true , address=77.90.31.18:4838 , piece_id=AP7T734AGCYXVKAGGCJ5MG6SMC6K7H7ZGL772K3L6XPTQJRXIMVA, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.934772154 (251h52m26.666039805s) [upload=261964]: Next returned nil segment
Aug 19 05:18:45.934786632 (251h52m26.666054282s) [upload=261964]: Waiting for error group managing segments...
Aug 19 05:18:45.943751541 (251h52m26.675019192s) [noise=true , address=79.127.219.47:4062 , piece_id=T5XXU7QTR7V6XKBDSN3LBNQXGMBQFPY72VECY7PK7XWIXOXJRVSA, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:45.944650221 (251h52m26.675917871s) [noise=true , address=79.127.219.48:4085 , piece_id=FGJO2ZTYAN4WR4ZMZXU2SALJNLYL3Y4WPVBRYLT3NMLWHMS7FLWQ, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:45.945600968 (251h52m26.676868618s) [noise=true , address=79.127.219.51:4205 , piece_id=OBW3ZAQE25CKKJF6E3JQ76CAKS35L6GRVNZ6CQZAXMFWA6RIC6NQ, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.019064917 (251h52m26.750332567s) [noise=true , address=45.91.116.6:4988 , piece_id=LIXV5NLQJCOI6YPSRKJVHKM6HXGESZODCFSVLQWELWOLDSAQGUAA, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.030693834 (251h52m26.761961484s) [noise=true , address=77.90.31.19:4862 , piece_id=ZOZTQMXHBIGCJKOHCVTSEQJH5XDGS7CVHFJXYH7MIQEUDNYFLZZQ, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.031047147 (251h52m26.762314798s) [noise=true , address=45.91.116.9:4271 , piece_id=VVRPQ3ZKOEX4ANJFO2DGOYJD5SGCDECP7OH2ZTOI7VJ3KRRQ5JJA, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.032353223 (251h52m26.763620873s) [noise=true , address=77.90.31.17:4796 , piece_id=GTUBHDLN56RTXMF3JDA4CBE2PFNUNDQODUZ7PHFY3BH2RRNOPBSA, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.033056985 (251h52m26.764324635s) [noise=true , address=77.90.31.11:4561 , piece_id=A4YHL3TXQKVEXWL4IN6IM3HDPJWRTQ2OCGRMUK7GRGX4DQ7ZCNUQ, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.033135343 (251h52m26.764402993s) [noise=true , address=77.90.31.15:4714 , piece_id=AIFPKUXL4OW3FMGFKQZH22Q3TFD6HI7MCMGQAYT5FOA2HPEVVI2Q, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.041772277 (251h52m26.773039926s) [noise=true , address=77.90.31.14:4687 , piece_id=2YYS4OPFWGEK62N42P22S7Q5K5DYDMLYYU5Z5NKCO4MJ6PL3NQ5Q, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.042572200 (251h52m26.77383986s) [noise=true , address=45.91.116.4:4970 , piece_id=GCRF42CNAEML3QDKVLE3GWUIMEQ2ZBG7LM5FA4UR3DRCVAGXD4MQ, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.044576828 (251h52m26.775844487s) [noise=true , address=104.36.82.60:4339 , piece_id=BXBAVZZ4NILTU2G3Y2THA7YHFNYHYP3C2TAG6XEWLL25F4RK657Q, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.057100085 (251h52m26.788367735s) [noise=true , address=104.36.82.23:4476 , piece_id=PQJIUPB6MWNXM6BD3IF6BZYQCERCBWJ6Q3AMRJKXCQAGLLHSEAOA, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.058633368 (251h52m26.789901017s) [noise=true , address=104.36.82.44:4888 , piece_id=UDJDNGE2I3K4CME5JEKQMBTFIPJWM67WJDMZQMNTTNGMK5ZYKK4A, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.058668493 (251h52m26.789936144s) [seg_pos={0 0}, upload=261964]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:18:46.058836578 (251h52m26.790104229s) [noise=true , address=77.90.31.21:4884 , piece_id=YURRGVPDQCJJFKZJOGDTZKCZHYMUWJJA3OYHNQFUE5BJHLTXPFPQ, seg_pos={0 0}, upload=261964]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aqgkDxFY3xZa9s2vq1DdCFFX2725aDicrxfvoYuXPfe4ozkHV): protocol: expected piece hash; context canceled; EOF
Aug 19 05:18:46.058945163 (251h52m26.790212813s) [noise=true , address=79.127.201.215:4356 , piece_id=W4ACVXXL6XPP27HTAOF3S7LUSL2GKA3VJZ35SLWPIV423NE4K7HQ, seg_pos={0 0}, upload=261964]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 19 05:18:46.059098361 (251h52m26.79036602s) [noise=true , address=77.90.31.18:4838 , piece_id=AP7T734AGCYXVKAGGCJ5MG6SMC6K7H7ZGL772K3L6XPTQJRXIMVA, seg_pos={0 0}, upload=261964]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1if7vf1cNTBwAhb6owi6tuGLYqSfa3feWhsvGSevwuwykhz2RY): protocol: expected piece hash; context canceled; EOF
Aug 19 05:18:46.059433802 (251h52m26.790701451s) [noise=true , address=79.127.205.233:4654 , piece_id=5V5ZA3PQ5VEBVJJLVOJRRQZ2CEYMRZGB4WXI7JNCMZ3DPC2WOOKA, seg_pos={0 0}, upload=261964]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jh6NFSjhYdd9w3yCf9a4t8TBH2UGXcN3TjzEJkvf173hGnXY8): protocol: context canceled; context canceled
Aug 19 05:18:46.059504244 (251h52m26.790771894s) [seg_pos={0 0}, upload=261964]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:18:46.059644538 (251h52m26.790912198s) [upload=261964]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:18:46.059654156 (251h52m26.790921816s) [upload=261964]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:18:46.247069599 (251h52m26.978337249s) [upload=261964]: Done uploading segments...
Aug 19 05:18:46.247089045 (251h52m26.978356696s) [upload=261964]: Upload finished. err: <nil>
Duration: 1.071262646s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........X..............................................X....] duration:
545.823661ms
FAIL (2025-08-19 05:21:19 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 19 05:18:45.789559792 (251h52m26.520827441s) [upload=261964]: Starting upload
Aug 19 05:18:45.789620084 (251h52m26.520887745s) [upload=261964]: Done starting upload
Aug 19 05:18:45.789757363 (251h52m26.521025023s) [upload=261964]: Uploading segments...
Aug 19 05:18:45.790009878 (251h52m26.521277527s) [upload=261964]: Got next segment. Inline: false
Aug 19 05:18:45.790064680 (251h52m26.521332331s) [upload=261964]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 05:18:45.790070992 (251h52m26.521338642s) [upload=261964]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:18:45.815063657 (251h52m26.546331327s) [seg_pos={0 0}, upload=261964]: Begin upload segment...
Aug 19 05:18:45.815120123 (251h52m26.546387783s) [seg_pos={0 0}, upload=261964]: Done begin upload segment.
Aug 19 05:18:45.815135172 (251h52m26.546402822s) [noise=true , address=79.127.205.233:4654 , piece_id=5V5ZA3PQ5VEBVJJLVOJRRQZ2CEYMRZGB4WXI7JNCMZ3DPC2WOOKA, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.815147224 (251h52m26.546414875s) [noise=true , address=77.90.31.19:4862 , piece_id=ZOZTQMXHBIGCJKOHCVTSEQJH5XDGS7CVHFJXYH7MIQEUDNYFLZZQ, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.815251620 (251h52m26.546519271s) [noise=true , address=104.36.82.60:4339 , piece_id=BXBAVZZ4NILTU2G3Y2THA7YHFNYHYP3C2TAG6XEWLL25F4RK657Q, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.815718588 (251h52m26.546986238s) [noise=true , address=77.90.31.11:4561 , piece_id=A4YHL3TXQKVEXWL4IN6IM3HDPJWRTQ2OCGRMUK7GRGX4DQ7ZCNUQ, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.816298257 (251h52m26.547565918s) [noise=true , address=79.127.201.215:4356 , piece_id=W4ACVXXL6XPP27HTAOF3S7LUSL2GKA3VJZ35SLWPIV423NE4K7HQ, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.816860774 (251h52m26.548128424s) [noise=true , address=77.90.31.15:4714 , piece_id=AIFPKUXL4OW3FMGFKQZH22Q3TFD6HI7MCMGQAYT5FOA2HPEVVI2Q, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.817508322 (251h52m26.548776032s) [noise=true , address=104.36.82.23:4476 , piece_id=PQJIUPB6MWNXM6BD3IF6BZYQCERCBWJ6Q3AMRJKXCQAGLLHSEAOA, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.818079004 (251h52m26.549346654s) [noise=true , address=45.91.116.6:4988 , piece_id=LIXV5NLQJCOI6YPSRKJVHKM6HXGESZODCFSVLQWELWOLDSAQGUAA, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.818501528 (251h52m26.549769179s) [noise=true , address=79.127.219.51:4205 , piece_id=OBW3ZAQE25CKKJF6E3JQ76CAKS35L6GRVNZ6CQZAXMFWA6RIC6NQ, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.819038087 (251h52m26.550305747s) [noise=true , address=104.36.82.44:4888 , piece_id=UDJDNGE2I3K4CME5JEKQMBTFIPJWM67WJDMZQMNTTNGMK5ZYKK4A, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.819510014 (251h52m26.550777664s) [noise=true , address=79.127.219.48:4085 , piece_id=FGJO2ZTYAN4WR4ZMZXU2SALJNLYL3Y4WPVBRYLT3NMLWHMS7FLWQ, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.820065197 (251h52m26.551332857s) [noise=true , address=77.90.31.14:4687 , piece_id=2YYS4OPFWGEK62N42P22S7Q5K5DYDMLYYU5Z5NKCO4MJ6PL3NQ5Q, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.820553455 (251h52m26.551821115s) [noise=true , address=77.90.31.17:4796 , piece_id=GTUBHDLN56RTXMF3JDA4CBE2PFNUNDQODUZ7PHFY3BH2RRNOPBSA, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.821108177 (251h52m26.552375838s) [noise=true , address=45.91.116.4:4970 , piece_id=GCRF42CNAEML3QDKVLE3GWUIMEQ2ZBG7LM5FA4UR3DRCVAGXD4MQ, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.821675584 (251h52m26.552943244s) [noise=true , address=77.90.31.21:4884 , piece_id=YURRGVPDQCJJFKZJOGDTZKCZHYMUWJJA3OYHNQFUE5BJHLTXPFPQ, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.822228784 (251h52m26.553496434s) [noise=true , address=45.91.116.9:4271 , piece_id=VVRPQ3ZKOEX4ANJFO2DGOYJD5SGCDECP7OH2ZTOI7VJ3KRRQ5JJA, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.823577548 (251h52m26.554845199s) [noise=true , address=79.127.219.47:4062 , piece_id=T5XXU7QTR7V6XKBDSN3LBNQXGMBQFPY72VECY7PK7XWIXOXJRVSA, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.824835683 (251h52m26.556103333s) [noise=true , address=77.90.31.18:4838 , piece_id=AP7T734AGCYXVKAGGCJ5MG6SMC6K7H7ZGL772K3L6XPTQJRXIMVA, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.934772154 (251h52m26.666039805s) [upload=261964]: Next returned nil segment
Aug 19 05:18:45.934786632 (251h52m26.666054282s) [upload=261964]: Waiting for error group managing segments...
Aug 19 05:18:45.943751541 (251h52m26.675019192s) [noise=true , address=79.127.219.47:4062 , piece_id=T5XXU7QTR7V6XKBDSN3LBNQXGMBQFPY72VECY7PK7XWIXOXJRVSA, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:45.944650221 (251h52m26.675917871s) [noise=true , address=79.127.219.48:4085 , piece_id=FGJO2ZTYAN4WR4ZMZXU2SALJNLYL3Y4WPVBRYLT3NMLWHMS7FLWQ, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:45.945600968 (251h52m26.676868618s) [noise=true , address=79.127.219.51:4205 , piece_id=OBW3ZAQE25CKKJF6E3JQ76CAKS35L6GRVNZ6CQZAXMFWA6RIC6NQ, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.019064917 (251h52m26.750332567s) [noise=true , address=45.91.116.6:4988 , piece_id=LIXV5NLQJCOI6YPSRKJVHKM6HXGESZODCFSVLQWELWOLDSAQGUAA, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.030693834 (251h52m26.761961484s) [noise=true , address=77.90.31.19:4862 , piece_id=ZOZTQMXHBIGCJKOHCVTSEQJH5XDGS7CVHFJXYH7MIQEUDNYFLZZQ, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.031047147 (251h52m26.762314798s) [noise=true , address=45.91.116.9:4271 , piece_id=VVRPQ3ZKOEX4ANJFO2DGOYJD5SGCDECP7OH2ZTOI7VJ3KRRQ5JJA, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.032353223 (251h52m26.763620873s) [noise=true , address=77.90.31.17:4796 , piece_id=GTUBHDLN56RTXMF3JDA4CBE2PFNUNDQODUZ7PHFY3BH2RRNOPBSA, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.033056985 (251h52m26.764324635s) [noise=true , address=77.90.31.11:4561 , piece_id=A4YHL3TXQKVEXWL4IN6IM3HDPJWRTQ2OCGRMUK7GRGX4DQ7ZCNUQ, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.033135343 (251h52m26.764402993s) [noise=true , address=77.90.31.15:4714 , piece_id=AIFPKUXL4OW3FMGFKQZH22Q3TFD6HI7MCMGQAYT5FOA2HPEVVI2Q, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.041772277 (251h52m26.773039926s) [noise=true , address=77.90.31.14:4687 , piece_id=2YYS4OPFWGEK62N42P22S7Q5K5DYDMLYYU5Z5NKCO4MJ6PL3NQ5Q, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.042572200 (251h52m26.77383986s) [noise=true , address=45.91.116.4:4970 , piece_id=GCRF42CNAEML3QDKVLE3GWUIMEQ2ZBG7LM5FA4UR3DRCVAGXD4MQ, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.044576828 (251h52m26.775844487s) [noise=true , address=104.36.82.60:4339 , piece_id=BXBAVZZ4NILTU2G3Y2THA7YHFNYHYP3C2TAG6XEWLL25F4RK657Q, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.057100085 (251h52m26.788367735s) [noise=true , address=104.36.82.23:4476 , piece_id=PQJIUPB6MWNXM6BD3IF6BZYQCERCBWJ6Q3AMRJKXCQAGLLHSEAOA, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.058633368 (251h52m26.789901017s) [noise=true , address=104.36.82.44:4888 , piece_id=UDJDNGE2I3K4CME5JEKQMBTFIPJWM67WJDMZQMNTTNGMK5ZYKK4A, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.058668493 (251h52m26.789936144s) [seg_pos={0 0}, upload=261964]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:18:46.058836578 (251h52m26.790104229s) [noise=true , address=77.90.31.21:4884 , piece_id=YURRGVPDQCJJFKZJOGDTZKCZHYMUWJJA3OYHNQFUE5BJHLTXPFPQ, seg_pos={0 0}, upload=261964]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aqgkDxFY3xZa9s2vq1DdCFFX2725aDicrxfvoYuXPfe4ozkHV): protocol: expected piece hash; context canceled; EOF
Aug 19 05:18:46.058945163 (251h52m26.790212813s) [noise=true , address=79.127.201.215:4356 , piece_id=W4ACVXXL6XPP27HTAOF3S7LUSL2GKA3VJZ35SLWPIV423NE4K7HQ, seg_pos={0 0}, upload=261964]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 19 05:18:46.059098361 (251h52m26.79036602s) [noise=true , address=77.90.31.18:4838 , piece_id=AP7T734AGCYXVKAGGCJ5MG6SMC6K7H7ZGL772K3L6XPTQJRXIMVA, seg_pos={0 0}, upload=261964]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1if7vf1cNTBwAhb6owi6tuGLYqSfa3feWhsvGSevwuwykhz2RY): protocol: expected piece hash; context canceled; EOF
Aug 19 05:18:46.059433802 (251h52m26.790701451s) [noise=true , address=79.127.205.233:4654 , piece_id=5V5ZA3PQ5VEBVJJLVOJRRQZ2CEYMRZGB4WXI7JNCMZ3DPC2WOOKA, seg_pos={0 0}, upload=261964]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jh6NFSjhYdd9w3yCf9a4t8TBH2UGXcN3TjzEJkvf173hGnXY8): protocol: context canceled; context canceled
Aug 19 05:18:46.059504244 (251h52m26.790771894s) [seg_pos={0 0}, upload=261964]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:18:46.059644538 (251h52m26.790912198s) [upload=261964]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:18:46.059654156 (251h52m26.790921816s) [upload=261964]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:18:46.247069599 (251h52m26.978337249s) [upload=261964]: Done uploading segments...
Aug 19 05:18:46.247089045 (251h52m26.978356696s) [upload=261964]: Upload finished. err: <nil>
Duration: 545.841193ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
143.426798ms
FAIL (2025-08-19 05:21:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 05:15:42.950619396 (251h49m23.681887026s) [upload=261914]: Starting upload Aug 19 05:15:42.950659280 (251h49m23.68192691s) [upload=261914]: Done starting upload Aug 19 05:15:42.950696701 (251h49m23.68196432s) [upload=261914]: Uploading segments... Aug 19 05:15:42.950723471 (251h49m23.681991101s) [upload=261914]: Got next segment. Inline: true Aug 19 05:15:42.950727057 (251h49m23.681994677s) [upload=261914]: Waiting for error group managing segments... Aug 19 05:15:42.950754749 (251h49m23.682022369s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 05:15:42.950758136 (251h49m23.682025755s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 05:15:42.950760279 (251h49m23.682027909s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 05:15:42.953451979 (251h49m23.684719599s) [upload=261914]: Done uploading segments... Aug 19 05:15:42.953459052 (251h49m23.684726672s) [upload=261914]: Upload finished. err: metaclient: Too Many Requests
Duration: 143.452907ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
311.070054ms
FAIL (2025-08-19 05:20:36 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 05:15:42.950619396 (251h49m23.681887026s) [upload=261914]: Starting upload Aug 19 05:15:42.950659280 (251h49m23.68192691s) [upload=261914]: Done starting upload Aug 19 05:15:42.950696701 (251h49m23.68196432s) [upload=261914]: Uploading segments... Aug 19 05:15:42.950723471 (251h49m23.681991101s) [upload=261914]: Got next segment. Inline: true Aug 19 05:15:42.950727057 (251h49m23.681994677s) [upload=261914]: Waiting for error group managing segments... Aug 19 05:15:42.950754749 (251h49m23.682022369s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 05:15:42.950758136 (251h49m23.682025755s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 05:15:42.950760279 (251h49m23.682027909s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 05:15:42.953451979 (251h49m23.684719599s) [upload=261914]: Done uploading segments... Aug 19 05:15:42.953459052 (251h49m23.684726672s) [upload=261914]: Upload finished. err: metaclient: Too Many Requests
Duration: 311.095622ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........X..............................................X...] duration:
565.279921ms
FAIL (2025-08-19 05:20:26 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 19 05:18:45.789559792 (251h52m26.520827441s) [upload=261964]: Starting upload
Aug 19 05:18:45.789620084 (251h52m26.520887745s) [upload=261964]: Done starting upload
Aug 19 05:18:45.789757363 (251h52m26.521025023s) [upload=261964]: Uploading segments...
Aug 19 05:18:45.790009878 (251h52m26.521277527s) [upload=261964]: Got next segment. Inline: false
Aug 19 05:18:45.790064680 (251h52m26.521332331s) [upload=261964]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 05:18:45.790070992 (251h52m26.521338642s) [upload=261964]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:18:45.815063657 (251h52m26.546331327s) [seg_pos={0 0}, upload=261964]: Begin upload segment...
Aug 19 05:18:45.815120123 (251h52m26.546387783s) [seg_pos={0 0}, upload=261964]: Done begin upload segment.
Aug 19 05:18:45.815135172 (251h52m26.546402822s) [noise=true , address=79.127.205.233:4654 , piece_id=5V5ZA3PQ5VEBVJJLVOJRRQZ2CEYMRZGB4WXI7JNCMZ3DPC2WOOKA, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.815147224 (251h52m26.546414875s) [noise=true , address=77.90.31.19:4862 , piece_id=ZOZTQMXHBIGCJKOHCVTSEQJH5XDGS7CVHFJXYH7MIQEUDNYFLZZQ, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.815251620 (251h52m26.546519271s) [noise=true , address=104.36.82.60:4339 , piece_id=BXBAVZZ4NILTU2G3Y2THA7YHFNYHYP3C2TAG6XEWLL25F4RK657Q, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.815718588 (251h52m26.546986238s) [noise=true , address=77.90.31.11:4561 , piece_id=A4YHL3TXQKVEXWL4IN6IM3HDPJWRTQ2OCGRMUK7GRGX4DQ7ZCNUQ, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.816298257 (251h52m26.547565918s) [noise=true , address=79.127.201.215:4356 , piece_id=W4ACVXXL6XPP27HTAOF3S7LUSL2GKA3VJZ35SLWPIV423NE4K7HQ, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.816860774 (251h52m26.548128424s) [noise=true , address=77.90.31.15:4714 , piece_id=AIFPKUXL4OW3FMGFKQZH22Q3TFD6HI7MCMGQAYT5FOA2HPEVVI2Q, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.817508322 (251h52m26.548776032s) [noise=true , address=104.36.82.23:4476 , piece_id=PQJIUPB6MWNXM6BD3IF6BZYQCERCBWJ6Q3AMRJKXCQAGLLHSEAOA, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.818079004 (251h52m26.549346654s) [noise=true , address=45.91.116.6:4988 , piece_id=LIXV5NLQJCOI6YPSRKJVHKM6HXGESZODCFSVLQWELWOLDSAQGUAA, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.818501528 (251h52m26.549769179s) [noise=true , address=79.127.219.51:4205 , piece_id=OBW3ZAQE25CKKJF6E3JQ76CAKS35L6GRVNZ6CQZAXMFWA6RIC6NQ, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.819038087 (251h52m26.550305747s) [noise=true , address=104.36.82.44:4888 , piece_id=UDJDNGE2I3K4CME5JEKQMBTFIPJWM67WJDMZQMNTTNGMK5ZYKK4A, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.819510014 (251h52m26.550777664s) [noise=true , address=79.127.219.48:4085 , piece_id=FGJO2ZTYAN4WR4ZMZXU2SALJNLYL3Y4WPVBRYLT3NMLWHMS7FLWQ, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.820065197 (251h52m26.551332857s) [noise=true , address=77.90.31.14:4687 , piece_id=2YYS4OPFWGEK62N42P22S7Q5K5DYDMLYYU5Z5NKCO4MJ6PL3NQ5Q, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.820553455 (251h52m26.551821115s) [noise=true , address=77.90.31.17:4796 , piece_id=GTUBHDLN56RTXMF3JDA4CBE2PFNUNDQODUZ7PHFY3BH2RRNOPBSA, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.821108177 (251h52m26.552375838s) [noise=true , address=45.91.116.4:4970 , piece_id=GCRF42CNAEML3QDKVLE3GWUIMEQ2ZBG7LM5FA4UR3DRCVAGXD4MQ, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.821675584 (251h52m26.552943244s) [noise=true , address=77.90.31.21:4884 , piece_id=YURRGVPDQCJJFKZJOGDTZKCZHYMUWJJA3OYHNQFUE5BJHLTXPFPQ, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.822228784 (251h52m26.553496434s) [noise=true , address=45.91.116.9:4271 , piece_id=VVRPQ3ZKOEX4ANJFO2DGOYJD5SGCDECP7OH2ZTOI7VJ3KRRQ5JJA, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.823577548 (251h52m26.554845199s) [noise=true , address=79.127.219.47:4062 , piece_id=T5XXU7QTR7V6XKBDSN3LBNQXGMBQFPY72VECY7PK7XWIXOXJRVSA, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.824835683 (251h52m26.556103333s) [noise=true , address=77.90.31.18:4838 , piece_id=AP7T734AGCYXVKAGGCJ5MG6SMC6K7H7ZGL772K3L6XPTQJRXIMVA, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.934772154 (251h52m26.666039805s) [upload=261964]: Next returned nil segment
Aug 19 05:18:45.934786632 (251h52m26.666054282s) [upload=261964]: Waiting for error group managing segments...
Aug 19 05:18:45.943751541 (251h52m26.675019192s) [noise=true , address=79.127.219.47:4062 , piece_id=T5XXU7QTR7V6XKBDSN3LBNQXGMBQFPY72VECY7PK7XWIXOXJRVSA, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:45.944650221 (251h52m26.675917871s) [noise=true , address=79.127.219.48:4085 , piece_id=FGJO2ZTYAN4WR4ZMZXU2SALJNLYL3Y4WPVBRYLT3NMLWHMS7FLWQ, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:45.945600968 (251h52m26.676868618s) [noise=true , address=79.127.219.51:4205 , piece_id=OBW3ZAQE25CKKJF6E3JQ76CAKS35L6GRVNZ6CQZAXMFWA6RIC6NQ, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.019064917 (251h52m26.750332567s) [noise=true , address=45.91.116.6:4988 , piece_id=LIXV5NLQJCOI6YPSRKJVHKM6HXGESZODCFSVLQWELWOLDSAQGUAA, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.030693834 (251h52m26.761961484s) [noise=true , address=77.90.31.19:4862 , piece_id=ZOZTQMXHBIGCJKOHCVTSEQJH5XDGS7CVHFJXYH7MIQEUDNYFLZZQ, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.031047147 (251h52m26.762314798s) [noise=true , address=45.91.116.9:4271 , piece_id=VVRPQ3ZKOEX4ANJFO2DGOYJD5SGCDECP7OH2ZTOI7VJ3KRRQ5JJA, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.032353223 (251h52m26.763620873s) [noise=true , address=77.90.31.17:4796 , piece_id=GTUBHDLN56RTXMF3JDA4CBE2PFNUNDQODUZ7PHFY3BH2RRNOPBSA, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.033056985 (251h52m26.764324635s) [noise=true , address=77.90.31.11:4561 , piece_id=A4YHL3TXQKVEXWL4IN6IM3HDPJWRTQ2OCGRMUK7GRGX4DQ7ZCNUQ, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.033135343 (251h52m26.764402993s) [noise=true , address=77.90.31.15:4714 , piece_id=AIFPKUXL4OW3FMGFKQZH22Q3TFD6HI7MCMGQAYT5FOA2HPEVVI2Q, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.041772277 (251h52m26.773039926s) [noise=true , address=77.90.31.14:4687 , piece_id=2YYS4OPFWGEK62N42P22S7Q5K5DYDMLYYU5Z5NKCO4MJ6PL3NQ5Q, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.042572200 (251h52m26.77383986s) [noise=true , address=45.91.116.4:4970 , piece_id=GCRF42CNAEML3QDKVLE3GWUIMEQ2ZBG7LM5FA4UR3DRCVAGXD4MQ, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.044576828 (251h52m26.775844487s) [noise=true , address=104.36.82.60:4339 , piece_id=BXBAVZZ4NILTU2G3Y2THA7YHFNYHYP3C2TAG6XEWLL25F4RK657Q, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.057100085 (251h52m26.788367735s) [noise=true , address=104.36.82.23:4476 , piece_id=PQJIUPB6MWNXM6BD3IF6BZYQCERCBWJ6Q3AMRJKXCQAGLLHSEAOA, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.058633368 (251h52m26.789901017s) [noise=true , address=104.36.82.44:4888 , piece_id=UDJDNGE2I3K4CME5JEKQMBTFIPJWM67WJDMZQMNTTNGMK5ZYKK4A, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.058668493 (251h52m26.789936144s) [seg_pos={0 0}, upload=261964]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:18:46.058836578 (251h52m26.790104229s) [noise=true , address=77.90.31.21:4884 , piece_id=YURRGVPDQCJJFKZJOGDTZKCZHYMUWJJA3OYHNQFUE5BJHLTXPFPQ, seg_pos={0 0}, upload=261964]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aqgkDxFY3xZa9s2vq1DdCFFX2725aDicrxfvoYuXPfe4ozkHV): protocol: expected piece hash; context canceled; EOF
Aug 19 05:18:46.058945163 (251h52m26.790212813s) [noise=true , address=79.127.201.215:4356 , piece_id=W4ACVXXL6XPP27HTAOF3S7LUSL2GKA3VJZ35SLWPIV423NE4K7HQ, seg_pos={0 0}, upload=261964]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 19 05:18:46.059098361 (251h52m26.79036602s) [noise=true , address=77.90.31.18:4838 , piece_id=AP7T734AGCYXVKAGGCJ5MG6SMC6K7H7ZGL772K3L6XPTQJRXIMVA, seg_pos={0 0}, upload=261964]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1if7vf1cNTBwAhb6owi6tuGLYqSfa3feWhsvGSevwuwykhz2RY): protocol: expected piece hash; context canceled; EOF
Aug 19 05:18:46.059433802 (251h52m26.790701451s) [noise=true , address=79.127.205.233:4654 , piece_id=5V5ZA3PQ5VEBVJJLVOJRRQZ2CEYMRZGB4WXI7JNCMZ3DPC2WOOKA, seg_pos={0 0}, upload=261964]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jh6NFSjhYdd9w3yCf9a4t8TBH2UGXcN3TjzEJkvf173hGnXY8): protocol: context canceled; context canceled
Aug 19 05:18:46.059504244 (251h52m26.790771894s) [seg_pos={0 0}, upload=261964]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:18:46.059644538 (251h52m26.790912198s) [upload=261964]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:18:46.059654156 (251h52m26.790921816s) [upload=261964]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:18:46.247069599 (251h52m26.978337249s) [upload=261964]: Done uploading segments...
Aug 19 05:18:46.247089045 (251h52m26.978356696s) [upload=261964]: Upload finished. err: <nil>
Duration: 565.30606ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
136.638478ms
FAIL (2025-08-19 05:20:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 05:15:42.950619396 (251h49m23.681887026s) [upload=261914]: Starting upload Aug 19 05:15:42.950659280 (251h49m23.68192691s) [upload=261914]: Done starting upload Aug 19 05:15:42.950696701 (251h49m23.68196432s) [upload=261914]: Uploading segments... Aug 19 05:15:42.950723471 (251h49m23.681991101s) [upload=261914]: Got next segment. Inline: true Aug 19 05:15:42.950727057 (251h49m23.681994677s) [upload=261914]: Waiting for error group managing segments... Aug 19 05:15:42.950754749 (251h49m23.682022369s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 05:15:42.950758136 (251h49m23.682025755s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 05:15:42.950760279 (251h49m23.682027909s) [upload=261914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 05:15:42.953451979 (251h49m23.684719599s) [upload=261914]: Done uploading segments... Aug 19 05:15:42.953459052 (251h49m23.684726672s) [upload=261914]: Upload finished. err: metaclient: Too Many Requests
Duration: 136.668214ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........X..............................................X..] duration:
841.856998ms
FAIL (2025-08-19 05:19:49 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 19 05:18:45.789559792 (251h52m26.520827441s) [upload=261964]: Starting upload
Aug 19 05:18:45.789620084 (251h52m26.520887745s) [upload=261964]: Done starting upload
Aug 19 05:18:45.789757363 (251h52m26.521025023s) [upload=261964]: Uploading segments...
Aug 19 05:18:45.790009878 (251h52m26.521277527s) [upload=261964]: Got next segment. Inline: false
Aug 19 05:18:45.790064680 (251h52m26.521332331s) [upload=261964]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 05:18:45.790070992 (251h52m26.521338642s) [upload=261964]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:18:45.815063657 (251h52m26.546331327s) [seg_pos={0 0}, upload=261964]: Begin upload segment...
Aug 19 05:18:45.815120123 (251h52m26.546387783s) [seg_pos={0 0}, upload=261964]: Done begin upload segment.
Aug 19 05:18:45.815135172 (251h52m26.546402822s) [noise=true , address=79.127.205.233:4654 , piece_id=5V5ZA3PQ5VEBVJJLVOJRRQZ2CEYMRZGB4WXI7JNCMZ3DPC2WOOKA, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.815147224 (251h52m26.546414875s) [noise=true , address=77.90.31.19:4862 , piece_id=ZOZTQMXHBIGCJKOHCVTSEQJH5XDGS7CVHFJXYH7MIQEUDNYFLZZQ, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.815251620 (251h52m26.546519271s) [noise=true , address=104.36.82.60:4339 , piece_id=BXBAVZZ4NILTU2G3Y2THA7YHFNYHYP3C2TAG6XEWLL25F4RK657Q, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.815718588 (251h52m26.546986238s) [noise=true , address=77.90.31.11:4561 , piece_id=A4YHL3TXQKVEXWL4IN6IM3HDPJWRTQ2OCGRMUK7GRGX4DQ7ZCNUQ, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.816298257 (251h52m26.547565918s) [noise=true , address=79.127.201.215:4356 , piece_id=W4ACVXXL6XPP27HTAOF3S7LUSL2GKA3VJZ35SLWPIV423NE4K7HQ, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.816860774 (251h52m26.548128424s) [noise=true , address=77.90.31.15:4714 , piece_id=AIFPKUXL4OW3FMGFKQZH22Q3TFD6HI7MCMGQAYT5FOA2HPEVVI2Q, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.817508322 (251h52m26.548776032s) [noise=true , address=104.36.82.23:4476 , piece_id=PQJIUPB6MWNXM6BD3IF6BZYQCERCBWJ6Q3AMRJKXCQAGLLHSEAOA, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.818079004 (251h52m26.549346654s) [noise=true , address=45.91.116.6:4988 , piece_id=LIXV5NLQJCOI6YPSRKJVHKM6HXGESZODCFSVLQWELWOLDSAQGUAA, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.818501528 (251h52m26.549769179s) [noise=true , address=79.127.219.51:4205 , piece_id=OBW3ZAQE25CKKJF6E3JQ76CAKS35L6GRVNZ6CQZAXMFWA6RIC6NQ, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.819038087 (251h52m26.550305747s) [noise=true , address=104.36.82.44:4888 , piece_id=UDJDNGE2I3K4CME5JEKQMBTFIPJWM67WJDMZQMNTTNGMK5ZYKK4A, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.819510014 (251h52m26.550777664s) [noise=true , address=79.127.219.48:4085 , piece_id=FGJO2ZTYAN4WR4ZMZXU2SALJNLYL3Y4WPVBRYLT3NMLWHMS7FLWQ, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.820065197 (251h52m26.551332857s) [noise=true , address=77.90.31.14:4687 , piece_id=2YYS4OPFWGEK62N42P22S7Q5K5DYDMLYYU5Z5NKCO4MJ6PL3NQ5Q, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.820553455 (251h52m26.551821115s) [noise=true , address=77.90.31.17:4796 , piece_id=GTUBHDLN56RTXMF3JDA4CBE2PFNUNDQODUZ7PHFY3BH2RRNOPBSA, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.821108177 (251h52m26.552375838s) [noise=true , address=45.91.116.4:4970 , piece_id=GCRF42CNAEML3QDKVLE3GWUIMEQ2ZBG7LM5FA4UR3DRCVAGXD4MQ, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.821675584 (251h52m26.552943244s) [noise=true , address=77.90.31.21:4884 , piece_id=YURRGVPDQCJJFKZJOGDTZKCZHYMUWJJA3OYHNQFUE5BJHLTXPFPQ, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.822228784 (251h52m26.553496434s) [noise=true , address=45.91.116.9:4271 , piece_id=VVRPQ3ZKOEX4ANJFO2DGOYJD5SGCDECP7OH2ZTOI7VJ3KRRQ5JJA, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.823577548 (251h52m26.554845199s) [noise=true , address=79.127.219.47:4062 , piece_id=T5XXU7QTR7V6XKBDSN3LBNQXGMBQFPY72VECY7PK7XWIXOXJRVSA, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.824835683 (251h52m26.556103333s) [noise=true , address=77.90.31.18:4838 , piece_id=AP7T734AGCYXVKAGGCJ5MG6SMC6K7H7ZGL772K3L6XPTQJRXIMVA, seg_pos={0 0}, upload=261964]: Uploading piece...
Aug 19 05:18:45.934772154 (251h52m26.666039805s) [upload=261964]: Next returned nil segment
Aug 19 05:18:45.934786632 (251h52m26.666054282s) [upload=261964]: Waiting for error group managing segments...
Aug 19 05:18:45.943751541 (251h52m26.675019192s) [noise=true , address=79.127.219.47:4062 , piece_id=T5XXU7QTR7V6XKBDSN3LBNQXGMBQFPY72VECY7PK7XWIXOXJRVSA, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:45.944650221 (251h52m26.675917871s) [noise=true , address=79.127.219.48:4085 , piece_id=FGJO2ZTYAN4WR4ZMZXU2SALJNLYL3Y4WPVBRYLT3NMLWHMS7FLWQ, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:45.945600968 (251h52m26.676868618s) [noise=true , address=79.127.219.51:4205 , piece_id=OBW3ZAQE25CKKJF6E3JQ76CAKS35L6GRVNZ6CQZAXMFWA6RIC6NQ, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.019064917 (251h52m26.750332567s) [noise=true , address=45.91.116.6:4988 , piece_id=LIXV5NLQJCOI6YPSRKJVHKM6HXGESZODCFSVLQWELWOLDSAQGUAA, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.030693834 (251h52m26.761961484s) [noise=true , address=77.90.31.19:4862 , piece_id=ZOZTQMXHBIGCJKOHCVTSEQJH5XDGS7CVHFJXYH7MIQEUDNYFLZZQ, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.031047147 (251h52m26.762314798s) [noise=true , address=45.91.116.9:4271 , piece_id=VVRPQ3ZKOEX4ANJFO2DGOYJD5SGCDECP7OH2ZTOI7VJ3KRRQ5JJA, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.032353223 (251h52m26.763620873s) [noise=true , address=77.90.31.17:4796 , piece_id=GTUBHDLN56RTXMF3JDA4CBE2PFNUNDQODUZ7PHFY3BH2RRNOPBSA, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.033056985 (251h52m26.764324635s) [noise=true , address=77.90.31.11:4561 , piece_id=A4YHL3TXQKVEXWL4IN6IM3HDPJWRTQ2OCGRMUK7GRGX4DQ7ZCNUQ, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.033135343 (251h52m26.764402993s) [noise=true , address=77.90.31.15:4714 , piece_id=AIFPKUXL4OW3FMGFKQZH22Q3TFD6HI7MCMGQAYT5FOA2HPEVVI2Q, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.041772277 (251h52m26.773039926s) [noise=true , address=77.90.31.14:4687 , piece_id=2YYS4OPFWGEK62N42P22S7Q5K5DYDMLYYU5Z5NKCO4MJ6PL3NQ5Q, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.042572200 (251h52m26.77383986s) [noise=true , address=45.91.116.4:4970 , piece_id=GCRF42CNAEML3QDKVLE3GWUIMEQ2ZBG7LM5FA4UR3DRCVAGXD4MQ, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.044576828 (251h52m26.775844487s) [noise=true , address=104.36.82.60:4339 , piece_id=BXBAVZZ4NILTU2G3Y2THA7YHFNYHYP3C2TAG6XEWLL25F4RK657Q, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.057100085 (251h52m26.788367735s) [noise=true , address=104.36.82.23:4476 , piece_id=PQJIUPB6MWNXM6BD3IF6BZYQCERCBWJ6Q3AMRJKXCQAGLLHSEAOA, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.058633368 (251h52m26.789901017s) [noise=true , address=104.36.82.44:4888 , piece_id=UDJDNGE2I3K4CME5JEKQMBTFIPJWM67WJDMZQMNTTNGMK5ZYKK4A, seg_pos={0 0}, upload=261964]: Done uploading piece. err: <nil>
Aug 19 05:18:46.058668493 (251h52m26.789936144s) [seg_pos={0 0}, upload=261964]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:18:46.058836578 (251h52m26.790104229s) [noise=true , address=77.90.31.21:4884 , piece_id=YURRGVPDQCJJFKZJOGDTZKCZHYMUWJJA3OYHNQFUE5BJHLTXPFPQ, seg_pos={0 0}, upload=261964]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aqgkDxFY3xZa9s2vq1DdCFFX2725aDicrxfvoYuXPfe4ozkHV): protocol: expected piece hash; context canceled; EOF
Aug 19 05:18:46.058945163 (251h52m26.790212813s) [noise=true , address=79.127.201.215:4356 , piece_id=W4ACVXXL6XPP27HTAOF3S7LUSL2GKA3VJZ35SLWPIV423NE4K7HQ, seg_pos={0 0}, upload=261964]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 19 05:18:46.059098361 (251h52m26.79036602s) [noise=true , address=77.90.31.18:4838 , piece_id=AP7T734AGCYXVKAGGCJ5MG6SMC6K7H7ZGL772K3L6XPTQJRXIMVA, seg_pos={0 0}, upload=261964]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1if7vf1cNTBwAhb6owi6tuGLYqSfa3feWhsvGSevwuwykhz2RY): protocol: expected piece hash; context canceled; EOF
Aug 19 05:18:46.059433802 (251h52m26.790701451s) [noise=true , address=79.127.205.233:4654 , piece_id=5V5ZA3PQ5VEBVJJLVOJRRQZ2CEYMRZGB4WXI7JNCMZ3DPC2WOOKA, seg_pos={0 0}, upload=261964]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jh6NFSjhYdd9w3yCf9a4t8TBH2UGXcN3TjzEJkvf173hGnXY8): protocol: context canceled; context canceled
Aug 19 05:18:46.059504244 (251h52m26.790771894s) [seg_pos={0 0}, upload=261964]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:18:46.059644538 (251h52m26.790912198s) [upload=261964]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:18:46.059654156 (251h52m26.790921816s) [upload=261964]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:18:46.247069599 (251h52m26.978337249s) [upload=261964]: Done uploading segments...
Aug 19 05:18:46.247089045 (251h52m26.978356696s) [upload=261964]: Upload finished. err: <nil>
Duration: 841.925797ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|