Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
1.607975812s
FAIL (2025-08-22 04:51:23 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 22 04:14:56.030180971 (322h48m36.761448621s) [upload=335638]: Starting upload
Aug 22 04:14:56.030251765 (322h48m36.761519415s) [upload=335638]: Done starting upload
Aug 22 04:14:56.030449677 (322h48m36.761717337s) [upload=335638]: Uploading segments...
Aug 22 04:14:56.030627822 (322h48m36.761895473s) [upload=335638]: Got next segment. Inline: false
Aug 22 04:14:56.030671194 (322h48m36.761938845s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 04:14:56.030679730 (322h48m36.761947381s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 04:14:56.078560813 (322h48m36.809828453s) [seg_pos={0 0}, upload=335638]: Begin upload segment...
Aug 22 04:14:56.078602301 (322h48m36.809869951s) [seg_pos={0 0}, upload=335638]: Done begin upload segment.
Aug 22 04:14:56.078638679 (322h48m36.809906329s) [noise=true , address=77.90.31.15:4703 , piece_id=XH433WREH7EVXIAQMLI5EDLEN5FZJHAEHCYK5NL55VA2JWAVHTIA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.078649209 (322h48m36.809916859s) [noise=true , address=77.90.31.17:4775 , piece_id=2KCZ36SQFRJWMC3OBYW6674TLYLJEMDPQA7QSS4JVELCBC75BF7A, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079202952 (322h48m36.810470601s) [noise=true , address=79.127.201.215:4344 , piece_id=I4KQ6C7QKCUXYFYIVHMWWLI5RZC3YXUNVBQTGHAHZU7F6ELJ5GMA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079216498 (322h48m36.810484148s) [noise=true , address=77.90.31.10:4535 , piece_id=3MOUQMV5N7JI4V27RP3ZPKLF2P3ABFO4XP4TFHOPUHGVGILJYZWA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079590982 (322h48m36.810858633s) [noise=true , address=79.127.219.51:4185 , piece_id=5RHU7PFIBAY7KLYYVMNPGJBM33K5WWZ6E35Z52O3SF2XSVG3WKMQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079604748 (322h48m36.810872388s) [noise=true , address=104.36.82.6:4892 , piece_id=3WLX4OFVLCBLAE5OEI52JHUPYZNBOWMRX6LJWUYLPEKWPCFDBIBA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080091395 (322h48m36.811359044s) [noise=true , address=79.127.219.48:4093 , piece_id=NZBRQBL7Z52H3JCLLLD7CFBFWGC7H7MJTW6G2CFH57J2F4XDP4SA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080144284 (322h48m36.811411934s) [noise=true , address=79.127.205.235:4677 , piece_id=CB422NDFIO6VHBDC4QCP7UGLZRCGP2N3JRVZPFX4DFE5SU77RKMQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080582860 (322h48m36.811850511s) [noise=true , address=77.90.31.16:4761 , piece_id=AJWEB2GXZABAMZW7V4S3LF7FEYOI23K2ASL42NFIOFOWWQBZQQCA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081056942 (322h48m36.812324582s) [noise=true , address=77.90.31.11:4568 , piece_id=JC2LPEKYMWNJRQ2HMCIHDZKSICEZLK6C4ET3UIDUIRDD6MCL6ZJA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081504335 (322h48m36.812771984s) [noise=true , address=77.90.31.18:4811 , piece_id=ODPH32QDN7CTPF5IDUNQ5DEBC6HASD4BAP43ZVZDBIJFJLJWXHXA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081853813 (322h48m36.813121463s) [noise=true , address=104.36.82.23:4472 , piece_id=FCUL2C2XCQ2JKS46BDPNDSENIJBDDLL7TR7BW337GB6OR63DF4CQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082215645 (322h48m36.813483284s) [noise=true , address=77.90.31.19:4874 , piece_id=MCAFOKTALBSPDPMRSTHYZB3RGF7M5I55HOG3RUD463VCTVW7QCGQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082563559 (322h48m36.813831199s) [noise=true , address=104.36.82.60:4372 , piece_id=KUGRHZF4E4FOB4SYJF2NQ75LIF6IUXWMZ35URXHB7VDADYLZNYHQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082885666 (322h48m36.814153317s) [noise=true , address=45.91.116.11:4132 , piece_id=SBIASMWS5NC2XSHDENEKASMDEKQ3ODBPE4RKIQ4EZKZG6SP67JNQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.083847547 (322h48m36.815115197s) [noise=true , address=79.127.219.51:4200 , piece_id=SPPCLJ66SEENUH7SLHHXWI2UZHBEEY3KZIVVUAS3FBZ7CQY2G4LQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.084798477 (322h48m36.816066128s) [noise=true , address=104.36.82.44:4874 , piece_id=UCCAF4MUEIVBLMZRA2LSGWLJZSIBFMA7NY36IA7IB3KH4IBGXKAQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.088490439 (322h48m36.819758089s) [noise=true , address=104.36.82.5:4858 , piece_id=IYUCCI5NCZOTML7GFYI4LAS6NV47IC5UHCVLHFON3LJKZA2LFABA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.206801759 (322h48m36.938069408s) [upload=335638]: Next returned nil segment
Aug 22 04:14:56.206950910 (322h48m36.93821856s) [upload=335638]: Waiting for error group managing segments...
Aug 22 04:14:56.219298197 (322h48m36.950565838s) [noise=true , address=79.127.219.51:4185 , piece_id=5RHU7PFIBAY7KLYYVMNPGJBM33K5WWZ6E35Z52O3SF2XSVG3WKMQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.221650127 (322h48m36.952917776s) [noise=true , address=79.127.219.51:4200 , piece_id=SPPCLJ66SEENUH7SLHHXWI2UZHBEEY3KZIVVUAS3FBZ7CQY2G4LQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.221873898 (322h48m36.953141537s) [noise=true , address=79.127.219.48:4093 , piece_id=NZBRQBL7Z52H3JCLLLD7CFBFWGC7H7MJTW6G2CFH57J2F4XDP4SA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.222678583 (322h48m36.953946232s) [noise=true , address=77.90.31.18:4811 , piece_id=ODPH32QDN7CTPF5IDUNQ5DEBC6HASD4BAP43ZVZDBIJFJLJWXHXA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.224688627 (322h48m36.955956277s) [noise=true , address=104.36.82.6:4892 , piece_id=3WLX4OFVLCBLAE5OEI52JHUPYZNBOWMRX6LJWUYLPEKWPCFDBIBA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.226219780 (322h48m36.95748742s) [noise=true , address=77.90.31.19:4874 , piece_id=MCAFOKTALBSPDPMRSTHYZB3RGF7M5I55HOG3RUD463VCTVW7QCGQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.226285995 (322h48m36.957553645s) [noise=true , address=77.90.31.17:4775 , piece_id=2KCZ36SQFRJWMC3OBYW6674TLYLJEMDPQA7QSS4JVELCBC75BF7A, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.228103006 (322h48m36.959370626s) [noise=true , address=104.36.82.44:4874 , piece_id=UCCAF4MUEIVBLMZRA2LSGWLJZSIBFMA7NY36IA7IB3KH4IBGXKAQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.237068737 (322h48m36.968336377s) [noise=true , address=77.90.31.16:4761 , piece_id=AJWEB2GXZABAMZW7V4S3LF7FEYOI23K2ASL42NFIOFOWWQBZQQCA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.248700377 (322h48m36.979968027s) [noise=true , address=45.91.116.11:4132 , piece_id=SBIASMWS5NC2XSHDENEKASMDEKQ3ODBPE4RKIQ4EZKZG6SP67JNQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.252483180 (322h48m36.98375083s) [noise=true , address=104.36.82.5:4858 , piece_id=IYUCCI5NCZOTML7GFYI4LAS6NV47IC5UHCVLHFON3LJKZA2LFABA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.268821762 (322h48m37.000089423s) [noise=true , address=77.90.31.15:4703 , piece_id=XH433WREH7EVXIAQMLI5EDLEN5FZJHAEHCYK5NL55VA2JWAVHTIA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.273574892 (322h48m37.004842553s) [noise=true , address=77.90.31.10:4535 , piece_id=3MOUQMV5N7JI4V27RP3ZPKLF2P3ABFO4XP4TFHOPUHGVGILJYZWA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.308274656 (322h48m37.039542306s) [noise=true , address=104.36.82.60:4372 , piece_id=KUGRHZF4E4FOB4SYJF2NQ75LIF6IUXWMZ35URXHB7VDADYLZNYHQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.308311565 (322h48m37.039579215s) [seg_pos={0 0}, upload=335638]: Segment reached optimal threshold of 14 pieces.
Aug 22 04:14:56.308536709 (322h48m37.039804359s) [noise=true , address=104.36.82.23:4472 , piece_id=FCUL2C2XCQ2JKS46BDPNDSENIJBDDLL7TR7BW337GB6OR63DF4CQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF
Aug 22 04:14:56.308649492 (322h48m37.039917141s) [noise=true , address=77.90.31.11:4568 , piece_id=JC2LPEKYMWNJRQ2HMCIHDZKSICEZLK6C4ET3UIDUIRDD6MCL6ZJA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1H1L8DTKD7W7Xx1PVT7KzB9GkGBadnTEj9BHtbSgcW1S7Jj8Tw): protocol: expected piece hash; context canceled; EOF
Aug 22 04:14:56.308765871 (322h48m37.040033521s) [noise=true , address=79.127.205.235:4677 , piece_id=CB422NDFIO6VHBDC4QCP7UGLZRCGP2N3JRVZPFX4DFE5SU77RKMQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oeYzce3yvWfVUnLYKyRyPePYh4QRj86FowWm3hRZ1qHQ6TSLa): protocol: read tcp 5.161.89.252:30854->79.127.205.235:4677: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 04:14:56.308796689 (322h48m37.040064349s) [noise=true , address=79.127.201.215:4344 , piece_id=I4KQ6C7QKCUXYFYIVHMWWLI5RZC3YXUNVBQTGHAHZU7F6ELJ5GMA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: read tcp 5.161.89.252:38178->79.127.201.215:4344: use of closed network connection; context canceled
Aug 22 04:14:56.308831504 (322h48m37.040099164s) [seg_pos={0 0}, upload=335638]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 04:14:56.309045818 (322h48m37.040313488s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 04:14:56.309058031 (322h48m37.040325681s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 04:14:56.409269392 (322h48m37.140537052s) [upload=335638]: Done uploading segments...
Aug 22 04:14:56.409287577 (322h48m37.140555237s) [upload=335638]: Upload finished. err: <nil>
Duration: 1.608005908s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
447.987364ms
FAIL (2025-08-22 04:51:19 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 448.015196ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....................X.......X......................X.......] duration:
152.253065ms
FAIL (2025-08-22 04:51:08 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 22 04:46:40.583386657 (323h20m21.314654308s) [upload=336202]: Starting upload Aug 22 04:46:40.583444356 (323h20m21.314712005s) [upload=336202]: Done starting upload Aug 22 04:46:40.583509328 (323h20m21.314776979s) [upload=336202]: Uploading segments... Aug 22 04:46:40.583573990 (323h20m21.31484166s) [upload=336202]: Got next segment. Inline: true Aug 22 04:46:40.583580282 (323h20m21.314847931s) [upload=336202]: Waiting for error group managing segments... Aug 22 04:46:40.583657377 (323h20m21.314925027s) [upload=336202]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 04:46:40.583663078 (323h20m21.314930728s) [upload=336202]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 04:46:40.583666133 (323h20m21.314933783s) [upload=336202]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 04:46:40.895260936 (323h20m21.626528577s) [upload=336202]: Done uploading segments... Aug 22 04:46:40.895278780 (323h20m21.62654643s) [upload=336202]: Upload finished. err: <nil>
Duration: 152.272323ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [......................X.......X......................X......] duration:
131.038111ms
FAIL (2025-08-22 04:50:34 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 22 04:46:40.583386657 (323h20m21.314654308s) [upload=336202]: Starting upload Aug 22 04:46:40.583444356 (323h20m21.314712005s) [upload=336202]: Done starting upload Aug 22 04:46:40.583509328 (323h20m21.314776979s) [upload=336202]: Uploading segments... Aug 22 04:46:40.583573990 (323h20m21.31484166s) [upload=336202]: Got next segment. Inline: true Aug 22 04:46:40.583580282 (323h20m21.314847931s) [upload=336202]: Waiting for error group managing segments... Aug 22 04:46:40.583657377 (323h20m21.314925027s) [upload=336202]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 04:46:40.583663078 (323h20m21.314930728s) [upload=336202]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 04:46:40.583666133 (323h20m21.314933783s) [upload=336202]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 04:46:40.895260936 (323h20m21.626528577s) [upload=336202]: Done uploading segments... Aug 22 04:46:40.895278780 (323h20m21.62654643s) [upload=336202]: Upload finished. err: <nil>
Duration: 131.065483ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
403.053739ms
FAIL (2025-08-22 04:50:30 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 403.078285ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.......................X.......X......................X.....] duration:
117.576124ms
FAIL (2025-08-22 04:50:11 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 22 04:46:40.583386657 (323h20m21.314654308s) [upload=336202]: Starting upload Aug 22 04:46:40.583444356 (323h20m21.314712005s) [upload=336202]: Done starting upload Aug 22 04:46:40.583509328 (323h20m21.314776979s) [upload=336202]: Uploading segments... Aug 22 04:46:40.583573990 (323h20m21.31484166s) [upload=336202]: Got next segment. Inline: true Aug 22 04:46:40.583580282 (323h20m21.314847931s) [upload=336202]: Waiting for error group managing segments... Aug 22 04:46:40.583657377 (323h20m21.314925027s) [upload=336202]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 04:46:40.583663078 (323h20m21.314930728s) [upload=336202]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 04:46:40.583666133 (323h20m21.314933783s) [upload=336202]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 04:46:40.895260936 (323h20m21.626528577s) [upload=336202]: Done uploading segments... Aug 22 04:46:40.895278780 (323h20m21.62654643s) [upload=336202]: Upload finished. err: <nil>
Duration: 117.592594ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
342.648131ms
FAIL (2025-08-22 04:50:10 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 22 04:14:56.030180971 (322h48m36.761448621s) [upload=335638]: Starting upload
Aug 22 04:14:56.030251765 (322h48m36.761519415s) [upload=335638]: Done starting upload
Aug 22 04:14:56.030449677 (322h48m36.761717337s) [upload=335638]: Uploading segments...
Aug 22 04:14:56.030627822 (322h48m36.761895473s) [upload=335638]: Got next segment. Inline: false
Aug 22 04:14:56.030671194 (322h48m36.761938845s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 04:14:56.030679730 (322h48m36.761947381s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 04:14:56.078560813 (322h48m36.809828453s) [seg_pos={0 0}, upload=335638]: Begin upload segment...
Aug 22 04:14:56.078602301 (322h48m36.809869951s) [seg_pos={0 0}, upload=335638]: Done begin upload segment.
Aug 22 04:14:56.078638679 (322h48m36.809906329s) [noise=true , address=77.90.31.15:4703 , piece_id=XH433WREH7EVXIAQMLI5EDLEN5FZJHAEHCYK5NL55VA2JWAVHTIA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.078649209 (322h48m36.809916859s) [noise=true , address=77.90.31.17:4775 , piece_id=2KCZ36SQFRJWMC3OBYW6674TLYLJEMDPQA7QSS4JVELCBC75BF7A, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079202952 (322h48m36.810470601s) [noise=true , address=79.127.201.215:4344 , piece_id=I4KQ6C7QKCUXYFYIVHMWWLI5RZC3YXUNVBQTGHAHZU7F6ELJ5GMA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079216498 (322h48m36.810484148s) [noise=true , address=77.90.31.10:4535 , piece_id=3MOUQMV5N7JI4V27RP3ZPKLF2P3ABFO4XP4TFHOPUHGVGILJYZWA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079590982 (322h48m36.810858633s) [noise=true , address=79.127.219.51:4185 , piece_id=5RHU7PFIBAY7KLYYVMNPGJBM33K5WWZ6E35Z52O3SF2XSVG3WKMQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079604748 (322h48m36.810872388s) [noise=true , address=104.36.82.6:4892 , piece_id=3WLX4OFVLCBLAE5OEI52JHUPYZNBOWMRX6LJWUYLPEKWPCFDBIBA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080091395 (322h48m36.811359044s) [noise=true , address=79.127.219.48:4093 , piece_id=NZBRQBL7Z52H3JCLLLD7CFBFWGC7H7MJTW6G2CFH57J2F4XDP4SA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080144284 (322h48m36.811411934s) [noise=true , address=79.127.205.235:4677 , piece_id=CB422NDFIO6VHBDC4QCP7UGLZRCGP2N3JRVZPFX4DFE5SU77RKMQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080582860 (322h48m36.811850511s) [noise=true , address=77.90.31.16:4761 , piece_id=AJWEB2GXZABAMZW7V4S3LF7FEYOI23K2ASL42NFIOFOWWQBZQQCA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081056942 (322h48m36.812324582s) [noise=true , address=77.90.31.11:4568 , piece_id=JC2LPEKYMWNJRQ2HMCIHDZKSICEZLK6C4ET3UIDUIRDD6MCL6ZJA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081504335 (322h48m36.812771984s) [noise=true , address=77.90.31.18:4811 , piece_id=ODPH32QDN7CTPF5IDUNQ5DEBC6HASD4BAP43ZVZDBIJFJLJWXHXA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081853813 (322h48m36.813121463s) [noise=true , address=104.36.82.23:4472 , piece_id=FCUL2C2XCQ2JKS46BDPNDSENIJBDDLL7TR7BW337GB6OR63DF4CQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082215645 (322h48m36.813483284s) [noise=true , address=77.90.31.19:4874 , piece_id=MCAFOKTALBSPDPMRSTHYZB3RGF7M5I55HOG3RUD463VCTVW7QCGQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082563559 (322h48m36.813831199s) [noise=true , address=104.36.82.60:4372 , piece_id=KUGRHZF4E4FOB4SYJF2NQ75LIF6IUXWMZ35URXHB7VDADYLZNYHQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082885666 (322h48m36.814153317s) [noise=true , address=45.91.116.11:4132 , piece_id=SBIASMWS5NC2XSHDENEKASMDEKQ3ODBPE4RKIQ4EZKZG6SP67JNQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.083847547 (322h48m36.815115197s) [noise=true , address=79.127.219.51:4200 , piece_id=SPPCLJ66SEENUH7SLHHXWI2UZHBEEY3KZIVVUAS3FBZ7CQY2G4LQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.084798477 (322h48m36.816066128s) [noise=true , address=104.36.82.44:4874 , piece_id=UCCAF4MUEIVBLMZRA2LSGWLJZSIBFMA7NY36IA7IB3KH4IBGXKAQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.088490439 (322h48m36.819758089s) [noise=true , address=104.36.82.5:4858 , piece_id=IYUCCI5NCZOTML7GFYI4LAS6NV47IC5UHCVLHFON3LJKZA2LFABA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.206801759 (322h48m36.938069408s) [upload=335638]: Next returned nil segment
Aug 22 04:14:56.206950910 (322h48m36.93821856s) [upload=335638]: Waiting for error group managing segments...
Aug 22 04:14:56.219298197 (322h48m36.950565838s) [noise=true , address=79.127.219.51:4185 , piece_id=5RHU7PFIBAY7KLYYVMNPGJBM33K5WWZ6E35Z52O3SF2XSVG3WKMQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.221650127 (322h48m36.952917776s) [noise=true , address=79.127.219.51:4200 , piece_id=SPPCLJ66SEENUH7SLHHXWI2UZHBEEY3KZIVVUAS3FBZ7CQY2G4LQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.221873898 (322h48m36.953141537s) [noise=true , address=79.127.219.48:4093 , piece_id=NZBRQBL7Z52H3JCLLLD7CFBFWGC7H7MJTW6G2CFH57J2F4XDP4SA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.222678583 (322h48m36.953946232s) [noise=true , address=77.90.31.18:4811 , piece_id=ODPH32QDN7CTPF5IDUNQ5DEBC6HASD4BAP43ZVZDBIJFJLJWXHXA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.224688627 (322h48m36.955956277s) [noise=true , address=104.36.82.6:4892 , piece_id=3WLX4OFVLCBLAE5OEI52JHUPYZNBOWMRX6LJWUYLPEKWPCFDBIBA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.226219780 (322h48m36.95748742s) [noise=true , address=77.90.31.19:4874 , piece_id=MCAFOKTALBSPDPMRSTHYZB3RGF7M5I55HOG3RUD463VCTVW7QCGQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.226285995 (322h48m36.957553645s) [noise=true , address=77.90.31.17:4775 , piece_id=2KCZ36SQFRJWMC3OBYW6674TLYLJEMDPQA7QSS4JVELCBC75BF7A, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.228103006 (322h48m36.959370626s) [noise=true , address=104.36.82.44:4874 , piece_id=UCCAF4MUEIVBLMZRA2LSGWLJZSIBFMA7NY36IA7IB3KH4IBGXKAQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.237068737 (322h48m36.968336377s) [noise=true , address=77.90.31.16:4761 , piece_id=AJWEB2GXZABAMZW7V4S3LF7FEYOI23K2ASL42NFIOFOWWQBZQQCA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.248700377 (322h48m36.979968027s) [noise=true , address=45.91.116.11:4132 , piece_id=SBIASMWS5NC2XSHDENEKASMDEKQ3ODBPE4RKIQ4EZKZG6SP67JNQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.252483180 (322h48m36.98375083s) [noise=true , address=104.36.82.5:4858 , piece_id=IYUCCI5NCZOTML7GFYI4LAS6NV47IC5UHCVLHFON3LJKZA2LFABA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.268821762 (322h48m37.000089423s) [noise=true , address=77.90.31.15:4703 , piece_id=XH433WREH7EVXIAQMLI5EDLEN5FZJHAEHCYK5NL55VA2JWAVHTIA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.273574892 (322h48m37.004842553s) [noise=true , address=77.90.31.10:4535 , piece_id=3MOUQMV5N7JI4V27RP3ZPKLF2P3ABFO4XP4TFHOPUHGVGILJYZWA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.308274656 (322h48m37.039542306s) [noise=true , address=104.36.82.60:4372 , piece_id=KUGRHZF4E4FOB4SYJF2NQ75LIF6IUXWMZ35URXHB7VDADYLZNYHQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.308311565 (322h48m37.039579215s) [seg_pos={0 0}, upload=335638]: Segment reached optimal threshold of 14 pieces.
Aug 22 04:14:56.308536709 (322h48m37.039804359s) [noise=true , address=104.36.82.23:4472 , piece_id=FCUL2C2XCQ2JKS46BDPNDSENIJBDDLL7TR7BW337GB6OR63DF4CQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF
Aug 22 04:14:56.308649492 (322h48m37.039917141s) [noise=true , address=77.90.31.11:4568 , piece_id=JC2LPEKYMWNJRQ2HMCIHDZKSICEZLK6C4ET3UIDUIRDD6MCL6ZJA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1H1L8DTKD7W7Xx1PVT7KzB9GkGBadnTEj9BHtbSgcW1S7Jj8Tw): protocol: expected piece hash; context canceled; EOF
Aug 22 04:14:56.308765871 (322h48m37.040033521s) [noise=true , address=79.127.205.235:4677 , piece_id=CB422NDFIO6VHBDC4QCP7UGLZRCGP2N3JRVZPFX4DFE5SU77RKMQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oeYzce3yvWfVUnLYKyRyPePYh4QRj86FowWm3hRZ1qHQ6TSLa): protocol: read tcp 5.161.89.252:30854->79.127.205.235:4677: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 04:14:56.308796689 (322h48m37.040064349s) [noise=true , address=79.127.201.215:4344 , piece_id=I4KQ6C7QKCUXYFYIVHMWWLI5RZC3YXUNVBQTGHAHZU7F6ELJ5GMA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: read tcp 5.161.89.252:38178->79.127.201.215:4344: use of closed network connection; context canceled
Aug 22 04:14:56.308831504 (322h48m37.040099164s) [seg_pos={0 0}, upload=335638]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 04:14:56.309045818 (322h48m37.040313488s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 04:14:56.309058031 (322h48m37.040325681s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 04:14:56.409269392 (322h48m37.140537052s) [upload=335638]: Done uploading segments...
Aug 22 04:14:56.409287577 (322h48m37.140555237s) [upload=335638]: Upload finished. err: <nil>
Duration: 342.670213ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
1.203308835s
FAIL (2025-08-22 04:49:43 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 22 04:14:56.030180971 (322h48m36.761448621s) [upload=335638]: Starting upload
Aug 22 04:14:56.030251765 (322h48m36.761519415s) [upload=335638]: Done starting upload
Aug 22 04:14:56.030449677 (322h48m36.761717337s) [upload=335638]: Uploading segments...
Aug 22 04:14:56.030627822 (322h48m36.761895473s) [upload=335638]: Got next segment. Inline: false
Aug 22 04:14:56.030671194 (322h48m36.761938845s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 04:14:56.030679730 (322h48m36.761947381s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 04:14:56.078560813 (322h48m36.809828453s) [seg_pos={0 0}, upload=335638]: Begin upload segment...
Aug 22 04:14:56.078602301 (322h48m36.809869951s) [seg_pos={0 0}, upload=335638]: Done begin upload segment.
Aug 22 04:14:56.078638679 (322h48m36.809906329s) [noise=true , address=77.90.31.15:4703 , piece_id=XH433WREH7EVXIAQMLI5EDLEN5FZJHAEHCYK5NL55VA2JWAVHTIA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.078649209 (322h48m36.809916859s) [noise=true , address=77.90.31.17:4775 , piece_id=2KCZ36SQFRJWMC3OBYW6674TLYLJEMDPQA7QSS4JVELCBC75BF7A, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079202952 (322h48m36.810470601s) [noise=true , address=79.127.201.215:4344 , piece_id=I4KQ6C7QKCUXYFYIVHMWWLI5RZC3YXUNVBQTGHAHZU7F6ELJ5GMA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079216498 (322h48m36.810484148s) [noise=true , address=77.90.31.10:4535 , piece_id=3MOUQMV5N7JI4V27RP3ZPKLF2P3ABFO4XP4TFHOPUHGVGILJYZWA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079590982 (322h48m36.810858633s) [noise=true , address=79.127.219.51:4185 , piece_id=5RHU7PFIBAY7KLYYVMNPGJBM33K5WWZ6E35Z52O3SF2XSVG3WKMQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079604748 (322h48m36.810872388s) [noise=true , address=104.36.82.6:4892 , piece_id=3WLX4OFVLCBLAE5OEI52JHUPYZNBOWMRX6LJWUYLPEKWPCFDBIBA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080091395 (322h48m36.811359044s) [noise=true , address=79.127.219.48:4093 , piece_id=NZBRQBL7Z52H3JCLLLD7CFBFWGC7H7MJTW6G2CFH57J2F4XDP4SA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080144284 (322h48m36.811411934s) [noise=true , address=79.127.205.235:4677 , piece_id=CB422NDFIO6VHBDC4QCP7UGLZRCGP2N3JRVZPFX4DFE5SU77RKMQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080582860 (322h48m36.811850511s) [noise=true , address=77.90.31.16:4761 , piece_id=AJWEB2GXZABAMZW7V4S3LF7FEYOI23K2ASL42NFIOFOWWQBZQQCA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081056942 (322h48m36.812324582s) [noise=true , address=77.90.31.11:4568 , piece_id=JC2LPEKYMWNJRQ2HMCIHDZKSICEZLK6C4ET3UIDUIRDD6MCL6ZJA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081504335 (322h48m36.812771984s) [noise=true , address=77.90.31.18:4811 , piece_id=ODPH32QDN7CTPF5IDUNQ5DEBC6HASD4BAP43ZVZDBIJFJLJWXHXA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081853813 (322h48m36.813121463s) [noise=true , address=104.36.82.23:4472 , piece_id=FCUL2C2XCQ2JKS46BDPNDSENIJBDDLL7TR7BW337GB6OR63DF4CQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082215645 (322h48m36.813483284s) [noise=true , address=77.90.31.19:4874 , piece_id=MCAFOKTALBSPDPMRSTHYZB3RGF7M5I55HOG3RUD463VCTVW7QCGQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082563559 (322h48m36.813831199s) [noise=true , address=104.36.82.60:4372 , piece_id=KUGRHZF4E4FOB4SYJF2NQ75LIF6IUXWMZ35URXHB7VDADYLZNYHQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082885666 (322h48m36.814153317s) [noise=true , address=45.91.116.11:4132 , piece_id=SBIASMWS5NC2XSHDENEKASMDEKQ3ODBPE4RKIQ4EZKZG6SP67JNQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.083847547 (322h48m36.815115197s) [noise=true , address=79.127.219.51:4200 , piece_id=SPPCLJ66SEENUH7SLHHXWI2UZHBEEY3KZIVVUAS3FBZ7CQY2G4LQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.084798477 (322h48m36.816066128s) [noise=true , address=104.36.82.44:4874 , piece_id=UCCAF4MUEIVBLMZRA2LSGWLJZSIBFMA7NY36IA7IB3KH4IBGXKAQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.088490439 (322h48m36.819758089s) [noise=true , address=104.36.82.5:4858 , piece_id=IYUCCI5NCZOTML7GFYI4LAS6NV47IC5UHCVLHFON3LJKZA2LFABA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.206801759 (322h48m36.938069408s) [upload=335638]: Next returned nil segment
Aug 22 04:14:56.206950910 (322h48m36.93821856s) [upload=335638]: Waiting for error group managing segments...
Aug 22 04:14:56.219298197 (322h48m36.950565838s) [noise=true , address=79.127.219.51:4185 , piece_id=5RHU7PFIBAY7KLYYVMNPGJBM33K5WWZ6E35Z52O3SF2XSVG3WKMQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.221650127 (322h48m36.952917776s) [noise=true , address=79.127.219.51:4200 , piece_id=SPPCLJ66SEENUH7SLHHXWI2UZHBEEY3KZIVVUAS3FBZ7CQY2G4LQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.221873898 (322h48m36.953141537s) [noise=true , address=79.127.219.48:4093 , piece_id=NZBRQBL7Z52H3JCLLLD7CFBFWGC7H7MJTW6G2CFH57J2F4XDP4SA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.222678583 (322h48m36.953946232s) [noise=true , address=77.90.31.18:4811 , piece_id=ODPH32QDN7CTPF5IDUNQ5DEBC6HASD4BAP43ZVZDBIJFJLJWXHXA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.224688627 (322h48m36.955956277s) [noise=true , address=104.36.82.6:4892 , piece_id=3WLX4OFVLCBLAE5OEI52JHUPYZNBOWMRX6LJWUYLPEKWPCFDBIBA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.226219780 (322h48m36.95748742s) [noise=true , address=77.90.31.19:4874 , piece_id=MCAFOKTALBSPDPMRSTHYZB3RGF7M5I55HOG3RUD463VCTVW7QCGQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.226285995 (322h48m36.957553645s) [noise=true , address=77.90.31.17:4775 , piece_id=2KCZ36SQFRJWMC3OBYW6674TLYLJEMDPQA7QSS4JVELCBC75BF7A, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.228103006 (322h48m36.959370626s) [noise=true , address=104.36.82.44:4874 , piece_id=UCCAF4MUEIVBLMZRA2LSGWLJZSIBFMA7NY36IA7IB3KH4IBGXKAQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.237068737 (322h48m36.968336377s) [noise=true , address=77.90.31.16:4761 , piece_id=AJWEB2GXZABAMZW7V4S3LF7FEYOI23K2ASL42NFIOFOWWQBZQQCA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.248700377 (322h48m36.979968027s) [noise=true , address=45.91.116.11:4132 , piece_id=SBIASMWS5NC2XSHDENEKASMDEKQ3ODBPE4RKIQ4EZKZG6SP67JNQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.252483180 (322h48m36.98375083s) [noise=true , address=104.36.82.5:4858 , piece_id=IYUCCI5NCZOTML7GFYI4LAS6NV47IC5UHCVLHFON3LJKZA2LFABA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.268821762 (322h48m37.000089423s) [noise=true , address=77.90.31.15:4703 , piece_id=XH433WREH7EVXIAQMLI5EDLEN5FZJHAEHCYK5NL55VA2JWAVHTIA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.273574892 (322h48m37.004842553s) [noise=true , address=77.90.31.10:4535 , piece_id=3MOUQMV5N7JI4V27RP3ZPKLF2P3ABFO4XP4TFHOPUHGVGILJYZWA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.308274656 (322h48m37.039542306s) [noise=true , address=104.36.82.60:4372 , piece_id=KUGRHZF4E4FOB4SYJF2NQ75LIF6IUXWMZ35URXHB7VDADYLZNYHQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.308311565 (322h48m37.039579215s) [seg_pos={0 0}, upload=335638]: Segment reached optimal threshold of 14 pieces.
Aug 22 04:14:56.308536709 (322h48m37.039804359s) [noise=true , address=104.36.82.23:4472 , piece_id=FCUL2C2XCQ2JKS46BDPNDSENIJBDDLL7TR7BW337GB6OR63DF4CQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF
Aug 22 04:14:56.308649492 (322h48m37.039917141s) [noise=true , address=77.90.31.11:4568 , piece_id=JC2LPEKYMWNJRQ2HMCIHDZKSICEZLK6C4ET3UIDUIRDD6MCL6ZJA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1H1L8DTKD7W7Xx1PVT7KzB9GkGBadnTEj9BHtbSgcW1S7Jj8Tw): protocol: expected piece hash; context canceled; EOF
Aug 22 04:14:56.308765871 (322h48m37.040033521s) [noise=true , address=79.127.205.235:4677 , piece_id=CB422NDFIO6VHBDC4QCP7UGLZRCGP2N3JRVZPFX4DFE5SU77RKMQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oeYzce3yvWfVUnLYKyRyPePYh4QRj86FowWm3hRZ1qHQ6TSLa): protocol: read tcp 5.161.89.252:30854->79.127.205.235:4677: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 04:14:56.308796689 (322h48m37.040064349s) [noise=true , address=79.127.201.215:4344 , piece_id=I4KQ6C7QKCUXYFYIVHMWWLI5RZC3YXUNVBQTGHAHZU7F6ELJ5GMA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: read tcp 5.161.89.252:38178->79.127.201.215:4344: use of closed network connection; context canceled
Aug 22 04:14:56.308831504 (322h48m37.040099164s) [seg_pos={0 0}, upload=335638]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 04:14:56.309045818 (322h48m37.040313488s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 04:14:56.309058031 (322h48m37.040325681s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 04:14:56.409269392 (322h48m37.140537052s) [upload=335638]: Done uploading segments...
Aug 22 04:14:56.409287577 (322h48m37.140555237s) [upload=335638]: Upload finished. err: <nil>
Duration: 1.20332733s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [........................X.......X......................X....] duration:
122.141501ms
FAIL (2025-08-22 04:49:36 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 22 04:46:40.583386657 (323h20m21.314654308s) [upload=336202]: Starting upload Aug 22 04:46:40.583444356 (323h20m21.314712005s) [upload=336202]: Done starting upload Aug 22 04:46:40.583509328 (323h20m21.314776979s) [upload=336202]: Uploading segments... Aug 22 04:46:40.583573990 (323h20m21.31484166s) [upload=336202]: Got next segment. Inline: true Aug 22 04:46:40.583580282 (323h20m21.314847931s) [upload=336202]: Waiting for error group managing segments... Aug 22 04:46:40.583657377 (323h20m21.314925027s) [upload=336202]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 04:46:40.583663078 (323h20m21.314930728s) [upload=336202]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 04:46:40.583666133 (323h20m21.314933783s) [upload=336202]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 04:46:40.895260936 (323h20m21.626528577s) [upload=336202]: Done uploading segments... Aug 22 04:46:40.895278780 (323h20m21.62654643s) [upload=336202]: Upload finished. err: <nil>
Duration: 122.159084ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
455.965746ms
FAIL (2025-08-22 04:49:25 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 455.987226ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.........................X.......X......................X...] duration:
348.484935ms
FAIL (2025-08-22 04:49:13 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 22 04:46:40.583386657 (323h20m21.314654308s) [upload=336202]: Starting upload Aug 22 04:46:40.583444356 (323h20m21.314712005s) [upload=336202]: Done starting upload Aug 22 04:46:40.583509328 (323h20m21.314776979s) [upload=336202]: Uploading segments... Aug 22 04:46:40.583573990 (323h20m21.31484166s) [upload=336202]: Got next segment. Inline: true Aug 22 04:46:40.583580282 (323h20m21.314847931s) [upload=336202]: Waiting for error group managing segments... Aug 22 04:46:40.583657377 (323h20m21.314925027s) [upload=336202]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 04:46:40.583663078 (323h20m21.314930728s) [upload=336202]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 04:46:40.583666133 (323h20m21.314933783s) [upload=336202]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 04:46:40.895260936 (323h20m21.626528577s) [upload=336202]: Done uploading segments... Aug 22 04:46:40.895278780 (323h20m21.62654643s) [upload=336202]: Upload finished. err: <nil>
Duration: 348.513519ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
2.576020089s
FAIL (2025-08-22 04:48:49 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 22 04:14:56.030180971 (322h48m36.761448621s) [upload=335638]: Starting upload
Aug 22 04:14:56.030251765 (322h48m36.761519415s) [upload=335638]: Done starting upload
Aug 22 04:14:56.030449677 (322h48m36.761717337s) [upload=335638]: Uploading segments...
Aug 22 04:14:56.030627822 (322h48m36.761895473s) [upload=335638]: Got next segment. Inline: false
Aug 22 04:14:56.030671194 (322h48m36.761938845s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 04:14:56.030679730 (322h48m36.761947381s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 04:14:56.078560813 (322h48m36.809828453s) [seg_pos={0 0}, upload=335638]: Begin upload segment...
Aug 22 04:14:56.078602301 (322h48m36.809869951s) [seg_pos={0 0}, upload=335638]: Done begin upload segment.
Aug 22 04:14:56.078638679 (322h48m36.809906329s) [noise=true , address=77.90.31.15:4703 , piece_id=XH433WREH7EVXIAQMLI5EDLEN5FZJHAEHCYK5NL55VA2JWAVHTIA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.078649209 (322h48m36.809916859s) [noise=true , address=77.90.31.17:4775 , piece_id=2KCZ36SQFRJWMC3OBYW6674TLYLJEMDPQA7QSS4JVELCBC75BF7A, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079202952 (322h48m36.810470601s) [noise=true , address=79.127.201.215:4344 , piece_id=I4KQ6C7QKCUXYFYIVHMWWLI5RZC3YXUNVBQTGHAHZU7F6ELJ5GMA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079216498 (322h48m36.810484148s) [noise=true , address=77.90.31.10:4535 , piece_id=3MOUQMV5N7JI4V27RP3ZPKLF2P3ABFO4XP4TFHOPUHGVGILJYZWA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079590982 (322h48m36.810858633s) [noise=true , address=79.127.219.51:4185 , piece_id=5RHU7PFIBAY7KLYYVMNPGJBM33K5WWZ6E35Z52O3SF2XSVG3WKMQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079604748 (322h48m36.810872388s) [noise=true , address=104.36.82.6:4892 , piece_id=3WLX4OFVLCBLAE5OEI52JHUPYZNBOWMRX6LJWUYLPEKWPCFDBIBA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080091395 (322h48m36.811359044s) [noise=true , address=79.127.219.48:4093 , piece_id=NZBRQBL7Z52H3JCLLLD7CFBFWGC7H7MJTW6G2CFH57J2F4XDP4SA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080144284 (322h48m36.811411934s) [noise=true , address=79.127.205.235:4677 , piece_id=CB422NDFIO6VHBDC4QCP7UGLZRCGP2N3JRVZPFX4DFE5SU77RKMQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080582860 (322h48m36.811850511s) [noise=true , address=77.90.31.16:4761 , piece_id=AJWEB2GXZABAMZW7V4S3LF7FEYOI23K2ASL42NFIOFOWWQBZQQCA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081056942 (322h48m36.812324582s) [noise=true , address=77.90.31.11:4568 , piece_id=JC2LPEKYMWNJRQ2HMCIHDZKSICEZLK6C4ET3UIDUIRDD6MCL6ZJA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081504335 (322h48m36.812771984s) [noise=true , address=77.90.31.18:4811 , piece_id=ODPH32QDN7CTPF5IDUNQ5DEBC6HASD4BAP43ZVZDBIJFJLJWXHXA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081853813 (322h48m36.813121463s) [noise=true , address=104.36.82.23:4472 , piece_id=FCUL2C2XCQ2JKS46BDPNDSENIJBDDLL7TR7BW337GB6OR63DF4CQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082215645 (322h48m36.813483284s) [noise=true , address=77.90.31.19:4874 , piece_id=MCAFOKTALBSPDPMRSTHYZB3RGF7M5I55HOG3RUD463VCTVW7QCGQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082563559 (322h48m36.813831199s) [noise=true , address=104.36.82.60:4372 , piece_id=KUGRHZF4E4FOB4SYJF2NQ75LIF6IUXWMZ35URXHB7VDADYLZNYHQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082885666 (322h48m36.814153317s) [noise=true , address=45.91.116.11:4132 , piece_id=SBIASMWS5NC2XSHDENEKASMDEKQ3ODBPE4RKIQ4EZKZG6SP67JNQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.083847547 (322h48m36.815115197s) [noise=true , address=79.127.219.51:4200 , piece_id=SPPCLJ66SEENUH7SLHHXWI2UZHBEEY3KZIVVUAS3FBZ7CQY2G4LQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.084798477 (322h48m36.816066128s) [noise=true , address=104.36.82.44:4874 , piece_id=UCCAF4MUEIVBLMZRA2LSGWLJZSIBFMA7NY36IA7IB3KH4IBGXKAQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.088490439 (322h48m36.819758089s) [noise=true , address=104.36.82.5:4858 , piece_id=IYUCCI5NCZOTML7GFYI4LAS6NV47IC5UHCVLHFON3LJKZA2LFABA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.206801759 (322h48m36.938069408s) [upload=335638]: Next returned nil segment
Aug 22 04:14:56.206950910 (322h48m36.93821856s) [upload=335638]: Waiting for error group managing segments...
Aug 22 04:14:56.219298197 (322h48m36.950565838s) [noise=true , address=79.127.219.51:4185 , piece_id=5RHU7PFIBAY7KLYYVMNPGJBM33K5WWZ6E35Z52O3SF2XSVG3WKMQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.221650127 (322h48m36.952917776s) [noise=true , address=79.127.219.51:4200 , piece_id=SPPCLJ66SEENUH7SLHHXWI2UZHBEEY3KZIVVUAS3FBZ7CQY2G4LQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.221873898 (322h48m36.953141537s) [noise=true , address=79.127.219.48:4093 , piece_id=NZBRQBL7Z52H3JCLLLD7CFBFWGC7H7MJTW6G2CFH57J2F4XDP4SA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.222678583 (322h48m36.953946232s) [noise=true , address=77.90.31.18:4811 , piece_id=ODPH32QDN7CTPF5IDUNQ5DEBC6HASD4BAP43ZVZDBIJFJLJWXHXA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.224688627 (322h48m36.955956277s) [noise=true , address=104.36.82.6:4892 , piece_id=3WLX4OFVLCBLAE5OEI52JHUPYZNBOWMRX6LJWUYLPEKWPCFDBIBA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.226219780 (322h48m36.95748742s) [noise=true , address=77.90.31.19:4874 , piece_id=MCAFOKTALBSPDPMRSTHYZB3RGF7M5I55HOG3RUD463VCTVW7QCGQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.226285995 (322h48m36.957553645s) [noise=true , address=77.90.31.17:4775 , piece_id=2KCZ36SQFRJWMC3OBYW6674TLYLJEMDPQA7QSS4JVELCBC75BF7A, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.228103006 (322h48m36.959370626s) [noise=true , address=104.36.82.44:4874 , piece_id=UCCAF4MUEIVBLMZRA2LSGWLJZSIBFMA7NY36IA7IB3KH4IBGXKAQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.237068737 (322h48m36.968336377s) [noise=true , address=77.90.31.16:4761 , piece_id=AJWEB2GXZABAMZW7V4S3LF7FEYOI23K2ASL42NFIOFOWWQBZQQCA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.248700377 (322h48m36.979968027s) [noise=true , address=45.91.116.11:4132 , piece_id=SBIASMWS5NC2XSHDENEKASMDEKQ3ODBPE4RKIQ4EZKZG6SP67JNQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.252483180 (322h48m36.98375083s) [noise=true , address=104.36.82.5:4858 , piece_id=IYUCCI5NCZOTML7GFYI4LAS6NV47IC5UHCVLHFON3LJKZA2LFABA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.268821762 (322h48m37.000089423s) [noise=true , address=77.90.31.15:4703 , piece_id=XH433WREH7EVXIAQMLI5EDLEN5FZJHAEHCYK5NL55VA2JWAVHTIA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.273574892 (322h48m37.004842553s) [noise=true , address=77.90.31.10:4535 , piece_id=3MOUQMV5N7JI4V27RP3ZPKLF2P3ABFO4XP4TFHOPUHGVGILJYZWA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.308274656 (322h48m37.039542306s) [noise=true , address=104.36.82.60:4372 , piece_id=KUGRHZF4E4FOB4SYJF2NQ75LIF6IUXWMZ35URXHB7VDADYLZNYHQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.308311565 (322h48m37.039579215s) [seg_pos={0 0}, upload=335638]: Segment reached optimal threshold of 14 pieces.
Aug 22 04:14:56.308536709 (322h48m37.039804359s) [noise=true , address=104.36.82.23:4472 , piece_id=FCUL2C2XCQ2JKS46BDPNDSENIJBDDLL7TR7BW337GB6OR63DF4CQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF
Aug 22 04:14:56.308649492 (322h48m37.039917141s) [noise=true , address=77.90.31.11:4568 , piece_id=JC2LPEKYMWNJRQ2HMCIHDZKSICEZLK6C4ET3UIDUIRDD6MCL6ZJA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1H1L8DTKD7W7Xx1PVT7KzB9GkGBadnTEj9BHtbSgcW1S7Jj8Tw): protocol: expected piece hash; context canceled; EOF
Aug 22 04:14:56.308765871 (322h48m37.040033521s) [noise=true , address=79.127.205.235:4677 , piece_id=CB422NDFIO6VHBDC4QCP7UGLZRCGP2N3JRVZPFX4DFE5SU77RKMQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oeYzce3yvWfVUnLYKyRyPePYh4QRj86FowWm3hRZ1qHQ6TSLa): protocol: read tcp 5.161.89.252:30854->79.127.205.235:4677: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 04:14:56.308796689 (322h48m37.040064349s) [noise=true , address=79.127.201.215:4344 , piece_id=I4KQ6C7QKCUXYFYIVHMWWLI5RZC3YXUNVBQTGHAHZU7F6ELJ5GMA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: read tcp 5.161.89.252:38178->79.127.201.215:4344: use of closed network connection; context canceled
Aug 22 04:14:56.308831504 (322h48m37.040099164s) [seg_pos={0 0}, upload=335638]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 04:14:56.309045818 (322h48m37.040313488s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 04:14:56.309058031 (322h48m37.040325681s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 04:14:56.409269392 (322h48m37.140537052s) [upload=335638]: Done uploading segments...
Aug 22 04:14:56.409287577 (322h48m37.140555237s) [upload=335638]: Upload finished. err: <nil>
Duration: 2.576042744s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
426.16828ms
FAIL (2025-08-22 04:48:39 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 426.191202ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
1.77421772s
FAIL (2025-08-22 04:48:14 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 22 04:14:56.030180971 (322h48m36.761448621s) [upload=335638]: Starting upload
Aug 22 04:14:56.030251765 (322h48m36.761519415s) [upload=335638]: Done starting upload
Aug 22 04:14:56.030449677 (322h48m36.761717337s) [upload=335638]: Uploading segments...
Aug 22 04:14:56.030627822 (322h48m36.761895473s) [upload=335638]: Got next segment. Inline: false
Aug 22 04:14:56.030671194 (322h48m36.761938845s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 04:14:56.030679730 (322h48m36.761947381s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 04:14:56.078560813 (322h48m36.809828453s) [seg_pos={0 0}, upload=335638]: Begin upload segment...
Aug 22 04:14:56.078602301 (322h48m36.809869951s) [seg_pos={0 0}, upload=335638]: Done begin upload segment.
Aug 22 04:14:56.078638679 (322h48m36.809906329s) [noise=true , address=77.90.31.15:4703 , piece_id=XH433WREH7EVXIAQMLI5EDLEN5FZJHAEHCYK5NL55VA2JWAVHTIA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.078649209 (322h48m36.809916859s) [noise=true , address=77.90.31.17:4775 , piece_id=2KCZ36SQFRJWMC3OBYW6674TLYLJEMDPQA7QSS4JVELCBC75BF7A, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079202952 (322h48m36.810470601s) [noise=true , address=79.127.201.215:4344 , piece_id=I4KQ6C7QKCUXYFYIVHMWWLI5RZC3YXUNVBQTGHAHZU7F6ELJ5GMA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079216498 (322h48m36.810484148s) [noise=true , address=77.90.31.10:4535 , piece_id=3MOUQMV5N7JI4V27RP3ZPKLF2P3ABFO4XP4TFHOPUHGVGILJYZWA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079590982 (322h48m36.810858633s) [noise=true , address=79.127.219.51:4185 , piece_id=5RHU7PFIBAY7KLYYVMNPGJBM33K5WWZ6E35Z52O3SF2XSVG3WKMQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079604748 (322h48m36.810872388s) [noise=true , address=104.36.82.6:4892 , piece_id=3WLX4OFVLCBLAE5OEI52JHUPYZNBOWMRX6LJWUYLPEKWPCFDBIBA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080091395 (322h48m36.811359044s) [noise=true , address=79.127.219.48:4093 , piece_id=NZBRQBL7Z52H3JCLLLD7CFBFWGC7H7MJTW6G2CFH57J2F4XDP4SA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080144284 (322h48m36.811411934s) [noise=true , address=79.127.205.235:4677 , piece_id=CB422NDFIO6VHBDC4QCP7UGLZRCGP2N3JRVZPFX4DFE5SU77RKMQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080582860 (322h48m36.811850511s) [noise=true , address=77.90.31.16:4761 , piece_id=AJWEB2GXZABAMZW7V4S3LF7FEYOI23K2ASL42NFIOFOWWQBZQQCA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081056942 (322h48m36.812324582s) [noise=true , address=77.90.31.11:4568 , piece_id=JC2LPEKYMWNJRQ2HMCIHDZKSICEZLK6C4ET3UIDUIRDD6MCL6ZJA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081504335 (322h48m36.812771984s) [noise=true , address=77.90.31.18:4811 , piece_id=ODPH32QDN7CTPF5IDUNQ5DEBC6HASD4BAP43ZVZDBIJFJLJWXHXA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081853813 (322h48m36.813121463s) [noise=true , address=104.36.82.23:4472 , piece_id=FCUL2C2XCQ2JKS46BDPNDSENIJBDDLL7TR7BW337GB6OR63DF4CQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082215645 (322h48m36.813483284s) [noise=true , address=77.90.31.19:4874 , piece_id=MCAFOKTALBSPDPMRSTHYZB3RGF7M5I55HOG3RUD463VCTVW7QCGQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082563559 (322h48m36.813831199s) [noise=true , address=104.36.82.60:4372 , piece_id=KUGRHZF4E4FOB4SYJF2NQ75LIF6IUXWMZ35URXHB7VDADYLZNYHQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082885666 (322h48m36.814153317s) [noise=true , address=45.91.116.11:4132 , piece_id=SBIASMWS5NC2XSHDENEKASMDEKQ3ODBPE4RKIQ4EZKZG6SP67JNQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.083847547 (322h48m36.815115197s) [noise=true , address=79.127.219.51:4200 , piece_id=SPPCLJ66SEENUH7SLHHXWI2UZHBEEY3KZIVVUAS3FBZ7CQY2G4LQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.084798477 (322h48m36.816066128s) [noise=true , address=104.36.82.44:4874 , piece_id=UCCAF4MUEIVBLMZRA2LSGWLJZSIBFMA7NY36IA7IB3KH4IBGXKAQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.088490439 (322h48m36.819758089s) [noise=true , address=104.36.82.5:4858 , piece_id=IYUCCI5NCZOTML7GFYI4LAS6NV47IC5UHCVLHFON3LJKZA2LFABA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.206801759 (322h48m36.938069408s) [upload=335638]: Next returned nil segment
Aug 22 04:14:56.206950910 (322h48m36.93821856s) [upload=335638]: Waiting for error group managing segments...
Aug 22 04:14:56.219298197 (322h48m36.950565838s) [noise=true , address=79.127.219.51:4185 , piece_id=5RHU7PFIBAY7KLYYVMNPGJBM33K5WWZ6E35Z52O3SF2XSVG3WKMQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.221650127 (322h48m36.952917776s) [noise=true , address=79.127.219.51:4200 , piece_id=SPPCLJ66SEENUH7SLHHXWI2UZHBEEY3KZIVVUAS3FBZ7CQY2G4LQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.221873898 (322h48m36.953141537s) [noise=true , address=79.127.219.48:4093 , piece_id=NZBRQBL7Z52H3JCLLLD7CFBFWGC7H7MJTW6G2CFH57J2F4XDP4SA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.222678583 (322h48m36.953946232s) [noise=true , address=77.90.31.18:4811 , piece_id=ODPH32QDN7CTPF5IDUNQ5DEBC6HASD4BAP43ZVZDBIJFJLJWXHXA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.224688627 (322h48m36.955956277s) [noise=true , address=104.36.82.6:4892 , piece_id=3WLX4OFVLCBLAE5OEI52JHUPYZNBOWMRX6LJWUYLPEKWPCFDBIBA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.226219780 (322h48m36.95748742s) [noise=true , address=77.90.31.19:4874 , piece_id=MCAFOKTALBSPDPMRSTHYZB3RGF7M5I55HOG3RUD463VCTVW7QCGQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.226285995 (322h48m36.957553645s) [noise=true , address=77.90.31.17:4775 , piece_id=2KCZ36SQFRJWMC3OBYW6674TLYLJEMDPQA7QSS4JVELCBC75BF7A, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.228103006 (322h48m36.959370626s) [noise=true , address=104.36.82.44:4874 , piece_id=UCCAF4MUEIVBLMZRA2LSGWLJZSIBFMA7NY36IA7IB3KH4IBGXKAQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.237068737 (322h48m36.968336377s) [noise=true , address=77.90.31.16:4761 , piece_id=AJWEB2GXZABAMZW7V4S3LF7FEYOI23K2ASL42NFIOFOWWQBZQQCA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.248700377 (322h48m36.979968027s) [noise=true , address=45.91.116.11:4132 , piece_id=SBIASMWS5NC2XSHDENEKASMDEKQ3ODBPE4RKIQ4EZKZG6SP67JNQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.252483180 (322h48m36.98375083s) [noise=true , address=104.36.82.5:4858 , piece_id=IYUCCI5NCZOTML7GFYI4LAS6NV47IC5UHCVLHFON3LJKZA2LFABA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.268821762 (322h48m37.000089423s) [noise=true , address=77.90.31.15:4703 , piece_id=XH433WREH7EVXIAQMLI5EDLEN5FZJHAEHCYK5NL55VA2JWAVHTIA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.273574892 (322h48m37.004842553s) [noise=true , address=77.90.31.10:4535 , piece_id=3MOUQMV5N7JI4V27RP3ZPKLF2P3ABFO4XP4TFHOPUHGVGILJYZWA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.308274656 (322h48m37.039542306s) [noise=true , address=104.36.82.60:4372 , piece_id=KUGRHZF4E4FOB4SYJF2NQ75LIF6IUXWMZ35URXHB7VDADYLZNYHQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.308311565 (322h48m37.039579215s) [seg_pos={0 0}, upload=335638]: Segment reached optimal threshold of 14 pieces.
Aug 22 04:14:56.308536709 (322h48m37.039804359s) [noise=true , address=104.36.82.23:4472 , piece_id=FCUL2C2XCQ2JKS46BDPNDSENIJBDDLL7TR7BW337GB6OR63DF4CQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF
Aug 22 04:14:56.308649492 (322h48m37.039917141s) [noise=true , address=77.90.31.11:4568 , piece_id=JC2LPEKYMWNJRQ2HMCIHDZKSICEZLK6C4ET3UIDUIRDD6MCL6ZJA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1H1L8DTKD7W7Xx1PVT7KzB9GkGBadnTEj9BHtbSgcW1S7Jj8Tw): protocol: expected piece hash; context canceled; EOF
Aug 22 04:14:56.308765871 (322h48m37.040033521s) [noise=true , address=79.127.205.235:4677 , piece_id=CB422NDFIO6VHBDC4QCP7UGLZRCGP2N3JRVZPFX4DFE5SU77RKMQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oeYzce3yvWfVUnLYKyRyPePYh4QRj86FowWm3hRZ1qHQ6TSLa): protocol: read tcp 5.161.89.252:30854->79.127.205.235:4677: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 04:14:56.308796689 (322h48m37.040064349s) [noise=true , address=79.127.201.215:4344 , piece_id=I4KQ6C7QKCUXYFYIVHMWWLI5RZC3YXUNVBQTGHAHZU7F6ELJ5GMA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: read tcp 5.161.89.252:38178->79.127.201.215:4344: use of closed network connection; context canceled
Aug 22 04:14:56.308831504 (322h48m37.040099164s) [seg_pos={0 0}, upload=335638]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 04:14:56.309045818 (322h48m37.040313488s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 04:14:56.309058031 (322h48m37.040325681s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 04:14:56.409269392 (322h48m37.140537052s) [upload=335638]: Done uploading segments...
Aug 22 04:14:56.409287577 (322h48m37.140555237s) [upload=335638]: Upload finished. err: <nil>
Duration: 1.774236657s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..........................X.......X......................X..] duration:
139.133514ms
FAIL (2025-08-22 04:48:09 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 22 04:46:40.583386657 (323h20m21.314654308s) [upload=336202]: Starting upload Aug 22 04:46:40.583444356 (323h20m21.314712005s) [upload=336202]: Done starting upload Aug 22 04:46:40.583509328 (323h20m21.314776979s) [upload=336202]: Uploading segments... Aug 22 04:46:40.583573990 (323h20m21.31484166s) [upload=336202]: Got next segment. Inline: true Aug 22 04:46:40.583580282 (323h20m21.314847931s) [upload=336202]: Waiting for error group managing segments... Aug 22 04:46:40.583657377 (323h20m21.314925027s) [upload=336202]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 04:46:40.583663078 (323h20m21.314930728s) [upload=336202]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 04:46:40.583666133 (323h20m21.314933783s) [upload=336202]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 04:46:40.895260936 (323h20m21.626528577s) [upload=336202]: Done uploading segments... Aug 22 04:46:40.895278780 (323h20m21.62654643s) [upload=336202]: Upload finished. err: <nil>
Duration: 139.161396ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
477.207462ms
FAIL (2025-08-22 04:47:50 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 477.234291ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...........................X.......X......................X.] duration:
135.257598ms
FAIL (2025-08-22 04:47:18 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 22 04:46:40.583386657 (323h20m21.314654308s) [upload=336202]: Starting upload Aug 22 04:46:40.583444356 (323h20m21.314712005s) [upload=336202]: Done starting upload Aug 22 04:46:40.583509328 (323h20m21.314776979s) [upload=336202]: Uploading segments... Aug 22 04:46:40.583573990 (323h20m21.31484166s) [upload=336202]: Got next segment. Inline: true Aug 22 04:46:40.583580282 (323h20m21.314847931s) [upload=336202]: Waiting for error group managing segments... Aug 22 04:46:40.583657377 (323h20m21.314925027s) [upload=336202]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 04:46:40.583663078 (323h20m21.314930728s) [upload=336202]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 04:46:40.583666133 (323h20m21.314933783s) [upload=336202]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 04:46:40.895260936 (323h20m21.626528577s) [upload=336202]: Done uploading segments... Aug 22 04:46:40.895278780 (323h20m21.62654643s) [upload=336202]: Upload finished. err: <nil>
Duration: 135.284349ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
425.867422ms
FAIL (2025-08-22 04:47:01 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 22 04:14:56.030180971 (322h48m36.761448621s) [upload=335638]: Starting upload
Aug 22 04:14:56.030251765 (322h48m36.761519415s) [upload=335638]: Done starting upload
Aug 22 04:14:56.030449677 (322h48m36.761717337s) [upload=335638]: Uploading segments...
Aug 22 04:14:56.030627822 (322h48m36.761895473s) [upload=335638]: Got next segment. Inline: false
Aug 22 04:14:56.030671194 (322h48m36.761938845s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 04:14:56.030679730 (322h48m36.761947381s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 04:14:56.078560813 (322h48m36.809828453s) [seg_pos={0 0}, upload=335638]: Begin upload segment...
Aug 22 04:14:56.078602301 (322h48m36.809869951s) [seg_pos={0 0}, upload=335638]: Done begin upload segment.
Aug 22 04:14:56.078638679 (322h48m36.809906329s) [noise=true , address=77.90.31.15:4703 , piece_id=XH433WREH7EVXIAQMLI5EDLEN5FZJHAEHCYK5NL55VA2JWAVHTIA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.078649209 (322h48m36.809916859s) [noise=true , address=77.90.31.17:4775 , piece_id=2KCZ36SQFRJWMC3OBYW6674TLYLJEMDPQA7QSS4JVELCBC75BF7A, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079202952 (322h48m36.810470601s) [noise=true , address=79.127.201.215:4344 , piece_id=I4KQ6C7QKCUXYFYIVHMWWLI5RZC3YXUNVBQTGHAHZU7F6ELJ5GMA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079216498 (322h48m36.810484148s) [noise=true , address=77.90.31.10:4535 , piece_id=3MOUQMV5N7JI4V27RP3ZPKLF2P3ABFO4XP4TFHOPUHGVGILJYZWA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079590982 (322h48m36.810858633s) [noise=true , address=79.127.219.51:4185 , piece_id=5RHU7PFIBAY7KLYYVMNPGJBM33K5WWZ6E35Z52O3SF2XSVG3WKMQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079604748 (322h48m36.810872388s) [noise=true , address=104.36.82.6:4892 , piece_id=3WLX4OFVLCBLAE5OEI52JHUPYZNBOWMRX6LJWUYLPEKWPCFDBIBA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080091395 (322h48m36.811359044s) [noise=true , address=79.127.219.48:4093 , piece_id=NZBRQBL7Z52H3JCLLLD7CFBFWGC7H7MJTW6G2CFH57J2F4XDP4SA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080144284 (322h48m36.811411934s) [noise=true , address=79.127.205.235:4677 , piece_id=CB422NDFIO6VHBDC4QCP7UGLZRCGP2N3JRVZPFX4DFE5SU77RKMQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080582860 (322h48m36.811850511s) [noise=true , address=77.90.31.16:4761 , piece_id=AJWEB2GXZABAMZW7V4S3LF7FEYOI23K2ASL42NFIOFOWWQBZQQCA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081056942 (322h48m36.812324582s) [noise=true , address=77.90.31.11:4568 , piece_id=JC2LPEKYMWNJRQ2HMCIHDZKSICEZLK6C4ET3UIDUIRDD6MCL6ZJA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081504335 (322h48m36.812771984s) [noise=true , address=77.90.31.18:4811 , piece_id=ODPH32QDN7CTPF5IDUNQ5DEBC6HASD4BAP43ZVZDBIJFJLJWXHXA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081853813 (322h48m36.813121463s) [noise=true , address=104.36.82.23:4472 , piece_id=FCUL2C2XCQ2JKS46BDPNDSENIJBDDLL7TR7BW337GB6OR63DF4CQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082215645 (322h48m36.813483284s) [noise=true , address=77.90.31.19:4874 , piece_id=MCAFOKTALBSPDPMRSTHYZB3RGF7M5I55HOG3RUD463VCTVW7QCGQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082563559 (322h48m36.813831199s) [noise=true , address=104.36.82.60:4372 , piece_id=KUGRHZF4E4FOB4SYJF2NQ75LIF6IUXWMZ35URXHB7VDADYLZNYHQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082885666 (322h48m36.814153317s) [noise=true , address=45.91.116.11:4132 , piece_id=SBIASMWS5NC2XSHDENEKASMDEKQ3ODBPE4RKIQ4EZKZG6SP67JNQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.083847547 (322h48m36.815115197s) [noise=true , address=79.127.219.51:4200 , piece_id=SPPCLJ66SEENUH7SLHHXWI2UZHBEEY3KZIVVUAS3FBZ7CQY2G4LQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.084798477 (322h48m36.816066128s) [noise=true , address=104.36.82.44:4874 , piece_id=UCCAF4MUEIVBLMZRA2LSGWLJZSIBFMA7NY36IA7IB3KH4IBGXKAQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.088490439 (322h48m36.819758089s) [noise=true , address=104.36.82.5:4858 , piece_id=IYUCCI5NCZOTML7GFYI4LAS6NV47IC5UHCVLHFON3LJKZA2LFABA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.206801759 (322h48m36.938069408s) [upload=335638]: Next returned nil segment
Aug 22 04:14:56.206950910 (322h48m36.93821856s) [upload=335638]: Waiting for error group managing segments...
Aug 22 04:14:56.219298197 (322h48m36.950565838s) [noise=true , address=79.127.219.51:4185 , piece_id=5RHU7PFIBAY7KLYYVMNPGJBM33K5WWZ6E35Z52O3SF2XSVG3WKMQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.221650127 (322h48m36.952917776s) [noise=true , address=79.127.219.51:4200 , piece_id=SPPCLJ66SEENUH7SLHHXWI2UZHBEEY3KZIVVUAS3FBZ7CQY2G4LQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.221873898 (322h48m36.953141537s) [noise=true , address=79.127.219.48:4093 , piece_id=NZBRQBL7Z52H3JCLLLD7CFBFWGC7H7MJTW6G2CFH57J2F4XDP4SA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.222678583 (322h48m36.953946232s) [noise=true , address=77.90.31.18:4811 , piece_id=ODPH32QDN7CTPF5IDUNQ5DEBC6HASD4BAP43ZVZDBIJFJLJWXHXA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.224688627 (322h48m36.955956277s) [noise=true , address=104.36.82.6:4892 , piece_id=3WLX4OFVLCBLAE5OEI52JHUPYZNBOWMRX6LJWUYLPEKWPCFDBIBA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.226219780 (322h48m36.95748742s) [noise=true , address=77.90.31.19:4874 , piece_id=MCAFOKTALBSPDPMRSTHYZB3RGF7M5I55HOG3RUD463VCTVW7QCGQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.226285995 (322h48m36.957553645s) [noise=true , address=77.90.31.17:4775 , piece_id=2KCZ36SQFRJWMC3OBYW6674TLYLJEMDPQA7QSS4JVELCBC75BF7A, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.228103006 (322h48m36.959370626s) [noise=true , address=104.36.82.44:4874 , piece_id=UCCAF4MUEIVBLMZRA2LSGWLJZSIBFMA7NY36IA7IB3KH4IBGXKAQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.237068737 (322h48m36.968336377s) [noise=true , address=77.90.31.16:4761 , piece_id=AJWEB2GXZABAMZW7V4S3LF7FEYOI23K2ASL42NFIOFOWWQBZQQCA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.248700377 (322h48m36.979968027s) [noise=true , address=45.91.116.11:4132 , piece_id=SBIASMWS5NC2XSHDENEKASMDEKQ3ODBPE4RKIQ4EZKZG6SP67JNQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.252483180 (322h48m36.98375083s) [noise=true , address=104.36.82.5:4858 , piece_id=IYUCCI5NCZOTML7GFYI4LAS6NV47IC5UHCVLHFON3LJKZA2LFABA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.268821762 (322h48m37.000089423s) [noise=true , address=77.90.31.15:4703 , piece_id=XH433WREH7EVXIAQMLI5EDLEN5FZJHAEHCYK5NL55VA2JWAVHTIA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.273574892 (322h48m37.004842553s) [noise=true , address=77.90.31.10:4535 , piece_id=3MOUQMV5N7JI4V27RP3ZPKLF2P3ABFO4XP4TFHOPUHGVGILJYZWA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.308274656 (322h48m37.039542306s) [noise=true , address=104.36.82.60:4372 , piece_id=KUGRHZF4E4FOB4SYJF2NQ75LIF6IUXWMZ35URXHB7VDADYLZNYHQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.308311565 (322h48m37.039579215s) [seg_pos={0 0}, upload=335638]: Segment reached optimal threshold of 14 pieces.
Aug 22 04:14:56.308536709 (322h48m37.039804359s) [noise=true , address=104.36.82.23:4472 , piece_id=FCUL2C2XCQ2JKS46BDPNDSENIJBDDLL7TR7BW337GB6OR63DF4CQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF
Aug 22 04:14:56.308649492 (322h48m37.039917141s) [noise=true , address=77.90.31.11:4568 , piece_id=JC2LPEKYMWNJRQ2HMCIHDZKSICEZLK6C4ET3UIDUIRDD6MCL6ZJA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1H1L8DTKD7W7Xx1PVT7KzB9GkGBadnTEj9BHtbSgcW1S7Jj8Tw): protocol: expected piece hash; context canceled; EOF
Aug 22 04:14:56.308765871 (322h48m37.040033521s) [noise=true , address=79.127.205.235:4677 , piece_id=CB422NDFIO6VHBDC4QCP7UGLZRCGP2N3JRVZPFX4DFE5SU77RKMQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oeYzce3yvWfVUnLYKyRyPePYh4QRj86FowWm3hRZ1qHQ6TSLa): protocol: read tcp 5.161.89.252:30854->79.127.205.235:4677: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 04:14:56.308796689 (322h48m37.040064349s) [noise=true , address=79.127.201.215:4344 , piece_id=I4KQ6C7QKCUXYFYIVHMWWLI5RZC3YXUNVBQTGHAHZU7F6ELJ5GMA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: read tcp 5.161.89.252:38178->79.127.201.215:4344: use of closed network connection; context canceled
Aug 22 04:14:56.308831504 (322h48m37.040099164s) [seg_pos={0 0}, upload=335638]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 04:14:56.309045818 (322h48m37.040313488s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 04:14:56.309058031 (322h48m37.040325681s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 04:14:56.409269392 (322h48m37.140537052s) [upload=335638]: Done uploading segments...
Aug 22 04:14:56.409287577 (322h48m37.140555237s) [upload=335638]: Upload finished. err: <nil>
Duration: 425.887101ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
407.207968ms
FAIL (2025-08-22 04:46:49 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 407.239497ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [............................X.......X......................X] duration:
413.963642ms
FAIL (2025-08-22 04:46:40 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 22 04:46:40.583386657 (323h20m21.314654308s) [upload=336202]: Starting upload Aug 22 04:46:40.583444356 (323h20m21.314712005s) [upload=336202]: Done starting upload Aug 22 04:46:40.583509328 (323h20m21.314776979s) [upload=336202]: Uploading segments... Aug 22 04:46:40.583573990 (323h20m21.31484166s) [upload=336202]: Got next segment. Inline: true Aug 22 04:46:40.583580282 (323h20m21.314847931s) [upload=336202]: Waiting for error group managing segments... Aug 22 04:46:40.583657377 (323h20m21.314925027s) [upload=336202]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 04:46:40.583663078 (323h20m21.314930728s) [upload=336202]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 04:46:40.583666133 (323h20m21.314933783s) [upload=336202]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 04:46:40.895260936 (323h20m21.626528577s) [upload=336202]: Done uploading segments... Aug 22 04:46:40.895278780 (323h20m21.62654643s) [upload=336202]: Upload finished. err: <nil>
Duration: 413.986937ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
367.793678ms
FAIL (2025-08-22 04:46:08 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 367.811662ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
464.263519ms
FAIL (2025-08-22 04:46:07 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 22 04:14:56.030180971 (322h48m36.761448621s) [upload=335638]: Starting upload
Aug 22 04:14:56.030251765 (322h48m36.761519415s) [upload=335638]: Done starting upload
Aug 22 04:14:56.030449677 (322h48m36.761717337s) [upload=335638]: Uploading segments...
Aug 22 04:14:56.030627822 (322h48m36.761895473s) [upload=335638]: Got next segment. Inline: false
Aug 22 04:14:56.030671194 (322h48m36.761938845s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 04:14:56.030679730 (322h48m36.761947381s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 04:14:56.078560813 (322h48m36.809828453s) [seg_pos={0 0}, upload=335638]: Begin upload segment...
Aug 22 04:14:56.078602301 (322h48m36.809869951s) [seg_pos={0 0}, upload=335638]: Done begin upload segment.
Aug 22 04:14:56.078638679 (322h48m36.809906329s) [noise=true , address=77.90.31.15:4703 , piece_id=XH433WREH7EVXIAQMLI5EDLEN5FZJHAEHCYK5NL55VA2JWAVHTIA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.078649209 (322h48m36.809916859s) [noise=true , address=77.90.31.17:4775 , piece_id=2KCZ36SQFRJWMC3OBYW6674TLYLJEMDPQA7QSS4JVELCBC75BF7A, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079202952 (322h48m36.810470601s) [noise=true , address=79.127.201.215:4344 , piece_id=I4KQ6C7QKCUXYFYIVHMWWLI5RZC3YXUNVBQTGHAHZU7F6ELJ5GMA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079216498 (322h48m36.810484148s) [noise=true , address=77.90.31.10:4535 , piece_id=3MOUQMV5N7JI4V27RP3ZPKLF2P3ABFO4XP4TFHOPUHGVGILJYZWA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079590982 (322h48m36.810858633s) [noise=true , address=79.127.219.51:4185 , piece_id=5RHU7PFIBAY7KLYYVMNPGJBM33K5WWZ6E35Z52O3SF2XSVG3WKMQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079604748 (322h48m36.810872388s) [noise=true , address=104.36.82.6:4892 , piece_id=3WLX4OFVLCBLAE5OEI52JHUPYZNBOWMRX6LJWUYLPEKWPCFDBIBA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080091395 (322h48m36.811359044s) [noise=true , address=79.127.219.48:4093 , piece_id=NZBRQBL7Z52H3JCLLLD7CFBFWGC7H7MJTW6G2CFH57J2F4XDP4SA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080144284 (322h48m36.811411934s) [noise=true , address=79.127.205.235:4677 , piece_id=CB422NDFIO6VHBDC4QCP7UGLZRCGP2N3JRVZPFX4DFE5SU77RKMQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080582860 (322h48m36.811850511s) [noise=true , address=77.90.31.16:4761 , piece_id=AJWEB2GXZABAMZW7V4S3LF7FEYOI23K2ASL42NFIOFOWWQBZQQCA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081056942 (322h48m36.812324582s) [noise=true , address=77.90.31.11:4568 , piece_id=JC2LPEKYMWNJRQ2HMCIHDZKSICEZLK6C4ET3UIDUIRDD6MCL6ZJA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081504335 (322h48m36.812771984s) [noise=true , address=77.90.31.18:4811 , piece_id=ODPH32QDN7CTPF5IDUNQ5DEBC6HASD4BAP43ZVZDBIJFJLJWXHXA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081853813 (322h48m36.813121463s) [noise=true , address=104.36.82.23:4472 , piece_id=FCUL2C2XCQ2JKS46BDPNDSENIJBDDLL7TR7BW337GB6OR63DF4CQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082215645 (322h48m36.813483284s) [noise=true , address=77.90.31.19:4874 , piece_id=MCAFOKTALBSPDPMRSTHYZB3RGF7M5I55HOG3RUD463VCTVW7QCGQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082563559 (322h48m36.813831199s) [noise=true , address=104.36.82.60:4372 , piece_id=KUGRHZF4E4FOB4SYJF2NQ75LIF6IUXWMZ35URXHB7VDADYLZNYHQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082885666 (322h48m36.814153317s) [noise=true , address=45.91.116.11:4132 , piece_id=SBIASMWS5NC2XSHDENEKASMDEKQ3ODBPE4RKIQ4EZKZG6SP67JNQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.083847547 (322h48m36.815115197s) [noise=true , address=79.127.219.51:4200 , piece_id=SPPCLJ66SEENUH7SLHHXWI2UZHBEEY3KZIVVUAS3FBZ7CQY2G4LQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.084798477 (322h48m36.816066128s) [noise=true , address=104.36.82.44:4874 , piece_id=UCCAF4MUEIVBLMZRA2LSGWLJZSIBFMA7NY36IA7IB3KH4IBGXKAQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.088490439 (322h48m36.819758089s) [noise=true , address=104.36.82.5:4858 , piece_id=IYUCCI5NCZOTML7GFYI4LAS6NV47IC5UHCVLHFON3LJKZA2LFABA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.206801759 (322h48m36.938069408s) [upload=335638]: Next returned nil segment
Aug 22 04:14:56.206950910 (322h48m36.93821856s) [upload=335638]: Waiting for error group managing segments...
Aug 22 04:14:56.219298197 (322h48m36.950565838s) [noise=true , address=79.127.219.51:4185 , piece_id=5RHU7PFIBAY7KLYYVMNPGJBM33K5WWZ6E35Z52O3SF2XSVG3WKMQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.221650127 (322h48m36.952917776s) [noise=true , address=79.127.219.51:4200 , piece_id=SPPCLJ66SEENUH7SLHHXWI2UZHBEEY3KZIVVUAS3FBZ7CQY2G4LQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.221873898 (322h48m36.953141537s) [noise=true , address=79.127.219.48:4093 , piece_id=NZBRQBL7Z52H3JCLLLD7CFBFWGC7H7MJTW6G2CFH57J2F4XDP4SA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.222678583 (322h48m36.953946232s) [noise=true , address=77.90.31.18:4811 , piece_id=ODPH32QDN7CTPF5IDUNQ5DEBC6HASD4BAP43ZVZDBIJFJLJWXHXA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.224688627 (322h48m36.955956277s) [noise=true , address=104.36.82.6:4892 , piece_id=3WLX4OFVLCBLAE5OEI52JHUPYZNBOWMRX6LJWUYLPEKWPCFDBIBA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.226219780 (322h48m36.95748742s) [noise=true , address=77.90.31.19:4874 , piece_id=MCAFOKTALBSPDPMRSTHYZB3RGF7M5I55HOG3RUD463VCTVW7QCGQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.226285995 (322h48m36.957553645s) [noise=true , address=77.90.31.17:4775 , piece_id=2KCZ36SQFRJWMC3OBYW6674TLYLJEMDPQA7QSS4JVELCBC75BF7A, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.228103006 (322h48m36.959370626s) [noise=true , address=104.36.82.44:4874 , piece_id=UCCAF4MUEIVBLMZRA2LSGWLJZSIBFMA7NY36IA7IB3KH4IBGXKAQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.237068737 (322h48m36.968336377s) [noise=true , address=77.90.31.16:4761 , piece_id=AJWEB2GXZABAMZW7V4S3LF7FEYOI23K2ASL42NFIOFOWWQBZQQCA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.248700377 (322h48m36.979968027s) [noise=true , address=45.91.116.11:4132 , piece_id=SBIASMWS5NC2XSHDENEKASMDEKQ3ODBPE4RKIQ4EZKZG6SP67JNQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.252483180 (322h48m36.98375083s) [noise=true , address=104.36.82.5:4858 , piece_id=IYUCCI5NCZOTML7GFYI4LAS6NV47IC5UHCVLHFON3LJKZA2LFABA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.268821762 (322h48m37.000089423s) [noise=true , address=77.90.31.15:4703 , piece_id=XH433WREH7EVXIAQMLI5EDLEN5FZJHAEHCYK5NL55VA2JWAVHTIA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.273574892 (322h48m37.004842553s) [noise=true , address=77.90.31.10:4535 , piece_id=3MOUQMV5N7JI4V27RP3ZPKLF2P3ABFO4XP4TFHOPUHGVGILJYZWA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.308274656 (322h48m37.039542306s) [noise=true , address=104.36.82.60:4372 , piece_id=KUGRHZF4E4FOB4SYJF2NQ75LIF6IUXWMZ35URXHB7VDADYLZNYHQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.308311565 (322h48m37.039579215s) [seg_pos={0 0}, upload=335638]: Segment reached optimal threshold of 14 pieces.
Aug 22 04:14:56.308536709 (322h48m37.039804359s) [noise=true , address=104.36.82.23:4472 , piece_id=FCUL2C2XCQ2JKS46BDPNDSENIJBDDLL7TR7BW337GB6OR63DF4CQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF
Aug 22 04:14:56.308649492 (322h48m37.039917141s) [noise=true , address=77.90.31.11:4568 , piece_id=JC2LPEKYMWNJRQ2HMCIHDZKSICEZLK6C4ET3UIDUIRDD6MCL6ZJA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1H1L8DTKD7W7Xx1PVT7KzB9GkGBadnTEj9BHtbSgcW1S7Jj8Tw): protocol: expected piece hash; context canceled; EOF
Aug 22 04:14:56.308765871 (322h48m37.040033521s) [noise=true , address=79.127.205.235:4677 , piece_id=CB422NDFIO6VHBDC4QCP7UGLZRCGP2N3JRVZPFX4DFE5SU77RKMQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oeYzce3yvWfVUnLYKyRyPePYh4QRj86FowWm3hRZ1qHQ6TSLa): protocol: read tcp 5.161.89.252:30854->79.127.205.235:4677: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 04:14:56.308796689 (322h48m37.040064349s) [noise=true , address=79.127.201.215:4344 , piece_id=I4KQ6C7QKCUXYFYIVHMWWLI5RZC3YXUNVBQTGHAHZU7F6ELJ5GMA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: read tcp 5.161.89.252:38178->79.127.201.215:4344: use of closed network connection; context canceled
Aug 22 04:14:56.308831504 (322h48m37.040099164s) [seg_pos={0 0}, upload=335638]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 04:14:56.309045818 (322h48m37.040313488s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 04:14:56.309058031 (322h48m37.040325681s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 04:14:56.409269392 (322h48m37.140537052s) [upload=335638]: Done uploading segments...
Aug 22 04:14:56.409287577 (322h48m37.140555237s) [upload=335638]: Upload finished. err: <nil>
Duration: 464.282236ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
496.640804ms
FAIL (2025-08-22 04:45:45 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 22 04:14:56.030180971 (322h48m36.761448621s) [upload=335638]: Starting upload
Aug 22 04:14:56.030251765 (322h48m36.761519415s) [upload=335638]: Done starting upload
Aug 22 04:14:56.030449677 (322h48m36.761717337s) [upload=335638]: Uploading segments...
Aug 22 04:14:56.030627822 (322h48m36.761895473s) [upload=335638]: Got next segment. Inline: false
Aug 22 04:14:56.030671194 (322h48m36.761938845s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 04:14:56.030679730 (322h48m36.761947381s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 04:14:56.078560813 (322h48m36.809828453s) [seg_pos={0 0}, upload=335638]: Begin upload segment...
Aug 22 04:14:56.078602301 (322h48m36.809869951s) [seg_pos={0 0}, upload=335638]: Done begin upload segment.
Aug 22 04:14:56.078638679 (322h48m36.809906329s) [noise=true , address=77.90.31.15:4703 , piece_id=XH433WREH7EVXIAQMLI5EDLEN5FZJHAEHCYK5NL55VA2JWAVHTIA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.078649209 (322h48m36.809916859s) [noise=true , address=77.90.31.17:4775 , piece_id=2KCZ36SQFRJWMC3OBYW6674TLYLJEMDPQA7QSS4JVELCBC75BF7A, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079202952 (322h48m36.810470601s) [noise=true , address=79.127.201.215:4344 , piece_id=I4KQ6C7QKCUXYFYIVHMWWLI5RZC3YXUNVBQTGHAHZU7F6ELJ5GMA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079216498 (322h48m36.810484148s) [noise=true , address=77.90.31.10:4535 , piece_id=3MOUQMV5N7JI4V27RP3ZPKLF2P3ABFO4XP4TFHOPUHGVGILJYZWA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079590982 (322h48m36.810858633s) [noise=true , address=79.127.219.51:4185 , piece_id=5RHU7PFIBAY7KLYYVMNPGJBM33K5WWZ6E35Z52O3SF2XSVG3WKMQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079604748 (322h48m36.810872388s) [noise=true , address=104.36.82.6:4892 , piece_id=3WLX4OFVLCBLAE5OEI52JHUPYZNBOWMRX6LJWUYLPEKWPCFDBIBA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080091395 (322h48m36.811359044s) [noise=true , address=79.127.219.48:4093 , piece_id=NZBRQBL7Z52H3JCLLLD7CFBFWGC7H7MJTW6G2CFH57J2F4XDP4SA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080144284 (322h48m36.811411934s) [noise=true , address=79.127.205.235:4677 , piece_id=CB422NDFIO6VHBDC4QCP7UGLZRCGP2N3JRVZPFX4DFE5SU77RKMQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080582860 (322h48m36.811850511s) [noise=true , address=77.90.31.16:4761 , piece_id=AJWEB2GXZABAMZW7V4S3LF7FEYOI23K2ASL42NFIOFOWWQBZQQCA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081056942 (322h48m36.812324582s) [noise=true , address=77.90.31.11:4568 , piece_id=JC2LPEKYMWNJRQ2HMCIHDZKSICEZLK6C4ET3UIDUIRDD6MCL6ZJA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081504335 (322h48m36.812771984s) [noise=true , address=77.90.31.18:4811 , piece_id=ODPH32QDN7CTPF5IDUNQ5DEBC6HASD4BAP43ZVZDBIJFJLJWXHXA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081853813 (322h48m36.813121463s) [noise=true , address=104.36.82.23:4472 , piece_id=FCUL2C2XCQ2JKS46BDPNDSENIJBDDLL7TR7BW337GB6OR63DF4CQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082215645 (322h48m36.813483284s) [noise=true , address=77.90.31.19:4874 , piece_id=MCAFOKTALBSPDPMRSTHYZB3RGF7M5I55HOG3RUD463VCTVW7QCGQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082563559 (322h48m36.813831199s) [noise=true , address=104.36.82.60:4372 , piece_id=KUGRHZF4E4FOB4SYJF2NQ75LIF6IUXWMZ35URXHB7VDADYLZNYHQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082885666 (322h48m36.814153317s) [noise=true , address=45.91.116.11:4132 , piece_id=SBIASMWS5NC2XSHDENEKASMDEKQ3ODBPE4RKIQ4EZKZG6SP67JNQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.083847547 (322h48m36.815115197s) [noise=true , address=79.127.219.51:4200 , piece_id=SPPCLJ66SEENUH7SLHHXWI2UZHBEEY3KZIVVUAS3FBZ7CQY2G4LQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.084798477 (322h48m36.816066128s) [noise=true , address=104.36.82.44:4874 , piece_id=UCCAF4MUEIVBLMZRA2LSGWLJZSIBFMA7NY36IA7IB3KH4IBGXKAQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.088490439 (322h48m36.819758089s) [noise=true , address=104.36.82.5:4858 , piece_id=IYUCCI5NCZOTML7GFYI4LAS6NV47IC5UHCVLHFON3LJKZA2LFABA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.206801759 (322h48m36.938069408s) [upload=335638]: Next returned nil segment
Aug 22 04:14:56.206950910 (322h48m36.93821856s) [upload=335638]: Waiting for error group managing segments...
Aug 22 04:14:56.219298197 (322h48m36.950565838s) [noise=true , address=79.127.219.51:4185 , piece_id=5RHU7PFIBAY7KLYYVMNPGJBM33K5WWZ6E35Z52O3SF2XSVG3WKMQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.221650127 (322h48m36.952917776s) [noise=true , address=79.127.219.51:4200 , piece_id=SPPCLJ66SEENUH7SLHHXWI2UZHBEEY3KZIVVUAS3FBZ7CQY2G4LQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.221873898 (322h48m36.953141537s) [noise=true , address=79.127.219.48:4093 , piece_id=NZBRQBL7Z52H3JCLLLD7CFBFWGC7H7MJTW6G2CFH57J2F4XDP4SA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.222678583 (322h48m36.953946232s) [noise=true , address=77.90.31.18:4811 , piece_id=ODPH32QDN7CTPF5IDUNQ5DEBC6HASD4BAP43ZVZDBIJFJLJWXHXA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.224688627 (322h48m36.955956277s) [noise=true , address=104.36.82.6:4892 , piece_id=3WLX4OFVLCBLAE5OEI52JHUPYZNBOWMRX6LJWUYLPEKWPCFDBIBA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.226219780 (322h48m36.95748742s) [noise=true , address=77.90.31.19:4874 , piece_id=MCAFOKTALBSPDPMRSTHYZB3RGF7M5I55HOG3RUD463VCTVW7QCGQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.226285995 (322h48m36.957553645s) [noise=true , address=77.90.31.17:4775 , piece_id=2KCZ36SQFRJWMC3OBYW6674TLYLJEMDPQA7QSS4JVELCBC75BF7A, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.228103006 (322h48m36.959370626s) [noise=true , address=104.36.82.44:4874 , piece_id=UCCAF4MUEIVBLMZRA2LSGWLJZSIBFMA7NY36IA7IB3KH4IBGXKAQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.237068737 (322h48m36.968336377s) [noise=true , address=77.90.31.16:4761 , piece_id=AJWEB2GXZABAMZW7V4S3LF7FEYOI23K2ASL42NFIOFOWWQBZQQCA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.248700377 (322h48m36.979968027s) [noise=true , address=45.91.116.11:4132 , piece_id=SBIASMWS5NC2XSHDENEKASMDEKQ3ODBPE4RKIQ4EZKZG6SP67JNQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.252483180 (322h48m36.98375083s) [noise=true , address=104.36.82.5:4858 , piece_id=IYUCCI5NCZOTML7GFYI4LAS6NV47IC5UHCVLHFON3LJKZA2LFABA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.268821762 (322h48m37.000089423s) [noise=true , address=77.90.31.15:4703 , piece_id=XH433WREH7EVXIAQMLI5EDLEN5FZJHAEHCYK5NL55VA2JWAVHTIA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.273574892 (322h48m37.004842553s) [noise=true , address=77.90.31.10:4535 , piece_id=3MOUQMV5N7JI4V27RP3ZPKLF2P3ABFO4XP4TFHOPUHGVGILJYZWA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.308274656 (322h48m37.039542306s) [noise=true , address=104.36.82.60:4372 , piece_id=KUGRHZF4E4FOB4SYJF2NQ75LIF6IUXWMZ35URXHB7VDADYLZNYHQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.308311565 (322h48m37.039579215s) [seg_pos={0 0}, upload=335638]: Segment reached optimal threshold of 14 pieces.
Aug 22 04:14:56.308536709 (322h48m37.039804359s) [noise=true , address=104.36.82.23:4472 , piece_id=FCUL2C2XCQ2JKS46BDPNDSENIJBDDLL7TR7BW337GB6OR63DF4CQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF
Aug 22 04:14:56.308649492 (322h48m37.039917141s) [noise=true , address=77.90.31.11:4568 , piece_id=JC2LPEKYMWNJRQ2HMCIHDZKSICEZLK6C4ET3UIDUIRDD6MCL6ZJA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1H1L8DTKD7W7Xx1PVT7KzB9GkGBadnTEj9BHtbSgcW1S7Jj8Tw): protocol: expected piece hash; context canceled; EOF
Aug 22 04:14:56.308765871 (322h48m37.040033521s) [noise=true , address=79.127.205.235:4677 , piece_id=CB422NDFIO6VHBDC4QCP7UGLZRCGP2N3JRVZPFX4DFE5SU77RKMQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oeYzce3yvWfVUnLYKyRyPePYh4QRj86FowWm3hRZ1qHQ6TSLa): protocol: read tcp 5.161.89.252:30854->79.127.205.235:4677: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 04:14:56.308796689 (322h48m37.040064349s) [noise=true , address=79.127.201.215:4344 , piece_id=I4KQ6C7QKCUXYFYIVHMWWLI5RZC3YXUNVBQTGHAHZU7F6ELJ5GMA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: read tcp 5.161.89.252:38178->79.127.201.215:4344: use of closed network connection; context canceled
Aug 22 04:14:56.308831504 (322h48m37.040099164s) [seg_pos={0 0}, upload=335638]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 04:14:56.309045818 (322h48m37.040313488s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 04:14:56.309058031 (322h48m37.040325681s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 04:14:56.409269392 (322h48m37.140537052s) [upload=335638]: Done uploading segments...
Aug 22 04:14:56.409287577 (322h48m37.140555237s) [upload=335638]: Upload finished. err: <nil>
Duration: 496.663186ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............................X.......X......................] duration:
124.703073ms
FAIL (2025-08-22 04:45:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 04:29:59.317195954 (323h3m40.048463603s) [upload=335908]: Starting upload Aug 22 04:29:59.317268290 (323h3m40.04853594s) [upload=335908]: Done starting upload Aug 22 04:29:59.317333152 (323h3m40.048600802s) [upload=335908]: Uploading segments... Aug 22 04:29:59.317373970 (323h3m40.048641619s) [upload=335908]: Got next segment. Inline: true Aug 22 04:29:59.317379219 (323h3m40.048646879s) [upload=335908]: Waiting for error group managing segments... Aug 22 04:29:59.317423863 (323h3m40.048691513s) [upload=335908]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 04:29:59.317429253 (323h3m40.048696903s) [upload=335908]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 04:29:59.317432609 (323h3m40.048700259s) [upload=335908]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 04:29:59.319941914 (323h3m40.051209544s) [upload=335908]: Done uploading segments... Aug 22 04:29:59.319955200 (323h3m40.05122283s) [upload=335908]: Upload finished. err: metaclient: Too Many Requests
Duration: 124.725124ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
523.146029ms
FAIL (2025-08-22 04:45:27 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 523.166067ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............................X.......X.....................] duration:
142.019668ms
FAIL (2025-08-22 04:45:04 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 04:29:59.317195954 (323h3m40.048463603s) [upload=335908]: Starting upload Aug 22 04:29:59.317268290 (323h3m40.04853594s) [upload=335908]: Done starting upload Aug 22 04:29:59.317333152 (323h3m40.048600802s) [upload=335908]: Uploading segments... Aug 22 04:29:59.317373970 (323h3m40.048641619s) [upload=335908]: Got next segment. Inline: true Aug 22 04:29:59.317379219 (323h3m40.048646879s) [upload=335908]: Waiting for error group managing segments... Aug 22 04:29:59.317423863 (323h3m40.048691513s) [upload=335908]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 04:29:59.317429253 (323h3m40.048696903s) [upload=335908]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 04:29:59.317432609 (323h3m40.048700259s) [upload=335908]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 04:29:59.319941914 (323h3m40.051209544s) [upload=335908]: Done uploading segments... Aug 22 04:29:59.319955200 (323h3m40.05122283s) [upload=335908]: Upload finished. err: metaclient: Too Many Requests
Duration: 142.040258ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
588.385167ms
FAIL (2025-08-22 04:45:02 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 22 04:14:56.030180971 (322h48m36.761448621s) [upload=335638]: Starting upload
Aug 22 04:14:56.030251765 (322h48m36.761519415s) [upload=335638]: Done starting upload
Aug 22 04:14:56.030449677 (322h48m36.761717337s) [upload=335638]: Uploading segments...
Aug 22 04:14:56.030627822 (322h48m36.761895473s) [upload=335638]: Got next segment. Inline: false
Aug 22 04:14:56.030671194 (322h48m36.761938845s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 04:14:56.030679730 (322h48m36.761947381s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 04:14:56.078560813 (322h48m36.809828453s) [seg_pos={0 0}, upload=335638]: Begin upload segment...
Aug 22 04:14:56.078602301 (322h48m36.809869951s) [seg_pos={0 0}, upload=335638]: Done begin upload segment.
Aug 22 04:14:56.078638679 (322h48m36.809906329s) [noise=true , address=77.90.31.15:4703 , piece_id=XH433WREH7EVXIAQMLI5EDLEN5FZJHAEHCYK5NL55VA2JWAVHTIA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.078649209 (322h48m36.809916859s) [noise=true , address=77.90.31.17:4775 , piece_id=2KCZ36SQFRJWMC3OBYW6674TLYLJEMDPQA7QSS4JVELCBC75BF7A, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079202952 (322h48m36.810470601s) [noise=true , address=79.127.201.215:4344 , piece_id=I4KQ6C7QKCUXYFYIVHMWWLI5RZC3YXUNVBQTGHAHZU7F6ELJ5GMA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079216498 (322h48m36.810484148s) [noise=true , address=77.90.31.10:4535 , piece_id=3MOUQMV5N7JI4V27RP3ZPKLF2P3ABFO4XP4TFHOPUHGVGILJYZWA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079590982 (322h48m36.810858633s) [noise=true , address=79.127.219.51:4185 , piece_id=5RHU7PFIBAY7KLYYVMNPGJBM33K5WWZ6E35Z52O3SF2XSVG3WKMQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079604748 (322h48m36.810872388s) [noise=true , address=104.36.82.6:4892 , piece_id=3WLX4OFVLCBLAE5OEI52JHUPYZNBOWMRX6LJWUYLPEKWPCFDBIBA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080091395 (322h48m36.811359044s) [noise=true , address=79.127.219.48:4093 , piece_id=NZBRQBL7Z52H3JCLLLD7CFBFWGC7H7MJTW6G2CFH57J2F4XDP4SA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080144284 (322h48m36.811411934s) [noise=true , address=79.127.205.235:4677 , piece_id=CB422NDFIO6VHBDC4QCP7UGLZRCGP2N3JRVZPFX4DFE5SU77RKMQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080582860 (322h48m36.811850511s) [noise=true , address=77.90.31.16:4761 , piece_id=AJWEB2GXZABAMZW7V4S3LF7FEYOI23K2ASL42NFIOFOWWQBZQQCA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081056942 (322h48m36.812324582s) [noise=true , address=77.90.31.11:4568 , piece_id=JC2LPEKYMWNJRQ2HMCIHDZKSICEZLK6C4ET3UIDUIRDD6MCL6ZJA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081504335 (322h48m36.812771984s) [noise=true , address=77.90.31.18:4811 , piece_id=ODPH32QDN7CTPF5IDUNQ5DEBC6HASD4BAP43ZVZDBIJFJLJWXHXA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081853813 (322h48m36.813121463s) [noise=true , address=104.36.82.23:4472 , piece_id=FCUL2C2XCQ2JKS46BDPNDSENIJBDDLL7TR7BW337GB6OR63DF4CQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082215645 (322h48m36.813483284s) [noise=true , address=77.90.31.19:4874 , piece_id=MCAFOKTALBSPDPMRSTHYZB3RGF7M5I55HOG3RUD463VCTVW7QCGQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082563559 (322h48m36.813831199s) [noise=true , address=104.36.82.60:4372 , piece_id=KUGRHZF4E4FOB4SYJF2NQ75LIF6IUXWMZ35URXHB7VDADYLZNYHQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082885666 (322h48m36.814153317s) [noise=true , address=45.91.116.11:4132 , piece_id=SBIASMWS5NC2XSHDENEKASMDEKQ3ODBPE4RKIQ4EZKZG6SP67JNQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.083847547 (322h48m36.815115197s) [noise=true , address=79.127.219.51:4200 , piece_id=SPPCLJ66SEENUH7SLHHXWI2UZHBEEY3KZIVVUAS3FBZ7CQY2G4LQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.084798477 (322h48m36.816066128s) [noise=true , address=104.36.82.44:4874 , piece_id=UCCAF4MUEIVBLMZRA2LSGWLJZSIBFMA7NY36IA7IB3KH4IBGXKAQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.088490439 (322h48m36.819758089s) [noise=true , address=104.36.82.5:4858 , piece_id=IYUCCI5NCZOTML7GFYI4LAS6NV47IC5UHCVLHFON3LJKZA2LFABA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.206801759 (322h48m36.938069408s) [upload=335638]: Next returned nil segment
Aug 22 04:14:56.206950910 (322h48m36.93821856s) [upload=335638]: Waiting for error group managing segments...
Aug 22 04:14:56.219298197 (322h48m36.950565838s) [noise=true , address=79.127.219.51:4185 , piece_id=5RHU7PFIBAY7KLYYVMNPGJBM33K5WWZ6E35Z52O3SF2XSVG3WKMQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.221650127 (322h48m36.952917776s) [noise=true , address=79.127.219.51:4200 , piece_id=SPPCLJ66SEENUH7SLHHXWI2UZHBEEY3KZIVVUAS3FBZ7CQY2G4LQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.221873898 (322h48m36.953141537s) [noise=true , address=79.127.219.48:4093 , piece_id=NZBRQBL7Z52H3JCLLLD7CFBFWGC7H7MJTW6G2CFH57J2F4XDP4SA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.222678583 (322h48m36.953946232s) [noise=true , address=77.90.31.18:4811 , piece_id=ODPH32QDN7CTPF5IDUNQ5DEBC6HASD4BAP43ZVZDBIJFJLJWXHXA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.224688627 (322h48m36.955956277s) [noise=true , address=104.36.82.6:4892 , piece_id=3WLX4OFVLCBLAE5OEI52JHUPYZNBOWMRX6LJWUYLPEKWPCFDBIBA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.226219780 (322h48m36.95748742s) [noise=true , address=77.90.31.19:4874 , piece_id=MCAFOKTALBSPDPMRSTHYZB3RGF7M5I55HOG3RUD463VCTVW7QCGQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.226285995 (322h48m36.957553645s) [noise=true , address=77.90.31.17:4775 , piece_id=2KCZ36SQFRJWMC3OBYW6674TLYLJEMDPQA7QSS4JVELCBC75BF7A, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.228103006 (322h48m36.959370626s) [noise=true , address=104.36.82.44:4874 , piece_id=UCCAF4MUEIVBLMZRA2LSGWLJZSIBFMA7NY36IA7IB3KH4IBGXKAQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.237068737 (322h48m36.968336377s) [noise=true , address=77.90.31.16:4761 , piece_id=AJWEB2GXZABAMZW7V4S3LF7FEYOI23K2ASL42NFIOFOWWQBZQQCA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.248700377 (322h48m36.979968027s) [noise=true , address=45.91.116.11:4132 , piece_id=SBIASMWS5NC2XSHDENEKASMDEKQ3ODBPE4RKIQ4EZKZG6SP67JNQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.252483180 (322h48m36.98375083s) [noise=true , address=104.36.82.5:4858 , piece_id=IYUCCI5NCZOTML7GFYI4LAS6NV47IC5UHCVLHFON3LJKZA2LFABA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.268821762 (322h48m37.000089423s) [noise=true , address=77.90.31.15:4703 , piece_id=XH433WREH7EVXIAQMLI5EDLEN5FZJHAEHCYK5NL55VA2JWAVHTIA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.273574892 (322h48m37.004842553s) [noise=true , address=77.90.31.10:4535 , piece_id=3MOUQMV5N7JI4V27RP3ZPKLF2P3ABFO4XP4TFHOPUHGVGILJYZWA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.308274656 (322h48m37.039542306s) [noise=true , address=104.36.82.60:4372 , piece_id=KUGRHZF4E4FOB4SYJF2NQ75LIF6IUXWMZ35URXHB7VDADYLZNYHQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.308311565 (322h48m37.039579215s) [seg_pos={0 0}, upload=335638]: Segment reached optimal threshold of 14 pieces.
Aug 22 04:14:56.308536709 (322h48m37.039804359s) [noise=true , address=104.36.82.23:4472 , piece_id=FCUL2C2XCQ2JKS46BDPNDSENIJBDDLL7TR7BW337GB6OR63DF4CQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF
Aug 22 04:14:56.308649492 (322h48m37.039917141s) [noise=true , address=77.90.31.11:4568 , piece_id=JC2LPEKYMWNJRQ2HMCIHDZKSICEZLK6C4ET3UIDUIRDD6MCL6ZJA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1H1L8DTKD7W7Xx1PVT7KzB9GkGBadnTEj9BHtbSgcW1S7Jj8Tw): protocol: expected piece hash; context canceled; EOF
Aug 22 04:14:56.308765871 (322h48m37.040033521s) [noise=true , address=79.127.205.235:4677 , piece_id=CB422NDFIO6VHBDC4QCP7UGLZRCGP2N3JRVZPFX4DFE5SU77RKMQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oeYzce3yvWfVUnLYKyRyPePYh4QRj86FowWm3hRZ1qHQ6TSLa): protocol: read tcp 5.161.89.252:30854->79.127.205.235:4677: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 04:14:56.308796689 (322h48m37.040064349s) [noise=true , address=79.127.201.215:4344 , piece_id=I4KQ6C7QKCUXYFYIVHMWWLI5RZC3YXUNVBQTGHAHZU7F6ELJ5GMA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: read tcp 5.161.89.252:38178->79.127.201.215:4344: use of closed network connection; context canceled
Aug 22 04:14:56.308831504 (322h48m37.040099164s) [seg_pos={0 0}, upload=335638]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 04:14:56.309045818 (322h48m37.040313488s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 04:14:56.309058031 (322h48m37.040325681s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 04:14:56.409269392 (322h48m37.140537052s) [upload=335638]: Done uploading segments...
Aug 22 04:14:56.409287577 (322h48m37.140555237s) [upload=335638]: Upload finished. err: <nil>
Duration: 588.404963ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
642.745913ms
FAIL (2025-08-22 04:45:02 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 642.757064ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
744.068555ms
FAIL (2025-08-22 04:44:24 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 22 04:14:56.030180971 (322h48m36.761448621s) [upload=335638]: Starting upload
Aug 22 04:14:56.030251765 (322h48m36.761519415s) [upload=335638]: Done starting upload
Aug 22 04:14:56.030449677 (322h48m36.761717337s) [upload=335638]: Uploading segments...
Aug 22 04:14:56.030627822 (322h48m36.761895473s) [upload=335638]: Got next segment. Inline: false
Aug 22 04:14:56.030671194 (322h48m36.761938845s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 04:14:56.030679730 (322h48m36.761947381s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 04:14:56.078560813 (322h48m36.809828453s) [seg_pos={0 0}, upload=335638]: Begin upload segment...
Aug 22 04:14:56.078602301 (322h48m36.809869951s) [seg_pos={0 0}, upload=335638]: Done begin upload segment.
Aug 22 04:14:56.078638679 (322h48m36.809906329s) [noise=true , address=77.90.31.15:4703 , piece_id=XH433WREH7EVXIAQMLI5EDLEN5FZJHAEHCYK5NL55VA2JWAVHTIA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.078649209 (322h48m36.809916859s) [noise=true , address=77.90.31.17:4775 , piece_id=2KCZ36SQFRJWMC3OBYW6674TLYLJEMDPQA7QSS4JVELCBC75BF7A, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079202952 (322h48m36.810470601s) [noise=true , address=79.127.201.215:4344 , piece_id=I4KQ6C7QKCUXYFYIVHMWWLI5RZC3YXUNVBQTGHAHZU7F6ELJ5GMA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079216498 (322h48m36.810484148s) [noise=true , address=77.90.31.10:4535 , piece_id=3MOUQMV5N7JI4V27RP3ZPKLF2P3ABFO4XP4TFHOPUHGVGILJYZWA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079590982 (322h48m36.810858633s) [noise=true , address=79.127.219.51:4185 , piece_id=5RHU7PFIBAY7KLYYVMNPGJBM33K5WWZ6E35Z52O3SF2XSVG3WKMQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079604748 (322h48m36.810872388s) [noise=true , address=104.36.82.6:4892 , piece_id=3WLX4OFVLCBLAE5OEI52JHUPYZNBOWMRX6LJWUYLPEKWPCFDBIBA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080091395 (322h48m36.811359044s) [noise=true , address=79.127.219.48:4093 , piece_id=NZBRQBL7Z52H3JCLLLD7CFBFWGC7H7MJTW6G2CFH57J2F4XDP4SA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080144284 (322h48m36.811411934s) [noise=true , address=79.127.205.235:4677 , piece_id=CB422NDFIO6VHBDC4QCP7UGLZRCGP2N3JRVZPFX4DFE5SU77RKMQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080582860 (322h48m36.811850511s) [noise=true , address=77.90.31.16:4761 , piece_id=AJWEB2GXZABAMZW7V4S3LF7FEYOI23K2ASL42NFIOFOWWQBZQQCA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081056942 (322h48m36.812324582s) [noise=true , address=77.90.31.11:4568 , piece_id=JC2LPEKYMWNJRQ2HMCIHDZKSICEZLK6C4ET3UIDUIRDD6MCL6ZJA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081504335 (322h48m36.812771984s) [noise=true , address=77.90.31.18:4811 , piece_id=ODPH32QDN7CTPF5IDUNQ5DEBC6HASD4BAP43ZVZDBIJFJLJWXHXA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081853813 (322h48m36.813121463s) [noise=true , address=104.36.82.23:4472 , piece_id=FCUL2C2XCQ2JKS46BDPNDSENIJBDDLL7TR7BW337GB6OR63DF4CQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082215645 (322h48m36.813483284s) [noise=true , address=77.90.31.19:4874 , piece_id=MCAFOKTALBSPDPMRSTHYZB3RGF7M5I55HOG3RUD463VCTVW7QCGQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082563559 (322h48m36.813831199s) [noise=true , address=104.36.82.60:4372 , piece_id=KUGRHZF4E4FOB4SYJF2NQ75LIF6IUXWMZ35URXHB7VDADYLZNYHQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082885666 (322h48m36.814153317s) [noise=true , address=45.91.116.11:4132 , piece_id=SBIASMWS5NC2XSHDENEKASMDEKQ3ODBPE4RKIQ4EZKZG6SP67JNQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.083847547 (322h48m36.815115197s) [noise=true , address=79.127.219.51:4200 , piece_id=SPPCLJ66SEENUH7SLHHXWI2UZHBEEY3KZIVVUAS3FBZ7CQY2G4LQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.084798477 (322h48m36.816066128s) [noise=true , address=104.36.82.44:4874 , piece_id=UCCAF4MUEIVBLMZRA2LSGWLJZSIBFMA7NY36IA7IB3KH4IBGXKAQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.088490439 (322h48m36.819758089s) [noise=true , address=104.36.82.5:4858 , piece_id=IYUCCI5NCZOTML7GFYI4LAS6NV47IC5UHCVLHFON3LJKZA2LFABA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.206801759 (322h48m36.938069408s) [upload=335638]: Next returned nil segment
Aug 22 04:14:56.206950910 (322h48m36.93821856s) [upload=335638]: Waiting for error group managing segments...
Aug 22 04:14:56.219298197 (322h48m36.950565838s) [noise=true , address=79.127.219.51:4185 , piece_id=5RHU7PFIBAY7KLYYVMNPGJBM33K5WWZ6E35Z52O3SF2XSVG3WKMQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.221650127 (322h48m36.952917776s) [noise=true , address=79.127.219.51:4200 , piece_id=SPPCLJ66SEENUH7SLHHXWI2UZHBEEY3KZIVVUAS3FBZ7CQY2G4LQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.221873898 (322h48m36.953141537s) [noise=true , address=79.127.219.48:4093 , piece_id=NZBRQBL7Z52H3JCLLLD7CFBFWGC7H7MJTW6G2CFH57J2F4XDP4SA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.222678583 (322h48m36.953946232s) [noise=true , address=77.90.31.18:4811 , piece_id=ODPH32QDN7CTPF5IDUNQ5DEBC6HASD4BAP43ZVZDBIJFJLJWXHXA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.224688627 (322h48m36.955956277s) [noise=true , address=104.36.82.6:4892 , piece_id=3WLX4OFVLCBLAE5OEI52JHUPYZNBOWMRX6LJWUYLPEKWPCFDBIBA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.226219780 (322h48m36.95748742s) [noise=true , address=77.90.31.19:4874 , piece_id=MCAFOKTALBSPDPMRSTHYZB3RGF7M5I55HOG3RUD463VCTVW7QCGQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.226285995 (322h48m36.957553645s) [noise=true , address=77.90.31.17:4775 , piece_id=2KCZ36SQFRJWMC3OBYW6674TLYLJEMDPQA7QSS4JVELCBC75BF7A, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.228103006 (322h48m36.959370626s) [noise=true , address=104.36.82.44:4874 , piece_id=UCCAF4MUEIVBLMZRA2LSGWLJZSIBFMA7NY36IA7IB3KH4IBGXKAQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.237068737 (322h48m36.968336377s) [noise=true , address=77.90.31.16:4761 , piece_id=AJWEB2GXZABAMZW7V4S3LF7FEYOI23K2ASL42NFIOFOWWQBZQQCA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.248700377 (322h48m36.979968027s) [noise=true , address=45.91.116.11:4132 , piece_id=SBIASMWS5NC2XSHDENEKASMDEKQ3ODBPE4RKIQ4EZKZG6SP67JNQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.252483180 (322h48m36.98375083s) [noise=true , address=104.36.82.5:4858 , piece_id=IYUCCI5NCZOTML7GFYI4LAS6NV47IC5UHCVLHFON3LJKZA2LFABA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.268821762 (322h48m37.000089423s) [noise=true , address=77.90.31.15:4703 , piece_id=XH433WREH7EVXIAQMLI5EDLEN5FZJHAEHCYK5NL55VA2JWAVHTIA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.273574892 (322h48m37.004842553s) [noise=true , address=77.90.31.10:4535 , piece_id=3MOUQMV5N7JI4V27RP3ZPKLF2P3ABFO4XP4TFHOPUHGVGILJYZWA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.308274656 (322h48m37.039542306s) [noise=true , address=104.36.82.60:4372 , piece_id=KUGRHZF4E4FOB4SYJF2NQ75LIF6IUXWMZ35URXHB7VDADYLZNYHQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.308311565 (322h48m37.039579215s) [seg_pos={0 0}, upload=335638]: Segment reached optimal threshold of 14 pieces.
Aug 22 04:14:56.308536709 (322h48m37.039804359s) [noise=true , address=104.36.82.23:4472 , piece_id=FCUL2C2XCQ2JKS46BDPNDSENIJBDDLL7TR7BW337GB6OR63DF4CQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF
Aug 22 04:14:56.308649492 (322h48m37.039917141s) [noise=true , address=77.90.31.11:4568 , piece_id=JC2LPEKYMWNJRQ2HMCIHDZKSICEZLK6C4ET3UIDUIRDD6MCL6ZJA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1H1L8DTKD7W7Xx1PVT7KzB9GkGBadnTEj9BHtbSgcW1S7Jj8Tw): protocol: expected piece hash; context canceled; EOF
Aug 22 04:14:56.308765871 (322h48m37.040033521s) [noise=true , address=79.127.205.235:4677 , piece_id=CB422NDFIO6VHBDC4QCP7UGLZRCGP2N3JRVZPFX4DFE5SU77RKMQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oeYzce3yvWfVUnLYKyRyPePYh4QRj86FowWm3hRZ1qHQ6TSLa): protocol: read tcp 5.161.89.252:30854->79.127.205.235:4677: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 04:14:56.308796689 (322h48m37.040064349s) [noise=true , address=79.127.201.215:4344 , piece_id=I4KQ6C7QKCUXYFYIVHMWWLI5RZC3YXUNVBQTGHAHZU7F6ELJ5GMA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: read tcp 5.161.89.252:38178->79.127.201.215:4344: use of closed network connection; context canceled
Aug 22 04:14:56.308831504 (322h48m37.040099164s) [seg_pos={0 0}, upload=335638]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 04:14:56.309045818 (322h48m37.040313488s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 04:14:56.309058031 (322h48m37.040325681s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 04:14:56.409269392 (322h48m37.140537052s) [upload=335638]: Done uploading segments...
Aug 22 04:14:56.409287577 (322h48m37.140555237s) [upload=335638]: Upload finished. err: <nil>
Duration: 744.089585ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............................X.......X....................] duration:
136.84242ms
FAIL (2025-08-22 04:44:00 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 04:29:59.317195954 (323h3m40.048463603s) [upload=335908]: Starting upload Aug 22 04:29:59.317268290 (323h3m40.04853594s) [upload=335908]: Done starting upload Aug 22 04:29:59.317333152 (323h3m40.048600802s) [upload=335908]: Uploading segments... Aug 22 04:29:59.317373970 (323h3m40.048641619s) [upload=335908]: Got next segment. Inline: true Aug 22 04:29:59.317379219 (323h3m40.048646879s) [upload=335908]: Waiting for error group managing segments... Aug 22 04:29:59.317423863 (323h3m40.048691513s) [upload=335908]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 04:29:59.317429253 (323h3m40.048696903s) [upload=335908]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 04:29:59.317432609 (323h3m40.048700259s) [upload=335908]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 04:29:59.319941914 (323h3m40.051209544s) [upload=335908]: Done uploading segments... Aug 22 04:29:59.319955200 (323h3m40.05122283s) [upload=335908]: Upload finished. err: metaclient: Too Many Requests
Duration: 136.858972ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [X...............................X.......X...................] duration:
174.070606ms
FAIL (2025-08-22 04:43:41 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 04:29:59.317195954 (323h3m40.048463603s) [upload=335908]: Starting upload Aug 22 04:29:59.317268290 (323h3m40.04853594s) [upload=335908]: Done starting upload Aug 22 04:29:59.317333152 (323h3m40.048600802s) [upload=335908]: Uploading segments... Aug 22 04:29:59.317373970 (323h3m40.048641619s) [upload=335908]: Got next segment. Inline: true Aug 22 04:29:59.317379219 (323h3m40.048646879s) [upload=335908]: Waiting for error group managing segments... Aug 22 04:29:59.317423863 (323h3m40.048691513s) [upload=335908]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 04:29:59.317429253 (323h3m40.048696903s) [upload=335908]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 04:29:59.317432609 (323h3m40.048700259s) [upload=335908]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 04:29:59.319941914 (323h3m40.051209544s) [upload=335908]: Done uploading segments... Aug 22 04:29:59.319955200 (323h3m40.05122283s) [upload=335908]: Upload finished. err: metaclient: Too Many Requests
Duration: 174.097065ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
1.645446067s
FAIL (2025-08-22 04:43:13 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 22 04:14:56.030180971 (322h48m36.761448621s) [upload=335638]: Starting upload
Aug 22 04:14:56.030251765 (322h48m36.761519415s) [upload=335638]: Done starting upload
Aug 22 04:14:56.030449677 (322h48m36.761717337s) [upload=335638]: Uploading segments...
Aug 22 04:14:56.030627822 (322h48m36.761895473s) [upload=335638]: Got next segment. Inline: false
Aug 22 04:14:56.030671194 (322h48m36.761938845s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 04:14:56.030679730 (322h48m36.761947381s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 04:14:56.078560813 (322h48m36.809828453s) [seg_pos={0 0}, upload=335638]: Begin upload segment...
Aug 22 04:14:56.078602301 (322h48m36.809869951s) [seg_pos={0 0}, upload=335638]: Done begin upload segment.
Aug 22 04:14:56.078638679 (322h48m36.809906329s) [noise=true , address=77.90.31.15:4703 , piece_id=XH433WREH7EVXIAQMLI5EDLEN5FZJHAEHCYK5NL55VA2JWAVHTIA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.078649209 (322h48m36.809916859s) [noise=true , address=77.90.31.17:4775 , piece_id=2KCZ36SQFRJWMC3OBYW6674TLYLJEMDPQA7QSS4JVELCBC75BF7A, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079202952 (322h48m36.810470601s) [noise=true , address=79.127.201.215:4344 , piece_id=I4KQ6C7QKCUXYFYIVHMWWLI5RZC3YXUNVBQTGHAHZU7F6ELJ5GMA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079216498 (322h48m36.810484148s) [noise=true , address=77.90.31.10:4535 , piece_id=3MOUQMV5N7JI4V27RP3ZPKLF2P3ABFO4XP4TFHOPUHGVGILJYZWA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079590982 (322h48m36.810858633s) [noise=true , address=79.127.219.51:4185 , piece_id=5RHU7PFIBAY7KLYYVMNPGJBM33K5WWZ6E35Z52O3SF2XSVG3WKMQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079604748 (322h48m36.810872388s) [noise=true , address=104.36.82.6:4892 , piece_id=3WLX4OFVLCBLAE5OEI52JHUPYZNBOWMRX6LJWUYLPEKWPCFDBIBA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080091395 (322h48m36.811359044s) [noise=true , address=79.127.219.48:4093 , piece_id=NZBRQBL7Z52H3JCLLLD7CFBFWGC7H7MJTW6G2CFH57J2F4XDP4SA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080144284 (322h48m36.811411934s) [noise=true , address=79.127.205.235:4677 , piece_id=CB422NDFIO6VHBDC4QCP7UGLZRCGP2N3JRVZPFX4DFE5SU77RKMQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080582860 (322h48m36.811850511s) [noise=true , address=77.90.31.16:4761 , piece_id=AJWEB2GXZABAMZW7V4S3LF7FEYOI23K2ASL42NFIOFOWWQBZQQCA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081056942 (322h48m36.812324582s) [noise=true , address=77.90.31.11:4568 , piece_id=JC2LPEKYMWNJRQ2HMCIHDZKSICEZLK6C4ET3UIDUIRDD6MCL6ZJA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081504335 (322h48m36.812771984s) [noise=true , address=77.90.31.18:4811 , piece_id=ODPH32QDN7CTPF5IDUNQ5DEBC6HASD4BAP43ZVZDBIJFJLJWXHXA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081853813 (322h48m36.813121463s) [noise=true , address=104.36.82.23:4472 , piece_id=FCUL2C2XCQ2JKS46BDPNDSENIJBDDLL7TR7BW337GB6OR63DF4CQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082215645 (322h48m36.813483284s) [noise=true , address=77.90.31.19:4874 , piece_id=MCAFOKTALBSPDPMRSTHYZB3RGF7M5I55HOG3RUD463VCTVW7QCGQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082563559 (322h48m36.813831199s) [noise=true , address=104.36.82.60:4372 , piece_id=KUGRHZF4E4FOB4SYJF2NQ75LIF6IUXWMZ35URXHB7VDADYLZNYHQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082885666 (322h48m36.814153317s) [noise=true , address=45.91.116.11:4132 , piece_id=SBIASMWS5NC2XSHDENEKASMDEKQ3ODBPE4RKIQ4EZKZG6SP67JNQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.083847547 (322h48m36.815115197s) [noise=true , address=79.127.219.51:4200 , piece_id=SPPCLJ66SEENUH7SLHHXWI2UZHBEEY3KZIVVUAS3FBZ7CQY2G4LQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.084798477 (322h48m36.816066128s) [noise=true , address=104.36.82.44:4874 , piece_id=UCCAF4MUEIVBLMZRA2LSGWLJZSIBFMA7NY36IA7IB3KH4IBGXKAQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.088490439 (322h48m36.819758089s) [noise=true , address=104.36.82.5:4858 , piece_id=IYUCCI5NCZOTML7GFYI4LAS6NV47IC5UHCVLHFON3LJKZA2LFABA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.206801759 (322h48m36.938069408s) [upload=335638]: Next returned nil segment
Aug 22 04:14:56.206950910 (322h48m36.93821856s) [upload=335638]: Waiting for error group managing segments...
Aug 22 04:14:56.219298197 (322h48m36.950565838s) [noise=true , address=79.127.219.51:4185 , piece_id=5RHU7PFIBAY7KLYYVMNPGJBM33K5WWZ6E35Z52O3SF2XSVG3WKMQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.221650127 (322h48m36.952917776s) [noise=true , address=79.127.219.51:4200 , piece_id=SPPCLJ66SEENUH7SLHHXWI2UZHBEEY3KZIVVUAS3FBZ7CQY2G4LQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.221873898 (322h48m36.953141537s) [noise=true , address=79.127.219.48:4093 , piece_id=NZBRQBL7Z52H3JCLLLD7CFBFWGC7H7MJTW6G2CFH57J2F4XDP4SA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.222678583 (322h48m36.953946232s) [noise=true , address=77.90.31.18:4811 , piece_id=ODPH32QDN7CTPF5IDUNQ5DEBC6HASD4BAP43ZVZDBIJFJLJWXHXA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.224688627 (322h48m36.955956277s) [noise=true , address=104.36.82.6:4892 , piece_id=3WLX4OFVLCBLAE5OEI52JHUPYZNBOWMRX6LJWUYLPEKWPCFDBIBA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.226219780 (322h48m36.95748742s) [noise=true , address=77.90.31.19:4874 , piece_id=MCAFOKTALBSPDPMRSTHYZB3RGF7M5I55HOG3RUD463VCTVW7QCGQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.226285995 (322h48m36.957553645s) [noise=true , address=77.90.31.17:4775 , piece_id=2KCZ36SQFRJWMC3OBYW6674TLYLJEMDPQA7QSS4JVELCBC75BF7A, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.228103006 (322h48m36.959370626s) [noise=true , address=104.36.82.44:4874 , piece_id=UCCAF4MUEIVBLMZRA2LSGWLJZSIBFMA7NY36IA7IB3KH4IBGXKAQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.237068737 (322h48m36.968336377s) [noise=true , address=77.90.31.16:4761 , piece_id=AJWEB2GXZABAMZW7V4S3LF7FEYOI23K2ASL42NFIOFOWWQBZQQCA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.248700377 (322h48m36.979968027s) [noise=true , address=45.91.116.11:4132 , piece_id=SBIASMWS5NC2XSHDENEKASMDEKQ3ODBPE4RKIQ4EZKZG6SP67JNQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.252483180 (322h48m36.98375083s) [noise=true , address=104.36.82.5:4858 , piece_id=IYUCCI5NCZOTML7GFYI4LAS6NV47IC5UHCVLHFON3LJKZA2LFABA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.268821762 (322h48m37.000089423s) [noise=true , address=77.90.31.15:4703 , piece_id=XH433WREH7EVXIAQMLI5EDLEN5FZJHAEHCYK5NL55VA2JWAVHTIA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.273574892 (322h48m37.004842553s) [noise=true , address=77.90.31.10:4535 , piece_id=3MOUQMV5N7JI4V27RP3ZPKLF2P3ABFO4XP4TFHOPUHGVGILJYZWA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.308274656 (322h48m37.039542306s) [noise=true , address=104.36.82.60:4372 , piece_id=KUGRHZF4E4FOB4SYJF2NQ75LIF6IUXWMZ35URXHB7VDADYLZNYHQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.308311565 (322h48m37.039579215s) [seg_pos={0 0}, upload=335638]: Segment reached optimal threshold of 14 pieces.
Aug 22 04:14:56.308536709 (322h48m37.039804359s) [noise=true , address=104.36.82.23:4472 , piece_id=FCUL2C2XCQ2JKS46BDPNDSENIJBDDLL7TR7BW337GB6OR63DF4CQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF
Aug 22 04:14:56.308649492 (322h48m37.039917141s) [noise=true , address=77.90.31.11:4568 , piece_id=JC2LPEKYMWNJRQ2HMCIHDZKSICEZLK6C4ET3UIDUIRDD6MCL6ZJA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1H1L8DTKD7W7Xx1PVT7KzB9GkGBadnTEj9BHtbSgcW1S7Jj8Tw): protocol: expected piece hash; context canceled; EOF
Aug 22 04:14:56.308765871 (322h48m37.040033521s) [noise=true , address=79.127.205.235:4677 , piece_id=CB422NDFIO6VHBDC4QCP7UGLZRCGP2N3JRVZPFX4DFE5SU77RKMQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oeYzce3yvWfVUnLYKyRyPePYh4QRj86FowWm3hRZ1qHQ6TSLa): protocol: read tcp 5.161.89.252:30854->79.127.205.235:4677: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 04:14:56.308796689 (322h48m37.040064349s) [noise=true , address=79.127.201.215:4344 , piece_id=I4KQ6C7QKCUXYFYIVHMWWLI5RZC3YXUNVBQTGHAHZU7F6ELJ5GMA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: read tcp 5.161.89.252:38178->79.127.201.215:4344: use of closed network connection; context canceled
Aug 22 04:14:56.308831504 (322h48m37.040099164s) [seg_pos={0 0}, upload=335638]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 04:14:56.309045818 (322h48m37.040313488s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 04:14:56.309058031 (322h48m37.040325681s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 04:14:56.409269392 (322h48m37.140537052s) [upload=335638]: Done uploading segments...
Aug 22 04:14:56.409287577 (322h48m37.140555237s) [upload=335638]: Upload finished. err: <nil>
Duration: 1.64546929s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.X...............................X.......X..................] duration:
123.71909ms
FAIL (2025-08-22 04:42:39 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 04:29:59.317195954 (323h3m40.048463603s) [upload=335908]: Starting upload Aug 22 04:29:59.317268290 (323h3m40.04853594s) [upload=335908]: Done starting upload Aug 22 04:29:59.317333152 (323h3m40.048600802s) [upload=335908]: Uploading segments... Aug 22 04:29:59.317373970 (323h3m40.048641619s) [upload=335908]: Got next segment. Inline: true Aug 22 04:29:59.317379219 (323h3m40.048646879s) [upload=335908]: Waiting for error group managing segments... Aug 22 04:29:59.317423863 (323h3m40.048691513s) [upload=335908]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 04:29:59.317429253 (323h3m40.048696903s) [upload=335908]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 04:29:59.317432609 (323h3m40.048700259s) [upload=335908]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 04:29:59.319941914 (323h3m40.051209544s) [upload=335908]: Done uploading segments... Aug 22 04:29:59.319955200 (323h3m40.05122283s) [upload=335908]: Upload finished. err: metaclient: Too Many Requests
Duration: 123.743175ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
1.188940394s
FAIL (2025-08-22 04:42:22 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 22 04:14:56.030180971 (322h48m36.761448621s) [upload=335638]: Starting upload
Aug 22 04:14:56.030251765 (322h48m36.761519415s) [upload=335638]: Done starting upload
Aug 22 04:14:56.030449677 (322h48m36.761717337s) [upload=335638]: Uploading segments...
Aug 22 04:14:56.030627822 (322h48m36.761895473s) [upload=335638]: Got next segment. Inline: false
Aug 22 04:14:56.030671194 (322h48m36.761938845s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 04:14:56.030679730 (322h48m36.761947381s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 04:14:56.078560813 (322h48m36.809828453s) [seg_pos={0 0}, upload=335638]: Begin upload segment...
Aug 22 04:14:56.078602301 (322h48m36.809869951s) [seg_pos={0 0}, upload=335638]: Done begin upload segment.
Aug 22 04:14:56.078638679 (322h48m36.809906329s) [noise=true , address=77.90.31.15:4703 , piece_id=XH433WREH7EVXIAQMLI5EDLEN5FZJHAEHCYK5NL55VA2JWAVHTIA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.078649209 (322h48m36.809916859s) [noise=true , address=77.90.31.17:4775 , piece_id=2KCZ36SQFRJWMC3OBYW6674TLYLJEMDPQA7QSS4JVELCBC75BF7A, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079202952 (322h48m36.810470601s) [noise=true , address=79.127.201.215:4344 , piece_id=I4KQ6C7QKCUXYFYIVHMWWLI5RZC3YXUNVBQTGHAHZU7F6ELJ5GMA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079216498 (322h48m36.810484148s) [noise=true , address=77.90.31.10:4535 , piece_id=3MOUQMV5N7JI4V27RP3ZPKLF2P3ABFO4XP4TFHOPUHGVGILJYZWA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079590982 (322h48m36.810858633s) [noise=true , address=79.127.219.51:4185 , piece_id=5RHU7PFIBAY7KLYYVMNPGJBM33K5WWZ6E35Z52O3SF2XSVG3WKMQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079604748 (322h48m36.810872388s) [noise=true , address=104.36.82.6:4892 , piece_id=3WLX4OFVLCBLAE5OEI52JHUPYZNBOWMRX6LJWUYLPEKWPCFDBIBA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080091395 (322h48m36.811359044s) [noise=true , address=79.127.219.48:4093 , piece_id=NZBRQBL7Z52H3JCLLLD7CFBFWGC7H7MJTW6G2CFH57J2F4XDP4SA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080144284 (322h48m36.811411934s) [noise=true , address=79.127.205.235:4677 , piece_id=CB422NDFIO6VHBDC4QCP7UGLZRCGP2N3JRVZPFX4DFE5SU77RKMQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080582860 (322h48m36.811850511s) [noise=true , address=77.90.31.16:4761 , piece_id=AJWEB2GXZABAMZW7V4S3LF7FEYOI23K2ASL42NFIOFOWWQBZQQCA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081056942 (322h48m36.812324582s) [noise=true , address=77.90.31.11:4568 , piece_id=JC2LPEKYMWNJRQ2HMCIHDZKSICEZLK6C4ET3UIDUIRDD6MCL6ZJA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081504335 (322h48m36.812771984s) [noise=true , address=77.90.31.18:4811 , piece_id=ODPH32QDN7CTPF5IDUNQ5DEBC6HASD4BAP43ZVZDBIJFJLJWXHXA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081853813 (322h48m36.813121463s) [noise=true , address=104.36.82.23:4472 , piece_id=FCUL2C2XCQ2JKS46BDPNDSENIJBDDLL7TR7BW337GB6OR63DF4CQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082215645 (322h48m36.813483284s) [noise=true , address=77.90.31.19:4874 , piece_id=MCAFOKTALBSPDPMRSTHYZB3RGF7M5I55HOG3RUD463VCTVW7QCGQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082563559 (322h48m36.813831199s) [noise=true , address=104.36.82.60:4372 , piece_id=KUGRHZF4E4FOB4SYJF2NQ75LIF6IUXWMZ35URXHB7VDADYLZNYHQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082885666 (322h48m36.814153317s) [noise=true , address=45.91.116.11:4132 , piece_id=SBIASMWS5NC2XSHDENEKASMDEKQ3ODBPE4RKIQ4EZKZG6SP67JNQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.083847547 (322h48m36.815115197s) [noise=true , address=79.127.219.51:4200 , piece_id=SPPCLJ66SEENUH7SLHHXWI2UZHBEEY3KZIVVUAS3FBZ7CQY2G4LQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.084798477 (322h48m36.816066128s) [noise=true , address=104.36.82.44:4874 , piece_id=UCCAF4MUEIVBLMZRA2LSGWLJZSIBFMA7NY36IA7IB3KH4IBGXKAQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.088490439 (322h48m36.819758089s) [noise=true , address=104.36.82.5:4858 , piece_id=IYUCCI5NCZOTML7GFYI4LAS6NV47IC5UHCVLHFON3LJKZA2LFABA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.206801759 (322h48m36.938069408s) [upload=335638]: Next returned nil segment
Aug 22 04:14:56.206950910 (322h48m36.93821856s) [upload=335638]: Waiting for error group managing segments...
Aug 22 04:14:56.219298197 (322h48m36.950565838s) [noise=true , address=79.127.219.51:4185 , piece_id=5RHU7PFIBAY7KLYYVMNPGJBM33K5WWZ6E35Z52O3SF2XSVG3WKMQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.221650127 (322h48m36.952917776s) [noise=true , address=79.127.219.51:4200 , piece_id=SPPCLJ66SEENUH7SLHHXWI2UZHBEEY3KZIVVUAS3FBZ7CQY2G4LQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.221873898 (322h48m36.953141537s) [noise=true , address=79.127.219.48:4093 , piece_id=NZBRQBL7Z52H3JCLLLD7CFBFWGC7H7MJTW6G2CFH57J2F4XDP4SA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.222678583 (322h48m36.953946232s) [noise=true , address=77.90.31.18:4811 , piece_id=ODPH32QDN7CTPF5IDUNQ5DEBC6HASD4BAP43ZVZDBIJFJLJWXHXA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.224688627 (322h48m36.955956277s) [noise=true , address=104.36.82.6:4892 , piece_id=3WLX4OFVLCBLAE5OEI52JHUPYZNBOWMRX6LJWUYLPEKWPCFDBIBA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.226219780 (322h48m36.95748742s) [noise=true , address=77.90.31.19:4874 , piece_id=MCAFOKTALBSPDPMRSTHYZB3RGF7M5I55HOG3RUD463VCTVW7QCGQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.226285995 (322h48m36.957553645s) [noise=true , address=77.90.31.17:4775 , piece_id=2KCZ36SQFRJWMC3OBYW6674TLYLJEMDPQA7QSS4JVELCBC75BF7A, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.228103006 (322h48m36.959370626s) [noise=true , address=104.36.82.44:4874 , piece_id=UCCAF4MUEIVBLMZRA2LSGWLJZSIBFMA7NY36IA7IB3KH4IBGXKAQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.237068737 (322h48m36.968336377s) [noise=true , address=77.90.31.16:4761 , piece_id=AJWEB2GXZABAMZW7V4S3LF7FEYOI23K2ASL42NFIOFOWWQBZQQCA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.248700377 (322h48m36.979968027s) [noise=true , address=45.91.116.11:4132 , piece_id=SBIASMWS5NC2XSHDENEKASMDEKQ3ODBPE4RKIQ4EZKZG6SP67JNQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.252483180 (322h48m36.98375083s) [noise=true , address=104.36.82.5:4858 , piece_id=IYUCCI5NCZOTML7GFYI4LAS6NV47IC5UHCVLHFON3LJKZA2LFABA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.268821762 (322h48m37.000089423s) [noise=true , address=77.90.31.15:4703 , piece_id=XH433WREH7EVXIAQMLI5EDLEN5FZJHAEHCYK5NL55VA2JWAVHTIA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.273574892 (322h48m37.004842553s) [noise=true , address=77.90.31.10:4535 , piece_id=3MOUQMV5N7JI4V27RP3ZPKLF2P3ABFO4XP4TFHOPUHGVGILJYZWA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.308274656 (322h48m37.039542306s) [noise=true , address=104.36.82.60:4372 , piece_id=KUGRHZF4E4FOB4SYJF2NQ75LIF6IUXWMZ35URXHB7VDADYLZNYHQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.308311565 (322h48m37.039579215s) [seg_pos={0 0}, upload=335638]: Segment reached optimal threshold of 14 pieces.
Aug 22 04:14:56.308536709 (322h48m37.039804359s) [noise=true , address=104.36.82.23:4472 , piece_id=FCUL2C2XCQ2JKS46BDPNDSENIJBDDLL7TR7BW337GB6OR63DF4CQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF
Aug 22 04:14:56.308649492 (322h48m37.039917141s) [noise=true , address=77.90.31.11:4568 , piece_id=JC2LPEKYMWNJRQ2HMCIHDZKSICEZLK6C4ET3UIDUIRDD6MCL6ZJA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1H1L8DTKD7W7Xx1PVT7KzB9GkGBadnTEj9BHtbSgcW1S7Jj8Tw): protocol: expected piece hash; context canceled; EOF
Aug 22 04:14:56.308765871 (322h48m37.040033521s) [noise=true , address=79.127.205.235:4677 , piece_id=CB422NDFIO6VHBDC4QCP7UGLZRCGP2N3JRVZPFX4DFE5SU77RKMQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oeYzce3yvWfVUnLYKyRyPePYh4QRj86FowWm3hRZ1qHQ6TSLa): protocol: read tcp 5.161.89.252:30854->79.127.205.235:4677: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 04:14:56.308796689 (322h48m37.040064349s) [noise=true , address=79.127.201.215:4344 , piece_id=I4KQ6C7QKCUXYFYIVHMWWLI5RZC3YXUNVBQTGHAHZU7F6ELJ5GMA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: read tcp 5.161.89.252:38178->79.127.201.215:4344: use of closed network connection; context canceled
Aug 22 04:14:56.308831504 (322h48m37.040099164s) [seg_pos={0 0}, upload=335638]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 04:14:56.309045818 (322h48m37.040313488s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 04:14:56.309058031 (322h48m37.040325681s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 04:14:56.409269392 (322h48m37.140537052s) [upload=335638]: Done uploading segments...
Aug 22 04:14:56.409287577 (322h48m37.140555237s) [upload=335638]: Upload finished. err: <nil>
Duration: 1.18896022s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..X...............................X.......X.................] duration:
127.047897ms
FAIL (2025-08-22 04:42:03 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 04:29:59.317195954 (323h3m40.048463603s) [upload=335908]: Starting upload Aug 22 04:29:59.317268290 (323h3m40.04853594s) [upload=335908]: Done starting upload Aug 22 04:29:59.317333152 (323h3m40.048600802s) [upload=335908]: Uploading segments... Aug 22 04:29:59.317373970 (323h3m40.048641619s) [upload=335908]: Got next segment. Inline: true Aug 22 04:29:59.317379219 (323h3m40.048646879s) [upload=335908]: Waiting for error group managing segments... Aug 22 04:29:59.317423863 (323h3m40.048691513s) [upload=335908]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 04:29:59.317429253 (323h3m40.048696903s) [upload=335908]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 04:29:59.317432609 (323h3m40.048700259s) [upload=335908]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 04:29:59.319941914 (323h3m40.051209544s) [upload=335908]: Done uploading segments... Aug 22 04:29:59.319955200 (323h3m40.05122283s) [upload=335908]: Upload finished. err: metaclient: Too Many Requests
Duration: 127.077082ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
1.426109287s
FAIL (2025-08-22 04:41:35 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 22 04:14:56.030180971 (322h48m36.761448621s) [upload=335638]: Starting upload
Aug 22 04:14:56.030251765 (322h48m36.761519415s) [upload=335638]: Done starting upload
Aug 22 04:14:56.030449677 (322h48m36.761717337s) [upload=335638]: Uploading segments...
Aug 22 04:14:56.030627822 (322h48m36.761895473s) [upload=335638]: Got next segment. Inline: false
Aug 22 04:14:56.030671194 (322h48m36.761938845s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 04:14:56.030679730 (322h48m36.761947381s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 04:14:56.078560813 (322h48m36.809828453s) [seg_pos={0 0}, upload=335638]: Begin upload segment...
Aug 22 04:14:56.078602301 (322h48m36.809869951s) [seg_pos={0 0}, upload=335638]: Done begin upload segment.
Aug 22 04:14:56.078638679 (322h48m36.809906329s) [noise=true , address=77.90.31.15:4703 , piece_id=XH433WREH7EVXIAQMLI5EDLEN5FZJHAEHCYK5NL55VA2JWAVHTIA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.078649209 (322h48m36.809916859s) [noise=true , address=77.90.31.17:4775 , piece_id=2KCZ36SQFRJWMC3OBYW6674TLYLJEMDPQA7QSS4JVELCBC75BF7A, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079202952 (322h48m36.810470601s) [noise=true , address=79.127.201.215:4344 , piece_id=I4KQ6C7QKCUXYFYIVHMWWLI5RZC3YXUNVBQTGHAHZU7F6ELJ5GMA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079216498 (322h48m36.810484148s) [noise=true , address=77.90.31.10:4535 , piece_id=3MOUQMV5N7JI4V27RP3ZPKLF2P3ABFO4XP4TFHOPUHGVGILJYZWA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079590982 (322h48m36.810858633s) [noise=true , address=79.127.219.51:4185 , piece_id=5RHU7PFIBAY7KLYYVMNPGJBM33K5WWZ6E35Z52O3SF2XSVG3WKMQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079604748 (322h48m36.810872388s) [noise=true , address=104.36.82.6:4892 , piece_id=3WLX4OFVLCBLAE5OEI52JHUPYZNBOWMRX6LJWUYLPEKWPCFDBIBA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080091395 (322h48m36.811359044s) [noise=true , address=79.127.219.48:4093 , piece_id=NZBRQBL7Z52H3JCLLLD7CFBFWGC7H7MJTW6G2CFH57J2F4XDP4SA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080144284 (322h48m36.811411934s) [noise=true , address=79.127.205.235:4677 , piece_id=CB422NDFIO6VHBDC4QCP7UGLZRCGP2N3JRVZPFX4DFE5SU77RKMQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080582860 (322h48m36.811850511s) [noise=true , address=77.90.31.16:4761 , piece_id=AJWEB2GXZABAMZW7V4S3LF7FEYOI23K2ASL42NFIOFOWWQBZQQCA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081056942 (322h48m36.812324582s) [noise=true , address=77.90.31.11:4568 , piece_id=JC2LPEKYMWNJRQ2HMCIHDZKSICEZLK6C4ET3UIDUIRDD6MCL6ZJA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081504335 (322h48m36.812771984s) [noise=true , address=77.90.31.18:4811 , piece_id=ODPH32QDN7CTPF5IDUNQ5DEBC6HASD4BAP43ZVZDBIJFJLJWXHXA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081853813 (322h48m36.813121463s) [noise=true , address=104.36.82.23:4472 , piece_id=FCUL2C2XCQ2JKS46BDPNDSENIJBDDLL7TR7BW337GB6OR63DF4CQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082215645 (322h48m36.813483284s) [noise=true , address=77.90.31.19:4874 , piece_id=MCAFOKTALBSPDPMRSTHYZB3RGF7M5I55HOG3RUD463VCTVW7QCGQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082563559 (322h48m36.813831199s) [noise=true , address=104.36.82.60:4372 , piece_id=KUGRHZF4E4FOB4SYJF2NQ75LIF6IUXWMZ35URXHB7VDADYLZNYHQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082885666 (322h48m36.814153317s) [noise=true , address=45.91.116.11:4132 , piece_id=SBIASMWS5NC2XSHDENEKASMDEKQ3ODBPE4RKIQ4EZKZG6SP67JNQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.083847547 (322h48m36.815115197s) [noise=true , address=79.127.219.51:4200 , piece_id=SPPCLJ66SEENUH7SLHHXWI2UZHBEEY3KZIVVUAS3FBZ7CQY2G4LQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.084798477 (322h48m36.816066128s) [noise=true , address=104.36.82.44:4874 , piece_id=UCCAF4MUEIVBLMZRA2LSGWLJZSIBFMA7NY36IA7IB3KH4IBGXKAQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.088490439 (322h48m36.819758089s) [noise=true , address=104.36.82.5:4858 , piece_id=IYUCCI5NCZOTML7GFYI4LAS6NV47IC5UHCVLHFON3LJKZA2LFABA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.206801759 (322h48m36.938069408s) [upload=335638]: Next returned nil segment
Aug 22 04:14:56.206950910 (322h48m36.93821856s) [upload=335638]: Waiting for error group managing segments...
Aug 22 04:14:56.219298197 (322h48m36.950565838s) [noise=true , address=79.127.219.51:4185 , piece_id=5RHU7PFIBAY7KLYYVMNPGJBM33K5WWZ6E35Z52O3SF2XSVG3WKMQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.221650127 (322h48m36.952917776s) [noise=true , address=79.127.219.51:4200 , piece_id=SPPCLJ66SEENUH7SLHHXWI2UZHBEEY3KZIVVUAS3FBZ7CQY2G4LQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.221873898 (322h48m36.953141537s) [noise=true , address=79.127.219.48:4093 , piece_id=NZBRQBL7Z52H3JCLLLD7CFBFWGC7H7MJTW6G2CFH57J2F4XDP4SA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.222678583 (322h48m36.953946232s) [noise=true , address=77.90.31.18:4811 , piece_id=ODPH32QDN7CTPF5IDUNQ5DEBC6HASD4BAP43ZVZDBIJFJLJWXHXA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.224688627 (322h48m36.955956277s) [noise=true , address=104.36.82.6:4892 , piece_id=3WLX4OFVLCBLAE5OEI52JHUPYZNBOWMRX6LJWUYLPEKWPCFDBIBA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.226219780 (322h48m36.95748742s) [noise=true , address=77.90.31.19:4874 , piece_id=MCAFOKTALBSPDPMRSTHYZB3RGF7M5I55HOG3RUD463VCTVW7QCGQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.226285995 (322h48m36.957553645s) [noise=true , address=77.90.31.17:4775 , piece_id=2KCZ36SQFRJWMC3OBYW6674TLYLJEMDPQA7QSS4JVELCBC75BF7A, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.228103006 (322h48m36.959370626s) [noise=true , address=104.36.82.44:4874 , piece_id=UCCAF4MUEIVBLMZRA2LSGWLJZSIBFMA7NY36IA7IB3KH4IBGXKAQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.237068737 (322h48m36.968336377s) [noise=true , address=77.90.31.16:4761 , piece_id=AJWEB2GXZABAMZW7V4S3LF7FEYOI23K2ASL42NFIOFOWWQBZQQCA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.248700377 (322h48m36.979968027s) [noise=true , address=45.91.116.11:4132 , piece_id=SBIASMWS5NC2XSHDENEKASMDEKQ3ODBPE4RKIQ4EZKZG6SP67JNQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.252483180 (322h48m36.98375083s) [noise=true , address=104.36.82.5:4858 , piece_id=IYUCCI5NCZOTML7GFYI4LAS6NV47IC5UHCVLHFON3LJKZA2LFABA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.268821762 (322h48m37.000089423s) [noise=true , address=77.90.31.15:4703 , piece_id=XH433WREH7EVXIAQMLI5EDLEN5FZJHAEHCYK5NL55VA2JWAVHTIA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.273574892 (322h48m37.004842553s) [noise=true , address=77.90.31.10:4535 , piece_id=3MOUQMV5N7JI4V27RP3ZPKLF2P3ABFO4XP4TFHOPUHGVGILJYZWA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.308274656 (322h48m37.039542306s) [noise=true , address=104.36.82.60:4372 , piece_id=KUGRHZF4E4FOB4SYJF2NQ75LIF6IUXWMZ35URXHB7VDADYLZNYHQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.308311565 (322h48m37.039579215s) [seg_pos={0 0}, upload=335638]: Segment reached optimal threshold of 14 pieces.
Aug 22 04:14:56.308536709 (322h48m37.039804359s) [noise=true , address=104.36.82.23:4472 , piece_id=FCUL2C2XCQ2JKS46BDPNDSENIJBDDLL7TR7BW337GB6OR63DF4CQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF
Aug 22 04:14:56.308649492 (322h48m37.039917141s) [noise=true , address=77.90.31.11:4568 , piece_id=JC2LPEKYMWNJRQ2HMCIHDZKSICEZLK6C4ET3UIDUIRDD6MCL6ZJA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1H1L8DTKD7W7Xx1PVT7KzB9GkGBadnTEj9BHtbSgcW1S7Jj8Tw): protocol: expected piece hash; context canceled; EOF
Aug 22 04:14:56.308765871 (322h48m37.040033521s) [noise=true , address=79.127.205.235:4677 , piece_id=CB422NDFIO6VHBDC4QCP7UGLZRCGP2N3JRVZPFX4DFE5SU77RKMQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oeYzce3yvWfVUnLYKyRyPePYh4QRj86FowWm3hRZ1qHQ6TSLa): protocol: read tcp 5.161.89.252:30854->79.127.205.235:4677: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 04:14:56.308796689 (322h48m37.040064349s) [noise=true , address=79.127.201.215:4344 , piece_id=I4KQ6C7QKCUXYFYIVHMWWLI5RZC3YXUNVBQTGHAHZU7F6ELJ5GMA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: read tcp 5.161.89.252:38178->79.127.201.215:4344: use of closed network connection; context canceled
Aug 22 04:14:56.308831504 (322h48m37.040099164s) [seg_pos={0 0}, upload=335638]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 04:14:56.309045818 (322h48m37.040313488s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 04:14:56.309058031 (322h48m37.040325681s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 04:14:56.409269392 (322h48m37.140537052s) [upload=335638]: Done uploading segments...
Aug 22 04:14:56.409287577 (322h48m37.140555237s) [upload=335638]: Upload finished. err: <nil>
Duration: 1.426124385s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...X...............................X.......X................] duration:
214.309863ms
FAIL (2025-08-22 04:41:12 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 04:29:59.317195954 (323h3m40.048463603s) [upload=335908]: Starting upload Aug 22 04:29:59.317268290 (323h3m40.04853594s) [upload=335908]: Done starting upload Aug 22 04:29:59.317333152 (323h3m40.048600802s) [upload=335908]: Uploading segments... Aug 22 04:29:59.317373970 (323h3m40.048641619s) [upload=335908]: Got next segment. Inline: true Aug 22 04:29:59.317379219 (323h3m40.048646879s) [upload=335908]: Waiting for error group managing segments... Aug 22 04:29:59.317423863 (323h3m40.048691513s) [upload=335908]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 04:29:59.317429253 (323h3m40.048696903s) [upload=335908]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 04:29:59.317432609 (323h3m40.048700259s) [upload=335908]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 04:29:59.319941914 (323h3m40.051209544s) [upload=335908]: Done uploading segments... Aug 22 04:29:59.319955200 (323h3m40.05122283s) [upload=335908]: Upload finished. err: metaclient: Too Many Requests
Duration: 214.336874ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
1.015520441s
FAIL (2025-08-22 04:40:40 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 22 04:14:56.030180971 (322h48m36.761448621s) [upload=335638]: Starting upload
Aug 22 04:14:56.030251765 (322h48m36.761519415s) [upload=335638]: Done starting upload
Aug 22 04:14:56.030449677 (322h48m36.761717337s) [upload=335638]: Uploading segments...
Aug 22 04:14:56.030627822 (322h48m36.761895473s) [upload=335638]: Got next segment. Inline: false
Aug 22 04:14:56.030671194 (322h48m36.761938845s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 04:14:56.030679730 (322h48m36.761947381s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 04:14:56.078560813 (322h48m36.809828453s) [seg_pos={0 0}, upload=335638]: Begin upload segment...
Aug 22 04:14:56.078602301 (322h48m36.809869951s) [seg_pos={0 0}, upload=335638]: Done begin upload segment.
Aug 22 04:14:56.078638679 (322h48m36.809906329s) [noise=true , address=77.90.31.15:4703 , piece_id=XH433WREH7EVXIAQMLI5EDLEN5FZJHAEHCYK5NL55VA2JWAVHTIA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.078649209 (322h48m36.809916859s) [noise=true , address=77.90.31.17:4775 , piece_id=2KCZ36SQFRJWMC3OBYW6674TLYLJEMDPQA7QSS4JVELCBC75BF7A, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079202952 (322h48m36.810470601s) [noise=true , address=79.127.201.215:4344 , piece_id=I4KQ6C7QKCUXYFYIVHMWWLI5RZC3YXUNVBQTGHAHZU7F6ELJ5GMA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079216498 (322h48m36.810484148s) [noise=true , address=77.90.31.10:4535 , piece_id=3MOUQMV5N7JI4V27RP3ZPKLF2P3ABFO4XP4TFHOPUHGVGILJYZWA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079590982 (322h48m36.810858633s) [noise=true , address=79.127.219.51:4185 , piece_id=5RHU7PFIBAY7KLYYVMNPGJBM33K5WWZ6E35Z52O3SF2XSVG3WKMQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079604748 (322h48m36.810872388s) [noise=true , address=104.36.82.6:4892 , piece_id=3WLX4OFVLCBLAE5OEI52JHUPYZNBOWMRX6LJWUYLPEKWPCFDBIBA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080091395 (322h48m36.811359044s) [noise=true , address=79.127.219.48:4093 , piece_id=NZBRQBL7Z52H3JCLLLD7CFBFWGC7H7MJTW6G2CFH57J2F4XDP4SA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080144284 (322h48m36.811411934s) [noise=true , address=79.127.205.235:4677 , piece_id=CB422NDFIO6VHBDC4QCP7UGLZRCGP2N3JRVZPFX4DFE5SU77RKMQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080582860 (322h48m36.811850511s) [noise=true , address=77.90.31.16:4761 , piece_id=AJWEB2GXZABAMZW7V4S3LF7FEYOI23K2ASL42NFIOFOWWQBZQQCA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081056942 (322h48m36.812324582s) [noise=true , address=77.90.31.11:4568 , piece_id=JC2LPEKYMWNJRQ2HMCIHDZKSICEZLK6C4ET3UIDUIRDD6MCL6ZJA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081504335 (322h48m36.812771984s) [noise=true , address=77.90.31.18:4811 , piece_id=ODPH32QDN7CTPF5IDUNQ5DEBC6HASD4BAP43ZVZDBIJFJLJWXHXA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081853813 (322h48m36.813121463s) [noise=true , address=104.36.82.23:4472 , piece_id=FCUL2C2XCQ2JKS46BDPNDSENIJBDDLL7TR7BW337GB6OR63DF4CQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082215645 (322h48m36.813483284s) [noise=true , address=77.90.31.19:4874 , piece_id=MCAFOKTALBSPDPMRSTHYZB3RGF7M5I55HOG3RUD463VCTVW7QCGQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082563559 (322h48m36.813831199s) [noise=true , address=104.36.82.60:4372 , piece_id=KUGRHZF4E4FOB4SYJF2NQ75LIF6IUXWMZ35URXHB7VDADYLZNYHQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082885666 (322h48m36.814153317s) [noise=true , address=45.91.116.11:4132 , piece_id=SBIASMWS5NC2XSHDENEKASMDEKQ3ODBPE4RKIQ4EZKZG6SP67JNQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.083847547 (322h48m36.815115197s) [noise=true , address=79.127.219.51:4200 , piece_id=SPPCLJ66SEENUH7SLHHXWI2UZHBEEY3KZIVVUAS3FBZ7CQY2G4LQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.084798477 (322h48m36.816066128s) [noise=true , address=104.36.82.44:4874 , piece_id=UCCAF4MUEIVBLMZRA2LSGWLJZSIBFMA7NY36IA7IB3KH4IBGXKAQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.088490439 (322h48m36.819758089s) [noise=true , address=104.36.82.5:4858 , piece_id=IYUCCI5NCZOTML7GFYI4LAS6NV47IC5UHCVLHFON3LJKZA2LFABA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.206801759 (322h48m36.938069408s) [upload=335638]: Next returned nil segment
Aug 22 04:14:56.206950910 (322h48m36.93821856s) [upload=335638]: Waiting for error group managing segments...
Aug 22 04:14:56.219298197 (322h48m36.950565838s) [noise=true , address=79.127.219.51:4185 , piece_id=5RHU7PFIBAY7KLYYVMNPGJBM33K5WWZ6E35Z52O3SF2XSVG3WKMQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.221650127 (322h48m36.952917776s) [noise=true , address=79.127.219.51:4200 , piece_id=SPPCLJ66SEENUH7SLHHXWI2UZHBEEY3KZIVVUAS3FBZ7CQY2G4LQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.221873898 (322h48m36.953141537s) [noise=true , address=79.127.219.48:4093 , piece_id=NZBRQBL7Z52H3JCLLLD7CFBFWGC7H7MJTW6G2CFH57J2F4XDP4SA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.222678583 (322h48m36.953946232s) [noise=true , address=77.90.31.18:4811 , piece_id=ODPH32QDN7CTPF5IDUNQ5DEBC6HASD4BAP43ZVZDBIJFJLJWXHXA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.224688627 (322h48m36.955956277s) [noise=true , address=104.36.82.6:4892 , piece_id=3WLX4OFVLCBLAE5OEI52JHUPYZNBOWMRX6LJWUYLPEKWPCFDBIBA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.226219780 (322h48m36.95748742s) [noise=true , address=77.90.31.19:4874 , piece_id=MCAFOKTALBSPDPMRSTHYZB3RGF7M5I55HOG3RUD463VCTVW7QCGQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.226285995 (322h48m36.957553645s) [noise=true , address=77.90.31.17:4775 , piece_id=2KCZ36SQFRJWMC3OBYW6674TLYLJEMDPQA7QSS4JVELCBC75BF7A, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.228103006 (322h48m36.959370626s) [noise=true , address=104.36.82.44:4874 , piece_id=UCCAF4MUEIVBLMZRA2LSGWLJZSIBFMA7NY36IA7IB3KH4IBGXKAQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.237068737 (322h48m36.968336377s) [noise=true , address=77.90.31.16:4761 , piece_id=AJWEB2GXZABAMZW7V4S3LF7FEYOI23K2ASL42NFIOFOWWQBZQQCA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.248700377 (322h48m36.979968027s) [noise=true , address=45.91.116.11:4132 , piece_id=SBIASMWS5NC2XSHDENEKASMDEKQ3ODBPE4RKIQ4EZKZG6SP67JNQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.252483180 (322h48m36.98375083s) [noise=true , address=104.36.82.5:4858 , piece_id=IYUCCI5NCZOTML7GFYI4LAS6NV47IC5UHCVLHFON3LJKZA2LFABA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.268821762 (322h48m37.000089423s) [noise=true , address=77.90.31.15:4703 , piece_id=XH433WREH7EVXIAQMLI5EDLEN5FZJHAEHCYK5NL55VA2JWAVHTIA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.273574892 (322h48m37.004842553s) [noise=true , address=77.90.31.10:4535 , piece_id=3MOUQMV5N7JI4V27RP3ZPKLF2P3ABFO4XP4TFHOPUHGVGILJYZWA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.308274656 (322h48m37.039542306s) [noise=true , address=104.36.82.60:4372 , piece_id=KUGRHZF4E4FOB4SYJF2NQ75LIF6IUXWMZ35URXHB7VDADYLZNYHQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.308311565 (322h48m37.039579215s) [seg_pos={0 0}, upload=335638]: Segment reached optimal threshold of 14 pieces.
Aug 22 04:14:56.308536709 (322h48m37.039804359s) [noise=true , address=104.36.82.23:4472 , piece_id=FCUL2C2XCQ2JKS46BDPNDSENIJBDDLL7TR7BW337GB6OR63DF4CQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF
Aug 22 04:14:56.308649492 (322h48m37.039917141s) [noise=true , address=77.90.31.11:4568 , piece_id=JC2LPEKYMWNJRQ2HMCIHDZKSICEZLK6C4ET3UIDUIRDD6MCL6ZJA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1H1L8DTKD7W7Xx1PVT7KzB9GkGBadnTEj9BHtbSgcW1S7Jj8Tw): protocol: expected piece hash; context canceled; EOF
Aug 22 04:14:56.308765871 (322h48m37.040033521s) [noise=true , address=79.127.205.235:4677 , piece_id=CB422NDFIO6VHBDC4QCP7UGLZRCGP2N3JRVZPFX4DFE5SU77RKMQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oeYzce3yvWfVUnLYKyRyPePYh4QRj86FowWm3hRZ1qHQ6TSLa): protocol: read tcp 5.161.89.252:30854->79.127.205.235:4677: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 04:14:56.308796689 (322h48m37.040064349s) [noise=true , address=79.127.201.215:4344 , piece_id=I4KQ6C7QKCUXYFYIVHMWWLI5RZC3YXUNVBQTGHAHZU7F6ELJ5GMA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: read tcp 5.161.89.252:38178->79.127.201.215:4344: use of closed network connection; context canceled
Aug 22 04:14:56.308831504 (322h48m37.040099164s) [seg_pos={0 0}, upload=335638]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 04:14:56.309045818 (322h48m37.040313488s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 04:14:56.309058031 (322h48m37.040325681s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 04:14:56.409269392 (322h48m37.140537052s) [upload=335638]: Done uploading segments...
Aug 22 04:14:56.409287577 (322h48m37.140555237s) [upload=335638]: Upload finished. err: <nil>
Duration: 1.015546781s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....X...............................X.......X...............] duration:
150.67306ms
FAIL (2025-08-22 04:40:27 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 04:29:59.317195954 (323h3m40.048463603s) [upload=335908]: Starting upload Aug 22 04:29:59.317268290 (323h3m40.04853594s) [upload=335908]: Done starting upload Aug 22 04:29:59.317333152 (323h3m40.048600802s) [upload=335908]: Uploading segments... Aug 22 04:29:59.317373970 (323h3m40.048641619s) [upload=335908]: Got next segment. Inline: true Aug 22 04:29:59.317379219 (323h3m40.048646879s) [upload=335908]: Waiting for error group managing segments... Aug 22 04:29:59.317423863 (323h3m40.048691513s) [upload=335908]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 04:29:59.317429253 (323h3m40.048696903s) [upload=335908]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 04:29:59.317432609 (323h3m40.048700259s) [upload=335908]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 04:29:59.319941914 (323h3m40.051209544s) [upload=335908]: Done uploading segments... Aug 22 04:29:59.319955200 (323h3m40.05122283s) [upload=335908]: Upload finished. err: metaclient: Too Many Requests
Duration: 150.692997ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....X...............................X.......X..............] duration:
164.148393ms
FAIL (2025-08-22 04:40:03 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 04:29:59.317195954 (323h3m40.048463603s) [upload=335908]: Starting upload Aug 22 04:29:59.317268290 (323h3m40.04853594s) [upload=335908]: Done starting upload Aug 22 04:29:59.317333152 (323h3m40.048600802s) [upload=335908]: Uploading segments... Aug 22 04:29:59.317373970 (323h3m40.048641619s) [upload=335908]: Got next segment. Inline: true Aug 22 04:29:59.317379219 (323h3m40.048646879s) [upload=335908]: Waiting for error group managing segments... Aug 22 04:29:59.317423863 (323h3m40.048691513s) [upload=335908]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 04:29:59.317429253 (323h3m40.048696903s) [upload=335908]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 04:29:59.317432609 (323h3m40.048700259s) [upload=335908]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 04:29:59.319941914 (323h3m40.051209544s) [upload=335908]: Done uploading segments... Aug 22 04:29:59.319955200 (323h3m40.05122283s) [upload=335908]: Upload finished. err: metaclient: Too Many Requests
Duration: 164.169774ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
1.925088874s
FAIL (2025-08-22 04:39:42 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 22 04:14:56.030180971 (322h48m36.761448621s) [upload=335638]: Starting upload
Aug 22 04:14:56.030251765 (322h48m36.761519415s) [upload=335638]: Done starting upload
Aug 22 04:14:56.030449677 (322h48m36.761717337s) [upload=335638]: Uploading segments...
Aug 22 04:14:56.030627822 (322h48m36.761895473s) [upload=335638]: Got next segment. Inline: false
Aug 22 04:14:56.030671194 (322h48m36.761938845s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 04:14:56.030679730 (322h48m36.761947381s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 04:14:56.078560813 (322h48m36.809828453s) [seg_pos={0 0}, upload=335638]: Begin upload segment...
Aug 22 04:14:56.078602301 (322h48m36.809869951s) [seg_pos={0 0}, upload=335638]: Done begin upload segment.
Aug 22 04:14:56.078638679 (322h48m36.809906329s) [noise=true , address=77.90.31.15:4703 , piece_id=XH433WREH7EVXIAQMLI5EDLEN5FZJHAEHCYK5NL55VA2JWAVHTIA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.078649209 (322h48m36.809916859s) [noise=true , address=77.90.31.17:4775 , piece_id=2KCZ36SQFRJWMC3OBYW6674TLYLJEMDPQA7QSS4JVELCBC75BF7A, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079202952 (322h48m36.810470601s) [noise=true , address=79.127.201.215:4344 , piece_id=I4KQ6C7QKCUXYFYIVHMWWLI5RZC3YXUNVBQTGHAHZU7F6ELJ5GMA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079216498 (322h48m36.810484148s) [noise=true , address=77.90.31.10:4535 , piece_id=3MOUQMV5N7JI4V27RP3ZPKLF2P3ABFO4XP4TFHOPUHGVGILJYZWA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079590982 (322h48m36.810858633s) [noise=true , address=79.127.219.51:4185 , piece_id=5RHU7PFIBAY7KLYYVMNPGJBM33K5WWZ6E35Z52O3SF2XSVG3WKMQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079604748 (322h48m36.810872388s) [noise=true , address=104.36.82.6:4892 , piece_id=3WLX4OFVLCBLAE5OEI52JHUPYZNBOWMRX6LJWUYLPEKWPCFDBIBA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080091395 (322h48m36.811359044s) [noise=true , address=79.127.219.48:4093 , piece_id=NZBRQBL7Z52H3JCLLLD7CFBFWGC7H7MJTW6G2CFH57J2F4XDP4SA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080144284 (322h48m36.811411934s) [noise=true , address=79.127.205.235:4677 , piece_id=CB422NDFIO6VHBDC4QCP7UGLZRCGP2N3JRVZPFX4DFE5SU77RKMQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080582860 (322h48m36.811850511s) [noise=true , address=77.90.31.16:4761 , piece_id=AJWEB2GXZABAMZW7V4S3LF7FEYOI23K2ASL42NFIOFOWWQBZQQCA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081056942 (322h48m36.812324582s) [noise=true , address=77.90.31.11:4568 , piece_id=JC2LPEKYMWNJRQ2HMCIHDZKSICEZLK6C4ET3UIDUIRDD6MCL6ZJA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081504335 (322h48m36.812771984s) [noise=true , address=77.90.31.18:4811 , piece_id=ODPH32QDN7CTPF5IDUNQ5DEBC6HASD4BAP43ZVZDBIJFJLJWXHXA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081853813 (322h48m36.813121463s) [noise=true , address=104.36.82.23:4472 , piece_id=FCUL2C2XCQ2JKS46BDPNDSENIJBDDLL7TR7BW337GB6OR63DF4CQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082215645 (322h48m36.813483284s) [noise=true , address=77.90.31.19:4874 , piece_id=MCAFOKTALBSPDPMRSTHYZB3RGF7M5I55HOG3RUD463VCTVW7QCGQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082563559 (322h48m36.813831199s) [noise=true , address=104.36.82.60:4372 , piece_id=KUGRHZF4E4FOB4SYJF2NQ75LIF6IUXWMZ35URXHB7VDADYLZNYHQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082885666 (322h48m36.814153317s) [noise=true , address=45.91.116.11:4132 , piece_id=SBIASMWS5NC2XSHDENEKASMDEKQ3ODBPE4RKIQ4EZKZG6SP67JNQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.083847547 (322h48m36.815115197s) [noise=true , address=79.127.219.51:4200 , piece_id=SPPCLJ66SEENUH7SLHHXWI2UZHBEEY3KZIVVUAS3FBZ7CQY2G4LQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.084798477 (322h48m36.816066128s) [noise=true , address=104.36.82.44:4874 , piece_id=UCCAF4MUEIVBLMZRA2LSGWLJZSIBFMA7NY36IA7IB3KH4IBGXKAQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.088490439 (322h48m36.819758089s) [noise=true , address=104.36.82.5:4858 , piece_id=IYUCCI5NCZOTML7GFYI4LAS6NV47IC5UHCVLHFON3LJKZA2LFABA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.206801759 (322h48m36.938069408s) [upload=335638]: Next returned nil segment
Aug 22 04:14:56.206950910 (322h48m36.93821856s) [upload=335638]: Waiting for error group managing segments...
Aug 22 04:14:56.219298197 (322h48m36.950565838s) [noise=true , address=79.127.219.51:4185 , piece_id=5RHU7PFIBAY7KLYYVMNPGJBM33K5WWZ6E35Z52O3SF2XSVG3WKMQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.221650127 (322h48m36.952917776s) [noise=true , address=79.127.219.51:4200 , piece_id=SPPCLJ66SEENUH7SLHHXWI2UZHBEEY3KZIVVUAS3FBZ7CQY2G4LQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.221873898 (322h48m36.953141537s) [noise=true , address=79.127.219.48:4093 , piece_id=NZBRQBL7Z52H3JCLLLD7CFBFWGC7H7MJTW6G2CFH57J2F4XDP4SA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.222678583 (322h48m36.953946232s) [noise=true , address=77.90.31.18:4811 , piece_id=ODPH32QDN7CTPF5IDUNQ5DEBC6HASD4BAP43ZVZDBIJFJLJWXHXA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.224688627 (322h48m36.955956277s) [noise=true , address=104.36.82.6:4892 , piece_id=3WLX4OFVLCBLAE5OEI52JHUPYZNBOWMRX6LJWUYLPEKWPCFDBIBA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.226219780 (322h48m36.95748742s) [noise=true , address=77.90.31.19:4874 , piece_id=MCAFOKTALBSPDPMRSTHYZB3RGF7M5I55HOG3RUD463VCTVW7QCGQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.226285995 (322h48m36.957553645s) [noise=true , address=77.90.31.17:4775 , piece_id=2KCZ36SQFRJWMC3OBYW6674TLYLJEMDPQA7QSS4JVELCBC75BF7A, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.228103006 (322h48m36.959370626s) [noise=true , address=104.36.82.44:4874 , piece_id=UCCAF4MUEIVBLMZRA2LSGWLJZSIBFMA7NY36IA7IB3KH4IBGXKAQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.237068737 (322h48m36.968336377s) [noise=true , address=77.90.31.16:4761 , piece_id=AJWEB2GXZABAMZW7V4S3LF7FEYOI23K2ASL42NFIOFOWWQBZQQCA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.248700377 (322h48m36.979968027s) [noise=true , address=45.91.116.11:4132 , piece_id=SBIASMWS5NC2XSHDENEKASMDEKQ3ODBPE4RKIQ4EZKZG6SP67JNQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.252483180 (322h48m36.98375083s) [noise=true , address=104.36.82.5:4858 , piece_id=IYUCCI5NCZOTML7GFYI4LAS6NV47IC5UHCVLHFON3LJKZA2LFABA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.268821762 (322h48m37.000089423s) [noise=true , address=77.90.31.15:4703 , piece_id=XH433WREH7EVXIAQMLI5EDLEN5FZJHAEHCYK5NL55VA2JWAVHTIA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.273574892 (322h48m37.004842553s) [noise=true , address=77.90.31.10:4535 , piece_id=3MOUQMV5N7JI4V27RP3ZPKLF2P3ABFO4XP4TFHOPUHGVGILJYZWA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.308274656 (322h48m37.039542306s) [noise=true , address=104.36.82.60:4372 , piece_id=KUGRHZF4E4FOB4SYJF2NQ75LIF6IUXWMZ35URXHB7VDADYLZNYHQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.308311565 (322h48m37.039579215s) [seg_pos={0 0}, upload=335638]: Segment reached optimal threshold of 14 pieces.
Aug 22 04:14:56.308536709 (322h48m37.039804359s) [noise=true , address=104.36.82.23:4472 , piece_id=FCUL2C2XCQ2JKS46BDPNDSENIJBDDLL7TR7BW337GB6OR63DF4CQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF
Aug 22 04:14:56.308649492 (322h48m37.039917141s) [noise=true , address=77.90.31.11:4568 , piece_id=JC2LPEKYMWNJRQ2HMCIHDZKSICEZLK6C4ET3UIDUIRDD6MCL6ZJA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1H1L8DTKD7W7Xx1PVT7KzB9GkGBadnTEj9BHtbSgcW1S7Jj8Tw): protocol: expected piece hash; context canceled; EOF
Aug 22 04:14:56.308765871 (322h48m37.040033521s) [noise=true , address=79.127.205.235:4677 , piece_id=CB422NDFIO6VHBDC4QCP7UGLZRCGP2N3JRVZPFX4DFE5SU77RKMQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oeYzce3yvWfVUnLYKyRyPePYh4QRj86FowWm3hRZ1qHQ6TSLa): protocol: read tcp 5.161.89.252:30854->79.127.205.235:4677: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 04:14:56.308796689 (322h48m37.040064349s) [noise=true , address=79.127.201.215:4344 , piece_id=I4KQ6C7QKCUXYFYIVHMWWLI5RZC3YXUNVBQTGHAHZU7F6ELJ5GMA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: read tcp 5.161.89.252:38178->79.127.201.215:4344: use of closed network connection; context canceled
Aug 22 04:14:56.308831504 (322h48m37.040099164s) [seg_pos={0 0}, upload=335638]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 04:14:56.309045818 (322h48m37.040313488s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 04:14:56.309058031 (322h48m37.040325681s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 04:14:56.409269392 (322h48m37.140537052s) [upload=335638]: Done uploading segments...
Aug 22 04:14:56.409287577 (322h48m37.140555237s) [upload=335638]: Upload finished. err: <nil>
Duration: 1.925110284s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [......X...............................X.......X.............] duration:
348.82865ms
FAIL (2025-08-22 04:39:18 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 04:29:59.317195954 (323h3m40.048463603s) [upload=335908]: Starting upload Aug 22 04:29:59.317268290 (323h3m40.04853594s) [upload=335908]: Done starting upload Aug 22 04:29:59.317333152 (323h3m40.048600802s) [upload=335908]: Uploading segments... Aug 22 04:29:59.317373970 (323h3m40.048641619s) [upload=335908]: Got next segment. Inline: true Aug 22 04:29:59.317379219 (323h3m40.048646879s) [upload=335908]: Waiting for error group managing segments... Aug 22 04:29:59.317423863 (323h3m40.048691513s) [upload=335908]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 04:29:59.317429253 (323h3m40.048696903s) [upload=335908]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 04:29:59.317432609 (323h3m40.048700259s) [upload=335908]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 04:29:59.319941914 (323h3m40.051209544s) [upload=335908]: Done uploading segments... Aug 22 04:29:59.319955200 (323h3m40.05122283s) [upload=335908]: Upload finished. err: metaclient: Too Many Requests
Duration: 348.854959ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
371.378213ms
FAIL (2025-08-22 04:38:58 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 22 04:14:56.030180971 (322h48m36.761448621s) [upload=335638]: Starting upload
Aug 22 04:14:56.030251765 (322h48m36.761519415s) [upload=335638]: Done starting upload
Aug 22 04:14:56.030449677 (322h48m36.761717337s) [upload=335638]: Uploading segments...
Aug 22 04:14:56.030627822 (322h48m36.761895473s) [upload=335638]: Got next segment. Inline: false
Aug 22 04:14:56.030671194 (322h48m36.761938845s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 04:14:56.030679730 (322h48m36.761947381s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 04:14:56.078560813 (322h48m36.809828453s) [seg_pos={0 0}, upload=335638]: Begin upload segment...
Aug 22 04:14:56.078602301 (322h48m36.809869951s) [seg_pos={0 0}, upload=335638]: Done begin upload segment.
Aug 22 04:14:56.078638679 (322h48m36.809906329s) [noise=true , address=77.90.31.15:4703 , piece_id=XH433WREH7EVXIAQMLI5EDLEN5FZJHAEHCYK5NL55VA2JWAVHTIA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.078649209 (322h48m36.809916859s) [noise=true , address=77.90.31.17:4775 , piece_id=2KCZ36SQFRJWMC3OBYW6674TLYLJEMDPQA7QSS4JVELCBC75BF7A, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079202952 (322h48m36.810470601s) [noise=true , address=79.127.201.215:4344 , piece_id=I4KQ6C7QKCUXYFYIVHMWWLI5RZC3YXUNVBQTGHAHZU7F6ELJ5GMA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079216498 (322h48m36.810484148s) [noise=true , address=77.90.31.10:4535 , piece_id=3MOUQMV5N7JI4V27RP3ZPKLF2P3ABFO4XP4TFHOPUHGVGILJYZWA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079590982 (322h48m36.810858633s) [noise=true , address=79.127.219.51:4185 , piece_id=5RHU7PFIBAY7KLYYVMNPGJBM33K5WWZ6E35Z52O3SF2XSVG3WKMQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079604748 (322h48m36.810872388s) [noise=true , address=104.36.82.6:4892 , piece_id=3WLX4OFVLCBLAE5OEI52JHUPYZNBOWMRX6LJWUYLPEKWPCFDBIBA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080091395 (322h48m36.811359044s) [noise=true , address=79.127.219.48:4093 , piece_id=NZBRQBL7Z52H3JCLLLD7CFBFWGC7H7MJTW6G2CFH57J2F4XDP4SA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080144284 (322h48m36.811411934s) [noise=true , address=79.127.205.235:4677 , piece_id=CB422NDFIO6VHBDC4QCP7UGLZRCGP2N3JRVZPFX4DFE5SU77RKMQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080582860 (322h48m36.811850511s) [noise=true , address=77.90.31.16:4761 , piece_id=AJWEB2GXZABAMZW7V4S3LF7FEYOI23K2ASL42NFIOFOWWQBZQQCA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081056942 (322h48m36.812324582s) [noise=true , address=77.90.31.11:4568 , piece_id=JC2LPEKYMWNJRQ2HMCIHDZKSICEZLK6C4ET3UIDUIRDD6MCL6ZJA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081504335 (322h48m36.812771984s) [noise=true , address=77.90.31.18:4811 , piece_id=ODPH32QDN7CTPF5IDUNQ5DEBC6HASD4BAP43ZVZDBIJFJLJWXHXA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081853813 (322h48m36.813121463s) [noise=true , address=104.36.82.23:4472 , piece_id=FCUL2C2XCQ2JKS46BDPNDSENIJBDDLL7TR7BW337GB6OR63DF4CQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082215645 (322h48m36.813483284s) [noise=true , address=77.90.31.19:4874 , piece_id=MCAFOKTALBSPDPMRSTHYZB3RGF7M5I55HOG3RUD463VCTVW7QCGQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082563559 (322h48m36.813831199s) [noise=true , address=104.36.82.60:4372 , piece_id=KUGRHZF4E4FOB4SYJF2NQ75LIF6IUXWMZ35URXHB7VDADYLZNYHQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082885666 (322h48m36.814153317s) [noise=true , address=45.91.116.11:4132 , piece_id=SBIASMWS5NC2XSHDENEKASMDEKQ3ODBPE4RKIQ4EZKZG6SP67JNQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.083847547 (322h48m36.815115197s) [noise=true , address=79.127.219.51:4200 , piece_id=SPPCLJ66SEENUH7SLHHXWI2UZHBEEY3KZIVVUAS3FBZ7CQY2G4LQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.084798477 (322h48m36.816066128s) [noise=true , address=104.36.82.44:4874 , piece_id=UCCAF4MUEIVBLMZRA2LSGWLJZSIBFMA7NY36IA7IB3KH4IBGXKAQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.088490439 (322h48m36.819758089s) [noise=true , address=104.36.82.5:4858 , piece_id=IYUCCI5NCZOTML7GFYI4LAS6NV47IC5UHCVLHFON3LJKZA2LFABA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.206801759 (322h48m36.938069408s) [upload=335638]: Next returned nil segment
Aug 22 04:14:56.206950910 (322h48m36.93821856s) [upload=335638]: Waiting for error group managing segments...
Aug 22 04:14:56.219298197 (322h48m36.950565838s) [noise=true , address=79.127.219.51:4185 , piece_id=5RHU7PFIBAY7KLYYVMNPGJBM33K5WWZ6E35Z52O3SF2XSVG3WKMQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.221650127 (322h48m36.952917776s) [noise=true , address=79.127.219.51:4200 , piece_id=SPPCLJ66SEENUH7SLHHXWI2UZHBEEY3KZIVVUAS3FBZ7CQY2G4LQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.221873898 (322h48m36.953141537s) [noise=true , address=79.127.219.48:4093 , piece_id=NZBRQBL7Z52H3JCLLLD7CFBFWGC7H7MJTW6G2CFH57J2F4XDP4SA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.222678583 (322h48m36.953946232s) [noise=true , address=77.90.31.18:4811 , piece_id=ODPH32QDN7CTPF5IDUNQ5DEBC6HASD4BAP43ZVZDBIJFJLJWXHXA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.224688627 (322h48m36.955956277s) [noise=true , address=104.36.82.6:4892 , piece_id=3WLX4OFVLCBLAE5OEI52JHUPYZNBOWMRX6LJWUYLPEKWPCFDBIBA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.226219780 (322h48m36.95748742s) [noise=true , address=77.90.31.19:4874 , piece_id=MCAFOKTALBSPDPMRSTHYZB3RGF7M5I55HOG3RUD463VCTVW7QCGQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.226285995 (322h48m36.957553645s) [noise=true , address=77.90.31.17:4775 , piece_id=2KCZ36SQFRJWMC3OBYW6674TLYLJEMDPQA7QSS4JVELCBC75BF7A, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.228103006 (322h48m36.959370626s) [noise=true , address=104.36.82.44:4874 , piece_id=UCCAF4MUEIVBLMZRA2LSGWLJZSIBFMA7NY36IA7IB3KH4IBGXKAQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.237068737 (322h48m36.968336377s) [noise=true , address=77.90.31.16:4761 , piece_id=AJWEB2GXZABAMZW7V4S3LF7FEYOI23K2ASL42NFIOFOWWQBZQQCA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.248700377 (322h48m36.979968027s) [noise=true , address=45.91.116.11:4132 , piece_id=SBIASMWS5NC2XSHDENEKASMDEKQ3ODBPE4RKIQ4EZKZG6SP67JNQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.252483180 (322h48m36.98375083s) [noise=true , address=104.36.82.5:4858 , piece_id=IYUCCI5NCZOTML7GFYI4LAS6NV47IC5UHCVLHFON3LJKZA2LFABA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.268821762 (322h48m37.000089423s) [noise=true , address=77.90.31.15:4703 , piece_id=XH433WREH7EVXIAQMLI5EDLEN5FZJHAEHCYK5NL55VA2JWAVHTIA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.273574892 (322h48m37.004842553s) [noise=true , address=77.90.31.10:4535 , piece_id=3MOUQMV5N7JI4V27RP3ZPKLF2P3ABFO4XP4TFHOPUHGVGILJYZWA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.308274656 (322h48m37.039542306s) [noise=true , address=104.36.82.60:4372 , piece_id=KUGRHZF4E4FOB4SYJF2NQ75LIF6IUXWMZ35URXHB7VDADYLZNYHQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.308311565 (322h48m37.039579215s) [seg_pos={0 0}, upload=335638]: Segment reached optimal threshold of 14 pieces.
Aug 22 04:14:56.308536709 (322h48m37.039804359s) [noise=true , address=104.36.82.23:4472 , piece_id=FCUL2C2XCQ2JKS46BDPNDSENIJBDDLL7TR7BW337GB6OR63DF4CQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF
Aug 22 04:14:56.308649492 (322h48m37.039917141s) [noise=true , address=77.90.31.11:4568 , piece_id=JC2LPEKYMWNJRQ2HMCIHDZKSICEZLK6C4ET3UIDUIRDD6MCL6ZJA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1H1L8DTKD7W7Xx1PVT7KzB9GkGBadnTEj9BHtbSgcW1S7Jj8Tw): protocol: expected piece hash; context canceled; EOF
Aug 22 04:14:56.308765871 (322h48m37.040033521s) [noise=true , address=79.127.205.235:4677 , piece_id=CB422NDFIO6VHBDC4QCP7UGLZRCGP2N3JRVZPFX4DFE5SU77RKMQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oeYzce3yvWfVUnLYKyRyPePYh4QRj86FowWm3hRZ1qHQ6TSLa): protocol: read tcp 5.161.89.252:30854->79.127.205.235:4677: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 04:14:56.308796689 (322h48m37.040064349s) [noise=true , address=79.127.201.215:4344 , piece_id=I4KQ6C7QKCUXYFYIVHMWWLI5RZC3YXUNVBQTGHAHZU7F6ELJ5GMA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: read tcp 5.161.89.252:38178->79.127.201.215:4344: use of closed network connection; context canceled
Aug 22 04:14:56.308831504 (322h48m37.040099164s) [seg_pos={0 0}, upload=335638]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 04:14:56.309045818 (322h48m37.040313488s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 04:14:56.309058031 (322h48m37.040325681s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 04:14:56.409269392 (322h48m37.140537052s) [upload=335638]: Done uploading segments...
Aug 22 04:14:56.409287577 (322h48m37.140555237s) [upload=335638]: Upload finished. err: <nil>
Duration: 371.402058ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.......X...............................X.......X............] duration:
137.953121ms
FAIL (2025-08-22 04:38:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 04:29:59.317195954 (323h3m40.048463603s) [upload=335908]: Starting upload Aug 22 04:29:59.317268290 (323h3m40.04853594s) [upload=335908]: Done starting upload Aug 22 04:29:59.317333152 (323h3m40.048600802s) [upload=335908]: Uploading segments... Aug 22 04:29:59.317373970 (323h3m40.048641619s) [upload=335908]: Got next segment. Inline: true Aug 22 04:29:59.317379219 (323h3m40.048646879s) [upload=335908]: Waiting for error group managing segments... Aug 22 04:29:59.317423863 (323h3m40.048691513s) [upload=335908]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 04:29:59.317429253 (323h3m40.048696903s) [upload=335908]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 04:29:59.317432609 (323h3m40.048700259s) [upload=335908]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 04:29:59.319941914 (323h3m40.051209544s) [upload=335908]: Done uploading segments... Aug 22 04:29:59.319955200 (323h3m40.05122283s) [upload=335908]: Upload finished. err: metaclient: Too Many Requests
Duration: 137.982386ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
1.555985191s
FAIL (2025-08-22 04:38:31 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 22 04:14:56.030180971 (322h48m36.761448621s) [upload=335638]: Starting upload
Aug 22 04:14:56.030251765 (322h48m36.761519415s) [upload=335638]: Done starting upload
Aug 22 04:14:56.030449677 (322h48m36.761717337s) [upload=335638]: Uploading segments...
Aug 22 04:14:56.030627822 (322h48m36.761895473s) [upload=335638]: Got next segment. Inline: false
Aug 22 04:14:56.030671194 (322h48m36.761938845s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 04:14:56.030679730 (322h48m36.761947381s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 04:14:56.078560813 (322h48m36.809828453s) [seg_pos={0 0}, upload=335638]: Begin upload segment...
Aug 22 04:14:56.078602301 (322h48m36.809869951s) [seg_pos={0 0}, upload=335638]: Done begin upload segment.
Aug 22 04:14:56.078638679 (322h48m36.809906329s) [noise=true , address=77.90.31.15:4703 , piece_id=XH433WREH7EVXIAQMLI5EDLEN5FZJHAEHCYK5NL55VA2JWAVHTIA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.078649209 (322h48m36.809916859s) [noise=true , address=77.90.31.17:4775 , piece_id=2KCZ36SQFRJWMC3OBYW6674TLYLJEMDPQA7QSS4JVELCBC75BF7A, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079202952 (322h48m36.810470601s) [noise=true , address=79.127.201.215:4344 , piece_id=I4KQ6C7QKCUXYFYIVHMWWLI5RZC3YXUNVBQTGHAHZU7F6ELJ5GMA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079216498 (322h48m36.810484148s) [noise=true , address=77.90.31.10:4535 , piece_id=3MOUQMV5N7JI4V27RP3ZPKLF2P3ABFO4XP4TFHOPUHGVGILJYZWA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079590982 (322h48m36.810858633s) [noise=true , address=79.127.219.51:4185 , piece_id=5RHU7PFIBAY7KLYYVMNPGJBM33K5WWZ6E35Z52O3SF2XSVG3WKMQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079604748 (322h48m36.810872388s) [noise=true , address=104.36.82.6:4892 , piece_id=3WLX4OFVLCBLAE5OEI52JHUPYZNBOWMRX6LJWUYLPEKWPCFDBIBA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080091395 (322h48m36.811359044s) [noise=true , address=79.127.219.48:4093 , piece_id=NZBRQBL7Z52H3JCLLLD7CFBFWGC7H7MJTW6G2CFH57J2F4XDP4SA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080144284 (322h48m36.811411934s) [noise=true , address=79.127.205.235:4677 , piece_id=CB422NDFIO6VHBDC4QCP7UGLZRCGP2N3JRVZPFX4DFE5SU77RKMQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080582860 (322h48m36.811850511s) [noise=true , address=77.90.31.16:4761 , piece_id=AJWEB2GXZABAMZW7V4S3LF7FEYOI23K2ASL42NFIOFOWWQBZQQCA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081056942 (322h48m36.812324582s) [noise=true , address=77.90.31.11:4568 , piece_id=JC2LPEKYMWNJRQ2HMCIHDZKSICEZLK6C4ET3UIDUIRDD6MCL6ZJA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081504335 (322h48m36.812771984s) [noise=true , address=77.90.31.18:4811 , piece_id=ODPH32QDN7CTPF5IDUNQ5DEBC6HASD4BAP43ZVZDBIJFJLJWXHXA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081853813 (322h48m36.813121463s) [noise=true , address=104.36.82.23:4472 , piece_id=FCUL2C2XCQ2JKS46BDPNDSENIJBDDLL7TR7BW337GB6OR63DF4CQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082215645 (322h48m36.813483284s) [noise=true , address=77.90.31.19:4874 , piece_id=MCAFOKTALBSPDPMRSTHYZB3RGF7M5I55HOG3RUD463VCTVW7QCGQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082563559 (322h48m36.813831199s) [noise=true , address=104.36.82.60:4372 , piece_id=KUGRHZF4E4FOB4SYJF2NQ75LIF6IUXWMZ35URXHB7VDADYLZNYHQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082885666 (322h48m36.814153317s) [noise=true , address=45.91.116.11:4132 , piece_id=SBIASMWS5NC2XSHDENEKASMDEKQ3ODBPE4RKIQ4EZKZG6SP67JNQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.083847547 (322h48m36.815115197s) [noise=true , address=79.127.219.51:4200 , piece_id=SPPCLJ66SEENUH7SLHHXWI2UZHBEEY3KZIVVUAS3FBZ7CQY2G4LQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.084798477 (322h48m36.816066128s) [noise=true , address=104.36.82.44:4874 , piece_id=UCCAF4MUEIVBLMZRA2LSGWLJZSIBFMA7NY36IA7IB3KH4IBGXKAQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.088490439 (322h48m36.819758089s) [noise=true , address=104.36.82.5:4858 , piece_id=IYUCCI5NCZOTML7GFYI4LAS6NV47IC5UHCVLHFON3LJKZA2LFABA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.206801759 (322h48m36.938069408s) [upload=335638]: Next returned nil segment
Aug 22 04:14:56.206950910 (322h48m36.93821856s) [upload=335638]: Waiting for error group managing segments...
Aug 22 04:14:56.219298197 (322h48m36.950565838s) [noise=true , address=79.127.219.51:4185 , piece_id=5RHU7PFIBAY7KLYYVMNPGJBM33K5WWZ6E35Z52O3SF2XSVG3WKMQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.221650127 (322h48m36.952917776s) [noise=true , address=79.127.219.51:4200 , piece_id=SPPCLJ66SEENUH7SLHHXWI2UZHBEEY3KZIVVUAS3FBZ7CQY2G4LQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.221873898 (322h48m36.953141537s) [noise=true , address=79.127.219.48:4093 , piece_id=NZBRQBL7Z52H3JCLLLD7CFBFWGC7H7MJTW6G2CFH57J2F4XDP4SA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.222678583 (322h48m36.953946232s) [noise=true , address=77.90.31.18:4811 , piece_id=ODPH32QDN7CTPF5IDUNQ5DEBC6HASD4BAP43ZVZDBIJFJLJWXHXA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.224688627 (322h48m36.955956277s) [noise=true , address=104.36.82.6:4892 , piece_id=3WLX4OFVLCBLAE5OEI52JHUPYZNBOWMRX6LJWUYLPEKWPCFDBIBA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.226219780 (322h48m36.95748742s) [noise=true , address=77.90.31.19:4874 , piece_id=MCAFOKTALBSPDPMRSTHYZB3RGF7M5I55HOG3RUD463VCTVW7QCGQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.226285995 (322h48m36.957553645s) [noise=true , address=77.90.31.17:4775 , piece_id=2KCZ36SQFRJWMC3OBYW6674TLYLJEMDPQA7QSS4JVELCBC75BF7A, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.228103006 (322h48m36.959370626s) [noise=true , address=104.36.82.44:4874 , piece_id=UCCAF4MUEIVBLMZRA2LSGWLJZSIBFMA7NY36IA7IB3KH4IBGXKAQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.237068737 (322h48m36.968336377s) [noise=true , address=77.90.31.16:4761 , piece_id=AJWEB2GXZABAMZW7V4S3LF7FEYOI23K2ASL42NFIOFOWWQBZQQCA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.248700377 (322h48m36.979968027s) [noise=true , address=45.91.116.11:4132 , piece_id=SBIASMWS5NC2XSHDENEKASMDEKQ3ODBPE4RKIQ4EZKZG6SP67JNQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.252483180 (322h48m36.98375083s) [noise=true , address=104.36.82.5:4858 , piece_id=IYUCCI5NCZOTML7GFYI4LAS6NV47IC5UHCVLHFON3LJKZA2LFABA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.268821762 (322h48m37.000089423s) [noise=true , address=77.90.31.15:4703 , piece_id=XH433WREH7EVXIAQMLI5EDLEN5FZJHAEHCYK5NL55VA2JWAVHTIA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.273574892 (322h48m37.004842553s) [noise=true , address=77.90.31.10:4535 , piece_id=3MOUQMV5N7JI4V27RP3ZPKLF2P3ABFO4XP4TFHOPUHGVGILJYZWA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.308274656 (322h48m37.039542306s) [noise=true , address=104.36.82.60:4372 , piece_id=KUGRHZF4E4FOB4SYJF2NQ75LIF6IUXWMZ35URXHB7VDADYLZNYHQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.308311565 (322h48m37.039579215s) [seg_pos={0 0}, upload=335638]: Segment reached optimal threshold of 14 pieces.
Aug 22 04:14:56.308536709 (322h48m37.039804359s) [noise=true , address=104.36.82.23:4472 , piece_id=FCUL2C2XCQ2JKS46BDPNDSENIJBDDLL7TR7BW337GB6OR63DF4CQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF
Aug 22 04:14:56.308649492 (322h48m37.039917141s) [noise=true , address=77.90.31.11:4568 , piece_id=JC2LPEKYMWNJRQ2HMCIHDZKSICEZLK6C4ET3UIDUIRDD6MCL6ZJA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1H1L8DTKD7W7Xx1PVT7KzB9GkGBadnTEj9BHtbSgcW1S7Jj8Tw): protocol: expected piece hash; context canceled; EOF
Aug 22 04:14:56.308765871 (322h48m37.040033521s) [noise=true , address=79.127.205.235:4677 , piece_id=CB422NDFIO6VHBDC4QCP7UGLZRCGP2N3JRVZPFX4DFE5SU77RKMQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oeYzce3yvWfVUnLYKyRyPePYh4QRj86FowWm3hRZ1qHQ6TSLa): protocol: read tcp 5.161.89.252:30854->79.127.205.235:4677: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 04:14:56.308796689 (322h48m37.040064349s) [noise=true , address=79.127.201.215:4344 , piece_id=I4KQ6C7QKCUXYFYIVHMWWLI5RZC3YXUNVBQTGHAHZU7F6ELJ5GMA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: read tcp 5.161.89.252:38178->79.127.201.215:4344: use of closed network connection; context canceled
Aug 22 04:14:56.308831504 (322h48m37.040099164s) [seg_pos={0 0}, upload=335638]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 04:14:56.309045818 (322h48m37.040313488s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 04:14:56.309058031 (322h48m37.040325681s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 04:14:56.409269392 (322h48m37.140537052s) [upload=335638]: Done uploading segments...
Aug 22 04:14:56.409287577 (322h48m37.140555237s) [upload=335638]: Upload finished. err: <nil>
Duration: 1.556016129s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [........X...............................X.......X...........] duration:
172.859891ms
FAIL (2025-08-22 04:38:02 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 04:29:59.317195954 (323h3m40.048463603s) [upload=335908]: Starting upload Aug 22 04:29:59.317268290 (323h3m40.04853594s) [upload=335908]: Done starting upload Aug 22 04:29:59.317333152 (323h3m40.048600802s) [upload=335908]: Uploading segments... Aug 22 04:29:59.317373970 (323h3m40.048641619s) [upload=335908]: Got next segment. Inline: true Aug 22 04:29:59.317379219 (323h3m40.048646879s) [upload=335908]: Waiting for error group managing segments... Aug 22 04:29:59.317423863 (323h3m40.048691513s) [upload=335908]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 04:29:59.317429253 (323h3m40.048696903s) [upload=335908]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 04:29:59.317432609 (323h3m40.048700259s) [upload=335908]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 04:29:59.319941914 (323h3m40.051209544s) [upload=335908]: Done uploading segments... Aug 22 04:29:59.319955200 (323h3m40.05122283s) [upload=335908]: Upload finished. err: metaclient: Too Many Requests
Duration: 172.908674ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
1.927686204s
FAIL (2025-08-22 04:37:27 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 22 04:14:56.030180971 (322h48m36.761448621s) [upload=335638]: Starting upload
Aug 22 04:14:56.030251765 (322h48m36.761519415s) [upload=335638]: Done starting upload
Aug 22 04:14:56.030449677 (322h48m36.761717337s) [upload=335638]: Uploading segments...
Aug 22 04:14:56.030627822 (322h48m36.761895473s) [upload=335638]: Got next segment. Inline: false
Aug 22 04:14:56.030671194 (322h48m36.761938845s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 04:14:56.030679730 (322h48m36.761947381s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 04:14:56.078560813 (322h48m36.809828453s) [seg_pos={0 0}, upload=335638]: Begin upload segment...
Aug 22 04:14:56.078602301 (322h48m36.809869951s) [seg_pos={0 0}, upload=335638]: Done begin upload segment.
Aug 22 04:14:56.078638679 (322h48m36.809906329s) [noise=true , address=77.90.31.15:4703 , piece_id=XH433WREH7EVXIAQMLI5EDLEN5FZJHAEHCYK5NL55VA2JWAVHTIA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.078649209 (322h48m36.809916859s) [noise=true , address=77.90.31.17:4775 , piece_id=2KCZ36SQFRJWMC3OBYW6674TLYLJEMDPQA7QSS4JVELCBC75BF7A, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079202952 (322h48m36.810470601s) [noise=true , address=79.127.201.215:4344 , piece_id=I4KQ6C7QKCUXYFYIVHMWWLI5RZC3YXUNVBQTGHAHZU7F6ELJ5GMA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079216498 (322h48m36.810484148s) [noise=true , address=77.90.31.10:4535 , piece_id=3MOUQMV5N7JI4V27RP3ZPKLF2P3ABFO4XP4TFHOPUHGVGILJYZWA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079590982 (322h48m36.810858633s) [noise=true , address=79.127.219.51:4185 , piece_id=5RHU7PFIBAY7KLYYVMNPGJBM33K5WWZ6E35Z52O3SF2XSVG3WKMQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079604748 (322h48m36.810872388s) [noise=true , address=104.36.82.6:4892 , piece_id=3WLX4OFVLCBLAE5OEI52JHUPYZNBOWMRX6LJWUYLPEKWPCFDBIBA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080091395 (322h48m36.811359044s) [noise=true , address=79.127.219.48:4093 , piece_id=NZBRQBL7Z52H3JCLLLD7CFBFWGC7H7MJTW6G2CFH57J2F4XDP4SA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080144284 (322h48m36.811411934s) [noise=true , address=79.127.205.235:4677 , piece_id=CB422NDFIO6VHBDC4QCP7UGLZRCGP2N3JRVZPFX4DFE5SU77RKMQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080582860 (322h48m36.811850511s) [noise=true , address=77.90.31.16:4761 , piece_id=AJWEB2GXZABAMZW7V4S3LF7FEYOI23K2ASL42NFIOFOWWQBZQQCA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081056942 (322h48m36.812324582s) [noise=true , address=77.90.31.11:4568 , piece_id=JC2LPEKYMWNJRQ2HMCIHDZKSICEZLK6C4ET3UIDUIRDD6MCL6ZJA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081504335 (322h48m36.812771984s) [noise=true , address=77.90.31.18:4811 , piece_id=ODPH32QDN7CTPF5IDUNQ5DEBC6HASD4BAP43ZVZDBIJFJLJWXHXA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081853813 (322h48m36.813121463s) [noise=true , address=104.36.82.23:4472 , piece_id=FCUL2C2XCQ2JKS46BDPNDSENIJBDDLL7TR7BW337GB6OR63DF4CQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082215645 (322h48m36.813483284s) [noise=true , address=77.90.31.19:4874 , piece_id=MCAFOKTALBSPDPMRSTHYZB3RGF7M5I55HOG3RUD463VCTVW7QCGQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082563559 (322h48m36.813831199s) [noise=true , address=104.36.82.60:4372 , piece_id=KUGRHZF4E4FOB4SYJF2NQ75LIF6IUXWMZ35URXHB7VDADYLZNYHQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082885666 (322h48m36.814153317s) [noise=true , address=45.91.116.11:4132 , piece_id=SBIASMWS5NC2XSHDENEKASMDEKQ3ODBPE4RKIQ4EZKZG6SP67JNQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.083847547 (322h48m36.815115197s) [noise=true , address=79.127.219.51:4200 , piece_id=SPPCLJ66SEENUH7SLHHXWI2UZHBEEY3KZIVVUAS3FBZ7CQY2G4LQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.084798477 (322h48m36.816066128s) [noise=true , address=104.36.82.44:4874 , piece_id=UCCAF4MUEIVBLMZRA2LSGWLJZSIBFMA7NY36IA7IB3KH4IBGXKAQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.088490439 (322h48m36.819758089s) [noise=true , address=104.36.82.5:4858 , piece_id=IYUCCI5NCZOTML7GFYI4LAS6NV47IC5UHCVLHFON3LJKZA2LFABA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.206801759 (322h48m36.938069408s) [upload=335638]: Next returned nil segment
Aug 22 04:14:56.206950910 (322h48m36.93821856s) [upload=335638]: Waiting for error group managing segments...
Aug 22 04:14:56.219298197 (322h48m36.950565838s) [noise=true , address=79.127.219.51:4185 , piece_id=5RHU7PFIBAY7KLYYVMNPGJBM33K5WWZ6E35Z52O3SF2XSVG3WKMQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.221650127 (322h48m36.952917776s) [noise=true , address=79.127.219.51:4200 , piece_id=SPPCLJ66SEENUH7SLHHXWI2UZHBEEY3KZIVVUAS3FBZ7CQY2G4LQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.221873898 (322h48m36.953141537s) [noise=true , address=79.127.219.48:4093 , piece_id=NZBRQBL7Z52H3JCLLLD7CFBFWGC7H7MJTW6G2CFH57J2F4XDP4SA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.222678583 (322h48m36.953946232s) [noise=true , address=77.90.31.18:4811 , piece_id=ODPH32QDN7CTPF5IDUNQ5DEBC6HASD4BAP43ZVZDBIJFJLJWXHXA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.224688627 (322h48m36.955956277s) [noise=true , address=104.36.82.6:4892 , piece_id=3WLX4OFVLCBLAE5OEI52JHUPYZNBOWMRX6LJWUYLPEKWPCFDBIBA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.226219780 (322h48m36.95748742s) [noise=true , address=77.90.31.19:4874 , piece_id=MCAFOKTALBSPDPMRSTHYZB3RGF7M5I55HOG3RUD463VCTVW7QCGQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.226285995 (322h48m36.957553645s) [noise=true , address=77.90.31.17:4775 , piece_id=2KCZ36SQFRJWMC3OBYW6674TLYLJEMDPQA7QSS4JVELCBC75BF7A, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.228103006 (322h48m36.959370626s) [noise=true , address=104.36.82.44:4874 , piece_id=UCCAF4MUEIVBLMZRA2LSGWLJZSIBFMA7NY36IA7IB3KH4IBGXKAQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.237068737 (322h48m36.968336377s) [noise=true , address=77.90.31.16:4761 , piece_id=AJWEB2GXZABAMZW7V4S3LF7FEYOI23K2ASL42NFIOFOWWQBZQQCA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.248700377 (322h48m36.979968027s) [noise=true , address=45.91.116.11:4132 , piece_id=SBIASMWS5NC2XSHDENEKASMDEKQ3ODBPE4RKIQ4EZKZG6SP67JNQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.252483180 (322h48m36.98375083s) [noise=true , address=104.36.82.5:4858 , piece_id=IYUCCI5NCZOTML7GFYI4LAS6NV47IC5UHCVLHFON3LJKZA2LFABA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.268821762 (322h48m37.000089423s) [noise=true , address=77.90.31.15:4703 , piece_id=XH433WREH7EVXIAQMLI5EDLEN5FZJHAEHCYK5NL55VA2JWAVHTIA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.273574892 (322h48m37.004842553s) [noise=true , address=77.90.31.10:4535 , piece_id=3MOUQMV5N7JI4V27RP3ZPKLF2P3ABFO4XP4TFHOPUHGVGILJYZWA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.308274656 (322h48m37.039542306s) [noise=true , address=104.36.82.60:4372 , piece_id=KUGRHZF4E4FOB4SYJF2NQ75LIF6IUXWMZ35URXHB7VDADYLZNYHQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.308311565 (322h48m37.039579215s) [seg_pos={0 0}, upload=335638]: Segment reached optimal threshold of 14 pieces.
Aug 22 04:14:56.308536709 (322h48m37.039804359s) [noise=true , address=104.36.82.23:4472 , piece_id=FCUL2C2XCQ2JKS46BDPNDSENIJBDDLL7TR7BW337GB6OR63DF4CQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF
Aug 22 04:14:56.308649492 (322h48m37.039917141s) [noise=true , address=77.90.31.11:4568 , piece_id=JC2LPEKYMWNJRQ2HMCIHDZKSICEZLK6C4ET3UIDUIRDD6MCL6ZJA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1H1L8DTKD7W7Xx1PVT7KzB9GkGBadnTEj9BHtbSgcW1S7Jj8Tw): protocol: expected piece hash; context canceled; EOF
Aug 22 04:14:56.308765871 (322h48m37.040033521s) [noise=true , address=79.127.205.235:4677 , piece_id=CB422NDFIO6VHBDC4QCP7UGLZRCGP2N3JRVZPFX4DFE5SU77RKMQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oeYzce3yvWfVUnLYKyRyPePYh4QRj86FowWm3hRZ1qHQ6TSLa): protocol: read tcp 5.161.89.252:30854->79.127.205.235:4677: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 04:14:56.308796689 (322h48m37.040064349s) [noise=true , address=79.127.201.215:4344 , piece_id=I4KQ6C7QKCUXYFYIVHMWWLI5RZC3YXUNVBQTGHAHZU7F6ELJ5GMA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: read tcp 5.161.89.252:38178->79.127.201.215:4344: use of closed network connection; context canceled
Aug 22 04:14:56.308831504 (322h48m37.040099164s) [seg_pos={0 0}, upload=335638]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 04:14:56.309045818 (322h48m37.040313488s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 04:14:56.309058031 (322h48m37.040325681s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 04:14:56.409269392 (322h48m37.140537052s) [upload=335638]: Done uploading segments...
Aug 22 04:14:56.409287577 (322h48m37.140555237s) [upload=335638]: Upload finished. err: <nil>
Duration: 1.927712754s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.........X...............................X.......X..........] duration:
158.595617ms
FAIL (2025-08-22 04:36:48 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 04:29:59.317195954 (323h3m40.048463603s) [upload=335908]: Starting upload Aug 22 04:29:59.317268290 (323h3m40.04853594s) [upload=335908]: Done starting upload Aug 22 04:29:59.317333152 (323h3m40.048600802s) [upload=335908]: Uploading segments... Aug 22 04:29:59.317373970 (323h3m40.048641619s) [upload=335908]: Got next segment. Inline: true Aug 22 04:29:59.317379219 (323h3m40.048646879s) [upload=335908]: Waiting for error group managing segments... Aug 22 04:29:59.317423863 (323h3m40.048691513s) [upload=335908]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 04:29:59.317429253 (323h3m40.048696903s) [upload=335908]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 04:29:59.317432609 (323h3m40.048700259s) [upload=335908]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 04:29:59.319941914 (323h3m40.051209544s) [upload=335908]: Done uploading segments... Aug 22 04:29:59.319955200 (323h3m40.05122283s) [upload=335908]: Upload finished. err: metaclient: Too Many Requests
Duration: 158.615264ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
461.53602ms
FAIL (2025-08-22 04:36:29 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 22 04:14:56.030180971 (322h48m36.761448621s) [upload=335638]: Starting upload
Aug 22 04:14:56.030251765 (322h48m36.761519415s) [upload=335638]: Done starting upload
Aug 22 04:14:56.030449677 (322h48m36.761717337s) [upload=335638]: Uploading segments...
Aug 22 04:14:56.030627822 (322h48m36.761895473s) [upload=335638]: Got next segment. Inline: false
Aug 22 04:14:56.030671194 (322h48m36.761938845s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 04:14:56.030679730 (322h48m36.761947381s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 04:14:56.078560813 (322h48m36.809828453s) [seg_pos={0 0}, upload=335638]: Begin upload segment...
Aug 22 04:14:56.078602301 (322h48m36.809869951s) [seg_pos={0 0}, upload=335638]: Done begin upload segment.
Aug 22 04:14:56.078638679 (322h48m36.809906329s) [noise=true , address=77.90.31.15:4703 , piece_id=XH433WREH7EVXIAQMLI5EDLEN5FZJHAEHCYK5NL55VA2JWAVHTIA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.078649209 (322h48m36.809916859s) [noise=true , address=77.90.31.17:4775 , piece_id=2KCZ36SQFRJWMC3OBYW6674TLYLJEMDPQA7QSS4JVELCBC75BF7A, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079202952 (322h48m36.810470601s) [noise=true , address=79.127.201.215:4344 , piece_id=I4KQ6C7QKCUXYFYIVHMWWLI5RZC3YXUNVBQTGHAHZU7F6ELJ5GMA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079216498 (322h48m36.810484148s) [noise=true , address=77.90.31.10:4535 , piece_id=3MOUQMV5N7JI4V27RP3ZPKLF2P3ABFO4XP4TFHOPUHGVGILJYZWA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079590982 (322h48m36.810858633s) [noise=true , address=79.127.219.51:4185 , piece_id=5RHU7PFIBAY7KLYYVMNPGJBM33K5WWZ6E35Z52O3SF2XSVG3WKMQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079604748 (322h48m36.810872388s) [noise=true , address=104.36.82.6:4892 , piece_id=3WLX4OFVLCBLAE5OEI52JHUPYZNBOWMRX6LJWUYLPEKWPCFDBIBA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080091395 (322h48m36.811359044s) [noise=true , address=79.127.219.48:4093 , piece_id=NZBRQBL7Z52H3JCLLLD7CFBFWGC7H7MJTW6G2CFH57J2F4XDP4SA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080144284 (322h48m36.811411934s) [noise=true , address=79.127.205.235:4677 , piece_id=CB422NDFIO6VHBDC4QCP7UGLZRCGP2N3JRVZPFX4DFE5SU77RKMQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080582860 (322h48m36.811850511s) [noise=true , address=77.90.31.16:4761 , piece_id=AJWEB2GXZABAMZW7V4S3LF7FEYOI23K2ASL42NFIOFOWWQBZQQCA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081056942 (322h48m36.812324582s) [noise=true , address=77.90.31.11:4568 , piece_id=JC2LPEKYMWNJRQ2HMCIHDZKSICEZLK6C4ET3UIDUIRDD6MCL6ZJA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081504335 (322h48m36.812771984s) [noise=true , address=77.90.31.18:4811 , piece_id=ODPH32QDN7CTPF5IDUNQ5DEBC6HASD4BAP43ZVZDBIJFJLJWXHXA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081853813 (322h48m36.813121463s) [noise=true , address=104.36.82.23:4472 , piece_id=FCUL2C2XCQ2JKS46BDPNDSENIJBDDLL7TR7BW337GB6OR63DF4CQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082215645 (322h48m36.813483284s) [noise=true , address=77.90.31.19:4874 , piece_id=MCAFOKTALBSPDPMRSTHYZB3RGF7M5I55HOG3RUD463VCTVW7QCGQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082563559 (322h48m36.813831199s) [noise=true , address=104.36.82.60:4372 , piece_id=KUGRHZF4E4FOB4SYJF2NQ75LIF6IUXWMZ35URXHB7VDADYLZNYHQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082885666 (322h48m36.814153317s) [noise=true , address=45.91.116.11:4132 , piece_id=SBIASMWS5NC2XSHDENEKASMDEKQ3ODBPE4RKIQ4EZKZG6SP67JNQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.083847547 (322h48m36.815115197s) [noise=true , address=79.127.219.51:4200 , piece_id=SPPCLJ66SEENUH7SLHHXWI2UZHBEEY3KZIVVUAS3FBZ7CQY2G4LQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.084798477 (322h48m36.816066128s) [noise=true , address=104.36.82.44:4874 , piece_id=UCCAF4MUEIVBLMZRA2LSGWLJZSIBFMA7NY36IA7IB3KH4IBGXKAQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.088490439 (322h48m36.819758089s) [noise=true , address=104.36.82.5:4858 , piece_id=IYUCCI5NCZOTML7GFYI4LAS6NV47IC5UHCVLHFON3LJKZA2LFABA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.206801759 (322h48m36.938069408s) [upload=335638]: Next returned nil segment
Aug 22 04:14:56.206950910 (322h48m36.93821856s) [upload=335638]: Waiting for error group managing segments...
Aug 22 04:14:56.219298197 (322h48m36.950565838s) [noise=true , address=79.127.219.51:4185 , piece_id=5RHU7PFIBAY7KLYYVMNPGJBM33K5WWZ6E35Z52O3SF2XSVG3WKMQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.221650127 (322h48m36.952917776s) [noise=true , address=79.127.219.51:4200 , piece_id=SPPCLJ66SEENUH7SLHHXWI2UZHBEEY3KZIVVUAS3FBZ7CQY2G4LQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.221873898 (322h48m36.953141537s) [noise=true , address=79.127.219.48:4093 , piece_id=NZBRQBL7Z52H3JCLLLD7CFBFWGC7H7MJTW6G2CFH57J2F4XDP4SA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.222678583 (322h48m36.953946232s) [noise=true , address=77.90.31.18:4811 , piece_id=ODPH32QDN7CTPF5IDUNQ5DEBC6HASD4BAP43ZVZDBIJFJLJWXHXA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.224688627 (322h48m36.955956277s) [noise=true , address=104.36.82.6:4892 , piece_id=3WLX4OFVLCBLAE5OEI52JHUPYZNBOWMRX6LJWUYLPEKWPCFDBIBA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.226219780 (322h48m36.95748742s) [noise=true , address=77.90.31.19:4874 , piece_id=MCAFOKTALBSPDPMRSTHYZB3RGF7M5I55HOG3RUD463VCTVW7QCGQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.226285995 (322h48m36.957553645s) [noise=true , address=77.90.31.17:4775 , piece_id=2KCZ36SQFRJWMC3OBYW6674TLYLJEMDPQA7QSS4JVELCBC75BF7A, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.228103006 (322h48m36.959370626s) [noise=true , address=104.36.82.44:4874 , piece_id=UCCAF4MUEIVBLMZRA2LSGWLJZSIBFMA7NY36IA7IB3KH4IBGXKAQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.237068737 (322h48m36.968336377s) [noise=true , address=77.90.31.16:4761 , piece_id=AJWEB2GXZABAMZW7V4S3LF7FEYOI23K2ASL42NFIOFOWWQBZQQCA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.248700377 (322h48m36.979968027s) [noise=true , address=45.91.116.11:4132 , piece_id=SBIASMWS5NC2XSHDENEKASMDEKQ3ODBPE4RKIQ4EZKZG6SP67JNQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.252483180 (322h48m36.98375083s) [noise=true , address=104.36.82.5:4858 , piece_id=IYUCCI5NCZOTML7GFYI4LAS6NV47IC5UHCVLHFON3LJKZA2LFABA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.268821762 (322h48m37.000089423s) [noise=true , address=77.90.31.15:4703 , piece_id=XH433WREH7EVXIAQMLI5EDLEN5FZJHAEHCYK5NL55VA2JWAVHTIA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.273574892 (322h48m37.004842553s) [noise=true , address=77.90.31.10:4535 , piece_id=3MOUQMV5N7JI4V27RP3ZPKLF2P3ABFO4XP4TFHOPUHGVGILJYZWA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.308274656 (322h48m37.039542306s) [noise=true , address=104.36.82.60:4372 , piece_id=KUGRHZF4E4FOB4SYJF2NQ75LIF6IUXWMZ35URXHB7VDADYLZNYHQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.308311565 (322h48m37.039579215s) [seg_pos={0 0}, upload=335638]: Segment reached optimal threshold of 14 pieces.
Aug 22 04:14:56.308536709 (322h48m37.039804359s) [noise=true , address=104.36.82.23:4472 , piece_id=FCUL2C2XCQ2JKS46BDPNDSENIJBDDLL7TR7BW337GB6OR63DF4CQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF
Aug 22 04:14:56.308649492 (322h48m37.039917141s) [noise=true , address=77.90.31.11:4568 , piece_id=JC2LPEKYMWNJRQ2HMCIHDZKSICEZLK6C4ET3UIDUIRDD6MCL6ZJA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1H1L8DTKD7W7Xx1PVT7KzB9GkGBadnTEj9BHtbSgcW1S7Jj8Tw): protocol: expected piece hash; context canceled; EOF
Aug 22 04:14:56.308765871 (322h48m37.040033521s) [noise=true , address=79.127.205.235:4677 , piece_id=CB422NDFIO6VHBDC4QCP7UGLZRCGP2N3JRVZPFX4DFE5SU77RKMQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oeYzce3yvWfVUnLYKyRyPePYh4QRj86FowWm3hRZ1qHQ6TSLa): protocol: read tcp 5.161.89.252:30854->79.127.205.235:4677: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 04:14:56.308796689 (322h48m37.040064349s) [noise=true , address=79.127.201.215:4344 , piece_id=I4KQ6C7QKCUXYFYIVHMWWLI5RZC3YXUNVBQTGHAHZU7F6ELJ5GMA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: read tcp 5.161.89.252:38178->79.127.201.215:4344: use of closed network connection; context canceled
Aug 22 04:14:56.308831504 (322h48m37.040099164s) [seg_pos={0 0}, upload=335638]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 04:14:56.309045818 (322h48m37.040313488s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 04:14:56.309058031 (322h48m37.040325681s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 04:14:56.409269392 (322h48m37.140537052s) [upload=335638]: Done uploading segments...
Aug 22 04:14:56.409287577 (322h48m37.140555237s) [upload=335638]: Upload finished. err: <nil>
Duration: 461.565676ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..........X...............................X.......X.........] duration:
187.463419ms
FAIL (2025-08-22 04:36:01 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 04:29:59.317195954 (323h3m40.048463603s) [upload=335908]: Starting upload Aug 22 04:29:59.317268290 (323h3m40.04853594s) [upload=335908]: Done starting upload Aug 22 04:29:59.317333152 (323h3m40.048600802s) [upload=335908]: Uploading segments... Aug 22 04:29:59.317373970 (323h3m40.048641619s) [upload=335908]: Got next segment. Inline: true Aug 22 04:29:59.317379219 (323h3m40.048646879s) [upload=335908]: Waiting for error group managing segments... Aug 22 04:29:59.317423863 (323h3m40.048691513s) [upload=335908]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 04:29:59.317429253 (323h3m40.048696903s) [upload=335908]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 04:29:59.317432609 (323h3m40.048700259s) [upload=335908]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 04:29:59.319941914 (323h3m40.051209544s) [upload=335908]: Done uploading segments... Aug 22 04:29:59.319955200 (323h3m40.05122283s) [upload=335908]: Upload finished. err: metaclient: Too Many Requests
Duration: 187.493565ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|