Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure

Orbiter Check History

Showing 50 of 117729 reports (Page 1508 of 2355)
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................]
duration:
6.849364189s
FAIL (2025-08-22 04:18:19 UTC)
orbiter warning: operation: sync2.Copy
uplink: encryption: context deadline exceeded
Duration: 6.84938601s core uplink ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................]
duration:
543.050003ms
FAIL (2025-08-22 04:18:12 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 22 04:02:35.778567116 (322h36m16.509834776s) [upload=335425]: Starting upload
Aug 22 04:02:35.778627910 (322h36m16.50989556s) [upload=335425]: Done starting upload
Aug 22 04:02:35.778698904 (322h36m16.509966554s) [upload=335425]: Uploading segments...
Aug 22 04:02:35.778735532 (322h36m16.510003183s) [upload=335425]: Got next segment. Inline: true
Aug 22 04:02:35.778740812 (322h36m16.510008463s) [upload=335425]: Waiting for error group managing segments...
Aug 22 04:02:35.778782822 (322h36m16.510050482s) [upload=335425]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 04:02:35.778788092 (322h36m16.510055742s) [upload=335425]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 22 04:02:35.778791679 (322h36m16.510059329s) [upload=335425]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 04:02:35.860699428 (322h36m16.591967088s) [upload=335425]: Done uploading segments...
Aug 22 04:02:35.860716189 (322h36m16.591983839s) [upload=335425]: Upload finished. err: metaclient: Too Many Requests
Duration: 543.097432ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................]
duration:
5.086922969s
FAIL (2025-08-22 04:17:54 UTC)
orbiter warning: operation: sync2.Copy
uplink: encryption: context deadline exceeded
Duration: 5.086999602s core uplink ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....]
duration:
947.900478ms
FAIL (2025-08-22 04:17:50 UTC)
orbiter warning: 
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 22 04:14:56.030180971 (322h48m36.761448621s) [upload=335638]: Starting upload
Aug 22 04:14:56.030251765 (322h48m36.761519415s) [upload=335638]: Done starting upload
Aug 22 04:14:56.030449677 (322h48m36.761717337s) [upload=335638]: Uploading segments...
Aug 22 04:14:56.030627822 (322h48m36.761895473s) [upload=335638]: Got next segment. Inline: false
Aug 22 04:14:56.030671194 (322h48m36.761938845s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 04:14:56.030679730 (322h48m36.761947381s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 04:14:56.078560813 (322h48m36.809828453s) [seg_pos={0 0}, upload=335638]: Begin upload segment...
Aug 22 04:14:56.078602301 (322h48m36.809869951s) [seg_pos={0 0}, upload=335638]: Done begin upload segment.
Aug 22 04:14:56.078638679 (322h48m36.809906329s) [noise=true , address=77.90.31.15:4703     , piece_id=XH433WREH7EVXIAQMLI5EDLEN5FZJHAEHCYK5NL55VA2JWAVHTIA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.078649209 (322h48m36.809916859s) [noise=true , address=77.90.31.17:4775     , piece_id=2KCZ36SQFRJWMC3OBYW6674TLYLJEMDPQA7QSS4JVELCBC75BF7A, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079202952 (322h48m36.810470601s) [noise=true , address=79.127.201.215:4344  , piece_id=I4KQ6C7QKCUXYFYIVHMWWLI5RZC3YXUNVBQTGHAHZU7F6ELJ5GMA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079216498 (322h48m36.810484148s) [noise=true , address=77.90.31.10:4535     , piece_id=3MOUQMV5N7JI4V27RP3ZPKLF2P3ABFO4XP4TFHOPUHGVGILJYZWA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079590982 (322h48m36.810858633s) [noise=true , address=79.127.219.51:4185   , piece_id=5RHU7PFIBAY7KLYYVMNPGJBM33K5WWZ6E35Z52O3SF2XSVG3WKMQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079604748 (322h48m36.810872388s) [noise=true , address=104.36.82.6:4892     , piece_id=3WLX4OFVLCBLAE5OEI52JHUPYZNBOWMRX6LJWUYLPEKWPCFDBIBA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080091395 (322h48m36.811359044s) [noise=true , address=79.127.219.48:4093   , piece_id=NZBRQBL7Z52H3JCLLLD7CFBFWGC7H7MJTW6G2CFH57J2F4XDP4SA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080144284 (322h48m36.811411934s) [noise=true , address=79.127.205.235:4677  , piece_id=CB422NDFIO6VHBDC4QCP7UGLZRCGP2N3JRVZPFX4DFE5SU77RKMQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080582860 (322h48m36.811850511s) [noise=true , address=77.90.31.16:4761     , piece_id=AJWEB2GXZABAMZW7V4S3LF7FEYOI23K2ASL42NFIOFOWWQBZQQCA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081056942 (322h48m36.812324582s) [noise=true , address=77.90.31.11:4568     , piece_id=JC2LPEKYMWNJRQ2HMCIHDZKSICEZLK6C4ET3UIDUIRDD6MCL6ZJA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081504335 (322h48m36.812771984s) [noise=true , address=77.90.31.18:4811     , piece_id=ODPH32QDN7CTPF5IDUNQ5DEBC6HASD4BAP43ZVZDBIJFJLJWXHXA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081853813 (322h48m36.813121463s) [noise=true , address=104.36.82.23:4472    , piece_id=FCUL2C2XCQ2JKS46BDPNDSENIJBDDLL7TR7BW337GB6OR63DF4CQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082215645 (322h48m36.813483284s) [noise=true , address=77.90.31.19:4874     , piece_id=MCAFOKTALBSPDPMRSTHYZB3RGF7M5I55HOG3RUD463VCTVW7QCGQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082563559 (322h48m36.813831199s) [noise=true , address=104.36.82.60:4372    , piece_id=KUGRHZF4E4FOB4SYJF2NQ75LIF6IUXWMZ35URXHB7VDADYLZNYHQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082885666 (322h48m36.814153317s) [noise=true , address=45.91.116.11:4132    , piece_id=SBIASMWS5NC2XSHDENEKASMDEKQ3ODBPE4RKIQ4EZKZG6SP67JNQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.083847547 (322h48m36.815115197s) [noise=true , address=79.127.219.51:4200   , piece_id=SPPCLJ66SEENUH7SLHHXWI2UZHBEEY3KZIVVUAS3FBZ7CQY2G4LQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.084798477 (322h48m36.816066128s) [noise=true , address=104.36.82.44:4874    , piece_id=UCCAF4MUEIVBLMZRA2LSGWLJZSIBFMA7NY36IA7IB3KH4IBGXKAQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.088490439 (322h48m36.819758089s) [noise=true , address=104.36.82.5:4858     , piece_id=IYUCCI5NCZOTML7GFYI4LAS6NV47IC5UHCVLHFON3LJKZA2LFABA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.206801759 (322h48m36.938069408s) [upload=335638]: Next returned nil segment
Aug 22 04:14:56.206950910 (322h48m36.93821856s) [upload=335638]: Waiting for error group managing segments...
Aug 22 04:14:56.219298197 (322h48m36.950565838s) [noise=true , address=79.127.219.51:4185   , piece_id=5RHU7PFIBAY7KLYYVMNPGJBM33K5WWZ6E35Z52O3SF2XSVG3WKMQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.221650127 (322h48m36.952917776s) [noise=true , address=79.127.219.51:4200   , piece_id=SPPCLJ66SEENUH7SLHHXWI2UZHBEEY3KZIVVUAS3FBZ7CQY2G4LQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.221873898 (322h48m36.953141537s) [noise=true , address=79.127.219.48:4093   , piece_id=NZBRQBL7Z52H3JCLLLD7CFBFWGC7H7MJTW6G2CFH57J2F4XDP4SA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.222678583 (322h48m36.953946232s) [noise=true , address=77.90.31.18:4811     , piece_id=ODPH32QDN7CTPF5IDUNQ5DEBC6HASD4BAP43ZVZDBIJFJLJWXHXA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.224688627 (322h48m36.955956277s) [noise=true , address=104.36.82.6:4892     , piece_id=3WLX4OFVLCBLAE5OEI52JHUPYZNBOWMRX6LJWUYLPEKWPCFDBIBA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.226219780 (322h48m36.95748742s) [noise=true , address=77.90.31.19:4874     , piece_id=MCAFOKTALBSPDPMRSTHYZB3RGF7M5I55HOG3RUD463VCTVW7QCGQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.226285995 (322h48m36.957553645s) [noise=true , address=77.90.31.17:4775     , piece_id=2KCZ36SQFRJWMC3OBYW6674TLYLJEMDPQA7QSS4JVELCBC75BF7A, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.228103006 (322h48m36.959370626s) [noise=true , address=104.36.82.44:4874    , piece_id=UCCAF4MUEIVBLMZRA2LSGWLJZSIBFMA7NY36IA7IB3KH4IBGXKAQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.237068737 (322h48m36.968336377s) [noise=true , address=77.90.31.16:4761     , piece_id=AJWEB2GXZABAMZW7V4S3LF7FEYOI23K2ASL42NFIOFOWWQBZQQCA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.248700377 (322h48m36.979968027s) [noise=true , address=45.91.116.11:4132    , piece_id=SBIASMWS5NC2XSHDENEKASMDEKQ3ODBPE4RKIQ4EZKZG6SP67JNQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.252483180 (322h48m36.98375083s) [noise=true , address=104.36.82.5:4858     , piece_id=IYUCCI5NCZOTML7GFYI4LAS6NV47IC5UHCVLHFON3LJKZA2LFABA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.268821762 (322h48m37.000089423s) [noise=true , address=77.90.31.15:4703     , piece_id=XH433WREH7EVXIAQMLI5EDLEN5FZJHAEHCYK5NL55VA2JWAVHTIA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.273574892 (322h48m37.004842553s) [noise=true , address=77.90.31.10:4535     , piece_id=3MOUQMV5N7JI4V27RP3ZPKLF2P3ABFO4XP4TFHOPUHGVGILJYZWA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.308274656 (322h48m37.039542306s) [noise=true , address=104.36.82.60:4372    , piece_id=KUGRHZF4E4FOB4SYJF2NQ75LIF6IUXWMZ35URXHB7VDADYLZNYHQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.308311565 (322h48m37.039579215s) [seg_pos={0 0}, upload=335638]: Segment reached optimal threshold of 14 pieces.
Aug 22 04:14:56.308536709 (322h48m37.039804359s) [noise=true , address=104.36.82.23:4472    , piece_id=FCUL2C2XCQ2JKS46BDPNDSENIJBDDLL7TR7BW337GB6OR63DF4CQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF
Aug 22 04:14:56.308649492 (322h48m37.039917141s) [noise=true , address=77.90.31.11:4568     , piece_id=JC2LPEKYMWNJRQ2HMCIHDZKSICEZLK6C4ET3UIDUIRDD6MCL6ZJA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1H1L8DTKD7W7Xx1PVT7KzB9GkGBadnTEj9BHtbSgcW1S7Jj8Tw): protocol: expected piece hash; context canceled; EOF
Aug 22 04:14:56.308765871 (322h48m37.040033521s) [noise=true , address=79.127.205.235:4677  , piece_id=CB422NDFIO6VHBDC4QCP7UGLZRCGP2N3JRVZPFX4DFE5SU77RKMQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oeYzce3yvWfVUnLYKyRyPePYh4QRj86FowWm3hRZ1qHQ6TSLa): protocol: read tcp 5.161.89.252:30854->79.127.205.235:4677: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 04:14:56.308796689 (322h48m37.040064349s) [noise=true , address=79.127.201.215:4344  , piece_id=I4KQ6C7QKCUXYFYIVHMWWLI5RZC3YXUNVBQTGHAHZU7F6ELJ5GMA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: read tcp 5.161.89.252:38178->79.127.201.215:4344: use of closed network connection; context canceled
Aug 22 04:14:56.308831504 (322h48m37.040099164s) [seg_pos={0 0}, upload=335638]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 04:14:56.309045818 (322h48m37.040313488s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 04:14:56.309058031 (322h48m37.040325681s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 04:14:56.409269392 (322h48m37.140537052s) [upload=335638]: Done uploading segments...
Aug 22 04:14:56.409287577 (322h48m37.140555237s) [upload=335638]: Upload finished. err: <nil>
Duration: 947.924544ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
2 out of 60 is failed (threshold=3) [X.......................................................X...]
duration:
1.466277745s
FAIL (2025-08-22 04:17:35 UTC)
orbiter warning: 
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 22 04:14:56.030180971 (322h48m36.761448621s) [upload=335638]: Starting upload
Aug 22 04:14:56.030251765 (322h48m36.761519415s) [upload=335638]: Done starting upload
Aug 22 04:14:56.030449677 (322h48m36.761717337s) [upload=335638]: Uploading segments...
Aug 22 04:14:56.030627822 (322h48m36.761895473s) [upload=335638]: Got next segment. Inline: false
Aug 22 04:14:56.030671194 (322h48m36.761938845s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 04:14:56.030679730 (322h48m36.761947381s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 04:14:56.078560813 (322h48m36.809828453s) [seg_pos={0 0}, upload=335638]: Begin upload segment...
Aug 22 04:14:56.078602301 (322h48m36.809869951s) [seg_pos={0 0}, upload=335638]: Done begin upload segment.
Aug 22 04:14:56.078638679 (322h48m36.809906329s) [noise=true , address=77.90.31.15:4703     , piece_id=XH433WREH7EVXIAQMLI5EDLEN5FZJHAEHCYK5NL55VA2JWAVHTIA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.078649209 (322h48m36.809916859s) [noise=true , address=77.90.31.17:4775     , piece_id=2KCZ36SQFRJWMC3OBYW6674TLYLJEMDPQA7QSS4JVELCBC75BF7A, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079202952 (322h48m36.810470601s) [noise=true , address=79.127.201.215:4344  , piece_id=I4KQ6C7QKCUXYFYIVHMWWLI5RZC3YXUNVBQTGHAHZU7F6ELJ5GMA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079216498 (322h48m36.810484148s) [noise=true , address=77.90.31.10:4535     , piece_id=3MOUQMV5N7JI4V27RP3ZPKLF2P3ABFO4XP4TFHOPUHGVGILJYZWA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079590982 (322h48m36.810858633s) [noise=true , address=79.127.219.51:4185   , piece_id=5RHU7PFIBAY7KLYYVMNPGJBM33K5WWZ6E35Z52O3SF2XSVG3WKMQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079604748 (322h48m36.810872388s) [noise=true , address=104.36.82.6:4892     , piece_id=3WLX4OFVLCBLAE5OEI52JHUPYZNBOWMRX6LJWUYLPEKWPCFDBIBA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080091395 (322h48m36.811359044s) [noise=true , address=79.127.219.48:4093   , piece_id=NZBRQBL7Z52H3JCLLLD7CFBFWGC7H7MJTW6G2CFH57J2F4XDP4SA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080144284 (322h48m36.811411934s) [noise=true , address=79.127.205.235:4677  , piece_id=CB422NDFIO6VHBDC4QCP7UGLZRCGP2N3JRVZPFX4DFE5SU77RKMQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080582860 (322h48m36.811850511s) [noise=true , address=77.90.31.16:4761     , piece_id=AJWEB2GXZABAMZW7V4S3LF7FEYOI23K2ASL42NFIOFOWWQBZQQCA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081056942 (322h48m36.812324582s) [noise=true , address=77.90.31.11:4568     , piece_id=JC2LPEKYMWNJRQ2HMCIHDZKSICEZLK6C4ET3UIDUIRDD6MCL6ZJA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081504335 (322h48m36.812771984s) [noise=true , address=77.90.31.18:4811     , piece_id=ODPH32QDN7CTPF5IDUNQ5DEBC6HASD4BAP43ZVZDBIJFJLJWXHXA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081853813 (322h48m36.813121463s) [noise=true , address=104.36.82.23:4472    , piece_id=FCUL2C2XCQ2JKS46BDPNDSENIJBDDLL7TR7BW337GB6OR63DF4CQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082215645 (322h48m36.813483284s) [noise=true , address=77.90.31.19:4874     , piece_id=MCAFOKTALBSPDPMRSTHYZB3RGF7M5I55HOG3RUD463VCTVW7QCGQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082563559 (322h48m36.813831199s) [noise=true , address=104.36.82.60:4372    , piece_id=KUGRHZF4E4FOB4SYJF2NQ75LIF6IUXWMZ35URXHB7VDADYLZNYHQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082885666 (322h48m36.814153317s) [noise=true , address=45.91.116.11:4132    , piece_id=SBIASMWS5NC2XSHDENEKASMDEKQ3ODBPE4RKIQ4EZKZG6SP67JNQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.083847547 (322h48m36.815115197s) [noise=true , address=79.127.219.51:4200   , piece_id=SPPCLJ66SEENUH7SLHHXWI2UZHBEEY3KZIVVUAS3FBZ7CQY2G4LQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.084798477 (322h48m36.816066128s) [noise=true , address=104.36.82.44:4874    , piece_id=UCCAF4MUEIVBLMZRA2LSGWLJZSIBFMA7NY36IA7IB3KH4IBGXKAQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.088490439 (322h48m36.819758089s) [noise=true , address=104.36.82.5:4858     , piece_id=IYUCCI5NCZOTML7GFYI4LAS6NV47IC5UHCVLHFON3LJKZA2LFABA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.206801759 (322h48m36.938069408s) [upload=335638]: Next returned nil segment
Aug 22 04:14:56.206950910 (322h48m36.93821856s) [upload=335638]: Waiting for error group managing segments...
Aug 22 04:14:56.219298197 (322h48m36.950565838s) [noise=true , address=79.127.219.51:4185   , piece_id=5RHU7PFIBAY7KLYYVMNPGJBM33K5WWZ6E35Z52O3SF2XSVG3WKMQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.221650127 (322h48m36.952917776s) [noise=true , address=79.127.219.51:4200   , piece_id=SPPCLJ66SEENUH7SLHHXWI2UZHBEEY3KZIVVUAS3FBZ7CQY2G4LQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.221873898 (322h48m36.953141537s) [noise=true , address=79.127.219.48:4093   , piece_id=NZBRQBL7Z52H3JCLLLD7CFBFWGC7H7MJTW6G2CFH57J2F4XDP4SA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.222678583 (322h48m36.953946232s) [noise=true , address=77.90.31.18:4811     , piece_id=ODPH32QDN7CTPF5IDUNQ5DEBC6HASD4BAP43ZVZDBIJFJLJWXHXA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.224688627 (322h48m36.955956277s) [noise=true , address=104.36.82.6:4892     , piece_id=3WLX4OFVLCBLAE5OEI52JHUPYZNBOWMRX6LJWUYLPEKWPCFDBIBA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.226219780 (322h48m36.95748742s) [noise=true , address=77.90.31.19:4874     , piece_id=MCAFOKTALBSPDPMRSTHYZB3RGF7M5I55HOG3RUD463VCTVW7QCGQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.226285995 (322h48m36.957553645s) [noise=true , address=77.90.31.17:4775     , piece_id=2KCZ36SQFRJWMC3OBYW6674TLYLJEMDPQA7QSS4JVELCBC75BF7A, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.228103006 (322h48m36.959370626s) [noise=true , address=104.36.82.44:4874    , piece_id=UCCAF4MUEIVBLMZRA2LSGWLJZSIBFMA7NY36IA7IB3KH4IBGXKAQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.237068737 (322h48m36.968336377s) [noise=true , address=77.90.31.16:4761     , piece_id=AJWEB2GXZABAMZW7V4S3LF7FEYOI23K2ASL42NFIOFOWWQBZQQCA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.248700377 (322h48m36.979968027s) [noise=true , address=45.91.116.11:4132    , piece_id=SBIASMWS5NC2XSHDENEKASMDEKQ3ODBPE4RKIQ4EZKZG6SP67JNQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.252483180 (322h48m36.98375083s) [noise=true , address=104.36.82.5:4858     , piece_id=IYUCCI5NCZOTML7GFYI4LAS6NV47IC5UHCVLHFON3LJKZA2LFABA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.268821762 (322h48m37.000089423s) [noise=true , address=77.90.31.15:4703     , piece_id=XH433WREH7EVXIAQMLI5EDLEN5FZJHAEHCYK5NL55VA2JWAVHTIA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.273574892 (322h48m37.004842553s) [noise=true , address=77.90.31.10:4535     , piece_id=3MOUQMV5N7JI4V27RP3ZPKLF2P3ABFO4XP4TFHOPUHGVGILJYZWA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.308274656 (322h48m37.039542306s) [noise=true , address=104.36.82.60:4372    , piece_id=KUGRHZF4E4FOB4SYJF2NQ75LIF6IUXWMZ35URXHB7VDADYLZNYHQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.308311565 (322h48m37.039579215s) [seg_pos={0 0}, upload=335638]: Segment reached optimal threshold of 14 pieces.
Aug 22 04:14:56.308536709 (322h48m37.039804359s) [noise=true , address=104.36.82.23:4472    , piece_id=FCUL2C2XCQ2JKS46BDPNDSENIJBDDLL7TR7BW337GB6OR63DF4CQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF
Aug 22 04:14:56.308649492 (322h48m37.039917141s) [noise=true , address=77.90.31.11:4568     , piece_id=JC2LPEKYMWNJRQ2HMCIHDZKSICEZLK6C4ET3UIDUIRDD6MCL6ZJA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1H1L8DTKD7W7Xx1PVT7KzB9GkGBadnTEj9BHtbSgcW1S7Jj8Tw): protocol: expected piece hash; context canceled; EOF
Aug 22 04:14:56.308765871 (322h48m37.040033521s) [noise=true , address=79.127.205.235:4677  , piece_id=CB422NDFIO6VHBDC4QCP7UGLZRCGP2N3JRVZPFX4DFE5SU77RKMQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oeYzce3yvWfVUnLYKyRyPePYh4QRj86FowWm3hRZ1qHQ6TSLa): protocol: read tcp 5.161.89.252:30854->79.127.205.235:4677: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 04:14:56.308796689 (322h48m37.040064349s) [noise=true , address=79.127.201.215:4344  , piece_id=I4KQ6C7QKCUXYFYIVHMWWLI5RZC3YXUNVBQTGHAHZU7F6ELJ5GMA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: read tcp 5.161.89.252:38178->79.127.201.215:4344: use of closed network connection; context canceled
Aug 22 04:14:56.308831504 (322h48m37.040099164s) [seg_pos={0 0}, upload=335638]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 04:14:56.309045818 (322h48m37.040313488s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 04:14:56.309058031 (322h48m37.040325681s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 04:14:56.409269392 (322h48m37.140537052s) [upload=335638]: Done uploading segments...
Aug 22 04:14:56.409287577 (322h48m37.140555237s) [upload=335638]: Upload finished. err: <nil>
Duration: 1.466304846s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................]
duration:
5.283351347s
FAIL (2025-08-22 04:17:03 UTC)
orbiter warning: operation: sync2.Copy
uplink: encryption: context deadline exceeded
Duration: 5.28337898s core uplink ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................]
duration:
162.180128ms
FAIL (2025-08-22 04:17:01 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 22 04:02:35.778567116 (322h36m16.509834776s) [upload=335425]: Starting upload
Aug 22 04:02:35.778627910 (322h36m16.50989556s) [upload=335425]: Done starting upload
Aug 22 04:02:35.778698904 (322h36m16.509966554s) [upload=335425]: Uploading segments...
Aug 22 04:02:35.778735532 (322h36m16.510003183s) [upload=335425]: Got next segment. Inline: true
Aug 22 04:02:35.778740812 (322h36m16.510008463s) [upload=335425]: Waiting for error group managing segments...
Aug 22 04:02:35.778782822 (322h36m16.510050482s) [upload=335425]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 04:02:35.778788092 (322h36m16.510055742s) [upload=335425]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 22 04:02:35.778791679 (322h36m16.510059329s) [upload=335425]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 04:02:35.860699428 (322h36m16.591967088s) [upload=335425]: Done uploading segments...
Aug 22 04:02:35.860716189 (322h36m16.591983839s) [upload=335425]: Upload finished. err: metaclient: Too Many Requests
Duration: 162.200837ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................]
duration:
6.561253357s
FAIL (2025-08-22 04:16:33 UTC)
orbiter warning: operation: sync2.Copy
uplink: encryption: context deadline exceeded
Duration: 6.561275238s core uplink ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
2 out of 60 is failed (threshold=3) [.X.......................................................X..]
duration:
2.18779931s
FAIL (2025-08-22 04:16:22 UTC)
orbiter warning: 
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 22 04:14:56.030180971 (322h48m36.761448621s) [upload=335638]: Starting upload
Aug 22 04:14:56.030251765 (322h48m36.761519415s) [upload=335638]: Done starting upload
Aug 22 04:14:56.030449677 (322h48m36.761717337s) [upload=335638]: Uploading segments...
Aug 22 04:14:56.030627822 (322h48m36.761895473s) [upload=335638]: Got next segment. Inline: false
Aug 22 04:14:56.030671194 (322h48m36.761938845s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 04:14:56.030679730 (322h48m36.761947381s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 04:14:56.078560813 (322h48m36.809828453s) [seg_pos={0 0}, upload=335638]: Begin upload segment...
Aug 22 04:14:56.078602301 (322h48m36.809869951s) [seg_pos={0 0}, upload=335638]: Done begin upload segment.
Aug 22 04:14:56.078638679 (322h48m36.809906329s) [noise=true , address=77.90.31.15:4703     , piece_id=XH433WREH7EVXIAQMLI5EDLEN5FZJHAEHCYK5NL55VA2JWAVHTIA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.078649209 (322h48m36.809916859s) [noise=true , address=77.90.31.17:4775     , piece_id=2KCZ36SQFRJWMC3OBYW6674TLYLJEMDPQA7QSS4JVELCBC75BF7A, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079202952 (322h48m36.810470601s) [noise=true , address=79.127.201.215:4344  , piece_id=I4KQ6C7QKCUXYFYIVHMWWLI5RZC3YXUNVBQTGHAHZU7F6ELJ5GMA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079216498 (322h48m36.810484148s) [noise=true , address=77.90.31.10:4535     , piece_id=3MOUQMV5N7JI4V27RP3ZPKLF2P3ABFO4XP4TFHOPUHGVGILJYZWA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079590982 (322h48m36.810858633s) [noise=true , address=79.127.219.51:4185   , piece_id=5RHU7PFIBAY7KLYYVMNPGJBM33K5WWZ6E35Z52O3SF2XSVG3WKMQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079604748 (322h48m36.810872388s) [noise=true , address=104.36.82.6:4892     , piece_id=3WLX4OFVLCBLAE5OEI52JHUPYZNBOWMRX6LJWUYLPEKWPCFDBIBA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080091395 (322h48m36.811359044s) [noise=true , address=79.127.219.48:4093   , piece_id=NZBRQBL7Z52H3JCLLLD7CFBFWGC7H7MJTW6G2CFH57J2F4XDP4SA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080144284 (322h48m36.811411934s) [noise=true , address=79.127.205.235:4677  , piece_id=CB422NDFIO6VHBDC4QCP7UGLZRCGP2N3JRVZPFX4DFE5SU77RKMQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080582860 (322h48m36.811850511s) [noise=true , address=77.90.31.16:4761     , piece_id=AJWEB2GXZABAMZW7V4S3LF7FEYOI23K2ASL42NFIOFOWWQBZQQCA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081056942 (322h48m36.812324582s) [noise=true , address=77.90.31.11:4568     , piece_id=JC2LPEKYMWNJRQ2HMCIHDZKSICEZLK6C4ET3UIDUIRDD6MCL6ZJA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081504335 (322h48m36.812771984s) [noise=true , address=77.90.31.18:4811     , piece_id=ODPH32QDN7CTPF5IDUNQ5DEBC6HASD4BAP43ZVZDBIJFJLJWXHXA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081853813 (322h48m36.813121463s) [noise=true , address=104.36.82.23:4472    , piece_id=FCUL2C2XCQ2JKS46BDPNDSENIJBDDLL7TR7BW337GB6OR63DF4CQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082215645 (322h48m36.813483284s) [noise=true , address=77.90.31.19:4874     , piece_id=MCAFOKTALBSPDPMRSTHYZB3RGF7M5I55HOG3RUD463VCTVW7QCGQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082563559 (322h48m36.813831199s) [noise=true , address=104.36.82.60:4372    , piece_id=KUGRHZF4E4FOB4SYJF2NQ75LIF6IUXWMZ35URXHB7VDADYLZNYHQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082885666 (322h48m36.814153317s) [noise=true , address=45.91.116.11:4132    , piece_id=SBIASMWS5NC2XSHDENEKASMDEKQ3ODBPE4RKIQ4EZKZG6SP67JNQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.083847547 (322h48m36.815115197s) [noise=true , address=79.127.219.51:4200   , piece_id=SPPCLJ66SEENUH7SLHHXWI2UZHBEEY3KZIVVUAS3FBZ7CQY2G4LQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.084798477 (322h48m36.816066128s) [noise=true , address=104.36.82.44:4874    , piece_id=UCCAF4MUEIVBLMZRA2LSGWLJZSIBFMA7NY36IA7IB3KH4IBGXKAQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.088490439 (322h48m36.819758089s) [noise=true , address=104.36.82.5:4858     , piece_id=IYUCCI5NCZOTML7GFYI4LAS6NV47IC5UHCVLHFON3LJKZA2LFABA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.206801759 (322h48m36.938069408s) [upload=335638]: Next returned nil segment
Aug 22 04:14:56.206950910 (322h48m36.93821856s) [upload=335638]: Waiting for error group managing segments...
Aug 22 04:14:56.219298197 (322h48m36.950565838s) [noise=true , address=79.127.219.51:4185   , piece_id=5RHU7PFIBAY7KLYYVMNPGJBM33K5WWZ6E35Z52O3SF2XSVG3WKMQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.221650127 (322h48m36.952917776s) [noise=true , address=79.127.219.51:4200   , piece_id=SPPCLJ66SEENUH7SLHHXWI2UZHBEEY3KZIVVUAS3FBZ7CQY2G4LQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.221873898 (322h48m36.953141537s) [noise=true , address=79.127.219.48:4093   , piece_id=NZBRQBL7Z52H3JCLLLD7CFBFWGC7H7MJTW6G2CFH57J2F4XDP4SA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.222678583 (322h48m36.953946232s) [noise=true , address=77.90.31.18:4811     , piece_id=ODPH32QDN7CTPF5IDUNQ5DEBC6HASD4BAP43ZVZDBIJFJLJWXHXA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.224688627 (322h48m36.955956277s) [noise=true , address=104.36.82.6:4892     , piece_id=3WLX4OFVLCBLAE5OEI52JHUPYZNBOWMRX6LJWUYLPEKWPCFDBIBA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.226219780 (322h48m36.95748742s) [noise=true , address=77.90.31.19:4874     , piece_id=MCAFOKTALBSPDPMRSTHYZB3RGF7M5I55HOG3RUD463VCTVW7QCGQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.226285995 (322h48m36.957553645s) [noise=true , address=77.90.31.17:4775     , piece_id=2KCZ36SQFRJWMC3OBYW6674TLYLJEMDPQA7QSS4JVELCBC75BF7A, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.228103006 (322h48m36.959370626s) [noise=true , address=104.36.82.44:4874    , piece_id=UCCAF4MUEIVBLMZRA2LSGWLJZSIBFMA7NY36IA7IB3KH4IBGXKAQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.237068737 (322h48m36.968336377s) [noise=true , address=77.90.31.16:4761     , piece_id=AJWEB2GXZABAMZW7V4S3LF7FEYOI23K2ASL42NFIOFOWWQBZQQCA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.248700377 (322h48m36.979968027s) [noise=true , address=45.91.116.11:4132    , piece_id=SBIASMWS5NC2XSHDENEKASMDEKQ3ODBPE4RKIQ4EZKZG6SP67JNQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.252483180 (322h48m36.98375083s) [noise=true , address=104.36.82.5:4858     , piece_id=IYUCCI5NCZOTML7GFYI4LAS6NV47IC5UHCVLHFON3LJKZA2LFABA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.268821762 (322h48m37.000089423s) [noise=true , address=77.90.31.15:4703     , piece_id=XH433WREH7EVXIAQMLI5EDLEN5FZJHAEHCYK5NL55VA2JWAVHTIA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.273574892 (322h48m37.004842553s) [noise=true , address=77.90.31.10:4535     , piece_id=3MOUQMV5N7JI4V27RP3ZPKLF2P3ABFO4XP4TFHOPUHGVGILJYZWA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.308274656 (322h48m37.039542306s) [noise=true , address=104.36.82.60:4372    , piece_id=KUGRHZF4E4FOB4SYJF2NQ75LIF6IUXWMZ35URXHB7VDADYLZNYHQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.308311565 (322h48m37.039579215s) [seg_pos={0 0}, upload=335638]: Segment reached optimal threshold of 14 pieces.
Aug 22 04:14:56.308536709 (322h48m37.039804359s) [noise=true , address=104.36.82.23:4472    , piece_id=FCUL2C2XCQ2JKS46BDPNDSENIJBDDLL7TR7BW337GB6OR63DF4CQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF
Aug 22 04:14:56.308649492 (322h48m37.039917141s) [noise=true , address=77.90.31.11:4568     , piece_id=JC2LPEKYMWNJRQ2HMCIHDZKSICEZLK6C4ET3UIDUIRDD6MCL6ZJA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1H1L8DTKD7W7Xx1PVT7KzB9GkGBadnTEj9BHtbSgcW1S7Jj8Tw): protocol: expected piece hash; context canceled; EOF
Aug 22 04:14:56.308765871 (322h48m37.040033521s) [noise=true , address=79.127.205.235:4677  , piece_id=CB422NDFIO6VHBDC4QCP7UGLZRCGP2N3JRVZPFX4DFE5SU77RKMQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oeYzce3yvWfVUnLYKyRyPePYh4QRj86FowWm3hRZ1qHQ6TSLa): protocol: read tcp 5.161.89.252:30854->79.127.205.235:4677: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 04:14:56.308796689 (322h48m37.040064349s) [noise=true , address=79.127.201.215:4344  , piece_id=I4KQ6C7QKCUXYFYIVHMWWLI5RZC3YXUNVBQTGHAHZU7F6ELJ5GMA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: read tcp 5.161.89.252:38178->79.127.201.215:4344: use of closed network connection; context canceled
Aug 22 04:14:56.308831504 (322h48m37.040099164s) [seg_pos={0 0}, upload=335638]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 04:14:56.309045818 (322h48m37.040313488s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 04:14:56.309058031 (322h48m37.040325681s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 04:14:56.409269392 (322h48m37.140537052s) [upload=335638]: Done uploading segments...
Aug 22 04:14:56.409287577 (322h48m37.140555237s) [upload=335638]: Upload finished. err: <nil>
Duration: 2.187824447s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................]
duration:
148.490171ms
FAIL (2025-08-22 04:15:51 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 22 04:02:35.778567116 (322h36m16.509834776s) [upload=335425]: Starting upload
Aug 22 04:02:35.778627910 (322h36m16.50989556s) [upload=335425]: Done starting upload
Aug 22 04:02:35.778698904 (322h36m16.509966554s) [upload=335425]: Uploading segments...
Aug 22 04:02:35.778735532 (322h36m16.510003183s) [upload=335425]: Got next segment. Inline: true
Aug 22 04:02:35.778740812 (322h36m16.510008463s) [upload=335425]: Waiting for error group managing segments...
Aug 22 04:02:35.778782822 (322h36m16.510050482s) [upload=335425]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 04:02:35.778788092 (322h36m16.510055742s) [upload=335425]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 22 04:02:35.778791679 (322h36m16.510059329s) [upload=335425]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 04:02:35.860699428 (322h36m16.591967088s) [upload=335425]: Done uploading segments...
Aug 22 04:02:35.860716189 (322h36m16.591983839s) [upload=335425]: Upload finished. err: metaclient: Too Many Requests
Duration: 148.513686ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................]
duration:
6.050625069s
FAIL (2025-08-22 04:15:33 UTC)
orbiter warning: operation: sync2.Copy
uplink: encryption: context deadline exceeded
Duration: 6.050649364s core uplink ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................]
duration:
304.872756ms
FAIL (2025-08-22 04:15:22 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 22 04:02:35.778567116 (322h36m16.509834776s) [upload=335425]: Starting upload
Aug 22 04:02:35.778627910 (322h36m16.50989556s) [upload=335425]: Done starting upload
Aug 22 04:02:35.778698904 (322h36m16.509966554s) [upload=335425]: Uploading segments...
Aug 22 04:02:35.778735532 (322h36m16.510003183s) [upload=335425]: Got next segment. Inline: true
Aug 22 04:02:35.778740812 (322h36m16.510008463s) [upload=335425]: Waiting for error group managing segments...
Aug 22 04:02:35.778782822 (322h36m16.510050482s) [upload=335425]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 04:02:35.778788092 (322h36m16.510055742s) [upload=335425]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 22 04:02:35.778791679 (322h36m16.510059329s) [upload=335425]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 04:02:35.860699428 (322h36m16.591967088s) [upload=335425]: Done uploading segments...
Aug 22 04:02:35.860716189 (322h36m16.591983839s) [upload=335425]: Upload finished. err: metaclient: Too Many Requests
Duration: 304.896109ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
2 out of 60 is failed (threshold=3) [..X.......................................................X.]
duration:
1.191258191s
FAIL (2025-08-22 04:15:17 UTC)
orbiter warning: 
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 22 04:14:56.030180971 (322h48m36.761448621s) [upload=335638]: Starting upload
Aug 22 04:14:56.030251765 (322h48m36.761519415s) [upload=335638]: Done starting upload
Aug 22 04:14:56.030449677 (322h48m36.761717337s) [upload=335638]: Uploading segments...
Aug 22 04:14:56.030627822 (322h48m36.761895473s) [upload=335638]: Got next segment. Inline: false
Aug 22 04:14:56.030671194 (322h48m36.761938845s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 04:14:56.030679730 (322h48m36.761947381s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 04:14:56.078560813 (322h48m36.809828453s) [seg_pos={0 0}, upload=335638]: Begin upload segment...
Aug 22 04:14:56.078602301 (322h48m36.809869951s) [seg_pos={0 0}, upload=335638]: Done begin upload segment.
Aug 22 04:14:56.078638679 (322h48m36.809906329s) [noise=true , address=77.90.31.15:4703     , piece_id=XH433WREH7EVXIAQMLI5EDLEN5FZJHAEHCYK5NL55VA2JWAVHTIA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.078649209 (322h48m36.809916859s) [noise=true , address=77.90.31.17:4775     , piece_id=2KCZ36SQFRJWMC3OBYW6674TLYLJEMDPQA7QSS4JVELCBC75BF7A, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079202952 (322h48m36.810470601s) [noise=true , address=79.127.201.215:4344  , piece_id=I4KQ6C7QKCUXYFYIVHMWWLI5RZC3YXUNVBQTGHAHZU7F6ELJ5GMA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079216498 (322h48m36.810484148s) [noise=true , address=77.90.31.10:4535     , piece_id=3MOUQMV5N7JI4V27RP3ZPKLF2P3ABFO4XP4TFHOPUHGVGILJYZWA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079590982 (322h48m36.810858633s) [noise=true , address=79.127.219.51:4185   , piece_id=5RHU7PFIBAY7KLYYVMNPGJBM33K5WWZ6E35Z52O3SF2XSVG3WKMQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079604748 (322h48m36.810872388s) [noise=true , address=104.36.82.6:4892     , piece_id=3WLX4OFVLCBLAE5OEI52JHUPYZNBOWMRX6LJWUYLPEKWPCFDBIBA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080091395 (322h48m36.811359044s) [noise=true , address=79.127.219.48:4093   , piece_id=NZBRQBL7Z52H3JCLLLD7CFBFWGC7H7MJTW6G2CFH57J2F4XDP4SA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080144284 (322h48m36.811411934s) [noise=true , address=79.127.205.235:4677  , piece_id=CB422NDFIO6VHBDC4QCP7UGLZRCGP2N3JRVZPFX4DFE5SU77RKMQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080582860 (322h48m36.811850511s) [noise=true , address=77.90.31.16:4761     , piece_id=AJWEB2GXZABAMZW7V4S3LF7FEYOI23K2ASL42NFIOFOWWQBZQQCA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081056942 (322h48m36.812324582s) [noise=true , address=77.90.31.11:4568     , piece_id=JC2LPEKYMWNJRQ2HMCIHDZKSICEZLK6C4ET3UIDUIRDD6MCL6ZJA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081504335 (322h48m36.812771984s) [noise=true , address=77.90.31.18:4811     , piece_id=ODPH32QDN7CTPF5IDUNQ5DEBC6HASD4BAP43ZVZDBIJFJLJWXHXA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081853813 (322h48m36.813121463s) [noise=true , address=104.36.82.23:4472    , piece_id=FCUL2C2XCQ2JKS46BDPNDSENIJBDDLL7TR7BW337GB6OR63DF4CQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082215645 (322h48m36.813483284s) [noise=true , address=77.90.31.19:4874     , piece_id=MCAFOKTALBSPDPMRSTHYZB3RGF7M5I55HOG3RUD463VCTVW7QCGQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082563559 (322h48m36.813831199s) [noise=true , address=104.36.82.60:4372    , piece_id=KUGRHZF4E4FOB4SYJF2NQ75LIF6IUXWMZ35URXHB7VDADYLZNYHQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082885666 (322h48m36.814153317s) [noise=true , address=45.91.116.11:4132    , piece_id=SBIASMWS5NC2XSHDENEKASMDEKQ3ODBPE4RKIQ4EZKZG6SP67JNQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.083847547 (322h48m36.815115197s) [noise=true , address=79.127.219.51:4200   , piece_id=SPPCLJ66SEENUH7SLHHXWI2UZHBEEY3KZIVVUAS3FBZ7CQY2G4LQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.084798477 (322h48m36.816066128s) [noise=true , address=104.36.82.44:4874    , piece_id=UCCAF4MUEIVBLMZRA2LSGWLJZSIBFMA7NY36IA7IB3KH4IBGXKAQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.088490439 (322h48m36.819758089s) [noise=true , address=104.36.82.5:4858     , piece_id=IYUCCI5NCZOTML7GFYI4LAS6NV47IC5UHCVLHFON3LJKZA2LFABA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.206801759 (322h48m36.938069408s) [upload=335638]: Next returned nil segment
Aug 22 04:14:56.206950910 (322h48m36.93821856s) [upload=335638]: Waiting for error group managing segments...
Aug 22 04:14:56.219298197 (322h48m36.950565838s) [noise=true , address=79.127.219.51:4185   , piece_id=5RHU7PFIBAY7KLYYVMNPGJBM33K5WWZ6E35Z52O3SF2XSVG3WKMQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.221650127 (322h48m36.952917776s) [noise=true , address=79.127.219.51:4200   , piece_id=SPPCLJ66SEENUH7SLHHXWI2UZHBEEY3KZIVVUAS3FBZ7CQY2G4LQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.221873898 (322h48m36.953141537s) [noise=true , address=79.127.219.48:4093   , piece_id=NZBRQBL7Z52H3JCLLLD7CFBFWGC7H7MJTW6G2CFH57J2F4XDP4SA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.222678583 (322h48m36.953946232s) [noise=true , address=77.90.31.18:4811     , piece_id=ODPH32QDN7CTPF5IDUNQ5DEBC6HASD4BAP43ZVZDBIJFJLJWXHXA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.224688627 (322h48m36.955956277s) [noise=true , address=104.36.82.6:4892     , piece_id=3WLX4OFVLCBLAE5OEI52JHUPYZNBOWMRX6LJWUYLPEKWPCFDBIBA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.226219780 (322h48m36.95748742s) [noise=true , address=77.90.31.19:4874     , piece_id=MCAFOKTALBSPDPMRSTHYZB3RGF7M5I55HOG3RUD463VCTVW7QCGQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.226285995 (322h48m36.957553645s) [noise=true , address=77.90.31.17:4775     , piece_id=2KCZ36SQFRJWMC3OBYW6674TLYLJEMDPQA7QSS4JVELCBC75BF7A, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.228103006 (322h48m36.959370626s) [noise=true , address=104.36.82.44:4874    , piece_id=UCCAF4MUEIVBLMZRA2LSGWLJZSIBFMA7NY36IA7IB3KH4IBGXKAQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.237068737 (322h48m36.968336377s) [noise=true , address=77.90.31.16:4761     , piece_id=AJWEB2GXZABAMZW7V4S3LF7FEYOI23K2ASL42NFIOFOWWQBZQQCA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.248700377 (322h48m36.979968027s) [noise=true , address=45.91.116.11:4132    , piece_id=SBIASMWS5NC2XSHDENEKASMDEKQ3ODBPE4RKIQ4EZKZG6SP67JNQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.252483180 (322h48m36.98375083s) [noise=true , address=104.36.82.5:4858     , piece_id=IYUCCI5NCZOTML7GFYI4LAS6NV47IC5UHCVLHFON3LJKZA2LFABA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.268821762 (322h48m37.000089423s) [noise=true , address=77.90.31.15:4703     , piece_id=XH433WREH7EVXIAQMLI5EDLEN5FZJHAEHCYK5NL55VA2JWAVHTIA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.273574892 (322h48m37.004842553s) [noise=true , address=77.90.31.10:4535     , piece_id=3MOUQMV5N7JI4V27RP3ZPKLF2P3ABFO4XP4TFHOPUHGVGILJYZWA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.308274656 (322h48m37.039542306s) [noise=true , address=104.36.82.60:4372    , piece_id=KUGRHZF4E4FOB4SYJF2NQ75LIF6IUXWMZ35URXHB7VDADYLZNYHQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.308311565 (322h48m37.039579215s) [seg_pos={0 0}, upload=335638]: Segment reached optimal threshold of 14 pieces.
Aug 22 04:14:56.308536709 (322h48m37.039804359s) [noise=true , address=104.36.82.23:4472    , piece_id=FCUL2C2XCQ2JKS46BDPNDSENIJBDDLL7TR7BW337GB6OR63DF4CQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF
Aug 22 04:14:56.308649492 (322h48m37.039917141s) [noise=true , address=77.90.31.11:4568     , piece_id=JC2LPEKYMWNJRQ2HMCIHDZKSICEZLK6C4ET3UIDUIRDD6MCL6ZJA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1H1L8DTKD7W7Xx1PVT7KzB9GkGBadnTEj9BHtbSgcW1S7Jj8Tw): protocol: expected piece hash; context canceled; EOF
Aug 22 04:14:56.308765871 (322h48m37.040033521s) [noise=true , address=79.127.205.235:4677  , piece_id=CB422NDFIO6VHBDC4QCP7UGLZRCGP2N3JRVZPFX4DFE5SU77RKMQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oeYzce3yvWfVUnLYKyRyPePYh4QRj86FowWm3hRZ1qHQ6TSLa): protocol: read tcp 5.161.89.252:30854->79.127.205.235:4677: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 04:14:56.308796689 (322h48m37.040064349s) [noise=true , address=79.127.201.215:4344  , piece_id=I4KQ6C7QKCUXYFYIVHMWWLI5RZC3YXUNVBQTGHAHZU7F6ELJ5GMA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: read tcp 5.161.89.252:38178->79.127.201.215:4344: use of closed network connection; context canceled
Aug 22 04:14:56.308831504 (322h48m37.040099164s) [seg_pos={0 0}, upload=335638]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 04:14:56.309045818 (322h48m37.040313488s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 04:14:56.309058031 (322h48m37.040325681s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 04:14:56.409269392 (322h48m37.140537052s) [upload=335638]: Done uploading segments...
Aug 22 04:14:56.409287577 (322h48m37.140555237s) [upload=335638]: Upload finished. err: <nil>
Duration: 1.191281685s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
2 out of 60 is failed (threshold=3) [...X.......................................................X]
duration:
479.689717ms
FAIL (2025-08-22 04:14:56 UTC)
orbiter warning: 
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 22 04:14:56.030180971 (322h48m36.761448621s) [upload=335638]: Starting upload
Aug 22 04:14:56.030251765 (322h48m36.761519415s) [upload=335638]: Done starting upload
Aug 22 04:14:56.030449677 (322h48m36.761717337s) [upload=335638]: Uploading segments...
Aug 22 04:14:56.030627822 (322h48m36.761895473s) [upload=335638]: Got next segment. Inline: false
Aug 22 04:14:56.030671194 (322h48m36.761938845s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 04:14:56.030679730 (322h48m36.761947381s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 04:14:56.078560813 (322h48m36.809828453s) [seg_pos={0 0}, upload=335638]: Begin upload segment...
Aug 22 04:14:56.078602301 (322h48m36.809869951s) [seg_pos={0 0}, upload=335638]: Done begin upload segment.
Aug 22 04:14:56.078638679 (322h48m36.809906329s) [noise=true , address=77.90.31.15:4703     , piece_id=XH433WREH7EVXIAQMLI5EDLEN5FZJHAEHCYK5NL55VA2JWAVHTIA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.078649209 (322h48m36.809916859s) [noise=true , address=77.90.31.17:4775     , piece_id=2KCZ36SQFRJWMC3OBYW6674TLYLJEMDPQA7QSS4JVELCBC75BF7A, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079202952 (322h48m36.810470601s) [noise=true , address=79.127.201.215:4344  , piece_id=I4KQ6C7QKCUXYFYIVHMWWLI5RZC3YXUNVBQTGHAHZU7F6ELJ5GMA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079216498 (322h48m36.810484148s) [noise=true , address=77.90.31.10:4535     , piece_id=3MOUQMV5N7JI4V27RP3ZPKLF2P3ABFO4XP4TFHOPUHGVGILJYZWA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079590982 (322h48m36.810858633s) [noise=true , address=79.127.219.51:4185   , piece_id=5RHU7PFIBAY7KLYYVMNPGJBM33K5WWZ6E35Z52O3SF2XSVG3WKMQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.079604748 (322h48m36.810872388s) [noise=true , address=104.36.82.6:4892     , piece_id=3WLX4OFVLCBLAE5OEI52JHUPYZNBOWMRX6LJWUYLPEKWPCFDBIBA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080091395 (322h48m36.811359044s) [noise=true , address=79.127.219.48:4093   , piece_id=NZBRQBL7Z52H3JCLLLD7CFBFWGC7H7MJTW6G2CFH57J2F4XDP4SA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080144284 (322h48m36.811411934s) [noise=true , address=79.127.205.235:4677  , piece_id=CB422NDFIO6VHBDC4QCP7UGLZRCGP2N3JRVZPFX4DFE5SU77RKMQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.080582860 (322h48m36.811850511s) [noise=true , address=77.90.31.16:4761     , piece_id=AJWEB2GXZABAMZW7V4S3LF7FEYOI23K2ASL42NFIOFOWWQBZQQCA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081056942 (322h48m36.812324582s) [noise=true , address=77.90.31.11:4568     , piece_id=JC2LPEKYMWNJRQ2HMCIHDZKSICEZLK6C4ET3UIDUIRDD6MCL6ZJA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081504335 (322h48m36.812771984s) [noise=true , address=77.90.31.18:4811     , piece_id=ODPH32QDN7CTPF5IDUNQ5DEBC6HASD4BAP43ZVZDBIJFJLJWXHXA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.081853813 (322h48m36.813121463s) [noise=true , address=104.36.82.23:4472    , piece_id=FCUL2C2XCQ2JKS46BDPNDSENIJBDDLL7TR7BW337GB6OR63DF4CQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082215645 (322h48m36.813483284s) [noise=true , address=77.90.31.19:4874     , piece_id=MCAFOKTALBSPDPMRSTHYZB3RGF7M5I55HOG3RUD463VCTVW7QCGQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082563559 (322h48m36.813831199s) [noise=true , address=104.36.82.60:4372    , piece_id=KUGRHZF4E4FOB4SYJF2NQ75LIF6IUXWMZ35URXHB7VDADYLZNYHQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.082885666 (322h48m36.814153317s) [noise=true , address=45.91.116.11:4132    , piece_id=SBIASMWS5NC2XSHDENEKASMDEKQ3ODBPE4RKIQ4EZKZG6SP67JNQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.083847547 (322h48m36.815115197s) [noise=true , address=79.127.219.51:4200   , piece_id=SPPCLJ66SEENUH7SLHHXWI2UZHBEEY3KZIVVUAS3FBZ7CQY2G4LQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.084798477 (322h48m36.816066128s) [noise=true , address=104.36.82.44:4874    , piece_id=UCCAF4MUEIVBLMZRA2LSGWLJZSIBFMA7NY36IA7IB3KH4IBGXKAQ, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.088490439 (322h48m36.819758089s) [noise=true , address=104.36.82.5:4858     , piece_id=IYUCCI5NCZOTML7GFYI4LAS6NV47IC5UHCVLHFON3LJKZA2LFABA, seg_pos={0 0}, upload=335638]: Uploading piece...
Aug 22 04:14:56.206801759 (322h48m36.938069408s) [upload=335638]: Next returned nil segment
Aug 22 04:14:56.206950910 (322h48m36.93821856s) [upload=335638]: Waiting for error group managing segments...
Aug 22 04:14:56.219298197 (322h48m36.950565838s) [noise=true , address=79.127.219.51:4185   , piece_id=5RHU7PFIBAY7KLYYVMNPGJBM33K5WWZ6E35Z52O3SF2XSVG3WKMQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.221650127 (322h48m36.952917776s) [noise=true , address=79.127.219.51:4200   , piece_id=SPPCLJ66SEENUH7SLHHXWI2UZHBEEY3KZIVVUAS3FBZ7CQY2G4LQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.221873898 (322h48m36.953141537s) [noise=true , address=79.127.219.48:4093   , piece_id=NZBRQBL7Z52H3JCLLLD7CFBFWGC7H7MJTW6G2CFH57J2F4XDP4SA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.222678583 (322h48m36.953946232s) [noise=true , address=77.90.31.18:4811     , piece_id=ODPH32QDN7CTPF5IDUNQ5DEBC6HASD4BAP43ZVZDBIJFJLJWXHXA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.224688627 (322h48m36.955956277s) [noise=true , address=104.36.82.6:4892     , piece_id=3WLX4OFVLCBLAE5OEI52JHUPYZNBOWMRX6LJWUYLPEKWPCFDBIBA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.226219780 (322h48m36.95748742s) [noise=true , address=77.90.31.19:4874     , piece_id=MCAFOKTALBSPDPMRSTHYZB3RGF7M5I55HOG3RUD463VCTVW7QCGQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.226285995 (322h48m36.957553645s) [noise=true , address=77.90.31.17:4775     , piece_id=2KCZ36SQFRJWMC3OBYW6674TLYLJEMDPQA7QSS4JVELCBC75BF7A, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.228103006 (322h48m36.959370626s) [noise=true , address=104.36.82.44:4874    , piece_id=UCCAF4MUEIVBLMZRA2LSGWLJZSIBFMA7NY36IA7IB3KH4IBGXKAQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.237068737 (322h48m36.968336377s) [noise=true , address=77.90.31.16:4761     , piece_id=AJWEB2GXZABAMZW7V4S3LF7FEYOI23K2ASL42NFIOFOWWQBZQQCA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.248700377 (322h48m36.979968027s) [noise=true , address=45.91.116.11:4132    , piece_id=SBIASMWS5NC2XSHDENEKASMDEKQ3ODBPE4RKIQ4EZKZG6SP67JNQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.252483180 (322h48m36.98375083s) [noise=true , address=104.36.82.5:4858     , piece_id=IYUCCI5NCZOTML7GFYI4LAS6NV47IC5UHCVLHFON3LJKZA2LFABA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.268821762 (322h48m37.000089423s) [noise=true , address=77.90.31.15:4703     , piece_id=XH433WREH7EVXIAQMLI5EDLEN5FZJHAEHCYK5NL55VA2JWAVHTIA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.273574892 (322h48m37.004842553s) [noise=true , address=77.90.31.10:4535     , piece_id=3MOUQMV5N7JI4V27RP3ZPKLF2P3ABFO4XP4TFHOPUHGVGILJYZWA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.308274656 (322h48m37.039542306s) [noise=true , address=104.36.82.60:4372    , piece_id=KUGRHZF4E4FOB4SYJF2NQ75LIF6IUXWMZ35URXHB7VDADYLZNYHQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: <nil>
Aug 22 04:14:56.308311565 (322h48m37.039579215s) [seg_pos={0 0}, upload=335638]: Segment reached optimal threshold of 14 pieces.
Aug 22 04:14:56.308536709 (322h48m37.039804359s) [noise=true , address=104.36.82.23:4472    , piece_id=FCUL2C2XCQ2JKS46BDPNDSENIJBDDLL7TR7BW337GB6OR63DF4CQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF
Aug 22 04:14:56.308649492 (322h48m37.039917141s) [noise=true , address=77.90.31.11:4568     , piece_id=JC2LPEKYMWNJRQ2HMCIHDZKSICEZLK6C4ET3UIDUIRDD6MCL6ZJA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1H1L8DTKD7W7Xx1PVT7KzB9GkGBadnTEj9BHtbSgcW1S7Jj8Tw): protocol: expected piece hash; context canceled; EOF
Aug 22 04:14:56.308765871 (322h48m37.040033521s) [noise=true , address=79.127.205.235:4677  , piece_id=CB422NDFIO6VHBDC4QCP7UGLZRCGP2N3JRVZPFX4DFE5SU77RKMQ, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oeYzce3yvWfVUnLYKyRyPePYh4QRj86FowWm3hRZ1qHQ6TSLa): protocol: read tcp 5.161.89.252:30854->79.127.205.235:4677: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 04:14:56.308796689 (322h48m37.040064349s) [noise=true , address=79.127.201.215:4344  , piece_id=I4KQ6C7QKCUXYFYIVHMWWLI5RZC3YXUNVBQTGHAHZU7F6ELJ5GMA, seg_pos={0 0}, upload=335638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: read tcp 5.161.89.252:38178->79.127.201.215:4344: use of closed network connection; context canceled
Aug 22 04:14:56.308831504 (322h48m37.040099164s) [seg_pos={0 0}, upload=335638]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 04:14:56.309045818 (322h48m37.040313488s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 04:14:56.309058031 (322h48m37.040325681s) [upload=335638]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 04:14:56.409269392 (322h48m37.140537052s) [upload=335638]: Done uploading segments...
Aug 22 04:14:56.409287577 (322h48m37.140555237s) [upload=335638]: Upload finished. err: <nil>
Duration: 479.710837ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................]
duration:
422.829671ms
FAIL (2025-08-22 04:14:56 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 22 04:02:35.778567116 (322h36m16.509834776s) [upload=335425]: Starting upload
Aug 22 04:02:35.778627910 (322h36m16.50989556s) [upload=335425]: Done starting upload
Aug 22 04:02:35.778698904 (322h36m16.509966554s) [upload=335425]: Uploading segments...
Aug 22 04:02:35.778735532 (322h36m16.510003183s) [upload=335425]: Got next segment. Inline: true
Aug 22 04:02:35.778740812 (322h36m16.510008463s) [upload=335425]: Waiting for error group managing segments...
Aug 22 04:02:35.778782822 (322h36m16.510050482s) [upload=335425]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 04:02:35.778788092 (322h36m16.510055742s) [upload=335425]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 22 04:02:35.778791679 (322h36m16.510059329s) [upload=335425]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 04:02:35.860699428 (322h36m16.591967088s) [upload=335425]: Done uploading segments...
Aug 22 04:02:35.860716189 (322h36m16.591983839s) [upload=335425]: Upload finished. err: metaclient: Too Many Requests
Duration: 422.862803ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................]
duration:
7.470873529s
FAIL (2025-08-22 04:14:51 UTC)
orbiter warning: operation: sync2.Copy
uplink: encryption: context deadline exceeded
Duration: 7.470895851s core uplink ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................]
duration:
389.089631ms
FAIL (2025-08-22 04:14:11 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 22 04:02:35.778567116 (322h36m16.509834776s) [upload=335425]: Starting upload
Aug 22 04:02:35.778627910 (322h36m16.50989556s) [upload=335425]: Done starting upload
Aug 22 04:02:35.778698904 (322h36m16.509966554s) [upload=335425]: Uploading segments...
Aug 22 04:02:35.778735532 (322h36m16.510003183s) [upload=335425]: Got next segment. Inline: true
Aug 22 04:02:35.778740812 (322h36m16.510008463s) [upload=335425]: Waiting for error group managing segments...
Aug 22 04:02:35.778782822 (322h36m16.510050482s) [upload=335425]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 04:02:35.778788092 (322h36m16.510055742s) [upload=335425]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 22 04:02:35.778791679 (322h36m16.510059329s) [upload=335425]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 04:02:35.860699428 (322h36m16.591967088s) [upload=335425]: Done uploading segments...
Aug 22 04:02:35.860716189 (322h36m16.591983839s) [upload=335425]: Upload finished. err: metaclient: Too Many Requests
Duration: 389.110861ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................]
duration:
5.833195544s
FAIL (2025-08-22 04:14:05 UTC)
orbiter warning: operation: sync2.Copy
uplink: encryption: context deadline exceeded
Duration: 5.833212998s core uplink ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................]
duration:
1.630801505s
FAIL (2025-08-22 04:14:00 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 22 03:33:12.065785480 (322h6m52.79705311s) [upload=334916]: Starting upload
Aug 22 03:33:12.065835934 (322h6m52.797103564s) [upload=334916]: Done starting upload
Aug 22 03:33:12.065983522 (322h6m52.797251173s) [upload=334916]: Uploading segments...
Aug 22 03:33:12.066081026 (322h6m52.797348677s) [upload=334916]: Got next segment. Inline: false
Aug 22 03:33:12.066144705 (322h6m52.797412356s) [upload=334916]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 03:33:12.066152590 (322h6m52.79742024s) [upload=334916]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 03:33:12.069128052 (322h6m52.800395722s) [upload=334916]: Next segment err: metaclient: Too Many Requests
Aug 22 03:33:12.069226437 (322h6m52.800494097s) [upload=334916]: Done uploading segments...
Aug 22 03:33:12.069253408 (322h6m52.800521058s) [upload=334916]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.630823567s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................]
duration:
129.048095ms
FAIL (2025-08-22 04:13:53 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 22 04:02:35.778567116 (322h36m16.509834776s) [upload=335425]: Starting upload
Aug 22 04:02:35.778627910 (322h36m16.50989556s) [upload=335425]: Done starting upload
Aug 22 04:02:35.778698904 (322h36m16.509966554s) [upload=335425]: Uploading segments...
Aug 22 04:02:35.778735532 (322h36m16.510003183s) [upload=335425]: Got next segment. Inline: true
Aug 22 04:02:35.778740812 (322h36m16.510008463s) [upload=335425]: Waiting for error group managing segments...
Aug 22 04:02:35.778782822 (322h36m16.510050482s) [upload=335425]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 04:02:35.778788092 (322h36m16.510055742s) [upload=335425]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 22 04:02:35.778791679 (322h36m16.510059329s) [upload=335425]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 04:02:35.860699428 (322h36m16.591967088s) [upload=335425]: Done uploading segments...
Aug 22 04:02:35.860716189 (322h36m16.591983839s) [upload=335425]: Upload finished. err: metaclient: Too Many Requests
Duration: 129.068904ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................]
duration:
8.476935822s
FAIL (2025-08-22 04:13:51 UTC)
orbiter warning: operation: sync2.Copy
uplink: encryption: context deadline exceeded
Duration: 8.476949729s core uplink ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................]
duration:
161.306824ms
FAIL (2025-08-22 04:13:18 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 22 04:02:35.778567116 (322h36m16.509834776s) [upload=335425]: Starting upload
Aug 22 04:02:35.778627910 (322h36m16.50989556s) [upload=335425]: Done starting upload
Aug 22 04:02:35.778698904 (322h36m16.509966554s) [upload=335425]: Uploading segments...
Aug 22 04:02:35.778735532 (322h36m16.510003183s) [upload=335425]: Got next segment. Inline: true
Aug 22 04:02:35.778740812 (322h36m16.510008463s) [upload=335425]: Waiting for error group managing segments...
Aug 22 04:02:35.778782822 (322h36m16.510050482s) [upload=335425]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 04:02:35.778788092 (322h36m16.510055742s) [upload=335425]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 22 04:02:35.778791679 (322h36m16.510059329s) [upload=335425]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 04:02:35.860699428 (322h36m16.591967088s) [upload=335425]: Done uploading segments...
Aug 22 04:02:35.860716189 (322h36m16.591983839s) [upload=335425]: Upload finished. err: metaclient: Too Many Requests
Duration: 161.329287ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................]
duration:
6.388456144s
FAIL (2025-08-22 04:13:07 UTC)
orbiter warning: operation: sync2.Copy
uplink: encryption: context deadline exceeded
Duration: 6.388481542s core uplink ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................]
duration:
1.829119115s
FAIL (2025-08-22 04:13:04 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 22 03:33:12.065785480 (322h6m52.79705311s) [upload=334916]: Starting upload
Aug 22 03:33:12.065835934 (322h6m52.797103564s) [upload=334916]: Done starting upload
Aug 22 03:33:12.065983522 (322h6m52.797251173s) [upload=334916]: Uploading segments...
Aug 22 03:33:12.066081026 (322h6m52.797348677s) [upload=334916]: Got next segment. Inline: false
Aug 22 03:33:12.066144705 (322h6m52.797412356s) [upload=334916]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 03:33:12.066152590 (322h6m52.79742024s) [upload=334916]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 03:33:12.069128052 (322h6m52.800395722s) [upload=334916]: Next segment err: metaclient: Too Many Requests
Aug 22 03:33:12.069226437 (322h6m52.800494097s) [upload=334916]: Done uploading segments...
Aug 22 03:33:12.069253408 (322h6m52.800521058s) [upload=334916]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.829151737s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................]
duration:
154.637277ms
FAIL (2025-08-22 04:12:58 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 22 04:02:35.778567116 (322h36m16.509834776s) [upload=335425]: Starting upload
Aug 22 04:02:35.778627910 (322h36m16.50989556s) [upload=335425]: Done starting upload
Aug 22 04:02:35.778698904 (322h36m16.509966554s) [upload=335425]: Uploading segments...
Aug 22 04:02:35.778735532 (322h36m16.510003183s) [upload=335425]: Got next segment. Inline: true
Aug 22 04:02:35.778740812 (322h36m16.510008463s) [upload=335425]: Waiting for error group managing segments...
Aug 22 04:02:35.778782822 (322h36m16.510050482s) [upload=335425]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 04:02:35.778788092 (322h36m16.510055742s) [upload=335425]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 22 04:02:35.778791679 (322h36m16.510059329s) [upload=335425]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 04:02:35.860699428 (322h36m16.591967088s) [upload=335425]: Done uploading segments...
Aug 22 04:02:35.860716189 (322h36m16.591983839s) [upload=335425]: Upload finished. err: metaclient: Too Many Requests
Duration: 154.657335ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................]
duration:
5.661338959s
FAIL (2025-08-22 04:12:45 UTC)
orbiter warning: operation: sync2.Copy
uplink: encryption: context deadline exceeded
Duration: 5.661357034s core uplink ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................]
duration:
132.465672ms
FAIL (2025-08-22 04:12:43 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 22 04:02:35.778567116 (322h36m16.509834776s) [upload=335425]: Starting upload
Aug 22 04:02:35.778627910 (322h36m16.50989556s) [upload=335425]: Done starting upload
Aug 22 04:02:35.778698904 (322h36m16.509966554s) [upload=335425]: Uploading segments...
Aug 22 04:02:35.778735532 (322h36m16.510003183s) [upload=335425]: Got next segment. Inline: true
Aug 22 04:02:35.778740812 (322h36m16.510008463s) [upload=335425]: Waiting for error group managing segments...
Aug 22 04:02:35.778782822 (322h36m16.510050482s) [upload=335425]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 04:02:35.778788092 (322h36m16.510055742s) [upload=335425]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 22 04:02:35.778791679 (322h36m16.510059329s) [upload=335425]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 04:02:35.860699428 (322h36m16.591967088s) [upload=335425]: Done uploading segments...
Aug 22 04:02:35.860716189 (322h36m16.591983839s) [upload=335425]: Upload finished. err: metaclient: Too Many Requests
Duration: 132.483836ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................]
duration:
1.18705691s
FAIL (2025-08-22 04:12:42 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 22 03:33:12.065785480 (322h6m52.79705311s) [upload=334916]: Starting upload
Aug 22 03:33:12.065835934 (322h6m52.797103564s) [upload=334916]: Done starting upload
Aug 22 03:33:12.065983522 (322h6m52.797251173s) [upload=334916]: Uploading segments...
Aug 22 03:33:12.066081026 (322h6m52.797348677s) [upload=334916]: Got next segment. Inline: false
Aug 22 03:33:12.066144705 (322h6m52.797412356s) [upload=334916]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 03:33:12.066152590 (322h6m52.79742024s) [upload=334916]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 03:33:12.069128052 (322h6m52.800395722s) [upload=334916]: Next segment err: metaclient: Too Many Requests
Aug 22 03:33:12.069226437 (322h6m52.800494097s) [upload=334916]: Done uploading segments...
Aug 22 03:33:12.069253408 (322h6m52.800521058s) [upload=334916]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.187088339s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................]
duration:
1.222932331s
FAIL (2025-08-22 04:12:06 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 22 03:33:12.065785480 (322h6m52.79705311s) [upload=334916]: Starting upload
Aug 22 03:33:12.065835934 (322h6m52.797103564s) [upload=334916]: Done starting upload
Aug 22 03:33:12.065983522 (322h6m52.797251173s) [upload=334916]: Uploading segments...
Aug 22 03:33:12.066081026 (322h6m52.797348677s) [upload=334916]: Got next segment. Inline: false
Aug 22 03:33:12.066144705 (322h6m52.797412356s) [upload=334916]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 03:33:12.066152590 (322h6m52.79742024s) [upload=334916]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 03:33:12.069128052 (322h6m52.800395722s) [upload=334916]: Next segment err: metaclient: Too Many Requests
Aug 22 03:33:12.069226437 (322h6m52.800494097s) [upload=334916]: Done uploading segments...
Aug 22 03:33:12.069253408 (322h6m52.800521058s) [upload=334916]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.222956617s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............]
duration:
222.796628ms
FAIL (2025-08-22 04:12:04 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 22 04:02:35.778567116 (322h36m16.509834776s) [upload=335425]: Starting upload
Aug 22 04:02:35.778627910 (322h36m16.50989556s) [upload=335425]: Done starting upload
Aug 22 04:02:35.778698904 (322h36m16.509966554s) [upload=335425]: Uploading segments...
Aug 22 04:02:35.778735532 (322h36m16.510003183s) [upload=335425]: Got next segment. Inline: true
Aug 22 04:02:35.778740812 (322h36m16.510008463s) [upload=335425]: Waiting for error group managing segments...
Aug 22 04:02:35.778782822 (322h36m16.510050482s) [upload=335425]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 04:02:35.778788092 (322h36m16.510055742s) [upload=335425]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 22 04:02:35.778791679 (322h36m16.510059329s) [upload=335425]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 04:02:35.860699428 (322h36m16.591967088s) [upload=335425]: Done uploading segments...
Aug 22 04:02:35.860716189 (322h36m16.591983839s) [upload=335425]: Upload finished. err: metaclient: Too Many Requests
Duration: 222.824943ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................]
duration:
5.261364222s
FAIL (2025-08-22 04:11:49 UTC)
orbiter warning: operation: sync2.Copy
uplink: encryption: context deadline exceeded
Duration: 5.26139567s core uplink ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............]
duration:
152.792753ms
FAIL (2025-08-22 04:11:24 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 22 04:02:35.778567116 (322h36m16.509834776s) [upload=335425]: Starting upload
Aug 22 04:02:35.778627910 (322h36m16.50989556s) [upload=335425]: Done starting upload
Aug 22 04:02:35.778698904 (322h36m16.509966554s) [upload=335425]: Uploading segments...
Aug 22 04:02:35.778735532 (322h36m16.510003183s) [upload=335425]: Got next segment. Inline: true
Aug 22 04:02:35.778740812 (322h36m16.510008463s) [upload=335425]: Waiting for error group managing segments...
Aug 22 04:02:35.778782822 (322h36m16.510050482s) [upload=335425]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 04:02:35.778788092 (322h36m16.510055742s) [upload=335425]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 22 04:02:35.778791679 (322h36m16.510059329s) [upload=335425]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 04:02:35.860699428 (322h36m16.591967088s) [upload=335425]: Done uploading segments...
Aug 22 04:02:35.860716189 (322h36m16.591983839s) [upload=335425]: Upload finished. err: metaclient: Too Many Requests
Duration: 152.813262ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................]
duration:
1.330510599s
FAIL (2025-08-22 04:11:18 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 22 03:33:12.065785480 (322h6m52.79705311s) [upload=334916]: Starting upload
Aug 22 03:33:12.065835934 (322h6m52.797103564s) [upload=334916]: Done starting upload
Aug 22 03:33:12.065983522 (322h6m52.797251173s) [upload=334916]: Uploading segments...
Aug 22 03:33:12.066081026 (322h6m52.797348677s) [upload=334916]: Got next segment. Inline: false
Aug 22 03:33:12.066144705 (322h6m52.797412356s) [upload=334916]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 03:33:12.066152590 (322h6m52.79742024s) [upload=334916]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 03:33:12.069128052 (322h6m52.800395722s) [upload=334916]: Next segment err: metaclient: Too Many Requests
Aug 22 03:33:12.069226437 (322h6m52.800494097s) [upload=334916]: Done uploading segments...
Aug 22 03:33:12.069253408 (322h6m52.800521058s) [upload=334916]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.330539475s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................]
duration:
7.26875521s
FAIL (2025-08-22 04:10:55 UTC)
orbiter warning: operation: sync2.Copy
uplink: encryption: context deadline exceeded
Duration: 7.268779715s core uplink ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............]
duration:
380.575911ms
FAIL (2025-08-22 04:10:33 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 22 04:02:35.778567116 (322h36m16.509834776s) [upload=335425]: Starting upload
Aug 22 04:02:35.778627910 (322h36m16.50989556s) [upload=335425]: Done starting upload
Aug 22 04:02:35.778698904 (322h36m16.509966554s) [upload=335425]: Uploading segments...
Aug 22 04:02:35.778735532 (322h36m16.510003183s) [upload=335425]: Got next segment. Inline: true
Aug 22 04:02:35.778740812 (322h36m16.510008463s) [upload=335425]: Waiting for error group managing segments...
Aug 22 04:02:35.778782822 (322h36m16.510050482s) [upload=335425]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 04:02:35.778788092 (322h36m16.510055742s) [upload=335425]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 22 04:02:35.778791679 (322h36m16.510059329s) [upload=335425]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 04:02:35.860699428 (322h36m16.591967088s) [upload=335425]: Done uploading segments...
Aug 22 04:02:35.860716189 (322h36m16.591983839s) [upload=335425]: Upload finished. err: metaclient: Too Many Requests
Duration: 380.592442ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................]
duration:
5.388474523s
FAIL (2025-08-22 04:10:31 UTC)
orbiter warning: operation: sync2.Copy
uplink: encryption: context deadline exceeded
Duration: 5.388520729s core uplink ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................]
duration:
1.40871703s
FAIL (2025-08-22 04:10:16 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 22 03:33:12.065785480 (322h6m52.79705311s) [upload=334916]: Starting upload
Aug 22 03:33:12.065835934 (322h6m52.797103564s) [upload=334916]: Done starting upload
Aug 22 03:33:12.065983522 (322h6m52.797251173s) [upload=334916]: Uploading segments...
Aug 22 03:33:12.066081026 (322h6m52.797348677s) [upload=334916]: Got next segment. Inline: false
Aug 22 03:33:12.066144705 (322h6m52.797412356s) [upload=334916]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 03:33:12.066152590 (322h6m52.79742024s) [upload=334916]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 03:33:12.069128052 (322h6m52.800395722s) [upload=334916]: Next segment err: metaclient: Too Many Requests
Aug 22 03:33:12.069226437 (322h6m52.800494097s) [upload=334916]: Done uploading segments...
Aug 22 03:33:12.069253408 (322h6m52.800521058s) [upload=334916]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.408742418s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............]
duration:
261.164791ms
FAIL (2025-08-22 04:10:10 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 22 04:02:35.778567116 (322h36m16.509834776s) [upload=335425]: Starting upload
Aug 22 04:02:35.778627910 (322h36m16.50989556s) [upload=335425]: Done starting upload
Aug 22 04:02:35.778698904 (322h36m16.509966554s) [upload=335425]: Uploading segments...
Aug 22 04:02:35.778735532 (322h36m16.510003183s) [upload=335425]: Got next segment. Inline: true
Aug 22 04:02:35.778740812 (322h36m16.510008463s) [upload=335425]: Waiting for error group managing segments...
Aug 22 04:02:35.778782822 (322h36m16.510050482s) [upload=335425]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 04:02:35.778788092 (322h36m16.510055742s) [upload=335425]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 22 04:02:35.778791679 (322h36m16.510059329s) [upload=335425]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 04:02:35.860699428 (322h36m16.591967088s) [upload=335425]: Done uploading segments...
Aug 22 04:02:35.860716189 (322h36m16.591983839s) [upload=335425]: Upload finished. err: metaclient: Too Many Requests
Duration: 261.187785ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........]
duration:
127.460898ms
FAIL (2025-08-22 04:09:46 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 22 04:02:35.778567116 (322h36m16.509834776s) [upload=335425]: Starting upload
Aug 22 04:02:35.778627910 (322h36m16.50989556s) [upload=335425]: Done starting upload
Aug 22 04:02:35.778698904 (322h36m16.509966554s) [upload=335425]: Uploading segments...
Aug 22 04:02:35.778735532 (322h36m16.510003183s) [upload=335425]: Got next segment. Inline: true
Aug 22 04:02:35.778740812 (322h36m16.510008463s) [upload=335425]: Waiting for error group managing segments...
Aug 22 04:02:35.778782822 (322h36m16.510050482s) [upload=335425]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 04:02:35.778788092 (322h36m16.510055742s) [upload=335425]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 22 04:02:35.778791679 (322h36m16.510059329s) [upload=335425]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 04:02:35.860699428 (322h36m16.591967088s) [upload=335425]: Done uploading segments...
Aug 22 04:02:35.860716189 (322h36m16.591983839s) [upload=335425]: Upload finished. err: metaclient: Too Many Requests
Duration: 127.482247ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................]
duration:
2.42510994s
FAIL (2025-08-22 04:09:33 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 22 03:33:12.065785480 (322h6m52.79705311s) [upload=334916]: Starting upload
Aug 22 03:33:12.065835934 (322h6m52.797103564s) [upload=334916]: Done starting upload
Aug 22 03:33:12.065983522 (322h6m52.797251173s) [upload=334916]: Uploading segments...
Aug 22 03:33:12.066081026 (322h6m52.797348677s) [upload=334916]: Got next segment. Inline: false
Aug 22 03:33:12.066144705 (322h6m52.797412356s) [upload=334916]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 03:33:12.066152590 (322h6m52.79742024s) [upload=334916]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 03:33:12.069128052 (322h6m52.800395722s) [upload=334916]: Next segment err: metaclient: Too Many Requests
Aug 22 03:33:12.069226437 (322h6m52.800494097s) [upload=334916]: Done uploading segments...
Aug 22 03:33:12.069253408 (322h6m52.800521058s) [upload=334916]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.425140607s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................]
duration:
4.8701589s
FAIL (2025-08-22 04:09:29 UTC)
orbiter warning: operation: sync2.Copy
uplink: encryption: context deadline exceeded
Duration: 4.870182233s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................]
duration:
8.166147224s
FAIL (2025-08-22 04:08:42 UTC)
orbiter warning: operation: sync2.Copy
uplink: encryption: context deadline exceeded
Duration: 8.166164907s core uplink ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................]
duration:
499.551212ms
FAIL (2025-08-22 04:08:38 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 22 03:33:12.065785480 (322h6m52.79705311s) [upload=334916]: Starting upload
Aug 22 03:33:12.065835934 (322h6m52.797103564s) [upload=334916]: Done starting upload
Aug 22 03:33:12.065983522 (322h6m52.797251173s) [upload=334916]: Uploading segments...
Aug 22 03:33:12.066081026 (322h6m52.797348677s) [upload=334916]: Got next segment. Inline: false
Aug 22 03:33:12.066144705 (322h6m52.797412356s) [upload=334916]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 03:33:12.066152590 (322h6m52.79742024s) [upload=334916]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 03:33:12.069128052 (322h6m52.800395722s) [upload=334916]: Next segment err: metaclient: Too Many Requests
Aug 22 03:33:12.069226437 (322h6m52.800494097s) [upload=334916]: Done uploading segments...
Aug 22 03:33:12.069253408 (322h6m52.800521058s) [upload=334916]: Upload finished. err: metaclient: Too Many Requests
Duration: 499.579055ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........]
duration:
260.161981ms
FAIL (2025-08-22 04:08:38 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 22 04:02:35.778567116 (322h36m16.509834776s) [upload=335425]: Starting upload
Aug 22 04:02:35.778627910 (322h36m16.50989556s) [upload=335425]: Done starting upload
Aug 22 04:02:35.778698904 (322h36m16.509966554s) [upload=335425]: Uploading segments...
Aug 22 04:02:35.778735532 (322h36m16.510003183s) [upload=335425]: Got next segment. Inline: true
Aug 22 04:02:35.778740812 (322h36m16.510008463s) [upload=335425]: Waiting for error group managing segments...
Aug 22 04:02:35.778782822 (322h36m16.510050482s) [upload=335425]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 04:02:35.778788092 (322h36m16.510055742s) [upload=335425]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 22 04:02:35.778791679 (322h36m16.510059329s) [upload=335425]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 04:02:35.860699428 (322h36m16.591967088s) [upload=335425]: Done uploading segments...
Aug 22 04:02:35.860716189 (322h36m16.591983839s) [upload=335425]: Upload finished. err: metaclient: Too Many Requests
Duration: 260.180106ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........]
duration:
164.123347ms
FAIL (2025-08-22 04:08:14 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 22 04:02:35.778567116 (322h36m16.509834776s) [upload=335425]: Starting upload
Aug 22 04:02:35.778627910 (322h36m16.50989556s) [upload=335425]: Done starting upload
Aug 22 04:02:35.778698904 (322h36m16.509966554s) [upload=335425]: Uploading segments...
Aug 22 04:02:35.778735532 (322h36m16.510003183s) [upload=335425]: Got next segment. Inline: true
Aug 22 04:02:35.778740812 (322h36m16.510008463s) [upload=335425]: Waiting for error group managing segments...
Aug 22 04:02:35.778782822 (322h36m16.510050482s) [upload=335425]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 04:02:35.778788092 (322h36m16.510055742s) [upload=335425]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 22 04:02:35.778791679 (322h36m16.510059329s) [upload=335425]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 04:02:35.860699428 (322h36m16.591967088s) [upload=335425]: Done uploading segments...
Aug 22 04:02:35.860716189 (322h36m16.591983839s) [upload=335425]: Upload finished. err: metaclient: Too Many Requests
Duration: 164.152942ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................]
duration:
5.906192966s
FAIL (2025-08-22 04:07:50 UTC)
orbiter warning: operation: sync2.Copy
uplink: encryption: context deadline exceeded
Duration: 5.906222832s core uplink ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................]
duration:
2.560868468s
FAIL (2025-08-22 04:07:48 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 22 03:33:12.065785480 (322h6m52.79705311s) [upload=334916]: Starting upload
Aug 22 03:33:12.065835934 (322h6m52.797103564s) [upload=334916]: Done starting upload
Aug 22 03:33:12.065983522 (322h6m52.797251173s) [upload=334916]: Uploading segments...
Aug 22 03:33:12.066081026 (322h6m52.797348677s) [upload=334916]: Got next segment. Inline: false
Aug 22 03:33:12.066144705 (322h6m52.797412356s) [upload=334916]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 03:33:12.066152590 (322h6m52.79742024s) [upload=334916]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 03:33:12.069128052 (322h6m52.800395722s) [upload=334916]: Next segment err: metaclient: Too Many Requests
Aug 22 03:33:12.069226437 (322h6m52.800494097s) [upload=334916]: Done uploading segments...
Aug 22 03:33:12.069253408 (322h6m52.800521058s) [upload=334916]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.560888676s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................]
duration:
2.279458059s
FAIL (2025-08-22 04:07:23 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 22 03:33:12.065785480 (322h6m52.79705311s) [upload=334916]: Starting upload
Aug 22 03:33:12.065835934 (322h6m52.797103564s) [upload=334916]: Done starting upload
Aug 22 03:33:12.065983522 (322h6m52.797251173s) [upload=334916]: Uploading segments...
Aug 22 03:33:12.066081026 (322h6m52.797348677s) [upload=334916]: Got next segment. Inline: false
Aug 22 03:33:12.066144705 (322h6m52.797412356s) [upload=334916]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 03:33:12.066152590 (322h6m52.79742024s) [upload=334916]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 03:33:12.069128052 (322h6m52.800395722s) [upload=334916]: Next segment err: metaclient: Too Many Requests
Aug 22 03:33:12.069226437 (322h6m52.800494097s) [upload=334916]: Done uploading segments...
Aug 22 03:33:12.069253408 (322h6m52.800521058s) [upload=334916]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.279482023s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................]
duration:
7.80898868s
FAIL (2025-08-22 04:07:20 UTC)
orbiter warning: operation: sync2.Copy
uplink: encryption: context deadline exceeded
Duration: 7.809005983s core uplink ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........]
duration:
156.057632ms
FAIL (2025-08-22 04:07:18 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 22 04:02:35.778567116 (322h36m16.509834776s) [upload=335425]: Starting upload
Aug 22 04:02:35.778627910 (322h36m16.50989556s) [upload=335425]: Done starting upload
Aug 22 04:02:35.778698904 (322h36m16.509966554s) [upload=335425]: Uploading segments...
Aug 22 04:02:35.778735532 (322h36m16.510003183s) [upload=335425]: Got next segment. Inline: true
Aug 22 04:02:35.778740812 (322h36m16.510008463s) [upload=335425]: Waiting for error group managing segments...
Aug 22 04:02:35.778782822 (322h36m16.510050482s) [upload=335425]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 04:02:35.778788092 (322h36m16.510055742s) [upload=335425]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 22 04:02:35.778791679 (322h36m16.510059329s) [upload=335425]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 04:02:35.860699428 (322h36m16.591967088s) [upload=335425]: Done uploading segments...
Aug 22 04:02:35.860716189 (322h36m16.591983839s) [upload=335425]: Upload finished. err: metaclient: Too Many Requests
Duration: 156.081837ms core uplink us-select-1 us1-placement-20 metainfo-projects