Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........................................X...X...............] duration:
817.640929ms
FAIL (2025-08-23 11:14:41 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 28245251ac342c007ce1fdace53a54430147658e4c1a99d2532414b8de3a590b != before cc998e750b4b2c5f32e8fd1890a376ff1ac4cb4bb7438b3dc26e176b0e67f259
======LOGS======
Aug 23 11:01:38.064016662 (353h35m18.795284282s) [upload=367603]: Starting upload
Aug 23 11:01:38.064051468 (353h35m18.795319088s) [upload=367603]: Done starting upload
Aug 23 11:01:38.064089499 (353h35m18.795357129s) [upload=367603]: Uploading segments...
Aug 23 11:01:38.064223582 (353h35m18.795491191s) [upload=367603]: Got next segment. Inline: false
Aug 23 11:01:38.064244992 (353h35m18.795512612s) [upload=367603]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 11:01:38.064248029 (353h35m18.795515648s) [upload=367603]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 11:01:38.118468561 (353h35m18.84973617s) [seg_pos={0 0}, upload=367603]: Begin upload segment...
Aug 23 11:01:38.118511180 (353h35m18.849778801s) [seg_pos={0 0}, upload=367603]: Done begin upload segment.
Aug 23 11:01:38.118532641 (353h35m18.849800251s) [noise=true , address=79.127.201.214:4289 , piece_id=TCE5UN2PB7EFIN7SIV6ZEKCXDPRWSPEAEPSPQABOEWEIGWCM4R4A, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.118847505 (353h35m18.850115124s) [noise=true , address=77.90.31.13:4631 , piece_id=XT35U3ICBYMGBKG7AJPDO5K255QLX6HGKG5B6DFKMXAUPGIEGXPA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119057940 (353h35m18.85032556s) [noise=true , address=77.90.31.17:4780 , piece_id=74BLTPAJVDGN5CXZ2N7ZW73VVCH5PX5VXLVHTQLACVZHDQO354ZA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119248149 (353h35m18.850515769s) [noise=true , address=77.90.31.16:4768 , piece_id=NZJBUTVSFT5A6XL3HWUNCELFW2X46IME6IFM5X3HGW6NHTPUWSJA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119419431 (353h35m18.850687051s) [noise=true , address=77.90.31.10:4535 , piece_id=BHHU5RSTS7CXSMSJGSJT64KRSAMRKQMC2A6WKNX7UXLIDEQOHFCQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119729384 (353h35m18.850997005s) [noise=true , address=79.127.205.245:4220 , piece_id=6XZLJDUMRHOEQDBXSF7KBSVCJ2EYDLPSISDFRGG3KSWLFRX2YAYQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119979636 (353h35m18.851247246s) [noise=true , address=77.90.31.18:4814 , piece_id=FY5HIMU3Y7QUJ24452HXIMCQLG5VELDEOS2NHCICLANDF74UXLDQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120175233 (353h35m18.851442854s) [noise=true , address=77.90.31.12:4607 , piece_id=KCALRY56PWGBC6PPNULERFUVJDJXRQS4GPT47BTQQHM45LH4MSFQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120350535 (353h35m18.851618154s) [noise=true , address=45.91.116.14:4212 , piece_id=BTQCNNOMSETWVTURIAFQORWWB6UMKJWX4LHUZTOVDXXOF6N3WPSQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120550500 (353h35m18.85181812s) [noise=true , address=104.36.82.23:4477 , piece_id=GVPQSMCF2CKVMWJWDGT5SLWWYG4BFW7RPSTLGS7XFIDWVNYC36BA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120813255 (353h35m18.852080865s) [noise=true , address=45.91.116.12:4232 , piece_id=IPF7UNNBP6JYQ5NCVUNFBQOBEFSSUBCTIWURVVKO5PH7MYWQQGZQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120993995 (353h35m18.852261616s) [noise=true , address=79.127.219.47:4054 , piece_id=SHV6YO5TSXJKUIA6RNWI5LKJUCOJPHUDDXDJZJ7YUXTXTAWCOXDA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.121160568 (353h35m18.852428189s) [noise=true , address=45.91.116.6:4990 , piece_id=E4F7AALJ6BJCNIFXOUYWIVQAPQ5CKZ6S732IJYDFZQ2WRQJV2JCA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.121325740 (353h35m18.852593361s) [noise=true , address=77.90.31.11:4580 , piece_id=T3DGRGQTY7P5NOFO2GJHJPCUKKQ7DAOSCJUGGMICDEZBE6EFUXJQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.121498415 (353h35m18.852766035s) [noise=true , address=104.36.82.23:4468 , piece_id=QS5BTJH5SVGPPDE232B7WK7AWDXJJBJCH3YNO6ECT7UG6HASNQ6A, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.121897627 (353h35m18.853165247s) [noise=true , address=77.90.31.14:4688 , piece_id=ASVRBAD6VDUVEIHNQ5T3LZ2MRQ7RBNDXSXIXHMBQXO76XONYIUPQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.122085360 (353h35m18.85335298s) [noise=true , address=104.36.82.44:4899 , piece_id=6URUBNUUNT55E37EB24U3TAENAZ53UJIN6GUDR6IQ4D4S5RVNTEQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.122256282 (353h35m18.853523891s) [noise=true , address=104.36.82.8:4984 , piece_id=XMSGV473QN7BZZF6N73Y6Y5SJZHHSDTXR7U7BSP3JDB4I2JDAAYQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.202732788 (353h35m18.934000418s) [upload=367603]: Next returned nil segment
Aug 23 11:01:38.202743218 (353h35m18.934010848s) [upload=367603]: Waiting for error group managing segments...
Aug 23 11:01:38.211564696 (353h35m18.942832326s) [noise=true , address=79.127.219.47:4054 , piece_id=SHV6YO5TSXJKUIA6RNWI5LKJUCOJPHUDDXDJZJ7YUXTXTAWCOXDA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.212219099 (353h35m18.943486729s) [noise=true , address=45.91.116.14:4212 , piece_id=BTQCNNOMSETWVTURIAFQORWWB6UMKJWX4LHUZTOVDXXOF6N3WPSQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.212696007 (353h35m18.943963627s) [noise=true , address=45.91.116.12:4232 , piece_id=IPF7UNNBP6JYQ5NCVUNFBQOBEFSSUBCTIWURVVKO5PH7MYWQQGZQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.213187322 (353h35m18.944454952s) [noise=true , address=45.91.116.6:4990 , piece_id=E4F7AALJ6BJCNIFXOUYWIVQAPQ5CKZ6S732IJYDFZQ2WRQJV2JCA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.213614956 (353h35m18.944882586s) [noise=true , address=77.90.31.17:4780 , piece_id=74BLTPAJVDGN5CXZ2N7ZW73VVCH5PX5VXLVHTQLACVZHDQO354ZA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.214004220 (353h35m18.945271839s) [noise=true , address=77.90.31.13:4631 , piece_id=XT35U3ICBYMGBKG7AJPDO5K255QLX6HGKG5B6DFKMXAUPGIEGXPA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.215762329 (353h35m18.947029949s) [noise=true , address=104.36.82.44:4899 , piece_id=6URUBNUUNT55E37EB24U3TAENAZ53UJIN6GUDR6IQ4D4S5RVNTEQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.216257632 (353h35m18.947525262s) [noise=true , address=77.90.31.14:4688 , piece_id=ASVRBAD6VDUVEIHNQ5T3LZ2MRQ7RBNDXSXIXHMBQXO76XONYIUPQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.216649570 (353h35m18.9479172s) [noise=true , address=104.36.82.23:4468 , piece_id=QS5BTJH5SVGPPDE232B7WK7AWDXJJBJCH3YNO6ECT7UG6HASNQ6A, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.217893071 (353h35m18.949160691s) [noise=true , address=104.36.82.23:4477 , piece_id=GVPQSMCF2CKVMWJWDGT5SLWWYG4BFW7RPSTLGS7XFIDWVNYC36BA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.220804442 (353h35m18.952072072s) [noise=true , address=77.90.31.11:4580 , piece_id=T3DGRGQTY7P5NOFO2GJHJPCUKKQ7DAOSCJUGGMICDEZBE6EFUXJQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.225729044 (353h35m18.956996674s) [noise=true , address=77.90.31.10:4535 , piece_id=BHHU5RSTS7CXSMSJGSJT64KRSAMRKQMC2A6WKNX7UXLIDEQOHFCQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.234375222 (353h35m18.965642843s) [noise=true , address=77.90.31.16:4768 , piece_id=NZJBUTVSFT5A6XL3HWUNCELFW2X46IME6IFM5X3HGW6NHTPUWSJA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.273055598 (353h35m19.004323218s) [noise=true , address=104.36.82.8:4984 , piece_id=XMSGV473QN7BZZF6N73Y6Y5SJZHHSDTXR7U7BSP3JDB4I2JDAAYQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.273068242 (353h35m19.004335872s) [seg_pos={0 0}, upload=367603]: Segment reached optimal threshold of 14 pieces.
Aug 23 11:01:38.273150165 (353h35m19.004417795s) [noise=true , address=77.90.31.12:4607 , piece_id=KCALRY56PWGBC6PPNULERFUVJDJXRQS4GPT47BTQQHM45LH4MSFQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UYNy47GZEha8wG9vZNUAws5ogTBjSXLdt7T2bwqcHGsPrKFrm): protocol: expected piece hash; context canceled; EOF
Aug 23 11:01:38.273298695 (353h35m19.004566315s) [noise=true , address=77.90.31.18:4814 , piece_id=FY5HIMU3Y7QUJ24452HXIMCQLG5VELDEOS2NHCICLANDF74UXLDQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FCikLXgPYS2qM9zLTthSNHKsQNckzg9oNkKGxfvwJZZjhKkVf): protocol: expected piece hash; context canceled; EOF
Aug 23 11:01:38.273416537 (353h35m19.004684157s) [noise=true , address=79.127.201.214:4289 , piece_id=TCE5UN2PB7EFIN7SIV6ZEKCXDPRWSPEAEPSPQABOEWEIGWCM4R4A, seg_pos={0 0}, upload=367603]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YfeEiw7zKAYgUcMqMLgEiS2t1gMqdwrpuAdTb2dZouuXRBSM4): protocol: write tcp 5.161.89.252:33260->79.127.201.214:4289: use of closed network connection; write tcp 5.161.89.252:33260->79.127.201.214:4289: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:33260->79.127.201.214:4289: use of closed network connection
Aug 23 11:01:38.273454208 (353h35m19.004721838s) [noise=true , address=79.127.205.245:4220 , piece_id=6XZLJDUMRHOEQDBXSF7KBSVCJ2EYDLPSISDFRGG3KSWLFRX2YAYQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123xj8bTNShfvqNJh3mSvM6V4TeXQoxFHR5TKELoUKTJJTzDyjD): protocol: read tcp 5.161.89.252:22462->79.127.205.245:4220: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 23 11:01:38.273461833 (353h35m19.004729463s) [seg_pos={0 0}, upload=367603]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 11:01:38.273524681 (353h35m19.004792311s) [upload=367603]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 11:01:38.273528298 (353h35m19.004795918s) [upload=367603]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 11:01:39.364638553 (353h35m20.095906173s) [upload=367603]: Done uploading segments...
Aug 23 11:01:39.364652760 (353h35m20.09592039s) [upload=367603]: Upload finished. err: <nil>
Duration: 817.669443ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..............X...X.......X.................................] duration:
137.066445ms
FAIL (2025-08-23 11:14:40 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 10:48:33.463894757 (353h22m14.195162387s) [upload=367374]: Starting upload Aug 23 10:48:33.463962204 (353h22m14.195229834s) [upload=367374]: Done starting upload Aug 23 10:48:33.464008170 (353h22m14.195275791s) [upload=367374]: Uploading segments... Aug 23 10:48:33.464037165 (353h22m14.195304784s) [upload=367374]: Got next segment. Inline: true Aug 23 10:48:33.464040791 (353h22m14.195308412s) [upload=367374]: Waiting for error group managing segments... Aug 23 10:48:33.464071779 (353h22m14.1953394s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 10:48:33.464075707 (353h22m14.195343337s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 10:48:33.464078402 (353h22m14.195346032s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 10:48:33.470151547 (353h22m14.201419167s) [upload=367374]: Done uploading segments... Aug 23 10:48:33.470166876 (353h22m14.201434496s) [upload=367374]: Upload finished. err: metaclient: Too Many Requests
Duration: 137.097844ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...............X...X.......X................................] duration:
128.643285ms
FAIL (2025-08-23 11:13:53 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 10:48:33.463894757 (353h22m14.195162387s) [upload=367374]: Starting upload Aug 23 10:48:33.463962204 (353h22m14.195229834s) [upload=367374]: Done starting upload Aug 23 10:48:33.464008170 (353h22m14.195275791s) [upload=367374]: Uploading segments... Aug 23 10:48:33.464037165 (353h22m14.195304784s) [upload=367374]: Got next segment. Inline: true Aug 23 10:48:33.464040791 (353h22m14.195308412s) [upload=367374]: Waiting for error group managing segments... Aug 23 10:48:33.464071779 (353h22m14.1953394s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 10:48:33.464075707 (353h22m14.195343337s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 10:48:33.464078402 (353h22m14.195346032s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 10:48:33.470151547 (353h22m14.201419167s) [upload=367374]: Done uploading segments... Aug 23 10:48:33.470166876 (353h22m14.201434496s) [upload=367374]: Upload finished. err: metaclient: Too Many Requests
Duration: 128.665357ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........................................X...X..............] duration:
544.108944ms
FAIL (2025-08-23 11:13:46 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 28245251ac342c007ce1fdace53a54430147658e4c1a99d2532414b8de3a590b != before cc998e750b4b2c5f32e8fd1890a376ff1ac4cb4bb7438b3dc26e176b0e67f259
======LOGS======
Aug 23 11:01:38.064016662 (353h35m18.795284282s) [upload=367603]: Starting upload
Aug 23 11:01:38.064051468 (353h35m18.795319088s) [upload=367603]: Done starting upload
Aug 23 11:01:38.064089499 (353h35m18.795357129s) [upload=367603]: Uploading segments...
Aug 23 11:01:38.064223582 (353h35m18.795491191s) [upload=367603]: Got next segment. Inline: false
Aug 23 11:01:38.064244992 (353h35m18.795512612s) [upload=367603]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 11:01:38.064248029 (353h35m18.795515648s) [upload=367603]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 11:01:38.118468561 (353h35m18.84973617s) [seg_pos={0 0}, upload=367603]: Begin upload segment...
Aug 23 11:01:38.118511180 (353h35m18.849778801s) [seg_pos={0 0}, upload=367603]: Done begin upload segment.
Aug 23 11:01:38.118532641 (353h35m18.849800251s) [noise=true , address=79.127.201.214:4289 , piece_id=TCE5UN2PB7EFIN7SIV6ZEKCXDPRWSPEAEPSPQABOEWEIGWCM4R4A, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.118847505 (353h35m18.850115124s) [noise=true , address=77.90.31.13:4631 , piece_id=XT35U3ICBYMGBKG7AJPDO5K255QLX6HGKG5B6DFKMXAUPGIEGXPA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119057940 (353h35m18.85032556s) [noise=true , address=77.90.31.17:4780 , piece_id=74BLTPAJVDGN5CXZ2N7ZW73VVCH5PX5VXLVHTQLACVZHDQO354ZA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119248149 (353h35m18.850515769s) [noise=true , address=77.90.31.16:4768 , piece_id=NZJBUTVSFT5A6XL3HWUNCELFW2X46IME6IFM5X3HGW6NHTPUWSJA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119419431 (353h35m18.850687051s) [noise=true , address=77.90.31.10:4535 , piece_id=BHHU5RSTS7CXSMSJGSJT64KRSAMRKQMC2A6WKNX7UXLIDEQOHFCQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119729384 (353h35m18.850997005s) [noise=true , address=79.127.205.245:4220 , piece_id=6XZLJDUMRHOEQDBXSF7KBSVCJ2EYDLPSISDFRGG3KSWLFRX2YAYQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119979636 (353h35m18.851247246s) [noise=true , address=77.90.31.18:4814 , piece_id=FY5HIMU3Y7QUJ24452HXIMCQLG5VELDEOS2NHCICLANDF74UXLDQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120175233 (353h35m18.851442854s) [noise=true , address=77.90.31.12:4607 , piece_id=KCALRY56PWGBC6PPNULERFUVJDJXRQS4GPT47BTQQHM45LH4MSFQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120350535 (353h35m18.851618154s) [noise=true , address=45.91.116.14:4212 , piece_id=BTQCNNOMSETWVTURIAFQORWWB6UMKJWX4LHUZTOVDXXOF6N3WPSQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120550500 (353h35m18.85181812s) [noise=true , address=104.36.82.23:4477 , piece_id=GVPQSMCF2CKVMWJWDGT5SLWWYG4BFW7RPSTLGS7XFIDWVNYC36BA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120813255 (353h35m18.852080865s) [noise=true , address=45.91.116.12:4232 , piece_id=IPF7UNNBP6JYQ5NCVUNFBQOBEFSSUBCTIWURVVKO5PH7MYWQQGZQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120993995 (353h35m18.852261616s) [noise=true , address=79.127.219.47:4054 , piece_id=SHV6YO5TSXJKUIA6RNWI5LKJUCOJPHUDDXDJZJ7YUXTXTAWCOXDA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.121160568 (353h35m18.852428189s) [noise=true , address=45.91.116.6:4990 , piece_id=E4F7AALJ6BJCNIFXOUYWIVQAPQ5CKZ6S732IJYDFZQ2WRQJV2JCA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.121325740 (353h35m18.852593361s) [noise=true , address=77.90.31.11:4580 , piece_id=T3DGRGQTY7P5NOFO2GJHJPCUKKQ7DAOSCJUGGMICDEZBE6EFUXJQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.121498415 (353h35m18.852766035s) [noise=true , address=104.36.82.23:4468 , piece_id=QS5BTJH5SVGPPDE232B7WK7AWDXJJBJCH3YNO6ECT7UG6HASNQ6A, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.121897627 (353h35m18.853165247s) [noise=true , address=77.90.31.14:4688 , piece_id=ASVRBAD6VDUVEIHNQ5T3LZ2MRQ7RBNDXSXIXHMBQXO76XONYIUPQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.122085360 (353h35m18.85335298s) [noise=true , address=104.36.82.44:4899 , piece_id=6URUBNUUNT55E37EB24U3TAENAZ53UJIN6GUDR6IQ4D4S5RVNTEQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.122256282 (353h35m18.853523891s) [noise=true , address=104.36.82.8:4984 , piece_id=XMSGV473QN7BZZF6N73Y6Y5SJZHHSDTXR7U7BSP3JDB4I2JDAAYQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.202732788 (353h35m18.934000418s) [upload=367603]: Next returned nil segment
Aug 23 11:01:38.202743218 (353h35m18.934010848s) [upload=367603]: Waiting for error group managing segments...
Aug 23 11:01:38.211564696 (353h35m18.942832326s) [noise=true , address=79.127.219.47:4054 , piece_id=SHV6YO5TSXJKUIA6RNWI5LKJUCOJPHUDDXDJZJ7YUXTXTAWCOXDA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.212219099 (353h35m18.943486729s) [noise=true , address=45.91.116.14:4212 , piece_id=BTQCNNOMSETWVTURIAFQORWWB6UMKJWX4LHUZTOVDXXOF6N3WPSQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.212696007 (353h35m18.943963627s) [noise=true , address=45.91.116.12:4232 , piece_id=IPF7UNNBP6JYQ5NCVUNFBQOBEFSSUBCTIWURVVKO5PH7MYWQQGZQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.213187322 (353h35m18.944454952s) [noise=true , address=45.91.116.6:4990 , piece_id=E4F7AALJ6BJCNIFXOUYWIVQAPQ5CKZ6S732IJYDFZQ2WRQJV2JCA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.213614956 (353h35m18.944882586s) [noise=true , address=77.90.31.17:4780 , piece_id=74BLTPAJVDGN5CXZ2N7ZW73VVCH5PX5VXLVHTQLACVZHDQO354ZA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.214004220 (353h35m18.945271839s) [noise=true , address=77.90.31.13:4631 , piece_id=XT35U3ICBYMGBKG7AJPDO5K255QLX6HGKG5B6DFKMXAUPGIEGXPA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.215762329 (353h35m18.947029949s) [noise=true , address=104.36.82.44:4899 , piece_id=6URUBNUUNT55E37EB24U3TAENAZ53UJIN6GUDR6IQ4D4S5RVNTEQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.216257632 (353h35m18.947525262s) [noise=true , address=77.90.31.14:4688 , piece_id=ASVRBAD6VDUVEIHNQ5T3LZ2MRQ7RBNDXSXIXHMBQXO76XONYIUPQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.216649570 (353h35m18.9479172s) [noise=true , address=104.36.82.23:4468 , piece_id=QS5BTJH5SVGPPDE232B7WK7AWDXJJBJCH3YNO6ECT7UG6HASNQ6A, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.217893071 (353h35m18.949160691s) [noise=true , address=104.36.82.23:4477 , piece_id=GVPQSMCF2CKVMWJWDGT5SLWWYG4BFW7RPSTLGS7XFIDWVNYC36BA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.220804442 (353h35m18.952072072s) [noise=true , address=77.90.31.11:4580 , piece_id=T3DGRGQTY7P5NOFO2GJHJPCUKKQ7DAOSCJUGGMICDEZBE6EFUXJQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.225729044 (353h35m18.956996674s) [noise=true , address=77.90.31.10:4535 , piece_id=BHHU5RSTS7CXSMSJGSJT64KRSAMRKQMC2A6WKNX7UXLIDEQOHFCQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.234375222 (353h35m18.965642843s) [noise=true , address=77.90.31.16:4768 , piece_id=NZJBUTVSFT5A6XL3HWUNCELFW2X46IME6IFM5X3HGW6NHTPUWSJA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.273055598 (353h35m19.004323218s) [noise=true , address=104.36.82.8:4984 , piece_id=XMSGV473QN7BZZF6N73Y6Y5SJZHHSDTXR7U7BSP3JDB4I2JDAAYQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.273068242 (353h35m19.004335872s) [seg_pos={0 0}, upload=367603]: Segment reached optimal threshold of 14 pieces.
Aug 23 11:01:38.273150165 (353h35m19.004417795s) [noise=true , address=77.90.31.12:4607 , piece_id=KCALRY56PWGBC6PPNULERFUVJDJXRQS4GPT47BTQQHM45LH4MSFQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UYNy47GZEha8wG9vZNUAws5ogTBjSXLdt7T2bwqcHGsPrKFrm): protocol: expected piece hash; context canceled; EOF
Aug 23 11:01:38.273298695 (353h35m19.004566315s) [noise=true , address=77.90.31.18:4814 , piece_id=FY5HIMU3Y7QUJ24452HXIMCQLG5VELDEOS2NHCICLANDF74UXLDQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FCikLXgPYS2qM9zLTthSNHKsQNckzg9oNkKGxfvwJZZjhKkVf): protocol: expected piece hash; context canceled; EOF
Aug 23 11:01:38.273416537 (353h35m19.004684157s) [noise=true , address=79.127.201.214:4289 , piece_id=TCE5UN2PB7EFIN7SIV6ZEKCXDPRWSPEAEPSPQABOEWEIGWCM4R4A, seg_pos={0 0}, upload=367603]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YfeEiw7zKAYgUcMqMLgEiS2t1gMqdwrpuAdTb2dZouuXRBSM4): protocol: write tcp 5.161.89.252:33260->79.127.201.214:4289: use of closed network connection; write tcp 5.161.89.252:33260->79.127.201.214:4289: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:33260->79.127.201.214:4289: use of closed network connection
Aug 23 11:01:38.273454208 (353h35m19.004721838s) [noise=true , address=79.127.205.245:4220 , piece_id=6XZLJDUMRHOEQDBXSF7KBSVCJ2EYDLPSISDFRGG3KSWLFRX2YAYQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123xj8bTNShfvqNJh3mSvM6V4TeXQoxFHR5TKELoUKTJJTzDyjD): protocol: read tcp 5.161.89.252:22462->79.127.205.245:4220: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 23 11:01:38.273461833 (353h35m19.004729463s) [seg_pos={0 0}, upload=367603]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 11:01:38.273524681 (353h35m19.004792311s) [upload=367603]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 11:01:38.273528298 (353h35m19.004795918s) [upload=367603]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 11:01:39.364638553 (353h35m20.095906173s) [upload=367603]: Done uploading segments...
Aug 23 11:01:39.364652760 (353h35m20.09592039s) [upload=367603]: Upload finished. err: <nil>
Duration: 544.131296ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........................................X...X.............] duration:
1.511865592s
FAIL (2025-08-23 11:12:48 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 28245251ac342c007ce1fdace53a54430147658e4c1a99d2532414b8de3a590b != before cc998e750b4b2c5f32e8fd1890a376ff1ac4cb4bb7438b3dc26e176b0e67f259
======LOGS======
Aug 23 11:01:38.064016662 (353h35m18.795284282s) [upload=367603]: Starting upload
Aug 23 11:01:38.064051468 (353h35m18.795319088s) [upload=367603]: Done starting upload
Aug 23 11:01:38.064089499 (353h35m18.795357129s) [upload=367603]: Uploading segments...
Aug 23 11:01:38.064223582 (353h35m18.795491191s) [upload=367603]: Got next segment. Inline: false
Aug 23 11:01:38.064244992 (353h35m18.795512612s) [upload=367603]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 11:01:38.064248029 (353h35m18.795515648s) [upload=367603]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 11:01:38.118468561 (353h35m18.84973617s) [seg_pos={0 0}, upload=367603]: Begin upload segment...
Aug 23 11:01:38.118511180 (353h35m18.849778801s) [seg_pos={0 0}, upload=367603]: Done begin upload segment.
Aug 23 11:01:38.118532641 (353h35m18.849800251s) [noise=true , address=79.127.201.214:4289 , piece_id=TCE5UN2PB7EFIN7SIV6ZEKCXDPRWSPEAEPSPQABOEWEIGWCM4R4A, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.118847505 (353h35m18.850115124s) [noise=true , address=77.90.31.13:4631 , piece_id=XT35U3ICBYMGBKG7AJPDO5K255QLX6HGKG5B6DFKMXAUPGIEGXPA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119057940 (353h35m18.85032556s) [noise=true , address=77.90.31.17:4780 , piece_id=74BLTPAJVDGN5CXZ2N7ZW73VVCH5PX5VXLVHTQLACVZHDQO354ZA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119248149 (353h35m18.850515769s) [noise=true , address=77.90.31.16:4768 , piece_id=NZJBUTVSFT5A6XL3HWUNCELFW2X46IME6IFM5X3HGW6NHTPUWSJA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119419431 (353h35m18.850687051s) [noise=true , address=77.90.31.10:4535 , piece_id=BHHU5RSTS7CXSMSJGSJT64KRSAMRKQMC2A6WKNX7UXLIDEQOHFCQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119729384 (353h35m18.850997005s) [noise=true , address=79.127.205.245:4220 , piece_id=6XZLJDUMRHOEQDBXSF7KBSVCJ2EYDLPSISDFRGG3KSWLFRX2YAYQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119979636 (353h35m18.851247246s) [noise=true , address=77.90.31.18:4814 , piece_id=FY5HIMU3Y7QUJ24452HXIMCQLG5VELDEOS2NHCICLANDF74UXLDQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120175233 (353h35m18.851442854s) [noise=true , address=77.90.31.12:4607 , piece_id=KCALRY56PWGBC6PPNULERFUVJDJXRQS4GPT47BTQQHM45LH4MSFQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120350535 (353h35m18.851618154s) [noise=true , address=45.91.116.14:4212 , piece_id=BTQCNNOMSETWVTURIAFQORWWB6UMKJWX4LHUZTOVDXXOF6N3WPSQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120550500 (353h35m18.85181812s) [noise=true , address=104.36.82.23:4477 , piece_id=GVPQSMCF2CKVMWJWDGT5SLWWYG4BFW7RPSTLGS7XFIDWVNYC36BA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120813255 (353h35m18.852080865s) [noise=true , address=45.91.116.12:4232 , piece_id=IPF7UNNBP6JYQ5NCVUNFBQOBEFSSUBCTIWURVVKO5PH7MYWQQGZQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120993995 (353h35m18.852261616s) [noise=true , address=79.127.219.47:4054 , piece_id=SHV6YO5TSXJKUIA6RNWI5LKJUCOJPHUDDXDJZJ7YUXTXTAWCOXDA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.121160568 (353h35m18.852428189s) [noise=true , address=45.91.116.6:4990 , piece_id=E4F7AALJ6BJCNIFXOUYWIVQAPQ5CKZ6S732IJYDFZQ2WRQJV2JCA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.121325740 (353h35m18.852593361s) [noise=true , address=77.90.31.11:4580 , piece_id=T3DGRGQTY7P5NOFO2GJHJPCUKKQ7DAOSCJUGGMICDEZBE6EFUXJQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.121498415 (353h35m18.852766035s) [noise=true , address=104.36.82.23:4468 , piece_id=QS5BTJH5SVGPPDE232B7WK7AWDXJJBJCH3YNO6ECT7UG6HASNQ6A, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.121897627 (353h35m18.853165247s) [noise=true , address=77.90.31.14:4688 , piece_id=ASVRBAD6VDUVEIHNQ5T3LZ2MRQ7RBNDXSXIXHMBQXO76XONYIUPQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.122085360 (353h35m18.85335298s) [noise=true , address=104.36.82.44:4899 , piece_id=6URUBNUUNT55E37EB24U3TAENAZ53UJIN6GUDR6IQ4D4S5RVNTEQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.122256282 (353h35m18.853523891s) [noise=true , address=104.36.82.8:4984 , piece_id=XMSGV473QN7BZZF6N73Y6Y5SJZHHSDTXR7U7BSP3JDB4I2JDAAYQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.202732788 (353h35m18.934000418s) [upload=367603]: Next returned nil segment
Aug 23 11:01:38.202743218 (353h35m18.934010848s) [upload=367603]: Waiting for error group managing segments...
Aug 23 11:01:38.211564696 (353h35m18.942832326s) [noise=true , address=79.127.219.47:4054 , piece_id=SHV6YO5TSXJKUIA6RNWI5LKJUCOJPHUDDXDJZJ7YUXTXTAWCOXDA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.212219099 (353h35m18.943486729s) [noise=true , address=45.91.116.14:4212 , piece_id=BTQCNNOMSETWVTURIAFQORWWB6UMKJWX4LHUZTOVDXXOF6N3WPSQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.212696007 (353h35m18.943963627s) [noise=true , address=45.91.116.12:4232 , piece_id=IPF7UNNBP6JYQ5NCVUNFBQOBEFSSUBCTIWURVVKO5PH7MYWQQGZQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.213187322 (353h35m18.944454952s) [noise=true , address=45.91.116.6:4990 , piece_id=E4F7AALJ6BJCNIFXOUYWIVQAPQ5CKZ6S732IJYDFZQ2WRQJV2JCA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.213614956 (353h35m18.944882586s) [noise=true , address=77.90.31.17:4780 , piece_id=74BLTPAJVDGN5CXZ2N7ZW73VVCH5PX5VXLVHTQLACVZHDQO354ZA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.214004220 (353h35m18.945271839s) [noise=true , address=77.90.31.13:4631 , piece_id=XT35U3ICBYMGBKG7AJPDO5K255QLX6HGKG5B6DFKMXAUPGIEGXPA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.215762329 (353h35m18.947029949s) [noise=true , address=104.36.82.44:4899 , piece_id=6URUBNUUNT55E37EB24U3TAENAZ53UJIN6GUDR6IQ4D4S5RVNTEQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.216257632 (353h35m18.947525262s) [noise=true , address=77.90.31.14:4688 , piece_id=ASVRBAD6VDUVEIHNQ5T3LZ2MRQ7RBNDXSXIXHMBQXO76XONYIUPQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.216649570 (353h35m18.9479172s) [noise=true , address=104.36.82.23:4468 , piece_id=QS5BTJH5SVGPPDE232B7WK7AWDXJJBJCH3YNO6ECT7UG6HASNQ6A, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.217893071 (353h35m18.949160691s) [noise=true , address=104.36.82.23:4477 , piece_id=GVPQSMCF2CKVMWJWDGT5SLWWYG4BFW7RPSTLGS7XFIDWVNYC36BA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.220804442 (353h35m18.952072072s) [noise=true , address=77.90.31.11:4580 , piece_id=T3DGRGQTY7P5NOFO2GJHJPCUKKQ7DAOSCJUGGMICDEZBE6EFUXJQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.225729044 (353h35m18.956996674s) [noise=true , address=77.90.31.10:4535 , piece_id=BHHU5RSTS7CXSMSJGSJT64KRSAMRKQMC2A6WKNX7UXLIDEQOHFCQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.234375222 (353h35m18.965642843s) [noise=true , address=77.90.31.16:4768 , piece_id=NZJBUTVSFT5A6XL3HWUNCELFW2X46IME6IFM5X3HGW6NHTPUWSJA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.273055598 (353h35m19.004323218s) [noise=true , address=104.36.82.8:4984 , piece_id=XMSGV473QN7BZZF6N73Y6Y5SJZHHSDTXR7U7BSP3JDB4I2JDAAYQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.273068242 (353h35m19.004335872s) [seg_pos={0 0}, upload=367603]: Segment reached optimal threshold of 14 pieces.
Aug 23 11:01:38.273150165 (353h35m19.004417795s) [noise=true , address=77.90.31.12:4607 , piece_id=KCALRY56PWGBC6PPNULERFUVJDJXRQS4GPT47BTQQHM45LH4MSFQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UYNy47GZEha8wG9vZNUAws5ogTBjSXLdt7T2bwqcHGsPrKFrm): protocol: expected piece hash; context canceled; EOF
Aug 23 11:01:38.273298695 (353h35m19.004566315s) [noise=true , address=77.90.31.18:4814 , piece_id=FY5HIMU3Y7QUJ24452HXIMCQLG5VELDEOS2NHCICLANDF74UXLDQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FCikLXgPYS2qM9zLTthSNHKsQNckzg9oNkKGxfvwJZZjhKkVf): protocol: expected piece hash; context canceled; EOF
Aug 23 11:01:38.273416537 (353h35m19.004684157s) [noise=true , address=79.127.201.214:4289 , piece_id=TCE5UN2PB7EFIN7SIV6ZEKCXDPRWSPEAEPSPQABOEWEIGWCM4R4A, seg_pos={0 0}, upload=367603]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YfeEiw7zKAYgUcMqMLgEiS2t1gMqdwrpuAdTb2dZouuXRBSM4): protocol: write tcp 5.161.89.252:33260->79.127.201.214:4289: use of closed network connection; write tcp 5.161.89.252:33260->79.127.201.214:4289: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:33260->79.127.201.214:4289: use of closed network connection
Aug 23 11:01:38.273454208 (353h35m19.004721838s) [noise=true , address=79.127.205.245:4220 , piece_id=6XZLJDUMRHOEQDBXSF7KBSVCJ2EYDLPSISDFRGG3KSWLFRX2YAYQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123xj8bTNShfvqNJh3mSvM6V4TeXQoxFHR5TKELoUKTJJTzDyjD): protocol: read tcp 5.161.89.252:22462->79.127.205.245:4220: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 23 11:01:38.273461833 (353h35m19.004729463s) [seg_pos={0 0}, upload=367603]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 11:01:38.273524681 (353h35m19.004792311s) [upload=367603]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 11:01:38.273528298 (353h35m19.004795918s) [upload=367603]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 11:01:39.364638553 (353h35m20.095906173s) [upload=367603]: Done uploading segments...
Aug 23 11:01:39.364652760 (353h35m20.09592039s) [upload=367603]: Upload finished. err: <nil>
Duration: 1.51189081s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [................X...X.......X...............................] duration:
127.810106ms
FAIL (2025-08-23 11:12:40 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 10:48:33.463894757 (353h22m14.195162387s) [upload=367374]: Starting upload Aug 23 10:48:33.463962204 (353h22m14.195229834s) [upload=367374]: Done starting upload Aug 23 10:48:33.464008170 (353h22m14.195275791s) [upload=367374]: Uploading segments... Aug 23 10:48:33.464037165 (353h22m14.195304784s) [upload=367374]: Got next segment. Inline: true Aug 23 10:48:33.464040791 (353h22m14.195308412s) [upload=367374]: Waiting for error group managing segments... Aug 23 10:48:33.464071779 (353h22m14.1953394s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 10:48:33.464075707 (353h22m14.195343337s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 10:48:33.464078402 (353h22m14.195346032s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 10:48:33.470151547 (353h22m14.201419167s) [upload=367374]: Done uploading segments... Aug 23 10:48:33.470166876 (353h22m14.201434496s) [upload=367374]: Upload finished. err: metaclient: Too Many Requests
Duration: 127.830945ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.................X...X.......X..............................] duration:
153.966904ms
FAIL (2025-08-23 11:11:52 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 10:48:33.463894757 (353h22m14.195162387s) [upload=367374]: Starting upload Aug 23 10:48:33.463962204 (353h22m14.195229834s) [upload=367374]: Done starting upload Aug 23 10:48:33.464008170 (353h22m14.195275791s) [upload=367374]: Uploading segments... Aug 23 10:48:33.464037165 (353h22m14.195304784s) [upload=367374]: Got next segment. Inline: true Aug 23 10:48:33.464040791 (353h22m14.195308412s) [upload=367374]: Waiting for error group managing segments... Aug 23 10:48:33.464071779 (353h22m14.1953394s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 10:48:33.464075707 (353h22m14.195343337s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 10:48:33.464078402 (353h22m14.195346032s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 10:48:33.470151547 (353h22m14.201419167s) [upload=367374]: Done uploading segments... Aug 23 10:48:33.470166876 (353h22m14.201434496s) [upload=367374]: Upload finished. err: metaclient: Too Many Requests
Duration: 153.98608ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........................................X...X............] duration:
579.846468ms
FAIL (2025-08-23 11:11:41 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 28245251ac342c007ce1fdace53a54430147658e4c1a99d2532414b8de3a590b != before cc998e750b4b2c5f32e8fd1890a376ff1ac4cb4bb7438b3dc26e176b0e67f259
======LOGS======
Aug 23 11:01:38.064016662 (353h35m18.795284282s) [upload=367603]: Starting upload
Aug 23 11:01:38.064051468 (353h35m18.795319088s) [upload=367603]: Done starting upload
Aug 23 11:01:38.064089499 (353h35m18.795357129s) [upload=367603]: Uploading segments...
Aug 23 11:01:38.064223582 (353h35m18.795491191s) [upload=367603]: Got next segment. Inline: false
Aug 23 11:01:38.064244992 (353h35m18.795512612s) [upload=367603]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 11:01:38.064248029 (353h35m18.795515648s) [upload=367603]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 11:01:38.118468561 (353h35m18.84973617s) [seg_pos={0 0}, upload=367603]: Begin upload segment...
Aug 23 11:01:38.118511180 (353h35m18.849778801s) [seg_pos={0 0}, upload=367603]: Done begin upload segment.
Aug 23 11:01:38.118532641 (353h35m18.849800251s) [noise=true , address=79.127.201.214:4289 , piece_id=TCE5UN2PB7EFIN7SIV6ZEKCXDPRWSPEAEPSPQABOEWEIGWCM4R4A, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.118847505 (353h35m18.850115124s) [noise=true , address=77.90.31.13:4631 , piece_id=XT35U3ICBYMGBKG7AJPDO5K255QLX6HGKG5B6DFKMXAUPGIEGXPA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119057940 (353h35m18.85032556s) [noise=true , address=77.90.31.17:4780 , piece_id=74BLTPAJVDGN5CXZ2N7ZW73VVCH5PX5VXLVHTQLACVZHDQO354ZA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119248149 (353h35m18.850515769s) [noise=true , address=77.90.31.16:4768 , piece_id=NZJBUTVSFT5A6XL3HWUNCELFW2X46IME6IFM5X3HGW6NHTPUWSJA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119419431 (353h35m18.850687051s) [noise=true , address=77.90.31.10:4535 , piece_id=BHHU5RSTS7CXSMSJGSJT64KRSAMRKQMC2A6WKNX7UXLIDEQOHFCQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119729384 (353h35m18.850997005s) [noise=true , address=79.127.205.245:4220 , piece_id=6XZLJDUMRHOEQDBXSF7KBSVCJ2EYDLPSISDFRGG3KSWLFRX2YAYQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119979636 (353h35m18.851247246s) [noise=true , address=77.90.31.18:4814 , piece_id=FY5HIMU3Y7QUJ24452HXIMCQLG5VELDEOS2NHCICLANDF74UXLDQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120175233 (353h35m18.851442854s) [noise=true , address=77.90.31.12:4607 , piece_id=KCALRY56PWGBC6PPNULERFUVJDJXRQS4GPT47BTQQHM45LH4MSFQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120350535 (353h35m18.851618154s) [noise=true , address=45.91.116.14:4212 , piece_id=BTQCNNOMSETWVTURIAFQORWWB6UMKJWX4LHUZTOVDXXOF6N3WPSQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120550500 (353h35m18.85181812s) [noise=true , address=104.36.82.23:4477 , piece_id=GVPQSMCF2CKVMWJWDGT5SLWWYG4BFW7RPSTLGS7XFIDWVNYC36BA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120813255 (353h35m18.852080865s) [noise=true , address=45.91.116.12:4232 , piece_id=IPF7UNNBP6JYQ5NCVUNFBQOBEFSSUBCTIWURVVKO5PH7MYWQQGZQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120993995 (353h35m18.852261616s) [noise=true , address=79.127.219.47:4054 , piece_id=SHV6YO5TSXJKUIA6RNWI5LKJUCOJPHUDDXDJZJ7YUXTXTAWCOXDA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.121160568 (353h35m18.852428189s) [noise=true , address=45.91.116.6:4990 , piece_id=E4F7AALJ6BJCNIFXOUYWIVQAPQ5CKZ6S732IJYDFZQ2WRQJV2JCA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.121325740 (353h35m18.852593361s) [noise=true , address=77.90.31.11:4580 , piece_id=T3DGRGQTY7P5NOFO2GJHJPCUKKQ7DAOSCJUGGMICDEZBE6EFUXJQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.121498415 (353h35m18.852766035s) [noise=true , address=104.36.82.23:4468 , piece_id=QS5BTJH5SVGPPDE232B7WK7AWDXJJBJCH3YNO6ECT7UG6HASNQ6A, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.121897627 (353h35m18.853165247s) [noise=true , address=77.90.31.14:4688 , piece_id=ASVRBAD6VDUVEIHNQ5T3LZ2MRQ7RBNDXSXIXHMBQXO76XONYIUPQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.122085360 (353h35m18.85335298s) [noise=true , address=104.36.82.44:4899 , piece_id=6URUBNUUNT55E37EB24U3TAENAZ53UJIN6GUDR6IQ4D4S5RVNTEQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.122256282 (353h35m18.853523891s) [noise=true , address=104.36.82.8:4984 , piece_id=XMSGV473QN7BZZF6N73Y6Y5SJZHHSDTXR7U7BSP3JDB4I2JDAAYQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.202732788 (353h35m18.934000418s) [upload=367603]: Next returned nil segment
Aug 23 11:01:38.202743218 (353h35m18.934010848s) [upload=367603]: Waiting for error group managing segments...
Aug 23 11:01:38.211564696 (353h35m18.942832326s) [noise=true , address=79.127.219.47:4054 , piece_id=SHV6YO5TSXJKUIA6RNWI5LKJUCOJPHUDDXDJZJ7YUXTXTAWCOXDA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.212219099 (353h35m18.943486729s) [noise=true , address=45.91.116.14:4212 , piece_id=BTQCNNOMSETWVTURIAFQORWWB6UMKJWX4LHUZTOVDXXOF6N3WPSQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.212696007 (353h35m18.943963627s) [noise=true , address=45.91.116.12:4232 , piece_id=IPF7UNNBP6JYQ5NCVUNFBQOBEFSSUBCTIWURVVKO5PH7MYWQQGZQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.213187322 (353h35m18.944454952s) [noise=true , address=45.91.116.6:4990 , piece_id=E4F7AALJ6BJCNIFXOUYWIVQAPQ5CKZ6S732IJYDFZQ2WRQJV2JCA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.213614956 (353h35m18.944882586s) [noise=true , address=77.90.31.17:4780 , piece_id=74BLTPAJVDGN5CXZ2N7ZW73VVCH5PX5VXLVHTQLACVZHDQO354ZA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.214004220 (353h35m18.945271839s) [noise=true , address=77.90.31.13:4631 , piece_id=XT35U3ICBYMGBKG7AJPDO5K255QLX6HGKG5B6DFKMXAUPGIEGXPA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.215762329 (353h35m18.947029949s) [noise=true , address=104.36.82.44:4899 , piece_id=6URUBNUUNT55E37EB24U3TAENAZ53UJIN6GUDR6IQ4D4S5RVNTEQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.216257632 (353h35m18.947525262s) [noise=true , address=77.90.31.14:4688 , piece_id=ASVRBAD6VDUVEIHNQ5T3LZ2MRQ7RBNDXSXIXHMBQXO76XONYIUPQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.216649570 (353h35m18.9479172s) [noise=true , address=104.36.82.23:4468 , piece_id=QS5BTJH5SVGPPDE232B7WK7AWDXJJBJCH3YNO6ECT7UG6HASNQ6A, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.217893071 (353h35m18.949160691s) [noise=true , address=104.36.82.23:4477 , piece_id=GVPQSMCF2CKVMWJWDGT5SLWWYG4BFW7RPSTLGS7XFIDWVNYC36BA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.220804442 (353h35m18.952072072s) [noise=true , address=77.90.31.11:4580 , piece_id=T3DGRGQTY7P5NOFO2GJHJPCUKKQ7DAOSCJUGGMICDEZBE6EFUXJQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.225729044 (353h35m18.956996674s) [noise=true , address=77.90.31.10:4535 , piece_id=BHHU5RSTS7CXSMSJGSJT64KRSAMRKQMC2A6WKNX7UXLIDEQOHFCQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.234375222 (353h35m18.965642843s) [noise=true , address=77.90.31.16:4768 , piece_id=NZJBUTVSFT5A6XL3HWUNCELFW2X46IME6IFM5X3HGW6NHTPUWSJA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.273055598 (353h35m19.004323218s) [noise=true , address=104.36.82.8:4984 , piece_id=XMSGV473QN7BZZF6N73Y6Y5SJZHHSDTXR7U7BSP3JDB4I2JDAAYQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.273068242 (353h35m19.004335872s) [seg_pos={0 0}, upload=367603]: Segment reached optimal threshold of 14 pieces.
Aug 23 11:01:38.273150165 (353h35m19.004417795s) [noise=true , address=77.90.31.12:4607 , piece_id=KCALRY56PWGBC6PPNULERFUVJDJXRQS4GPT47BTQQHM45LH4MSFQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UYNy47GZEha8wG9vZNUAws5ogTBjSXLdt7T2bwqcHGsPrKFrm): protocol: expected piece hash; context canceled; EOF
Aug 23 11:01:38.273298695 (353h35m19.004566315s) [noise=true , address=77.90.31.18:4814 , piece_id=FY5HIMU3Y7QUJ24452HXIMCQLG5VELDEOS2NHCICLANDF74UXLDQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FCikLXgPYS2qM9zLTthSNHKsQNckzg9oNkKGxfvwJZZjhKkVf): protocol: expected piece hash; context canceled; EOF
Aug 23 11:01:38.273416537 (353h35m19.004684157s) [noise=true , address=79.127.201.214:4289 , piece_id=TCE5UN2PB7EFIN7SIV6ZEKCXDPRWSPEAEPSPQABOEWEIGWCM4R4A, seg_pos={0 0}, upload=367603]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YfeEiw7zKAYgUcMqMLgEiS2t1gMqdwrpuAdTb2dZouuXRBSM4): protocol: write tcp 5.161.89.252:33260->79.127.201.214:4289: use of closed network connection; write tcp 5.161.89.252:33260->79.127.201.214:4289: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:33260->79.127.201.214:4289: use of closed network connection
Aug 23 11:01:38.273454208 (353h35m19.004721838s) [noise=true , address=79.127.205.245:4220 , piece_id=6XZLJDUMRHOEQDBXSF7KBSVCJ2EYDLPSISDFRGG3KSWLFRX2YAYQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123xj8bTNShfvqNJh3mSvM6V4TeXQoxFHR5TKELoUKTJJTzDyjD): protocol: read tcp 5.161.89.252:22462->79.127.205.245:4220: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 23 11:01:38.273461833 (353h35m19.004729463s) [seg_pos={0 0}, upload=367603]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 11:01:38.273524681 (353h35m19.004792311s) [upload=367603]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 11:01:38.273528298 (353h35m19.004795918s) [upload=367603]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 11:01:39.364638553 (353h35m20.095906173s) [upload=367603]: Done uploading segments...
Aug 23 11:01:39.364652760 (353h35m20.09592039s) [upload=367603]: Upload finished. err: <nil>
Duration: 579.872036ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [............................................X...X...........] duration:
614.924043ms
FAIL (2025-08-23 11:10:49 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 28245251ac342c007ce1fdace53a54430147658e4c1a99d2532414b8de3a590b != before cc998e750b4b2c5f32e8fd1890a376ff1ac4cb4bb7438b3dc26e176b0e67f259
======LOGS======
Aug 23 11:01:38.064016662 (353h35m18.795284282s) [upload=367603]: Starting upload
Aug 23 11:01:38.064051468 (353h35m18.795319088s) [upload=367603]: Done starting upload
Aug 23 11:01:38.064089499 (353h35m18.795357129s) [upload=367603]: Uploading segments...
Aug 23 11:01:38.064223582 (353h35m18.795491191s) [upload=367603]: Got next segment. Inline: false
Aug 23 11:01:38.064244992 (353h35m18.795512612s) [upload=367603]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 11:01:38.064248029 (353h35m18.795515648s) [upload=367603]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 11:01:38.118468561 (353h35m18.84973617s) [seg_pos={0 0}, upload=367603]: Begin upload segment...
Aug 23 11:01:38.118511180 (353h35m18.849778801s) [seg_pos={0 0}, upload=367603]: Done begin upload segment.
Aug 23 11:01:38.118532641 (353h35m18.849800251s) [noise=true , address=79.127.201.214:4289 , piece_id=TCE5UN2PB7EFIN7SIV6ZEKCXDPRWSPEAEPSPQABOEWEIGWCM4R4A, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.118847505 (353h35m18.850115124s) [noise=true , address=77.90.31.13:4631 , piece_id=XT35U3ICBYMGBKG7AJPDO5K255QLX6HGKG5B6DFKMXAUPGIEGXPA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119057940 (353h35m18.85032556s) [noise=true , address=77.90.31.17:4780 , piece_id=74BLTPAJVDGN5CXZ2N7ZW73VVCH5PX5VXLVHTQLACVZHDQO354ZA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119248149 (353h35m18.850515769s) [noise=true , address=77.90.31.16:4768 , piece_id=NZJBUTVSFT5A6XL3HWUNCELFW2X46IME6IFM5X3HGW6NHTPUWSJA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119419431 (353h35m18.850687051s) [noise=true , address=77.90.31.10:4535 , piece_id=BHHU5RSTS7CXSMSJGSJT64KRSAMRKQMC2A6WKNX7UXLIDEQOHFCQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119729384 (353h35m18.850997005s) [noise=true , address=79.127.205.245:4220 , piece_id=6XZLJDUMRHOEQDBXSF7KBSVCJ2EYDLPSISDFRGG3KSWLFRX2YAYQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119979636 (353h35m18.851247246s) [noise=true , address=77.90.31.18:4814 , piece_id=FY5HIMU3Y7QUJ24452HXIMCQLG5VELDEOS2NHCICLANDF74UXLDQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120175233 (353h35m18.851442854s) [noise=true , address=77.90.31.12:4607 , piece_id=KCALRY56PWGBC6PPNULERFUVJDJXRQS4GPT47BTQQHM45LH4MSFQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120350535 (353h35m18.851618154s) [noise=true , address=45.91.116.14:4212 , piece_id=BTQCNNOMSETWVTURIAFQORWWB6UMKJWX4LHUZTOVDXXOF6N3WPSQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120550500 (353h35m18.85181812s) [noise=true , address=104.36.82.23:4477 , piece_id=GVPQSMCF2CKVMWJWDGT5SLWWYG4BFW7RPSTLGS7XFIDWVNYC36BA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120813255 (353h35m18.852080865s) [noise=true , address=45.91.116.12:4232 , piece_id=IPF7UNNBP6JYQ5NCVUNFBQOBEFSSUBCTIWURVVKO5PH7MYWQQGZQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120993995 (353h35m18.852261616s) [noise=true , address=79.127.219.47:4054 , piece_id=SHV6YO5TSXJKUIA6RNWI5LKJUCOJPHUDDXDJZJ7YUXTXTAWCOXDA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.121160568 (353h35m18.852428189s) [noise=true , address=45.91.116.6:4990 , piece_id=E4F7AALJ6BJCNIFXOUYWIVQAPQ5CKZ6S732IJYDFZQ2WRQJV2JCA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.121325740 (353h35m18.852593361s) [noise=true , address=77.90.31.11:4580 , piece_id=T3DGRGQTY7P5NOFO2GJHJPCUKKQ7DAOSCJUGGMICDEZBE6EFUXJQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.121498415 (353h35m18.852766035s) [noise=true , address=104.36.82.23:4468 , piece_id=QS5BTJH5SVGPPDE232B7WK7AWDXJJBJCH3YNO6ECT7UG6HASNQ6A, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.121897627 (353h35m18.853165247s) [noise=true , address=77.90.31.14:4688 , piece_id=ASVRBAD6VDUVEIHNQ5T3LZ2MRQ7RBNDXSXIXHMBQXO76XONYIUPQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.122085360 (353h35m18.85335298s) [noise=true , address=104.36.82.44:4899 , piece_id=6URUBNUUNT55E37EB24U3TAENAZ53UJIN6GUDR6IQ4D4S5RVNTEQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.122256282 (353h35m18.853523891s) [noise=true , address=104.36.82.8:4984 , piece_id=XMSGV473QN7BZZF6N73Y6Y5SJZHHSDTXR7U7BSP3JDB4I2JDAAYQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.202732788 (353h35m18.934000418s) [upload=367603]: Next returned nil segment
Aug 23 11:01:38.202743218 (353h35m18.934010848s) [upload=367603]: Waiting for error group managing segments...
Aug 23 11:01:38.211564696 (353h35m18.942832326s) [noise=true , address=79.127.219.47:4054 , piece_id=SHV6YO5TSXJKUIA6RNWI5LKJUCOJPHUDDXDJZJ7YUXTXTAWCOXDA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.212219099 (353h35m18.943486729s) [noise=true , address=45.91.116.14:4212 , piece_id=BTQCNNOMSETWVTURIAFQORWWB6UMKJWX4LHUZTOVDXXOF6N3WPSQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.212696007 (353h35m18.943963627s) [noise=true , address=45.91.116.12:4232 , piece_id=IPF7UNNBP6JYQ5NCVUNFBQOBEFSSUBCTIWURVVKO5PH7MYWQQGZQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.213187322 (353h35m18.944454952s) [noise=true , address=45.91.116.6:4990 , piece_id=E4F7AALJ6BJCNIFXOUYWIVQAPQ5CKZ6S732IJYDFZQ2WRQJV2JCA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.213614956 (353h35m18.944882586s) [noise=true , address=77.90.31.17:4780 , piece_id=74BLTPAJVDGN5CXZ2N7ZW73VVCH5PX5VXLVHTQLACVZHDQO354ZA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.214004220 (353h35m18.945271839s) [noise=true , address=77.90.31.13:4631 , piece_id=XT35U3ICBYMGBKG7AJPDO5K255QLX6HGKG5B6DFKMXAUPGIEGXPA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.215762329 (353h35m18.947029949s) [noise=true , address=104.36.82.44:4899 , piece_id=6URUBNUUNT55E37EB24U3TAENAZ53UJIN6GUDR6IQ4D4S5RVNTEQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.216257632 (353h35m18.947525262s) [noise=true , address=77.90.31.14:4688 , piece_id=ASVRBAD6VDUVEIHNQ5T3LZ2MRQ7RBNDXSXIXHMBQXO76XONYIUPQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.216649570 (353h35m18.9479172s) [noise=true , address=104.36.82.23:4468 , piece_id=QS5BTJH5SVGPPDE232B7WK7AWDXJJBJCH3YNO6ECT7UG6HASNQ6A, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.217893071 (353h35m18.949160691s) [noise=true , address=104.36.82.23:4477 , piece_id=GVPQSMCF2CKVMWJWDGT5SLWWYG4BFW7RPSTLGS7XFIDWVNYC36BA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.220804442 (353h35m18.952072072s) [noise=true , address=77.90.31.11:4580 , piece_id=T3DGRGQTY7P5NOFO2GJHJPCUKKQ7DAOSCJUGGMICDEZBE6EFUXJQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.225729044 (353h35m18.956996674s) [noise=true , address=77.90.31.10:4535 , piece_id=BHHU5RSTS7CXSMSJGSJT64KRSAMRKQMC2A6WKNX7UXLIDEQOHFCQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.234375222 (353h35m18.965642843s) [noise=true , address=77.90.31.16:4768 , piece_id=NZJBUTVSFT5A6XL3HWUNCELFW2X46IME6IFM5X3HGW6NHTPUWSJA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.273055598 (353h35m19.004323218s) [noise=true , address=104.36.82.8:4984 , piece_id=XMSGV473QN7BZZF6N73Y6Y5SJZHHSDTXR7U7BSP3JDB4I2JDAAYQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.273068242 (353h35m19.004335872s) [seg_pos={0 0}, upload=367603]: Segment reached optimal threshold of 14 pieces.
Aug 23 11:01:38.273150165 (353h35m19.004417795s) [noise=true , address=77.90.31.12:4607 , piece_id=KCALRY56PWGBC6PPNULERFUVJDJXRQS4GPT47BTQQHM45LH4MSFQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UYNy47GZEha8wG9vZNUAws5ogTBjSXLdt7T2bwqcHGsPrKFrm): protocol: expected piece hash; context canceled; EOF
Aug 23 11:01:38.273298695 (353h35m19.004566315s) [noise=true , address=77.90.31.18:4814 , piece_id=FY5HIMU3Y7QUJ24452HXIMCQLG5VELDEOS2NHCICLANDF74UXLDQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FCikLXgPYS2qM9zLTthSNHKsQNckzg9oNkKGxfvwJZZjhKkVf): protocol: expected piece hash; context canceled; EOF
Aug 23 11:01:38.273416537 (353h35m19.004684157s) [noise=true , address=79.127.201.214:4289 , piece_id=TCE5UN2PB7EFIN7SIV6ZEKCXDPRWSPEAEPSPQABOEWEIGWCM4R4A, seg_pos={0 0}, upload=367603]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YfeEiw7zKAYgUcMqMLgEiS2t1gMqdwrpuAdTb2dZouuXRBSM4): protocol: write tcp 5.161.89.252:33260->79.127.201.214:4289: use of closed network connection; write tcp 5.161.89.252:33260->79.127.201.214:4289: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:33260->79.127.201.214:4289: use of closed network connection
Aug 23 11:01:38.273454208 (353h35m19.004721838s) [noise=true , address=79.127.205.245:4220 , piece_id=6XZLJDUMRHOEQDBXSF7KBSVCJ2EYDLPSISDFRGG3KSWLFRX2YAYQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123xj8bTNShfvqNJh3mSvM6V4TeXQoxFHR5TKELoUKTJJTzDyjD): protocol: read tcp 5.161.89.252:22462->79.127.205.245:4220: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 23 11:01:38.273461833 (353h35m19.004729463s) [seg_pos={0 0}, upload=367603]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 11:01:38.273524681 (353h35m19.004792311s) [upload=367603]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 11:01:38.273528298 (353h35m19.004795918s) [upload=367603]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 11:01:39.364638553 (353h35m20.095906173s) [upload=367603]: Done uploading segments...
Aug 23 11:01:39.364652760 (353h35m20.09592039s) [upload=367603]: Upload finished. err: <nil>
Duration: 614.945834ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..................X...X.......X.............................] duration:
217.329737ms
FAIL (2025-08-23 11:10:49 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 10:48:33.463894757 (353h22m14.195162387s) [upload=367374]: Starting upload Aug 23 10:48:33.463962204 (353h22m14.195229834s) [upload=367374]: Done starting upload Aug 23 10:48:33.464008170 (353h22m14.195275791s) [upload=367374]: Uploading segments... Aug 23 10:48:33.464037165 (353h22m14.195304784s) [upload=367374]: Got next segment. Inline: true Aug 23 10:48:33.464040791 (353h22m14.195308412s) [upload=367374]: Waiting for error group managing segments... Aug 23 10:48:33.464071779 (353h22m14.1953394s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 10:48:33.464075707 (353h22m14.195343337s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 10:48:33.464078402 (353h22m14.195346032s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 10:48:33.470151547 (353h22m14.201419167s) [upload=367374]: Done uploading segments... Aug 23 10:48:33.470166876 (353h22m14.201434496s) [upload=367374]: Upload finished. err: metaclient: Too Many Requests
Duration: 217.351989ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............................................X...X..........] duration:
1.857566585s
FAIL (2025-08-23 11:10:34 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 28245251ac342c007ce1fdace53a54430147658e4c1a99d2532414b8de3a590b != before cc998e750b4b2c5f32e8fd1890a376ff1ac4cb4bb7438b3dc26e176b0e67f259
======LOGS======
Aug 23 11:01:38.064016662 (353h35m18.795284282s) [upload=367603]: Starting upload
Aug 23 11:01:38.064051468 (353h35m18.795319088s) [upload=367603]: Done starting upload
Aug 23 11:01:38.064089499 (353h35m18.795357129s) [upload=367603]: Uploading segments...
Aug 23 11:01:38.064223582 (353h35m18.795491191s) [upload=367603]: Got next segment. Inline: false
Aug 23 11:01:38.064244992 (353h35m18.795512612s) [upload=367603]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 11:01:38.064248029 (353h35m18.795515648s) [upload=367603]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 11:01:38.118468561 (353h35m18.84973617s) [seg_pos={0 0}, upload=367603]: Begin upload segment...
Aug 23 11:01:38.118511180 (353h35m18.849778801s) [seg_pos={0 0}, upload=367603]: Done begin upload segment.
Aug 23 11:01:38.118532641 (353h35m18.849800251s) [noise=true , address=79.127.201.214:4289 , piece_id=TCE5UN2PB7EFIN7SIV6ZEKCXDPRWSPEAEPSPQABOEWEIGWCM4R4A, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.118847505 (353h35m18.850115124s) [noise=true , address=77.90.31.13:4631 , piece_id=XT35U3ICBYMGBKG7AJPDO5K255QLX6HGKG5B6DFKMXAUPGIEGXPA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119057940 (353h35m18.85032556s) [noise=true , address=77.90.31.17:4780 , piece_id=74BLTPAJVDGN5CXZ2N7ZW73VVCH5PX5VXLVHTQLACVZHDQO354ZA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119248149 (353h35m18.850515769s) [noise=true , address=77.90.31.16:4768 , piece_id=NZJBUTVSFT5A6XL3HWUNCELFW2X46IME6IFM5X3HGW6NHTPUWSJA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119419431 (353h35m18.850687051s) [noise=true , address=77.90.31.10:4535 , piece_id=BHHU5RSTS7CXSMSJGSJT64KRSAMRKQMC2A6WKNX7UXLIDEQOHFCQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119729384 (353h35m18.850997005s) [noise=true , address=79.127.205.245:4220 , piece_id=6XZLJDUMRHOEQDBXSF7KBSVCJ2EYDLPSISDFRGG3KSWLFRX2YAYQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119979636 (353h35m18.851247246s) [noise=true , address=77.90.31.18:4814 , piece_id=FY5HIMU3Y7QUJ24452HXIMCQLG5VELDEOS2NHCICLANDF74UXLDQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120175233 (353h35m18.851442854s) [noise=true , address=77.90.31.12:4607 , piece_id=KCALRY56PWGBC6PPNULERFUVJDJXRQS4GPT47BTQQHM45LH4MSFQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120350535 (353h35m18.851618154s) [noise=true , address=45.91.116.14:4212 , piece_id=BTQCNNOMSETWVTURIAFQORWWB6UMKJWX4LHUZTOVDXXOF6N3WPSQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120550500 (353h35m18.85181812s) [noise=true , address=104.36.82.23:4477 , piece_id=GVPQSMCF2CKVMWJWDGT5SLWWYG4BFW7RPSTLGS7XFIDWVNYC36BA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120813255 (353h35m18.852080865s) [noise=true , address=45.91.116.12:4232 , piece_id=IPF7UNNBP6JYQ5NCVUNFBQOBEFSSUBCTIWURVVKO5PH7MYWQQGZQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120993995 (353h35m18.852261616s) [noise=true , address=79.127.219.47:4054 , piece_id=SHV6YO5TSXJKUIA6RNWI5LKJUCOJPHUDDXDJZJ7YUXTXTAWCOXDA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.121160568 (353h35m18.852428189s) [noise=true , address=45.91.116.6:4990 , piece_id=E4F7AALJ6BJCNIFXOUYWIVQAPQ5CKZ6S732IJYDFZQ2WRQJV2JCA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.121325740 (353h35m18.852593361s) [noise=true , address=77.90.31.11:4580 , piece_id=T3DGRGQTY7P5NOFO2GJHJPCUKKQ7DAOSCJUGGMICDEZBE6EFUXJQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.121498415 (353h35m18.852766035s) [noise=true , address=104.36.82.23:4468 , piece_id=QS5BTJH5SVGPPDE232B7WK7AWDXJJBJCH3YNO6ECT7UG6HASNQ6A, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.121897627 (353h35m18.853165247s) [noise=true , address=77.90.31.14:4688 , piece_id=ASVRBAD6VDUVEIHNQ5T3LZ2MRQ7RBNDXSXIXHMBQXO76XONYIUPQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.122085360 (353h35m18.85335298s) [noise=true , address=104.36.82.44:4899 , piece_id=6URUBNUUNT55E37EB24U3TAENAZ53UJIN6GUDR6IQ4D4S5RVNTEQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.122256282 (353h35m18.853523891s) [noise=true , address=104.36.82.8:4984 , piece_id=XMSGV473QN7BZZF6N73Y6Y5SJZHHSDTXR7U7BSP3JDB4I2JDAAYQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.202732788 (353h35m18.934000418s) [upload=367603]: Next returned nil segment
Aug 23 11:01:38.202743218 (353h35m18.934010848s) [upload=367603]: Waiting for error group managing segments...
Aug 23 11:01:38.211564696 (353h35m18.942832326s) [noise=true , address=79.127.219.47:4054 , piece_id=SHV6YO5TSXJKUIA6RNWI5LKJUCOJPHUDDXDJZJ7YUXTXTAWCOXDA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.212219099 (353h35m18.943486729s) [noise=true , address=45.91.116.14:4212 , piece_id=BTQCNNOMSETWVTURIAFQORWWB6UMKJWX4LHUZTOVDXXOF6N3WPSQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.212696007 (353h35m18.943963627s) [noise=true , address=45.91.116.12:4232 , piece_id=IPF7UNNBP6JYQ5NCVUNFBQOBEFSSUBCTIWURVVKO5PH7MYWQQGZQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.213187322 (353h35m18.944454952s) [noise=true , address=45.91.116.6:4990 , piece_id=E4F7AALJ6BJCNIFXOUYWIVQAPQ5CKZ6S732IJYDFZQ2WRQJV2JCA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.213614956 (353h35m18.944882586s) [noise=true , address=77.90.31.17:4780 , piece_id=74BLTPAJVDGN5CXZ2N7ZW73VVCH5PX5VXLVHTQLACVZHDQO354ZA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.214004220 (353h35m18.945271839s) [noise=true , address=77.90.31.13:4631 , piece_id=XT35U3ICBYMGBKG7AJPDO5K255QLX6HGKG5B6DFKMXAUPGIEGXPA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.215762329 (353h35m18.947029949s) [noise=true , address=104.36.82.44:4899 , piece_id=6URUBNUUNT55E37EB24U3TAENAZ53UJIN6GUDR6IQ4D4S5RVNTEQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.216257632 (353h35m18.947525262s) [noise=true , address=77.90.31.14:4688 , piece_id=ASVRBAD6VDUVEIHNQ5T3LZ2MRQ7RBNDXSXIXHMBQXO76XONYIUPQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.216649570 (353h35m18.9479172s) [noise=true , address=104.36.82.23:4468 , piece_id=QS5BTJH5SVGPPDE232B7WK7AWDXJJBJCH3YNO6ECT7UG6HASNQ6A, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.217893071 (353h35m18.949160691s) [noise=true , address=104.36.82.23:4477 , piece_id=GVPQSMCF2CKVMWJWDGT5SLWWYG4BFW7RPSTLGS7XFIDWVNYC36BA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.220804442 (353h35m18.952072072s) [noise=true , address=77.90.31.11:4580 , piece_id=T3DGRGQTY7P5NOFO2GJHJPCUKKQ7DAOSCJUGGMICDEZBE6EFUXJQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.225729044 (353h35m18.956996674s) [noise=true , address=77.90.31.10:4535 , piece_id=BHHU5RSTS7CXSMSJGSJT64KRSAMRKQMC2A6WKNX7UXLIDEQOHFCQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.234375222 (353h35m18.965642843s) [noise=true , address=77.90.31.16:4768 , piece_id=NZJBUTVSFT5A6XL3HWUNCELFW2X46IME6IFM5X3HGW6NHTPUWSJA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.273055598 (353h35m19.004323218s) [noise=true , address=104.36.82.8:4984 , piece_id=XMSGV473QN7BZZF6N73Y6Y5SJZHHSDTXR7U7BSP3JDB4I2JDAAYQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.273068242 (353h35m19.004335872s) [seg_pos={0 0}, upload=367603]: Segment reached optimal threshold of 14 pieces.
Aug 23 11:01:38.273150165 (353h35m19.004417795s) [noise=true , address=77.90.31.12:4607 , piece_id=KCALRY56PWGBC6PPNULERFUVJDJXRQS4GPT47BTQQHM45LH4MSFQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UYNy47GZEha8wG9vZNUAws5ogTBjSXLdt7T2bwqcHGsPrKFrm): protocol: expected piece hash; context canceled; EOF
Aug 23 11:01:38.273298695 (353h35m19.004566315s) [noise=true , address=77.90.31.18:4814 , piece_id=FY5HIMU3Y7QUJ24452HXIMCQLG5VELDEOS2NHCICLANDF74UXLDQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FCikLXgPYS2qM9zLTthSNHKsQNckzg9oNkKGxfvwJZZjhKkVf): protocol: expected piece hash; context canceled; EOF
Aug 23 11:01:38.273416537 (353h35m19.004684157s) [noise=true , address=79.127.201.214:4289 , piece_id=TCE5UN2PB7EFIN7SIV6ZEKCXDPRWSPEAEPSPQABOEWEIGWCM4R4A, seg_pos={0 0}, upload=367603]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YfeEiw7zKAYgUcMqMLgEiS2t1gMqdwrpuAdTb2dZouuXRBSM4): protocol: write tcp 5.161.89.252:33260->79.127.201.214:4289: use of closed network connection; write tcp 5.161.89.252:33260->79.127.201.214:4289: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:33260->79.127.201.214:4289: use of closed network connection
Aug 23 11:01:38.273454208 (353h35m19.004721838s) [noise=true , address=79.127.205.245:4220 , piece_id=6XZLJDUMRHOEQDBXSF7KBSVCJ2EYDLPSISDFRGG3KSWLFRX2YAYQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123xj8bTNShfvqNJh3mSvM6V4TeXQoxFHR5TKELoUKTJJTzDyjD): protocol: read tcp 5.161.89.252:22462->79.127.205.245:4220: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 23 11:01:38.273461833 (353h35m19.004729463s) [seg_pos={0 0}, upload=367603]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 11:01:38.273524681 (353h35m19.004792311s) [upload=367603]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 11:01:38.273528298 (353h35m19.004795918s) [upload=367603]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 11:01:39.364638553 (353h35m20.095906173s) [upload=367603]: Done uploading segments...
Aug 23 11:01:39.364652760 (353h35m20.09592039s) [upload=367603]: Upload finished. err: <nil>
Duration: 1.857590008s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...................X...X.......X............................] duration:
148.076575ms
FAIL (2025-08-23 11:09:39 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 10:48:33.463894757 (353h22m14.195162387s) [upload=367374]: Starting upload Aug 23 10:48:33.463962204 (353h22m14.195229834s) [upload=367374]: Done starting upload Aug 23 10:48:33.464008170 (353h22m14.195275791s) [upload=367374]: Uploading segments... Aug 23 10:48:33.464037165 (353h22m14.195304784s) [upload=367374]: Got next segment. Inline: true Aug 23 10:48:33.464040791 (353h22m14.195308412s) [upload=367374]: Waiting for error group managing segments... Aug 23 10:48:33.464071779 (353h22m14.1953394s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 10:48:33.464075707 (353h22m14.195343337s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 10:48:33.464078402 (353h22m14.195346032s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 10:48:33.470151547 (353h22m14.201419167s) [upload=367374]: Done uploading segments... Aug 23 10:48:33.470166876 (353h22m14.201434496s) [upload=367374]: Upload finished. err: metaclient: Too Many Requests
Duration: 148.097693ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............................................X...X.........] duration:
1.503834251s
FAIL (2025-08-23 11:09:33 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 28245251ac342c007ce1fdace53a54430147658e4c1a99d2532414b8de3a590b != before cc998e750b4b2c5f32e8fd1890a376ff1ac4cb4bb7438b3dc26e176b0e67f259
======LOGS======
Aug 23 11:01:38.064016662 (353h35m18.795284282s) [upload=367603]: Starting upload
Aug 23 11:01:38.064051468 (353h35m18.795319088s) [upload=367603]: Done starting upload
Aug 23 11:01:38.064089499 (353h35m18.795357129s) [upload=367603]: Uploading segments...
Aug 23 11:01:38.064223582 (353h35m18.795491191s) [upload=367603]: Got next segment. Inline: false
Aug 23 11:01:38.064244992 (353h35m18.795512612s) [upload=367603]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 11:01:38.064248029 (353h35m18.795515648s) [upload=367603]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 11:01:38.118468561 (353h35m18.84973617s) [seg_pos={0 0}, upload=367603]: Begin upload segment...
Aug 23 11:01:38.118511180 (353h35m18.849778801s) [seg_pos={0 0}, upload=367603]: Done begin upload segment.
Aug 23 11:01:38.118532641 (353h35m18.849800251s) [noise=true , address=79.127.201.214:4289 , piece_id=TCE5UN2PB7EFIN7SIV6ZEKCXDPRWSPEAEPSPQABOEWEIGWCM4R4A, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.118847505 (353h35m18.850115124s) [noise=true , address=77.90.31.13:4631 , piece_id=XT35U3ICBYMGBKG7AJPDO5K255QLX6HGKG5B6DFKMXAUPGIEGXPA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119057940 (353h35m18.85032556s) [noise=true , address=77.90.31.17:4780 , piece_id=74BLTPAJVDGN5CXZ2N7ZW73VVCH5PX5VXLVHTQLACVZHDQO354ZA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119248149 (353h35m18.850515769s) [noise=true , address=77.90.31.16:4768 , piece_id=NZJBUTVSFT5A6XL3HWUNCELFW2X46IME6IFM5X3HGW6NHTPUWSJA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119419431 (353h35m18.850687051s) [noise=true , address=77.90.31.10:4535 , piece_id=BHHU5RSTS7CXSMSJGSJT64KRSAMRKQMC2A6WKNX7UXLIDEQOHFCQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119729384 (353h35m18.850997005s) [noise=true , address=79.127.205.245:4220 , piece_id=6XZLJDUMRHOEQDBXSF7KBSVCJ2EYDLPSISDFRGG3KSWLFRX2YAYQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119979636 (353h35m18.851247246s) [noise=true , address=77.90.31.18:4814 , piece_id=FY5HIMU3Y7QUJ24452HXIMCQLG5VELDEOS2NHCICLANDF74UXLDQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120175233 (353h35m18.851442854s) [noise=true , address=77.90.31.12:4607 , piece_id=KCALRY56PWGBC6PPNULERFUVJDJXRQS4GPT47BTQQHM45LH4MSFQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120350535 (353h35m18.851618154s) [noise=true , address=45.91.116.14:4212 , piece_id=BTQCNNOMSETWVTURIAFQORWWB6UMKJWX4LHUZTOVDXXOF6N3WPSQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120550500 (353h35m18.85181812s) [noise=true , address=104.36.82.23:4477 , piece_id=GVPQSMCF2CKVMWJWDGT5SLWWYG4BFW7RPSTLGS7XFIDWVNYC36BA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120813255 (353h35m18.852080865s) [noise=true , address=45.91.116.12:4232 , piece_id=IPF7UNNBP6JYQ5NCVUNFBQOBEFSSUBCTIWURVVKO5PH7MYWQQGZQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120993995 (353h35m18.852261616s) [noise=true , address=79.127.219.47:4054 , piece_id=SHV6YO5TSXJKUIA6RNWI5LKJUCOJPHUDDXDJZJ7YUXTXTAWCOXDA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.121160568 (353h35m18.852428189s) [noise=true , address=45.91.116.6:4990 , piece_id=E4F7AALJ6BJCNIFXOUYWIVQAPQ5CKZ6S732IJYDFZQ2WRQJV2JCA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.121325740 (353h35m18.852593361s) [noise=true , address=77.90.31.11:4580 , piece_id=T3DGRGQTY7P5NOFO2GJHJPCUKKQ7DAOSCJUGGMICDEZBE6EFUXJQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.121498415 (353h35m18.852766035s) [noise=true , address=104.36.82.23:4468 , piece_id=QS5BTJH5SVGPPDE232B7WK7AWDXJJBJCH3YNO6ECT7UG6HASNQ6A, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.121897627 (353h35m18.853165247s) [noise=true , address=77.90.31.14:4688 , piece_id=ASVRBAD6VDUVEIHNQ5T3LZ2MRQ7RBNDXSXIXHMBQXO76XONYIUPQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.122085360 (353h35m18.85335298s) [noise=true , address=104.36.82.44:4899 , piece_id=6URUBNUUNT55E37EB24U3TAENAZ53UJIN6GUDR6IQ4D4S5RVNTEQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.122256282 (353h35m18.853523891s) [noise=true , address=104.36.82.8:4984 , piece_id=XMSGV473QN7BZZF6N73Y6Y5SJZHHSDTXR7U7BSP3JDB4I2JDAAYQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.202732788 (353h35m18.934000418s) [upload=367603]: Next returned nil segment
Aug 23 11:01:38.202743218 (353h35m18.934010848s) [upload=367603]: Waiting for error group managing segments...
Aug 23 11:01:38.211564696 (353h35m18.942832326s) [noise=true , address=79.127.219.47:4054 , piece_id=SHV6YO5TSXJKUIA6RNWI5LKJUCOJPHUDDXDJZJ7YUXTXTAWCOXDA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.212219099 (353h35m18.943486729s) [noise=true , address=45.91.116.14:4212 , piece_id=BTQCNNOMSETWVTURIAFQORWWB6UMKJWX4LHUZTOVDXXOF6N3WPSQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.212696007 (353h35m18.943963627s) [noise=true , address=45.91.116.12:4232 , piece_id=IPF7UNNBP6JYQ5NCVUNFBQOBEFSSUBCTIWURVVKO5PH7MYWQQGZQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.213187322 (353h35m18.944454952s) [noise=true , address=45.91.116.6:4990 , piece_id=E4F7AALJ6BJCNIFXOUYWIVQAPQ5CKZ6S732IJYDFZQ2WRQJV2JCA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.213614956 (353h35m18.944882586s) [noise=true , address=77.90.31.17:4780 , piece_id=74BLTPAJVDGN5CXZ2N7ZW73VVCH5PX5VXLVHTQLACVZHDQO354ZA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.214004220 (353h35m18.945271839s) [noise=true , address=77.90.31.13:4631 , piece_id=XT35U3ICBYMGBKG7AJPDO5K255QLX6HGKG5B6DFKMXAUPGIEGXPA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.215762329 (353h35m18.947029949s) [noise=true , address=104.36.82.44:4899 , piece_id=6URUBNUUNT55E37EB24U3TAENAZ53UJIN6GUDR6IQ4D4S5RVNTEQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.216257632 (353h35m18.947525262s) [noise=true , address=77.90.31.14:4688 , piece_id=ASVRBAD6VDUVEIHNQ5T3LZ2MRQ7RBNDXSXIXHMBQXO76XONYIUPQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.216649570 (353h35m18.9479172s) [noise=true , address=104.36.82.23:4468 , piece_id=QS5BTJH5SVGPPDE232B7WK7AWDXJJBJCH3YNO6ECT7UG6HASNQ6A, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.217893071 (353h35m18.949160691s) [noise=true , address=104.36.82.23:4477 , piece_id=GVPQSMCF2CKVMWJWDGT5SLWWYG4BFW7RPSTLGS7XFIDWVNYC36BA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.220804442 (353h35m18.952072072s) [noise=true , address=77.90.31.11:4580 , piece_id=T3DGRGQTY7P5NOFO2GJHJPCUKKQ7DAOSCJUGGMICDEZBE6EFUXJQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.225729044 (353h35m18.956996674s) [noise=true , address=77.90.31.10:4535 , piece_id=BHHU5RSTS7CXSMSJGSJT64KRSAMRKQMC2A6WKNX7UXLIDEQOHFCQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.234375222 (353h35m18.965642843s) [noise=true , address=77.90.31.16:4768 , piece_id=NZJBUTVSFT5A6XL3HWUNCELFW2X46IME6IFM5X3HGW6NHTPUWSJA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.273055598 (353h35m19.004323218s) [noise=true , address=104.36.82.8:4984 , piece_id=XMSGV473QN7BZZF6N73Y6Y5SJZHHSDTXR7U7BSP3JDB4I2JDAAYQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.273068242 (353h35m19.004335872s) [seg_pos={0 0}, upload=367603]: Segment reached optimal threshold of 14 pieces.
Aug 23 11:01:38.273150165 (353h35m19.004417795s) [noise=true , address=77.90.31.12:4607 , piece_id=KCALRY56PWGBC6PPNULERFUVJDJXRQS4GPT47BTQQHM45LH4MSFQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UYNy47GZEha8wG9vZNUAws5ogTBjSXLdt7T2bwqcHGsPrKFrm): protocol: expected piece hash; context canceled; EOF
Aug 23 11:01:38.273298695 (353h35m19.004566315s) [noise=true , address=77.90.31.18:4814 , piece_id=FY5HIMU3Y7QUJ24452HXIMCQLG5VELDEOS2NHCICLANDF74UXLDQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FCikLXgPYS2qM9zLTthSNHKsQNckzg9oNkKGxfvwJZZjhKkVf): protocol: expected piece hash; context canceled; EOF
Aug 23 11:01:38.273416537 (353h35m19.004684157s) [noise=true , address=79.127.201.214:4289 , piece_id=TCE5UN2PB7EFIN7SIV6ZEKCXDPRWSPEAEPSPQABOEWEIGWCM4R4A, seg_pos={0 0}, upload=367603]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YfeEiw7zKAYgUcMqMLgEiS2t1gMqdwrpuAdTb2dZouuXRBSM4): protocol: write tcp 5.161.89.252:33260->79.127.201.214:4289: use of closed network connection; write tcp 5.161.89.252:33260->79.127.201.214:4289: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:33260->79.127.201.214:4289: use of closed network connection
Aug 23 11:01:38.273454208 (353h35m19.004721838s) [noise=true , address=79.127.205.245:4220 , piece_id=6XZLJDUMRHOEQDBXSF7KBSVCJ2EYDLPSISDFRGG3KSWLFRX2YAYQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123xj8bTNShfvqNJh3mSvM6V4TeXQoxFHR5TKELoUKTJJTzDyjD): protocol: read tcp 5.161.89.252:22462->79.127.205.245:4220: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 23 11:01:38.273461833 (353h35m19.004729463s) [seg_pos={0 0}, upload=367603]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 11:01:38.273524681 (353h35m19.004792311s) [upload=367603]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 11:01:38.273528298 (353h35m19.004795918s) [upload=367603]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 11:01:39.364638553 (353h35m20.095906173s) [upload=367603]: Done uploading segments...
Aug 23 11:01:39.364652760 (353h35m20.09592039s) [upload=367603]: Upload finished. err: <nil>
Duration: 1.503859769s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....................X...X.......X...........................] duration:
193.650574ms
FAIL (2025-08-23 11:08:37 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 10:48:33.463894757 (353h22m14.195162387s) [upload=367374]: Starting upload Aug 23 10:48:33.463962204 (353h22m14.195229834s) [upload=367374]: Done starting upload Aug 23 10:48:33.464008170 (353h22m14.195275791s) [upload=367374]: Uploading segments... Aug 23 10:48:33.464037165 (353h22m14.195304784s) [upload=367374]: Got next segment. Inline: true Aug 23 10:48:33.464040791 (353h22m14.195308412s) [upload=367374]: Waiting for error group managing segments... Aug 23 10:48:33.464071779 (353h22m14.1953394s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 10:48:33.464075707 (353h22m14.195343337s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 10:48:33.464078402 (353h22m14.195346032s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 10:48:33.470151547 (353h22m14.201419167s) [upload=367374]: Done uploading segments... Aug 23 10:48:33.470166876 (353h22m14.201434496s) [upload=367374]: Upload finished. err: metaclient: Too Many Requests
Duration: 193.672885ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............................................X...X........] duration:
825.962154ms
FAIL (2025-08-23 11:08:19 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 28245251ac342c007ce1fdace53a54430147658e4c1a99d2532414b8de3a590b != before cc998e750b4b2c5f32e8fd1890a376ff1ac4cb4bb7438b3dc26e176b0e67f259
======LOGS======
Aug 23 11:01:38.064016662 (353h35m18.795284282s) [upload=367603]: Starting upload
Aug 23 11:01:38.064051468 (353h35m18.795319088s) [upload=367603]: Done starting upload
Aug 23 11:01:38.064089499 (353h35m18.795357129s) [upload=367603]: Uploading segments...
Aug 23 11:01:38.064223582 (353h35m18.795491191s) [upload=367603]: Got next segment. Inline: false
Aug 23 11:01:38.064244992 (353h35m18.795512612s) [upload=367603]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 11:01:38.064248029 (353h35m18.795515648s) [upload=367603]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 11:01:38.118468561 (353h35m18.84973617s) [seg_pos={0 0}, upload=367603]: Begin upload segment...
Aug 23 11:01:38.118511180 (353h35m18.849778801s) [seg_pos={0 0}, upload=367603]: Done begin upload segment.
Aug 23 11:01:38.118532641 (353h35m18.849800251s) [noise=true , address=79.127.201.214:4289 , piece_id=TCE5UN2PB7EFIN7SIV6ZEKCXDPRWSPEAEPSPQABOEWEIGWCM4R4A, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.118847505 (353h35m18.850115124s) [noise=true , address=77.90.31.13:4631 , piece_id=XT35U3ICBYMGBKG7AJPDO5K255QLX6HGKG5B6DFKMXAUPGIEGXPA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119057940 (353h35m18.85032556s) [noise=true , address=77.90.31.17:4780 , piece_id=74BLTPAJVDGN5CXZ2N7ZW73VVCH5PX5VXLVHTQLACVZHDQO354ZA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119248149 (353h35m18.850515769s) [noise=true , address=77.90.31.16:4768 , piece_id=NZJBUTVSFT5A6XL3HWUNCELFW2X46IME6IFM5X3HGW6NHTPUWSJA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119419431 (353h35m18.850687051s) [noise=true , address=77.90.31.10:4535 , piece_id=BHHU5RSTS7CXSMSJGSJT64KRSAMRKQMC2A6WKNX7UXLIDEQOHFCQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119729384 (353h35m18.850997005s) [noise=true , address=79.127.205.245:4220 , piece_id=6XZLJDUMRHOEQDBXSF7KBSVCJ2EYDLPSISDFRGG3KSWLFRX2YAYQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119979636 (353h35m18.851247246s) [noise=true , address=77.90.31.18:4814 , piece_id=FY5HIMU3Y7QUJ24452HXIMCQLG5VELDEOS2NHCICLANDF74UXLDQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120175233 (353h35m18.851442854s) [noise=true , address=77.90.31.12:4607 , piece_id=KCALRY56PWGBC6PPNULERFUVJDJXRQS4GPT47BTQQHM45LH4MSFQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120350535 (353h35m18.851618154s) [noise=true , address=45.91.116.14:4212 , piece_id=BTQCNNOMSETWVTURIAFQORWWB6UMKJWX4LHUZTOVDXXOF6N3WPSQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120550500 (353h35m18.85181812s) [noise=true , address=104.36.82.23:4477 , piece_id=GVPQSMCF2CKVMWJWDGT5SLWWYG4BFW7RPSTLGS7XFIDWVNYC36BA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120813255 (353h35m18.852080865s) [noise=true , address=45.91.116.12:4232 , piece_id=IPF7UNNBP6JYQ5NCVUNFBQOBEFSSUBCTIWURVVKO5PH7MYWQQGZQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120993995 (353h35m18.852261616s) [noise=true , address=79.127.219.47:4054 , piece_id=SHV6YO5TSXJKUIA6RNWI5LKJUCOJPHUDDXDJZJ7YUXTXTAWCOXDA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.121160568 (353h35m18.852428189s) [noise=true , address=45.91.116.6:4990 , piece_id=E4F7AALJ6BJCNIFXOUYWIVQAPQ5CKZ6S732IJYDFZQ2WRQJV2JCA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.121325740 (353h35m18.852593361s) [noise=true , address=77.90.31.11:4580 , piece_id=T3DGRGQTY7P5NOFO2GJHJPCUKKQ7DAOSCJUGGMICDEZBE6EFUXJQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.121498415 (353h35m18.852766035s) [noise=true , address=104.36.82.23:4468 , piece_id=QS5BTJH5SVGPPDE232B7WK7AWDXJJBJCH3YNO6ECT7UG6HASNQ6A, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.121897627 (353h35m18.853165247s) [noise=true , address=77.90.31.14:4688 , piece_id=ASVRBAD6VDUVEIHNQ5T3LZ2MRQ7RBNDXSXIXHMBQXO76XONYIUPQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.122085360 (353h35m18.85335298s) [noise=true , address=104.36.82.44:4899 , piece_id=6URUBNUUNT55E37EB24U3TAENAZ53UJIN6GUDR6IQ4D4S5RVNTEQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.122256282 (353h35m18.853523891s) [noise=true , address=104.36.82.8:4984 , piece_id=XMSGV473QN7BZZF6N73Y6Y5SJZHHSDTXR7U7BSP3JDB4I2JDAAYQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.202732788 (353h35m18.934000418s) [upload=367603]: Next returned nil segment
Aug 23 11:01:38.202743218 (353h35m18.934010848s) [upload=367603]: Waiting for error group managing segments...
Aug 23 11:01:38.211564696 (353h35m18.942832326s) [noise=true , address=79.127.219.47:4054 , piece_id=SHV6YO5TSXJKUIA6RNWI5LKJUCOJPHUDDXDJZJ7YUXTXTAWCOXDA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.212219099 (353h35m18.943486729s) [noise=true , address=45.91.116.14:4212 , piece_id=BTQCNNOMSETWVTURIAFQORWWB6UMKJWX4LHUZTOVDXXOF6N3WPSQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.212696007 (353h35m18.943963627s) [noise=true , address=45.91.116.12:4232 , piece_id=IPF7UNNBP6JYQ5NCVUNFBQOBEFSSUBCTIWURVVKO5PH7MYWQQGZQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.213187322 (353h35m18.944454952s) [noise=true , address=45.91.116.6:4990 , piece_id=E4F7AALJ6BJCNIFXOUYWIVQAPQ5CKZ6S732IJYDFZQ2WRQJV2JCA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.213614956 (353h35m18.944882586s) [noise=true , address=77.90.31.17:4780 , piece_id=74BLTPAJVDGN5CXZ2N7ZW73VVCH5PX5VXLVHTQLACVZHDQO354ZA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.214004220 (353h35m18.945271839s) [noise=true , address=77.90.31.13:4631 , piece_id=XT35U3ICBYMGBKG7AJPDO5K255QLX6HGKG5B6DFKMXAUPGIEGXPA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.215762329 (353h35m18.947029949s) [noise=true , address=104.36.82.44:4899 , piece_id=6URUBNUUNT55E37EB24U3TAENAZ53UJIN6GUDR6IQ4D4S5RVNTEQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.216257632 (353h35m18.947525262s) [noise=true , address=77.90.31.14:4688 , piece_id=ASVRBAD6VDUVEIHNQ5T3LZ2MRQ7RBNDXSXIXHMBQXO76XONYIUPQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.216649570 (353h35m18.9479172s) [noise=true , address=104.36.82.23:4468 , piece_id=QS5BTJH5SVGPPDE232B7WK7AWDXJJBJCH3YNO6ECT7UG6HASNQ6A, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.217893071 (353h35m18.949160691s) [noise=true , address=104.36.82.23:4477 , piece_id=GVPQSMCF2CKVMWJWDGT5SLWWYG4BFW7RPSTLGS7XFIDWVNYC36BA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.220804442 (353h35m18.952072072s) [noise=true , address=77.90.31.11:4580 , piece_id=T3DGRGQTY7P5NOFO2GJHJPCUKKQ7DAOSCJUGGMICDEZBE6EFUXJQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.225729044 (353h35m18.956996674s) [noise=true , address=77.90.31.10:4535 , piece_id=BHHU5RSTS7CXSMSJGSJT64KRSAMRKQMC2A6WKNX7UXLIDEQOHFCQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.234375222 (353h35m18.965642843s) [noise=true , address=77.90.31.16:4768 , piece_id=NZJBUTVSFT5A6XL3HWUNCELFW2X46IME6IFM5X3HGW6NHTPUWSJA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.273055598 (353h35m19.004323218s) [noise=true , address=104.36.82.8:4984 , piece_id=XMSGV473QN7BZZF6N73Y6Y5SJZHHSDTXR7U7BSP3JDB4I2JDAAYQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.273068242 (353h35m19.004335872s) [seg_pos={0 0}, upload=367603]: Segment reached optimal threshold of 14 pieces.
Aug 23 11:01:38.273150165 (353h35m19.004417795s) [noise=true , address=77.90.31.12:4607 , piece_id=KCALRY56PWGBC6PPNULERFUVJDJXRQS4GPT47BTQQHM45LH4MSFQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UYNy47GZEha8wG9vZNUAws5ogTBjSXLdt7T2bwqcHGsPrKFrm): protocol: expected piece hash; context canceled; EOF
Aug 23 11:01:38.273298695 (353h35m19.004566315s) [noise=true , address=77.90.31.18:4814 , piece_id=FY5HIMU3Y7QUJ24452HXIMCQLG5VELDEOS2NHCICLANDF74UXLDQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FCikLXgPYS2qM9zLTthSNHKsQNckzg9oNkKGxfvwJZZjhKkVf): protocol: expected piece hash; context canceled; EOF
Aug 23 11:01:38.273416537 (353h35m19.004684157s) [noise=true , address=79.127.201.214:4289 , piece_id=TCE5UN2PB7EFIN7SIV6ZEKCXDPRWSPEAEPSPQABOEWEIGWCM4R4A, seg_pos={0 0}, upload=367603]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YfeEiw7zKAYgUcMqMLgEiS2t1gMqdwrpuAdTb2dZouuXRBSM4): protocol: write tcp 5.161.89.252:33260->79.127.201.214:4289: use of closed network connection; write tcp 5.161.89.252:33260->79.127.201.214:4289: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:33260->79.127.201.214:4289: use of closed network connection
Aug 23 11:01:38.273454208 (353h35m19.004721838s) [noise=true , address=79.127.205.245:4220 , piece_id=6XZLJDUMRHOEQDBXSF7KBSVCJ2EYDLPSISDFRGG3KSWLFRX2YAYQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123xj8bTNShfvqNJh3mSvM6V4TeXQoxFHR5TKELoUKTJJTzDyjD): protocol: read tcp 5.161.89.252:22462->79.127.205.245:4220: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 23 11:01:38.273461833 (353h35m19.004729463s) [seg_pos={0 0}, upload=367603]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 11:01:38.273524681 (353h35m19.004792311s) [upload=367603]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 11:01:38.273528298 (353h35m19.004795918s) [upload=367603]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 11:01:39.364638553 (353h35m20.095906173s) [upload=367603]: Done uploading segments...
Aug 23 11:01:39.364652760 (353h35m20.09592039s) [upload=367603]: Upload finished. err: <nil>
Duration: 825.988594ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....................X...X.......X..........................] duration:
141.45677ms
FAIL (2025-08-23 11:07:45 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 10:48:33.463894757 (353h22m14.195162387s) [upload=367374]: Starting upload Aug 23 10:48:33.463962204 (353h22m14.195229834s) [upload=367374]: Done starting upload Aug 23 10:48:33.464008170 (353h22m14.195275791s) [upload=367374]: Uploading segments... Aug 23 10:48:33.464037165 (353h22m14.195304784s) [upload=367374]: Got next segment. Inline: true Aug 23 10:48:33.464040791 (353h22m14.195308412s) [upload=367374]: Waiting for error group managing segments... Aug 23 10:48:33.464071779 (353h22m14.1953394s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 10:48:33.464075707 (353h22m14.195343337s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 10:48:33.464078402 (353h22m14.195346032s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 10:48:33.470151547 (353h22m14.201419167s) [upload=367374]: Done uploading segments... Aug 23 10:48:33.470166876 (353h22m14.201434496s) [upload=367374]: Upload finished. err: metaclient: Too Many Requests
Duration: 141.494351ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [................................................X...X.......] duration:
372.555042ms
FAIL (2025-08-23 11:07:34 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 28245251ac342c007ce1fdace53a54430147658e4c1a99d2532414b8de3a590b != before cc998e750b4b2c5f32e8fd1890a376ff1ac4cb4bb7438b3dc26e176b0e67f259
======LOGS======
Aug 23 11:01:38.064016662 (353h35m18.795284282s) [upload=367603]: Starting upload
Aug 23 11:01:38.064051468 (353h35m18.795319088s) [upload=367603]: Done starting upload
Aug 23 11:01:38.064089499 (353h35m18.795357129s) [upload=367603]: Uploading segments...
Aug 23 11:01:38.064223582 (353h35m18.795491191s) [upload=367603]: Got next segment. Inline: false
Aug 23 11:01:38.064244992 (353h35m18.795512612s) [upload=367603]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 11:01:38.064248029 (353h35m18.795515648s) [upload=367603]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 11:01:38.118468561 (353h35m18.84973617s) [seg_pos={0 0}, upload=367603]: Begin upload segment...
Aug 23 11:01:38.118511180 (353h35m18.849778801s) [seg_pos={0 0}, upload=367603]: Done begin upload segment.
Aug 23 11:01:38.118532641 (353h35m18.849800251s) [noise=true , address=79.127.201.214:4289 , piece_id=TCE5UN2PB7EFIN7SIV6ZEKCXDPRWSPEAEPSPQABOEWEIGWCM4R4A, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.118847505 (353h35m18.850115124s) [noise=true , address=77.90.31.13:4631 , piece_id=XT35U3ICBYMGBKG7AJPDO5K255QLX6HGKG5B6DFKMXAUPGIEGXPA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119057940 (353h35m18.85032556s) [noise=true , address=77.90.31.17:4780 , piece_id=74BLTPAJVDGN5CXZ2N7ZW73VVCH5PX5VXLVHTQLACVZHDQO354ZA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119248149 (353h35m18.850515769s) [noise=true , address=77.90.31.16:4768 , piece_id=NZJBUTVSFT5A6XL3HWUNCELFW2X46IME6IFM5X3HGW6NHTPUWSJA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119419431 (353h35m18.850687051s) [noise=true , address=77.90.31.10:4535 , piece_id=BHHU5RSTS7CXSMSJGSJT64KRSAMRKQMC2A6WKNX7UXLIDEQOHFCQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119729384 (353h35m18.850997005s) [noise=true , address=79.127.205.245:4220 , piece_id=6XZLJDUMRHOEQDBXSF7KBSVCJ2EYDLPSISDFRGG3KSWLFRX2YAYQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119979636 (353h35m18.851247246s) [noise=true , address=77.90.31.18:4814 , piece_id=FY5HIMU3Y7QUJ24452HXIMCQLG5VELDEOS2NHCICLANDF74UXLDQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120175233 (353h35m18.851442854s) [noise=true , address=77.90.31.12:4607 , piece_id=KCALRY56PWGBC6PPNULERFUVJDJXRQS4GPT47BTQQHM45LH4MSFQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120350535 (353h35m18.851618154s) [noise=true , address=45.91.116.14:4212 , piece_id=BTQCNNOMSETWVTURIAFQORWWB6UMKJWX4LHUZTOVDXXOF6N3WPSQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120550500 (353h35m18.85181812s) [noise=true , address=104.36.82.23:4477 , piece_id=GVPQSMCF2CKVMWJWDGT5SLWWYG4BFW7RPSTLGS7XFIDWVNYC36BA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120813255 (353h35m18.852080865s) [noise=true , address=45.91.116.12:4232 , piece_id=IPF7UNNBP6JYQ5NCVUNFBQOBEFSSUBCTIWURVVKO5PH7MYWQQGZQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120993995 (353h35m18.852261616s) [noise=true , address=79.127.219.47:4054 , piece_id=SHV6YO5TSXJKUIA6RNWI5LKJUCOJPHUDDXDJZJ7YUXTXTAWCOXDA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.121160568 (353h35m18.852428189s) [noise=true , address=45.91.116.6:4990 , piece_id=E4F7AALJ6BJCNIFXOUYWIVQAPQ5CKZ6S732IJYDFZQ2WRQJV2JCA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.121325740 (353h35m18.852593361s) [noise=true , address=77.90.31.11:4580 , piece_id=T3DGRGQTY7P5NOFO2GJHJPCUKKQ7DAOSCJUGGMICDEZBE6EFUXJQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.121498415 (353h35m18.852766035s) [noise=true , address=104.36.82.23:4468 , piece_id=QS5BTJH5SVGPPDE232B7WK7AWDXJJBJCH3YNO6ECT7UG6HASNQ6A, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.121897627 (353h35m18.853165247s) [noise=true , address=77.90.31.14:4688 , piece_id=ASVRBAD6VDUVEIHNQ5T3LZ2MRQ7RBNDXSXIXHMBQXO76XONYIUPQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.122085360 (353h35m18.85335298s) [noise=true , address=104.36.82.44:4899 , piece_id=6URUBNUUNT55E37EB24U3TAENAZ53UJIN6GUDR6IQ4D4S5RVNTEQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.122256282 (353h35m18.853523891s) [noise=true , address=104.36.82.8:4984 , piece_id=XMSGV473QN7BZZF6N73Y6Y5SJZHHSDTXR7U7BSP3JDB4I2JDAAYQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.202732788 (353h35m18.934000418s) [upload=367603]: Next returned nil segment
Aug 23 11:01:38.202743218 (353h35m18.934010848s) [upload=367603]: Waiting for error group managing segments...
Aug 23 11:01:38.211564696 (353h35m18.942832326s) [noise=true , address=79.127.219.47:4054 , piece_id=SHV6YO5TSXJKUIA6RNWI5LKJUCOJPHUDDXDJZJ7YUXTXTAWCOXDA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.212219099 (353h35m18.943486729s) [noise=true , address=45.91.116.14:4212 , piece_id=BTQCNNOMSETWVTURIAFQORWWB6UMKJWX4LHUZTOVDXXOF6N3WPSQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.212696007 (353h35m18.943963627s) [noise=true , address=45.91.116.12:4232 , piece_id=IPF7UNNBP6JYQ5NCVUNFBQOBEFSSUBCTIWURVVKO5PH7MYWQQGZQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.213187322 (353h35m18.944454952s) [noise=true , address=45.91.116.6:4990 , piece_id=E4F7AALJ6BJCNIFXOUYWIVQAPQ5CKZ6S732IJYDFZQ2WRQJV2JCA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.213614956 (353h35m18.944882586s) [noise=true , address=77.90.31.17:4780 , piece_id=74BLTPAJVDGN5CXZ2N7ZW73VVCH5PX5VXLVHTQLACVZHDQO354ZA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.214004220 (353h35m18.945271839s) [noise=true , address=77.90.31.13:4631 , piece_id=XT35U3ICBYMGBKG7AJPDO5K255QLX6HGKG5B6DFKMXAUPGIEGXPA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.215762329 (353h35m18.947029949s) [noise=true , address=104.36.82.44:4899 , piece_id=6URUBNUUNT55E37EB24U3TAENAZ53UJIN6GUDR6IQ4D4S5RVNTEQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.216257632 (353h35m18.947525262s) [noise=true , address=77.90.31.14:4688 , piece_id=ASVRBAD6VDUVEIHNQ5T3LZ2MRQ7RBNDXSXIXHMBQXO76XONYIUPQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.216649570 (353h35m18.9479172s) [noise=true , address=104.36.82.23:4468 , piece_id=QS5BTJH5SVGPPDE232B7WK7AWDXJJBJCH3YNO6ECT7UG6HASNQ6A, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.217893071 (353h35m18.949160691s) [noise=true , address=104.36.82.23:4477 , piece_id=GVPQSMCF2CKVMWJWDGT5SLWWYG4BFW7RPSTLGS7XFIDWVNYC36BA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.220804442 (353h35m18.952072072s) [noise=true , address=77.90.31.11:4580 , piece_id=T3DGRGQTY7P5NOFO2GJHJPCUKKQ7DAOSCJUGGMICDEZBE6EFUXJQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.225729044 (353h35m18.956996674s) [noise=true , address=77.90.31.10:4535 , piece_id=BHHU5RSTS7CXSMSJGSJT64KRSAMRKQMC2A6WKNX7UXLIDEQOHFCQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.234375222 (353h35m18.965642843s) [noise=true , address=77.90.31.16:4768 , piece_id=NZJBUTVSFT5A6XL3HWUNCELFW2X46IME6IFM5X3HGW6NHTPUWSJA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.273055598 (353h35m19.004323218s) [noise=true , address=104.36.82.8:4984 , piece_id=XMSGV473QN7BZZF6N73Y6Y5SJZHHSDTXR7U7BSP3JDB4I2JDAAYQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.273068242 (353h35m19.004335872s) [seg_pos={0 0}, upload=367603]: Segment reached optimal threshold of 14 pieces.
Aug 23 11:01:38.273150165 (353h35m19.004417795s) [noise=true , address=77.90.31.12:4607 , piece_id=KCALRY56PWGBC6PPNULERFUVJDJXRQS4GPT47BTQQHM45LH4MSFQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UYNy47GZEha8wG9vZNUAws5ogTBjSXLdt7T2bwqcHGsPrKFrm): protocol: expected piece hash; context canceled; EOF
Aug 23 11:01:38.273298695 (353h35m19.004566315s) [noise=true , address=77.90.31.18:4814 , piece_id=FY5HIMU3Y7QUJ24452HXIMCQLG5VELDEOS2NHCICLANDF74UXLDQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FCikLXgPYS2qM9zLTthSNHKsQNckzg9oNkKGxfvwJZZjhKkVf): protocol: expected piece hash; context canceled; EOF
Aug 23 11:01:38.273416537 (353h35m19.004684157s) [noise=true , address=79.127.201.214:4289 , piece_id=TCE5UN2PB7EFIN7SIV6ZEKCXDPRWSPEAEPSPQABOEWEIGWCM4R4A, seg_pos={0 0}, upload=367603]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YfeEiw7zKAYgUcMqMLgEiS2t1gMqdwrpuAdTb2dZouuXRBSM4): protocol: write tcp 5.161.89.252:33260->79.127.201.214:4289: use of closed network connection; write tcp 5.161.89.252:33260->79.127.201.214:4289: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:33260->79.127.201.214:4289: use of closed network connection
Aug 23 11:01:38.273454208 (353h35m19.004721838s) [noise=true , address=79.127.205.245:4220 , piece_id=6XZLJDUMRHOEQDBXSF7KBSVCJ2EYDLPSISDFRGG3KSWLFRX2YAYQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123xj8bTNShfvqNJh3mSvM6V4TeXQoxFHR5TKELoUKTJJTzDyjD): protocol: read tcp 5.161.89.252:22462->79.127.205.245:4220: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 23 11:01:38.273461833 (353h35m19.004729463s) [seg_pos={0 0}, upload=367603]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 11:01:38.273524681 (353h35m19.004792311s) [upload=367603]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 11:01:38.273528298 (353h35m19.004795918s) [upload=367603]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 11:01:39.364638553 (353h35m20.095906173s) [upload=367603]: Done uploading segments...
Aug 23 11:01:39.364652760 (353h35m20.09592039s) [upload=367603]: Upload finished. err: <nil>
Duration: 372.5758ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.................................................X...X......] duration:
358.117869ms
FAIL (2025-08-23 11:07:01 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 28245251ac342c007ce1fdace53a54430147658e4c1a99d2532414b8de3a590b != before cc998e750b4b2c5f32e8fd1890a376ff1ac4cb4bb7438b3dc26e176b0e67f259
======LOGS======
Aug 23 11:01:38.064016662 (353h35m18.795284282s) [upload=367603]: Starting upload
Aug 23 11:01:38.064051468 (353h35m18.795319088s) [upload=367603]: Done starting upload
Aug 23 11:01:38.064089499 (353h35m18.795357129s) [upload=367603]: Uploading segments...
Aug 23 11:01:38.064223582 (353h35m18.795491191s) [upload=367603]: Got next segment. Inline: false
Aug 23 11:01:38.064244992 (353h35m18.795512612s) [upload=367603]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 11:01:38.064248029 (353h35m18.795515648s) [upload=367603]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 11:01:38.118468561 (353h35m18.84973617s) [seg_pos={0 0}, upload=367603]: Begin upload segment...
Aug 23 11:01:38.118511180 (353h35m18.849778801s) [seg_pos={0 0}, upload=367603]: Done begin upload segment.
Aug 23 11:01:38.118532641 (353h35m18.849800251s) [noise=true , address=79.127.201.214:4289 , piece_id=TCE5UN2PB7EFIN7SIV6ZEKCXDPRWSPEAEPSPQABOEWEIGWCM4R4A, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.118847505 (353h35m18.850115124s) [noise=true , address=77.90.31.13:4631 , piece_id=XT35U3ICBYMGBKG7AJPDO5K255QLX6HGKG5B6DFKMXAUPGIEGXPA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119057940 (353h35m18.85032556s) [noise=true , address=77.90.31.17:4780 , piece_id=74BLTPAJVDGN5CXZ2N7ZW73VVCH5PX5VXLVHTQLACVZHDQO354ZA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119248149 (353h35m18.850515769s) [noise=true , address=77.90.31.16:4768 , piece_id=NZJBUTVSFT5A6XL3HWUNCELFW2X46IME6IFM5X3HGW6NHTPUWSJA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119419431 (353h35m18.850687051s) [noise=true , address=77.90.31.10:4535 , piece_id=BHHU5RSTS7CXSMSJGSJT64KRSAMRKQMC2A6WKNX7UXLIDEQOHFCQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119729384 (353h35m18.850997005s) [noise=true , address=79.127.205.245:4220 , piece_id=6XZLJDUMRHOEQDBXSF7KBSVCJ2EYDLPSISDFRGG3KSWLFRX2YAYQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119979636 (353h35m18.851247246s) [noise=true , address=77.90.31.18:4814 , piece_id=FY5HIMU3Y7QUJ24452HXIMCQLG5VELDEOS2NHCICLANDF74UXLDQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120175233 (353h35m18.851442854s) [noise=true , address=77.90.31.12:4607 , piece_id=KCALRY56PWGBC6PPNULERFUVJDJXRQS4GPT47BTQQHM45LH4MSFQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120350535 (353h35m18.851618154s) [noise=true , address=45.91.116.14:4212 , piece_id=BTQCNNOMSETWVTURIAFQORWWB6UMKJWX4LHUZTOVDXXOF6N3WPSQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120550500 (353h35m18.85181812s) [noise=true , address=104.36.82.23:4477 , piece_id=GVPQSMCF2CKVMWJWDGT5SLWWYG4BFW7RPSTLGS7XFIDWVNYC36BA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120813255 (353h35m18.852080865s) [noise=true , address=45.91.116.12:4232 , piece_id=IPF7UNNBP6JYQ5NCVUNFBQOBEFSSUBCTIWURVVKO5PH7MYWQQGZQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120993995 (353h35m18.852261616s) [noise=true , address=79.127.219.47:4054 , piece_id=SHV6YO5TSXJKUIA6RNWI5LKJUCOJPHUDDXDJZJ7YUXTXTAWCOXDA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.121160568 (353h35m18.852428189s) [noise=true , address=45.91.116.6:4990 , piece_id=E4F7AALJ6BJCNIFXOUYWIVQAPQ5CKZ6S732IJYDFZQ2WRQJV2JCA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.121325740 (353h35m18.852593361s) [noise=true , address=77.90.31.11:4580 , piece_id=T3DGRGQTY7P5NOFO2GJHJPCUKKQ7DAOSCJUGGMICDEZBE6EFUXJQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.121498415 (353h35m18.852766035s) [noise=true , address=104.36.82.23:4468 , piece_id=QS5BTJH5SVGPPDE232B7WK7AWDXJJBJCH3YNO6ECT7UG6HASNQ6A, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.121897627 (353h35m18.853165247s) [noise=true , address=77.90.31.14:4688 , piece_id=ASVRBAD6VDUVEIHNQ5T3LZ2MRQ7RBNDXSXIXHMBQXO76XONYIUPQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.122085360 (353h35m18.85335298s) [noise=true , address=104.36.82.44:4899 , piece_id=6URUBNUUNT55E37EB24U3TAENAZ53UJIN6GUDR6IQ4D4S5RVNTEQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.122256282 (353h35m18.853523891s) [noise=true , address=104.36.82.8:4984 , piece_id=XMSGV473QN7BZZF6N73Y6Y5SJZHHSDTXR7U7BSP3JDB4I2JDAAYQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.202732788 (353h35m18.934000418s) [upload=367603]: Next returned nil segment
Aug 23 11:01:38.202743218 (353h35m18.934010848s) [upload=367603]: Waiting for error group managing segments...
Aug 23 11:01:38.211564696 (353h35m18.942832326s) [noise=true , address=79.127.219.47:4054 , piece_id=SHV6YO5TSXJKUIA6RNWI5LKJUCOJPHUDDXDJZJ7YUXTXTAWCOXDA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.212219099 (353h35m18.943486729s) [noise=true , address=45.91.116.14:4212 , piece_id=BTQCNNOMSETWVTURIAFQORWWB6UMKJWX4LHUZTOVDXXOF6N3WPSQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.212696007 (353h35m18.943963627s) [noise=true , address=45.91.116.12:4232 , piece_id=IPF7UNNBP6JYQ5NCVUNFBQOBEFSSUBCTIWURVVKO5PH7MYWQQGZQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.213187322 (353h35m18.944454952s) [noise=true , address=45.91.116.6:4990 , piece_id=E4F7AALJ6BJCNIFXOUYWIVQAPQ5CKZ6S732IJYDFZQ2WRQJV2JCA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.213614956 (353h35m18.944882586s) [noise=true , address=77.90.31.17:4780 , piece_id=74BLTPAJVDGN5CXZ2N7ZW73VVCH5PX5VXLVHTQLACVZHDQO354ZA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.214004220 (353h35m18.945271839s) [noise=true , address=77.90.31.13:4631 , piece_id=XT35U3ICBYMGBKG7AJPDO5K255QLX6HGKG5B6DFKMXAUPGIEGXPA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.215762329 (353h35m18.947029949s) [noise=true , address=104.36.82.44:4899 , piece_id=6URUBNUUNT55E37EB24U3TAENAZ53UJIN6GUDR6IQ4D4S5RVNTEQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.216257632 (353h35m18.947525262s) [noise=true , address=77.90.31.14:4688 , piece_id=ASVRBAD6VDUVEIHNQ5T3LZ2MRQ7RBNDXSXIXHMBQXO76XONYIUPQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.216649570 (353h35m18.9479172s) [noise=true , address=104.36.82.23:4468 , piece_id=QS5BTJH5SVGPPDE232B7WK7AWDXJJBJCH3YNO6ECT7UG6HASNQ6A, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.217893071 (353h35m18.949160691s) [noise=true , address=104.36.82.23:4477 , piece_id=GVPQSMCF2CKVMWJWDGT5SLWWYG4BFW7RPSTLGS7XFIDWVNYC36BA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.220804442 (353h35m18.952072072s) [noise=true , address=77.90.31.11:4580 , piece_id=T3DGRGQTY7P5NOFO2GJHJPCUKKQ7DAOSCJUGGMICDEZBE6EFUXJQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.225729044 (353h35m18.956996674s) [noise=true , address=77.90.31.10:4535 , piece_id=BHHU5RSTS7CXSMSJGSJT64KRSAMRKQMC2A6WKNX7UXLIDEQOHFCQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.234375222 (353h35m18.965642843s) [noise=true , address=77.90.31.16:4768 , piece_id=NZJBUTVSFT5A6XL3HWUNCELFW2X46IME6IFM5X3HGW6NHTPUWSJA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.273055598 (353h35m19.004323218s) [noise=true , address=104.36.82.8:4984 , piece_id=XMSGV473QN7BZZF6N73Y6Y5SJZHHSDTXR7U7BSP3JDB4I2JDAAYQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.273068242 (353h35m19.004335872s) [seg_pos={0 0}, upload=367603]: Segment reached optimal threshold of 14 pieces.
Aug 23 11:01:38.273150165 (353h35m19.004417795s) [noise=true , address=77.90.31.12:4607 , piece_id=KCALRY56PWGBC6PPNULERFUVJDJXRQS4GPT47BTQQHM45LH4MSFQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UYNy47GZEha8wG9vZNUAws5ogTBjSXLdt7T2bwqcHGsPrKFrm): protocol: expected piece hash; context canceled; EOF
Aug 23 11:01:38.273298695 (353h35m19.004566315s) [noise=true , address=77.90.31.18:4814 , piece_id=FY5HIMU3Y7QUJ24452HXIMCQLG5VELDEOS2NHCICLANDF74UXLDQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FCikLXgPYS2qM9zLTthSNHKsQNckzg9oNkKGxfvwJZZjhKkVf): protocol: expected piece hash; context canceled; EOF
Aug 23 11:01:38.273416537 (353h35m19.004684157s) [noise=true , address=79.127.201.214:4289 , piece_id=TCE5UN2PB7EFIN7SIV6ZEKCXDPRWSPEAEPSPQABOEWEIGWCM4R4A, seg_pos={0 0}, upload=367603]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YfeEiw7zKAYgUcMqMLgEiS2t1gMqdwrpuAdTb2dZouuXRBSM4): protocol: write tcp 5.161.89.252:33260->79.127.201.214:4289: use of closed network connection; write tcp 5.161.89.252:33260->79.127.201.214:4289: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:33260->79.127.201.214:4289: use of closed network connection
Aug 23 11:01:38.273454208 (353h35m19.004721838s) [noise=true , address=79.127.205.245:4220 , piece_id=6XZLJDUMRHOEQDBXSF7KBSVCJ2EYDLPSISDFRGG3KSWLFRX2YAYQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123xj8bTNShfvqNJh3mSvM6V4TeXQoxFHR5TKELoUKTJJTzDyjD): protocol: read tcp 5.161.89.252:22462->79.127.205.245:4220: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 23 11:01:38.273461833 (353h35m19.004729463s) [seg_pos={0 0}, upload=367603]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 11:01:38.273524681 (353h35m19.004792311s) [upload=367603]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 11:01:38.273528298 (353h35m19.004795918s) [upload=367603]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 11:01:39.364638553 (353h35m20.095906173s) [upload=367603]: Done uploading segments...
Aug 23 11:01:39.364652760 (353h35m20.09592039s) [upload=367603]: Upload finished. err: <nil>
Duration: 358.148105ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [......................X...X.......X.........................] duration:
343.207593ms
FAIL (2025-08-23 11:06:48 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 10:48:33.463894757 (353h22m14.195162387s) [upload=367374]: Starting upload Aug 23 10:48:33.463962204 (353h22m14.195229834s) [upload=367374]: Done starting upload Aug 23 10:48:33.464008170 (353h22m14.195275791s) [upload=367374]: Uploading segments... Aug 23 10:48:33.464037165 (353h22m14.195304784s) [upload=367374]: Got next segment. Inline: true Aug 23 10:48:33.464040791 (353h22m14.195308412s) [upload=367374]: Waiting for error group managing segments... Aug 23 10:48:33.464071779 (353h22m14.1953394s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 10:48:33.464075707 (353h22m14.195343337s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 10:48:33.464078402 (353h22m14.195346032s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 10:48:33.470151547 (353h22m14.201419167s) [upload=367374]: Done uploading segments... Aug 23 10:48:33.470166876 (353h22m14.201434496s) [upload=367374]: Upload finished. err: metaclient: Too Many Requests
Duration: 343.224325ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................................................X...X.....] duration:
1.390232026s
FAIL (2025-08-23 11:06:15 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 28245251ac342c007ce1fdace53a54430147658e4c1a99d2532414b8de3a590b != before cc998e750b4b2c5f32e8fd1890a376ff1ac4cb4bb7438b3dc26e176b0e67f259
======LOGS======
Aug 23 11:01:38.064016662 (353h35m18.795284282s) [upload=367603]: Starting upload
Aug 23 11:01:38.064051468 (353h35m18.795319088s) [upload=367603]: Done starting upload
Aug 23 11:01:38.064089499 (353h35m18.795357129s) [upload=367603]: Uploading segments...
Aug 23 11:01:38.064223582 (353h35m18.795491191s) [upload=367603]: Got next segment. Inline: false
Aug 23 11:01:38.064244992 (353h35m18.795512612s) [upload=367603]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 11:01:38.064248029 (353h35m18.795515648s) [upload=367603]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 11:01:38.118468561 (353h35m18.84973617s) [seg_pos={0 0}, upload=367603]: Begin upload segment...
Aug 23 11:01:38.118511180 (353h35m18.849778801s) [seg_pos={0 0}, upload=367603]: Done begin upload segment.
Aug 23 11:01:38.118532641 (353h35m18.849800251s) [noise=true , address=79.127.201.214:4289 , piece_id=TCE5UN2PB7EFIN7SIV6ZEKCXDPRWSPEAEPSPQABOEWEIGWCM4R4A, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.118847505 (353h35m18.850115124s) [noise=true , address=77.90.31.13:4631 , piece_id=XT35U3ICBYMGBKG7AJPDO5K255QLX6HGKG5B6DFKMXAUPGIEGXPA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119057940 (353h35m18.85032556s) [noise=true , address=77.90.31.17:4780 , piece_id=74BLTPAJVDGN5CXZ2N7ZW73VVCH5PX5VXLVHTQLACVZHDQO354ZA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119248149 (353h35m18.850515769s) [noise=true , address=77.90.31.16:4768 , piece_id=NZJBUTVSFT5A6XL3HWUNCELFW2X46IME6IFM5X3HGW6NHTPUWSJA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119419431 (353h35m18.850687051s) [noise=true , address=77.90.31.10:4535 , piece_id=BHHU5RSTS7CXSMSJGSJT64KRSAMRKQMC2A6WKNX7UXLIDEQOHFCQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119729384 (353h35m18.850997005s) [noise=true , address=79.127.205.245:4220 , piece_id=6XZLJDUMRHOEQDBXSF7KBSVCJ2EYDLPSISDFRGG3KSWLFRX2YAYQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119979636 (353h35m18.851247246s) [noise=true , address=77.90.31.18:4814 , piece_id=FY5HIMU3Y7QUJ24452HXIMCQLG5VELDEOS2NHCICLANDF74UXLDQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120175233 (353h35m18.851442854s) [noise=true , address=77.90.31.12:4607 , piece_id=KCALRY56PWGBC6PPNULERFUVJDJXRQS4GPT47BTQQHM45LH4MSFQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120350535 (353h35m18.851618154s) [noise=true , address=45.91.116.14:4212 , piece_id=BTQCNNOMSETWVTURIAFQORWWB6UMKJWX4LHUZTOVDXXOF6N3WPSQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120550500 (353h35m18.85181812s) [noise=true , address=104.36.82.23:4477 , piece_id=GVPQSMCF2CKVMWJWDGT5SLWWYG4BFW7RPSTLGS7XFIDWVNYC36BA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120813255 (353h35m18.852080865s) [noise=true , address=45.91.116.12:4232 , piece_id=IPF7UNNBP6JYQ5NCVUNFBQOBEFSSUBCTIWURVVKO5PH7MYWQQGZQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120993995 (353h35m18.852261616s) [noise=true , address=79.127.219.47:4054 , piece_id=SHV6YO5TSXJKUIA6RNWI5LKJUCOJPHUDDXDJZJ7YUXTXTAWCOXDA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.121160568 (353h35m18.852428189s) [noise=true , address=45.91.116.6:4990 , piece_id=E4F7AALJ6BJCNIFXOUYWIVQAPQ5CKZ6S732IJYDFZQ2WRQJV2JCA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.121325740 (353h35m18.852593361s) [noise=true , address=77.90.31.11:4580 , piece_id=T3DGRGQTY7P5NOFO2GJHJPCUKKQ7DAOSCJUGGMICDEZBE6EFUXJQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.121498415 (353h35m18.852766035s) [noise=true , address=104.36.82.23:4468 , piece_id=QS5BTJH5SVGPPDE232B7WK7AWDXJJBJCH3YNO6ECT7UG6HASNQ6A, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.121897627 (353h35m18.853165247s) [noise=true , address=77.90.31.14:4688 , piece_id=ASVRBAD6VDUVEIHNQ5T3LZ2MRQ7RBNDXSXIXHMBQXO76XONYIUPQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.122085360 (353h35m18.85335298s) [noise=true , address=104.36.82.44:4899 , piece_id=6URUBNUUNT55E37EB24U3TAENAZ53UJIN6GUDR6IQ4D4S5RVNTEQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.122256282 (353h35m18.853523891s) [noise=true , address=104.36.82.8:4984 , piece_id=XMSGV473QN7BZZF6N73Y6Y5SJZHHSDTXR7U7BSP3JDB4I2JDAAYQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.202732788 (353h35m18.934000418s) [upload=367603]: Next returned nil segment
Aug 23 11:01:38.202743218 (353h35m18.934010848s) [upload=367603]: Waiting for error group managing segments...
Aug 23 11:01:38.211564696 (353h35m18.942832326s) [noise=true , address=79.127.219.47:4054 , piece_id=SHV6YO5TSXJKUIA6RNWI5LKJUCOJPHUDDXDJZJ7YUXTXTAWCOXDA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.212219099 (353h35m18.943486729s) [noise=true , address=45.91.116.14:4212 , piece_id=BTQCNNOMSETWVTURIAFQORWWB6UMKJWX4LHUZTOVDXXOF6N3WPSQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.212696007 (353h35m18.943963627s) [noise=true , address=45.91.116.12:4232 , piece_id=IPF7UNNBP6JYQ5NCVUNFBQOBEFSSUBCTIWURVVKO5PH7MYWQQGZQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.213187322 (353h35m18.944454952s) [noise=true , address=45.91.116.6:4990 , piece_id=E4F7AALJ6BJCNIFXOUYWIVQAPQ5CKZ6S732IJYDFZQ2WRQJV2JCA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.213614956 (353h35m18.944882586s) [noise=true , address=77.90.31.17:4780 , piece_id=74BLTPAJVDGN5CXZ2N7ZW73VVCH5PX5VXLVHTQLACVZHDQO354ZA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.214004220 (353h35m18.945271839s) [noise=true , address=77.90.31.13:4631 , piece_id=XT35U3ICBYMGBKG7AJPDO5K255QLX6HGKG5B6DFKMXAUPGIEGXPA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.215762329 (353h35m18.947029949s) [noise=true , address=104.36.82.44:4899 , piece_id=6URUBNUUNT55E37EB24U3TAENAZ53UJIN6GUDR6IQ4D4S5RVNTEQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.216257632 (353h35m18.947525262s) [noise=true , address=77.90.31.14:4688 , piece_id=ASVRBAD6VDUVEIHNQ5T3LZ2MRQ7RBNDXSXIXHMBQXO76XONYIUPQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.216649570 (353h35m18.9479172s) [noise=true , address=104.36.82.23:4468 , piece_id=QS5BTJH5SVGPPDE232B7WK7AWDXJJBJCH3YNO6ECT7UG6HASNQ6A, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.217893071 (353h35m18.949160691s) [noise=true , address=104.36.82.23:4477 , piece_id=GVPQSMCF2CKVMWJWDGT5SLWWYG4BFW7RPSTLGS7XFIDWVNYC36BA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.220804442 (353h35m18.952072072s) [noise=true , address=77.90.31.11:4580 , piece_id=T3DGRGQTY7P5NOFO2GJHJPCUKKQ7DAOSCJUGGMICDEZBE6EFUXJQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.225729044 (353h35m18.956996674s) [noise=true , address=77.90.31.10:4535 , piece_id=BHHU5RSTS7CXSMSJGSJT64KRSAMRKQMC2A6WKNX7UXLIDEQOHFCQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.234375222 (353h35m18.965642843s) [noise=true , address=77.90.31.16:4768 , piece_id=NZJBUTVSFT5A6XL3HWUNCELFW2X46IME6IFM5X3HGW6NHTPUWSJA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.273055598 (353h35m19.004323218s) [noise=true , address=104.36.82.8:4984 , piece_id=XMSGV473QN7BZZF6N73Y6Y5SJZHHSDTXR7U7BSP3JDB4I2JDAAYQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.273068242 (353h35m19.004335872s) [seg_pos={0 0}, upload=367603]: Segment reached optimal threshold of 14 pieces.
Aug 23 11:01:38.273150165 (353h35m19.004417795s) [noise=true , address=77.90.31.12:4607 , piece_id=KCALRY56PWGBC6PPNULERFUVJDJXRQS4GPT47BTQQHM45LH4MSFQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UYNy47GZEha8wG9vZNUAws5ogTBjSXLdt7T2bwqcHGsPrKFrm): protocol: expected piece hash; context canceled; EOF
Aug 23 11:01:38.273298695 (353h35m19.004566315s) [noise=true , address=77.90.31.18:4814 , piece_id=FY5HIMU3Y7QUJ24452HXIMCQLG5VELDEOS2NHCICLANDF74UXLDQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FCikLXgPYS2qM9zLTthSNHKsQNckzg9oNkKGxfvwJZZjhKkVf): protocol: expected piece hash; context canceled; EOF
Aug 23 11:01:38.273416537 (353h35m19.004684157s) [noise=true , address=79.127.201.214:4289 , piece_id=TCE5UN2PB7EFIN7SIV6ZEKCXDPRWSPEAEPSPQABOEWEIGWCM4R4A, seg_pos={0 0}, upload=367603]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YfeEiw7zKAYgUcMqMLgEiS2t1gMqdwrpuAdTb2dZouuXRBSM4): protocol: write tcp 5.161.89.252:33260->79.127.201.214:4289: use of closed network connection; write tcp 5.161.89.252:33260->79.127.201.214:4289: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:33260->79.127.201.214:4289: use of closed network connection
Aug 23 11:01:38.273454208 (353h35m19.004721838s) [noise=true , address=79.127.205.245:4220 , piece_id=6XZLJDUMRHOEQDBXSF7KBSVCJ2EYDLPSISDFRGG3KSWLFRX2YAYQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123xj8bTNShfvqNJh3mSvM6V4TeXQoxFHR5TKELoUKTJJTzDyjD): protocol: read tcp 5.161.89.252:22462->79.127.205.245:4220: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 23 11:01:38.273461833 (353h35m19.004729463s) [seg_pos={0 0}, upload=367603]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 11:01:38.273524681 (353h35m19.004792311s) [upload=367603]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 11:01:38.273528298 (353h35m19.004795918s) [upload=367603]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 11:01:39.364638553 (353h35m20.095906173s) [upload=367603]: Done uploading segments...
Aug 23 11:01:39.364652760 (353h35m20.09592039s) [upload=367603]: Upload finished. err: <nil>
Duration: 1.390255461s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [X......................X...X.......X........................] duration:
136.048453ms
FAIL (2025-08-23 11:05:34 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 10:48:33.463894757 (353h22m14.195162387s) [upload=367374]: Starting upload Aug 23 10:48:33.463962204 (353h22m14.195229834s) [upload=367374]: Done starting upload Aug 23 10:48:33.464008170 (353h22m14.195275791s) [upload=367374]: Uploading segments... Aug 23 10:48:33.464037165 (353h22m14.195304784s) [upload=367374]: Got next segment. Inline: true Aug 23 10:48:33.464040791 (353h22m14.195308412s) [upload=367374]: Waiting for error group managing segments... Aug 23 10:48:33.464071779 (353h22m14.1953394s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 10:48:33.464075707 (353h22m14.195343337s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 10:48:33.464078402 (353h22m14.195346032s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 10:48:33.470151547 (353h22m14.201419167s) [upload=367374]: Done uploading segments... Aug 23 10:48:33.470166876 (353h22m14.201434496s) [upload=367374]: Upload finished. err: metaclient: Too Many Requests
Duration: 136.07305ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................................................X...X....] duration:
370.819878ms
FAIL (2025-08-23 11:05:04 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 28245251ac342c007ce1fdace53a54430147658e4c1a99d2532414b8de3a590b != before cc998e750b4b2c5f32e8fd1890a376ff1ac4cb4bb7438b3dc26e176b0e67f259
======LOGS======
Aug 23 11:01:38.064016662 (353h35m18.795284282s) [upload=367603]: Starting upload
Aug 23 11:01:38.064051468 (353h35m18.795319088s) [upload=367603]: Done starting upload
Aug 23 11:01:38.064089499 (353h35m18.795357129s) [upload=367603]: Uploading segments...
Aug 23 11:01:38.064223582 (353h35m18.795491191s) [upload=367603]: Got next segment. Inline: false
Aug 23 11:01:38.064244992 (353h35m18.795512612s) [upload=367603]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 11:01:38.064248029 (353h35m18.795515648s) [upload=367603]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 11:01:38.118468561 (353h35m18.84973617s) [seg_pos={0 0}, upload=367603]: Begin upload segment...
Aug 23 11:01:38.118511180 (353h35m18.849778801s) [seg_pos={0 0}, upload=367603]: Done begin upload segment.
Aug 23 11:01:38.118532641 (353h35m18.849800251s) [noise=true , address=79.127.201.214:4289 , piece_id=TCE5UN2PB7EFIN7SIV6ZEKCXDPRWSPEAEPSPQABOEWEIGWCM4R4A, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.118847505 (353h35m18.850115124s) [noise=true , address=77.90.31.13:4631 , piece_id=XT35U3ICBYMGBKG7AJPDO5K255QLX6HGKG5B6DFKMXAUPGIEGXPA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119057940 (353h35m18.85032556s) [noise=true , address=77.90.31.17:4780 , piece_id=74BLTPAJVDGN5CXZ2N7ZW73VVCH5PX5VXLVHTQLACVZHDQO354ZA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119248149 (353h35m18.850515769s) [noise=true , address=77.90.31.16:4768 , piece_id=NZJBUTVSFT5A6XL3HWUNCELFW2X46IME6IFM5X3HGW6NHTPUWSJA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119419431 (353h35m18.850687051s) [noise=true , address=77.90.31.10:4535 , piece_id=BHHU5RSTS7CXSMSJGSJT64KRSAMRKQMC2A6WKNX7UXLIDEQOHFCQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119729384 (353h35m18.850997005s) [noise=true , address=79.127.205.245:4220 , piece_id=6XZLJDUMRHOEQDBXSF7KBSVCJ2EYDLPSISDFRGG3KSWLFRX2YAYQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119979636 (353h35m18.851247246s) [noise=true , address=77.90.31.18:4814 , piece_id=FY5HIMU3Y7QUJ24452HXIMCQLG5VELDEOS2NHCICLANDF74UXLDQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120175233 (353h35m18.851442854s) [noise=true , address=77.90.31.12:4607 , piece_id=KCALRY56PWGBC6PPNULERFUVJDJXRQS4GPT47BTQQHM45LH4MSFQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120350535 (353h35m18.851618154s) [noise=true , address=45.91.116.14:4212 , piece_id=BTQCNNOMSETWVTURIAFQORWWB6UMKJWX4LHUZTOVDXXOF6N3WPSQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120550500 (353h35m18.85181812s) [noise=true , address=104.36.82.23:4477 , piece_id=GVPQSMCF2CKVMWJWDGT5SLWWYG4BFW7RPSTLGS7XFIDWVNYC36BA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120813255 (353h35m18.852080865s) [noise=true , address=45.91.116.12:4232 , piece_id=IPF7UNNBP6JYQ5NCVUNFBQOBEFSSUBCTIWURVVKO5PH7MYWQQGZQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120993995 (353h35m18.852261616s) [noise=true , address=79.127.219.47:4054 , piece_id=SHV6YO5TSXJKUIA6RNWI5LKJUCOJPHUDDXDJZJ7YUXTXTAWCOXDA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.121160568 (353h35m18.852428189s) [noise=true , address=45.91.116.6:4990 , piece_id=E4F7AALJ6BJCNIFXOUYWIVQAPQ5CKZ6S732IJYDFZQ2WRQJV2JCA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.121325740 (353h35m18.852593361s) [noise=true , address=77.90.31.11:4580 , piece_id=T3DGRGQTY7P5NOFO2GJHJPCUKKQ7DAOSCJUGGMICDEZBE6EFUXJQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.121498415 (353h35m18.852766035s) [noise=true , address=104.36.82.23:4468 , piece_id=QS5BTJH5SVGPPDE232B7WK7AWDXJJBJCH3YNO6ECT7UG6HASNQ6A, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.121897627 (353h35m18.853165247s) [noise=true , address=77.90.31.14:4688 , piece_id=ASVRBAD6VDUVEIHNQ5T3LZ2MRQ7RBNDXSXIXHMBQXO76XONYIUPQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.122085360 (353h35m18.85335298s) [noise=true , address=104.36.82.44:4899 , piece_id=6URUBNUUNT55E37EB24U3TAENAZ53UJIN6GUDR6IQ4D4S5RVNTEQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.122256282 (353h35m18.853523891s) [noise=true , address=104.36.82.8:4984 , piece_id=XMSGV473QN7BZZF6N73Y6Y5SJZHHSDTXR7U7BSP3JDB4I2JDAAYQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.202732788 (353h35m18.934000418s) [upload=367603]: Next returned nil segment
Aug 23 11:01:38.202743218 (353h35m18.934010848s) [upload=367603]: Waiting for error group managing segments...
Aug 23 11:01:38.211564696 (353h35m18.942832326s) [noise=true , address=79.127.219.47:4054 , piece_id=SHV6YO5TSXJKUIA6RNWI5LKJUCOJPHUDDXDJZJ7YUXTXTAWCOXDA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.212219099 (353h35m18.943486729s) [noise=true , address=45.91.116.14:4212 , piece_id=BTQCNNOMSETWVTURIAFQORWWB6UMKJWX4LHUZTOVDXXOF6N3WPSQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.212696007 (353h35m18.943963627s) [noise=true , address=45.91.116.12:4232 , piece_id=IPF7UNNBP6JYQ5NCVUNFBQOBEFSSUBCTIWURVVKO5PH7MYWQQGZQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.213187322 (353h35m18.944454952s) [noise=true , address=45.91.116.6:4990 , piece_id=E4F7AALJ6BJCNIFXOUYWIVQAPQ5CKZ6S732IJYDFZQ2WRQJV2JCA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.213614956 (353h35m18.944882586s) [noise=true , address=77.90.31.17:4780 , piece_id=74BLTPAJVDGN5CXZ2N7ZW73VVCH5PX5VXLVHTQLACVZHDQO354ZA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.214004220 (353h35m18.945271839s) [noise=true , address=77.90.31.13:4631 , piece_id=XT35U3ICBYMGBKG7AJPDO5K255QLX6HGKG5B6DFKMXAUPGIEGXPA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.215762329 (353h35m18.947029949s) [noise=true , address=104.36.82.44:4899 , piece_id=6URUBNUUNT55E37EB24U3TAENAZ53UJIN6GUDR6IQ4D4S5RVNTEQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.216257632 (353h35m18.947525262s) [noise=true , address=77.90.31.14:4688 , piece_id=ASVRBAD6VDUVEIHNQ5T3LZ2MRQ7RBNDXSXIXHMBQXO76XONYIUPQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.216649570 (353h35m18.9479172s) [noise=true , address=104.36.82.23:4468 , piece_id=QS5BTJH5SVGPPDE232B7WK7AWDXJJBJCH3YNO6ECT7UG6HASNQ6A, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.217893071 (353h35m18.949160691s) [noise=true , address=104.36.82.23:4477 , piece_id=GVPQSMCF2CKVMWJWDGT5SLWWYG4BFW7RPSTLGS7XFIDWVNYC36BA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.220804442 (353h35m18.952072072s) [noise=true , address=77.90.31.11:4580 , piece_id=T3DGRGQTY7P5NOFO2GJHJPCUKKQ7DAOSCJUGGMICDEZBE6EFUXJQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.225729044 (353h35m18.956996674s) [noise=true , address=77.90.31.10:4535 , piece_id=BHHU5RSTS7CXSMSJGSJT64KRSAMRKQMC2A6WKNX7UXLIDEQOHFCQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.234375222 (353h35m18.965642843s) [noise=true , address=77.90.31.16:4768 , piece_id=NZJBUTVSFT5A6XL3HWUNCELFW2X46IME6IFM5X3HGW6NHTPUWSJA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.273055598 (353h35m19.004323218s) [noise=true , address=104.36.82.8:4984 , piece_id=XMSGV473QN7BZZF6N73Y6Y5SJZHHSDTXR7U7BSP3JDB4I2JDAAYQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.273068242 (353h35m19.004335872s) [seg_pos={0 0}, upload=367603]: Segment reached optimal threshold of 14 pieces.
Aug 23 11:01:38.273150165 (353h35m19.004417795s) [noise=true , address=77.90.31.12:4607 , piece_id=KCALRY56PWGBC6PPNULERFUVJDJXRQS4GPT47BTQQHM45LH4MSFQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UYNy47GZEha8wG9vZNUAws5ogTBjSXLdt7T2bwqcHGsPrKFrm): protocol: expected piece hash; context canceled; EOF
Aug 23 11:01:38.273298695 (353h35m19.004566315s) [noise=true , address=77.90.31.18:4814 , piece_id=FY5HIMU3Y7QUJ24452HXIMCQLG5VELDEOS2NHCICLANDF74UXLDQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FCikLXgPYS2qM9zLTthSNHKsQNckzg9oNkKGxfvwJZZjhKkVf): protocol: expected piece hash; context canceled; EOF
Aug 23 11:01:38.273416537 (353h35m19.004684157s) [noise=true , address=79.127.201.214:4289 , piece_id=TCE5UN2PB7EFIN7SIV6ZEKCXDPRWSPEAEPSPQABOEWEIGWCM4R4A, seg_pos={0 0}, upload=367603]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YfeEiw7zKAYgUcMqMLgEiS2t1gMqdwrpuAdTb2dZouuXRBSM4): protocol: write tcp 5.161.89.252:33260->79.127.201.214:4289: use of closed network connection; write tcp 5.161.89.252:33260->79.127.201.214:4289: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:33260->79.127.201.214:4289: use of closed network connection
Aug 23 11:01:38.273454208 (353h35m19.004721838s) [noise=true , address=79.127.205.245:4220 , piece_id=6XZLJDUMRHOEQDBXSF7KBSVCJ2EYDLPSISDFRGG3KSWLFRX2YAYQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123xj8bTNShfvqNJh3mSvM6V4TeXQoxFHR5TKELoUKTJJTzDyjD): protocol: read tcp 5.161.89.252:22462->79.127.205.245:4220: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 23 11:01:38.273461833 (353h35m19.004729463s) [seg_pos={0 0}, upload=367603]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 11:01:38.273524681 (353h35m19.004792311s) [upload=367603]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 11:01:38.273528298 (353h35m19.004795918s) [upload=367603]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 11:01:39.364638553 (353h35m20.095906173s) [upload=367603]: Done uploading segments...
Aug 23 11:01:39.364652760 (353h35m20.09592039s) [upload=367603]: Upload finished. err: <nil>
Duration: 370.857639ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.X......................X...X.......X.......................] duration:
144.12032ms
FAIL (2025-08-23 11:04:38 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 10:48:33.463894757 (353h22m14.195162387s) [upload=367374]: Starting upload Aug 23 10:48:33.463962204 (353h22m14.195229834s) [upload=367374]: Done starting upload Aug 23 10:48:33.464008170 (353h22m14.195275791s) [upload=367374]: Uploading segments... Aug 23 10:48:33.464037165 (353h22m14.195304784s) [upload=367374]: Got next segment. Inline: true Aug 23 10:48:33.464040791 (353h22m14.195308412s) [upload=367374]: Waiting for error group managing segments... Aug 23 10:48:33.464071779 (353h22m14.1953394s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 10:48:33.464075707 (353h22m14.195343337s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 10:48:33.464078402 (353h22m14.195346032s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 10:48:33.470151547 (353h22m14.201419167s) [upload=367374]: Done uploading segments... Aug 23 10:48:33.470166876 (353h22m14.201434496s) [upload=367374]: Upload finished. err: metaclient: Too Many Requests
Duration: 144.141701ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....................................................X...X...] duration:
477.161189ms
FAIL (2025-08-23 11:04:26 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 28245251ac342c007ce1fdace53a54430147658e4c1a99d2532414b8de3a590b != before cc998e750b4b2c5f32e8fd1890a376ff1ac4cb4bb7438b3dc26e176b0e67f259
======LOGS======
Aug 23 11:01:38.064016662 (353h35m18.795284282s) [upload=367603]: Starting upload
Aug 23 11:01:38.064051468 (353h35m18.795319088s) [upload=367603]: Done starting upload
Aug 23 11:01:38.064089499 (353h35m18.795357129s) [upload=367603]: Uploading segments...
Aug 23 11:01:38.064223582 (353h35m18.795491191s) [upload=367603]: Got next segment. Inline: false
Aug 23 11:01:38.064244992 (353h35m18.795512612s) [upload=367603]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 11:01:38.064248029 (353h35m18.795515648s) [upload=367603]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 11:01:38.118468561 (353h35m18.84973617s) [seg_pos={0 0}, upload=367603]: Begin upload segment...
Aug 23 11:01:38.118511180 (353h35m18.849778801s) [seg_pos={0 0}, upload=367603]: Done begin upload segment.
Aug 23 11:01:38.118532641 (353h35m18.849800251s) [noise=true , address=79.127.201.214:4289 , piece_id=TCE5UN2PB7EFIN7SIV6ZEKCXDPRWSPEAEPSPQABOEWEIGWCM4R4A, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.118847505 (353h35m18.850115124s) [noise=true , address=77.90.31.13:4631 , piece_id=XT35U3ICBYMGBKG7AJPDO5K255QLX6HGKG5B6DFKMXAUPGIEGXPA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119057940 (353h35m18.85032556s) [noise=true , address=77.90.31.17:4780 , piece_id=74BLTPAJVDGN5CXZ2N7ZW73VVCH5PX5VXLVHTQLACVZHDQO354ZA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119248149 (353h35m18.850515769s) [noise=true , address=77.90.31.16:4768 , piece_id=NZJBUTVSFT5A6XL3HWUNCELFW2X46IME6IFM5X3HGW6NHTPUWSJA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119419431 (353h35m18.850687051s) [noise=true , address=77.90.31.10:4535 , piece_id=BHHU5RSTS7CXSMSJGSJT64KRSAMRKQMC2A6WKNX7UXLIDEQOHFCQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119729384 (353h35m18.850997005s) [noise=true , address=79.127.205.245:4220 , piece_id=6XZLJDUMRHOEQDBXSF7KBSVCJ2EYDLPSISDFRGG3KSWLFRX2YAYQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119979636 (353h35m18.851247246s) [noise=true , address=77.90.31.18:4814 , piece_id=FY5HIMU3Y7QUJ24452HXIMCQLG5VELDEOS2NHCICLANDF74UXLDQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120175233 (353h35m18.851442854s) [noise=true , address=77.90.31.12:4607 , piece_id=KCALRY56PWGBC6PPNULERFUVJDJXRQS4GPT47BTQQHM45LH4MSFQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120350535 (353h35m18.851618154s) [noise=true , address=45.91.116.14:4212 , piece_id=BTQCNNOMSETWVTURIAFQORWWB6UMKJWX4LHUZTOVDXXOF6N3WPSQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120550500 (353h35m18.85181812s) [noise=true , address=104.36.82.23:4477 , piece_id=GVPQSMCF2CKVMWJWDGT5SLWWYG4BFW7RPSTLGS7XFIDWVNYC36BA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120813255 (353h35m18.852080865s) [noise=true , address=45.91.116.12:4232 , piece_id=IPF7UNNBP6JYQ5NCVUNFBQOBEFSSUBCTIWURVVKO5PH7MYWQQGZQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120993995 (353h35m18.852261616s) [noise=true , address=79.127.219.47:4054 , piece_id=SHV6YO5TSXJKUIA6RNWI5LKJUCOJPHUDDXDJZJ7YUXTXTAWCOXDA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.121160568 (353h35m18.852428189s) [noise=true , address=45.91.116.6:4990 , piece_id=E4F7AALJ6BJCNIFXOUYWIVQAPQ5CKZ6S732IJYDFZQ2WRQJV2JCA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.121325740 (353h35m18.852593361s) [noise=true , address=77.90.31.11:4580 , piece_id=T3DGRGQTY7P5NOFO2GJHJPCUKKQ7DAOSCJUGGMICDEZBE6EFUXJQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.121498415 (353h35m18.852766035s) [noise=true , address=104.36.82.23:4468 , piece_id=QS5BTJH5SVGPPDE232B7WK7AWDXJJBJCH3YNO6ECT7UG6HASNQ6A, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.121897627 (353h35m18.853165247s) [noise=true , address=77.90.31.14:4688 , piece_id=ASVRBAD6VDUVEIHNQ5T3LZ2MRQ7RBNDXSXIXHMBQXO76XONYIUPQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.122085360 (353h35m18.85335298s) [noise=true , address=104.36.82.44:4899 , piece_id=6URUBNUUNT55E37EB24U3TAENAZ53UJIN6GUDR6IQ4D4S5RVNTEQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.122256282 (353h35m18.853523891s) [noise=true , address=104.36.82.8:4984 , piece_id=XMSGV473QN7BZZF6N73Y6Y5SJZHHSDTXR7U7BSP3JDB4I2JDAAYQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.202732788 (353h35m18.934000418s) [upload=367603]: Next returned nil segment
Aug 23 11:01:38.202743218 (353h35m18.934010848s) [upload=367603]: Waiting for error group managing segments...
Aug 23 11:01:38.211564696 (353h35m18.942832326s) [noise=true , address=79.127.219.47:4054 , piece_id=SHV6YO5TSXJKUIA6RNWI5LKJUCOJPHUDDXDJZJ7YUXTXTAWCOXDA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.212219099 (353h35m18.943486729s) [noise=true , address=45.91.116.14:4212 , piece_id=BTQCNNOMSETWVTURIAFQORWWB6UMKJWX4LHUZTOVDXXOF6N3WPSQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.212696007 (353h35m18.943963627s) [noise=true , address=45.91.116.12:4232 , piece_id=IPF7UNNBP6JYQ5NCVUNFBQOBEFSSUBCTIWURVVKO5PH7MYWQQGZQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.213187322 (353h35m18.944454952s) [noise=true , address=45.91.116.6:4990 , piece_id=E4F7AALJ6BJCNIFXOUYWIVQAPQ5CKZ6S732IJYDFZQ2WRQJV2JCA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.213614956 (353h35m18.944882586s) [noise=true , address=77.90.31.17:4780 , piece_id=74BLTPAJVDGN5CXZ2N7ZW73VVCH5PX5VXLVHTQLACVZHDQO354ZA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.214004220 (353h35m18.945271839s) [noise=true , address=77.90.31.13:4631 , piece_id=XT35U3ICBYMGBKG7AJPDO5K255QLX6HGKG5B6DFKMXAUPGIEGXPA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.215762329 (353h35m18.947029949s) [noise=true , address=104.36.82.44:4899 , piece_id=6URUBNUUNT55E37EB24U3TAENAZ53UJIN6GUDR6IQ4D4S5RVNTEQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.216257632 (353h35m18.947525262s) [noise=true , address=77.90.31.14:4688 , piece_id=ASVRBAD6VDUVEIHNQ5T3LZ2MRQ7RBNDXSXIXHMBQXO76XONYIUPQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.216649570 (353h35m18.9479172s) [noise=true , address=104.36.82.23:4468 , piece_id=QS5BTJH5SVGPPDE232B7WK7AWDXJJBJCH3YNO6ECT7UG6HASNQ6A, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.217893071 (353h35m18.949160691s) [noise=true , address=104.36.82.23:4477 , piece_id=GVPQSMCF2CKVMWJWDGT5SLWWYG4BFW7RPSTLGS7XFIDWVNYC36BA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.220804442 (353h35m18.952072072s) [noise=true , address=77.90.31.11:4580 , piece_id=T3DGRGQTY7P5NOFO2GJHJPCUKKQ7DAOSCJUGGMICDEZBE6EFUXJQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.225729044 (353h35m18.956996674s) [noise=true , address=77.90.31.10:4535 , piece_id=BHHU5RSTS7CXSMSJGSJT64KRSAMRKQMC2A6WKNX7UXLIDEQOHFCQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.234375222 (353h35m18.965642843s) [noise=true , address=77.90.31.16:4768 , piece_id=NZJBUTVSFT5A6XL3HWUNCELFW2X46IME6IFM5X3HGW6NHTPUWSJA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.273055598 (353h35m19.004323218s) [noise=true , address=104.36.82.8:4984 , piece_id=XMSGV473QN7BZZF6N73Y6Y5SJZHHSDTXR7U7BSP3JDB4I2JDAAYQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.273068242 (353h35m19.004335872s) [seg_pos={0 0}, upload=367603]: Segment reached optimal threshold of 14 pieces.
Aug 23 11:01:38.273150165 (353h35m19.004417795s) [noise=true , address=77.90.31.12:4607 , piece_id=KCALRY56PWGBC6PPNULERFUVJDJXRQS4GPT47BTQQHM45LH4MSFQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UYNy47GZEha8wG9vZNUAws5ogTBjSXLdt7T2bwqcHGsPrKFrm): protocol: expected piece hash; context canceled; EOF
Aug 23 11:01:38.273298695 (353h35m19.004566315s) [noise=true , address=77.90.31.18:4814 , piece_id=FY5HIMU3Y7QUJ24452HXIMCQLG5VELDEOS2NHCICLANDF74UXLDQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FCikLXgPYS2qM9zLTthSNHKsQNckzg9oNkKGxfvwJZZjhKkVf): protocol: expected piece hash; context canceled; EOF
Aug 23 11:01:38.273416537 (353h35m19.004684157s) [noise=true , address=79.127.201.214:4289 , piece_id=TCE5UN2PB7EFIN7SIV6ZEKCXDPRWSPEAEPSPQABOEWEIGWCM4R4A, seg_pos={0 0}, upload=367603]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YfeEiw7zKAYgUcMqMLgEiS2t1gMqdwrpuAdTb2dZouuXRBSM4): protocol: write tcp 5.161.89.252:33260->79.127.201.214:4289: use of closed network connection; write tcp 5.161.89.252:33260->79.127.201.214:4289: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:33260->79.127.201.214:4289: use of closed network connection
Aug 23 11:01:38.273454208 (353h35m19.004721838s) [noise=true , address=79.127.205.245:4220 , piece_id=6XZLJDUMRHOEQDBXSF7KBSVCJ2EYDLPSISDFRGG3KSWLFRX2YAYQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123xj8bTNShfvqNJh3mSvM6V4TeXQoxFHR5TKELoUKTJJTzDyjD): protocol: read tcp 5.161.89.252:22462->79.127.205.245:4220: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 23 11:01:38.273461833 (353h35m19.004729463s) [seg_pos={0 0}, upload=367603]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 11:01:38.273524681 (353h35m19.004792311s) [upload=367603]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 11:01:38.273528298 (353h35m19.004795918s) [upload=367603]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 11:01:39.364638553 (353h35m20.095906173s) [upload=367603]: Done uploading segments...
Aug 23 11:01:39.364652760 (353h35m20.09592039s) [upload=367603]: Upload finished. err: <nil>
Duration: 477.178992ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..X......................X...X.......X......................] duration:
176.558503ms
FAIL (2025-08-23 11:04:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 10:48:33.463894757 (353h22m14.195162387s) [upload=367374]: Starting upload Aug 23 10:48:33.463962204 (353h22m14.195229834s) [upload=367374]: Done starting upload Aug 23 10:48:33.464008170 (353h22m14.195275791s) [upload=367374]: Uploading segments... Aug 23 10:48:33.464037165 (353h22m14.195304784s) [upload=367374]: Got next segment. Inline: true Aug 23 10:48:33.464040791 (353h22m14.195308412s) [upload=367374]: Waiting for error group managing segments... Aug 23 10:48:33.464071779 (353h22m14.1953394s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 10:48:33.464075707 (353h22m14.195343337s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 10:48:33.464078402 (353h22m14.195346032s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 10:48:33.470151547 (353h22m14.201419167s) [upload=367374]: Done uploading segments... Aug 23 10:48:33.470166876 (353h22m14.201434496s) [upload=367374]: Upload finished. err: metaclient: Too Many Requests
Duration: 176.585474ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....................................................X...X..] duration:
476.287957ms
FAIL (2025-08-23 11:03:45 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 28245251ac342c007ce1fdace53a54430147658e4c1a99d2532414b8de3a590b != before cc998e750b4b2c5f32e8fd1890a376ff1ac4cb4bb7438b3dc26e176b0e67f259
======LOGS======
Aug 23 11:01:38.064016662 (353h35m18.795284282s) [upload=367603]: Starting upload
Aug 23 11:01:38.064051468 (353h35m18.795319088s) [upload=367603]: Done starting upload
Aug 23 11:01:38.064089499 (353h35m18.795357129s) [upload=367603]: Uploading segments...
Aug 23 11:01:38.064223582 (353h35m18.795491191s) [upload=367603]: Got next segment. Inline: false
Aug 23 11:01:38.064244992 (353h35m18.795512612s) [upload=367603]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 11:01:38.064248029 (353h35m18.795515648s) [upload=367603]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 11:01:38.118468561 (353h35m18.84973617s) [seg_pos={0 0}, upload=367603]: Begin upload segment...
Aug 23 11:01:38.118511180 (353h35m18.849778801s) [seg_pos={0 0}, upload=367603]: Done begin upload segment.
Aug 23 11:01:38.118532641 (353h35m18.849800251s) [noise=true , address=79.127.201.214:4289 , piece_id=TCE5UN2PB7EFIN7SIV6ZEKCXDPRWSPEAEPSPQABOEWEIGWCM4R4A, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.118847505 (353h35m18.850115124s) [noise=true , address=77.90.31.13:4631 , piece_id=XT35U3ICBYMGBKG7AJPDO5K255QLX6HGKG5B6DFKMXAUPGIEGXPA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119057940 (353h35m18.85032556s) [noise=true , address=77.90.31.17:4780 , piece_id=74BLTPAJVDGN5CXZ2N7ZW73VVCH5PX5VXLVHTQLACVZHDQO354ZA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119248149 (353h35m18.850515769s) [noise=true , address=77.90.31.16:4768 , piece_id=NZJBUTVSFT5A6XL3HWUNCELFW2X46IME6IFM5X3HGW6NHTPUWSJA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119419431 (353h35m18.850687051s) [noise=true , address=77.90.31.10:4535 , piece_id=BHHU5RSTS7CXSMSJGSJT64KRSAMRKQMC2A6WKNX7UXLIDEQOHFCQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119729384 (353h35m18.850997005s) [noise=true , address=79.127.205.245:4220 , piece_id=6XZLJDUMRHOEQDBXSF7KBSVCJ2EYDLPSISDFRGG3KSWLFRX2YAYQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119979636 (353h35m18.851247246s) [noise=true , address=77.90.31.18:4814 , piece_id=FY5HIMU3Y7QUJ24452HXIMCQLG5VELDEOS2NHCICLANDF74UXLDQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120175233 (353h35m18.851442854s) [noise=true , address=77.90.31.12:4607 , piece_id=KCALRY56PWGBC6PPNULERFUVJDJXRQS4GPT47BTQQHM45LH4MSFQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120350535 (353h35m18.851618154s) [noise=true , address=45.91.116.14:4212 , piece_id=BTQCNNOMSETWVTURIAFQORWWB6UMKJWX4LHUZTOVDXXOF6N3WPSQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120550500 (353h35m18.85181812s) [noise=true , address=104.36.82.23:4477 , piece_id=GVPQSMCF2CKVMWJWDGT5SLWWYG4BFW7RPSTLGS7XFIDWVNYC36BA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120813255 (353h35m18.852080865s) [noise=true , address=45.91.116.12:4232 , piece_id=IPF7UNNBP6JYQ5NCVUNFBQOBEFSSUBCTIWURVVKO5PH7MYWQQGZQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120993995 (353h35m18.852261616s) [noise=true , address=79.127.219.47:4054 , piece_id=SHV6YO5TSXJKUIA6RNWI5LKJUCOJPHUDDXDJZJ7YUXTXTAWCOXDA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.121160568 (353h35m18.852428189s) [noise=true , address=45.91.116.6:4990 , piece_id=E4F7AALJ6BJCNIFXOUYWIVQAPQ5CKZ6S732IJYDFZQ2WRQJV2JCA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.121325740 (353h35m18.852593361s) [noise=true , address=77.90.31.11:4580 , piece_id=T3DGRGQTY7P5NOFO2GJHJPCUKKQ7DAOSCJUGGMICDEZBE6EFUXJQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.121498415 (353h35m18.852766035s) [noise=true , address=104.36.82.23:4468 , piece_id=QS5BTJH5SVGPPDE232B7WK7AWDXJJBJCH3YNO6ECT7UG6HASNQ6A, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.121897627 (353h35m18.853165247s) [noise=true , address=77.90.31.14:4688 , piece_id=ASVRBAD6VDUVEIHNQ5T3LZ2MRQ7RBNDXSXIXHMBQXO76XONYIUPQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.122085360 (353h35m18.85335298s) [noise=true , address=104.36.82.44:4899 , piece_id=6URUBNUUNT55E37EB24U3TAENAZ53UJIN6GUDR6IQ4D4S5RVNTEQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.122256282 (353h35m18.853523891s) [noise=true , address=104.36.82.8:4984 , piece_id=XMSGV473QN7BZZF6N73Y6Y5SJZHHSDTXR7U7BSP3JDB4I2JDAAYQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.202732788 (353h35m18.934000418s) [upload=367603]: Next returned nil segment
Aug 23 11:01:38.202743218 (353h35m18.934010848s) [upload=367603]: Waiting for error group managing segments...
Aug 23 11:01:38.211564696 (353h35m18.942832326s) [noise=true , address=79.127.219.47:4054 , piece_id=SHV6YO5TSXJKUIA6RNWI5LKJUCOJPHUDDXDJZJ7YUXTXTAWCOXDA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.212219099 (353h35m18.943486729s) [noise=true , address=45.91.116.14:4212 , piece_id=BTQCNNOMSETWVTURIAFQORWWB6UMKJWX4LHUZTOVDXXOF6N3WPSQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.212696007 (353h35m18.943963627s) [noise=true , address=45.91.116.12:4232 , piece_id=IPF7UNNBP6JYQ5NCVUNFBQOBEFSSUBCTIWURVVKO5PH7MYWQQGZQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.213187322 (353h35m18.944454952s) [noise=true , address=45.91.116.6:4990 , piece_id=E4F7AALJ6BJCNIFXOUYWIVQAPQ5CKZ6S732IJYDFZQ2WRQJV2JCA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.213614956 (353h35m18.944882586s) [noise=true , address=77.90.31.17:4780 , piece_id=74BLTPAJVDGN5CXZ2N7ZW73VVCH5PX5VXLVHTQLACVZHDQO354ZA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.214004220 (353h35m18.945271839s) [noise=true , address=77.90.31.13:4631 , piece_id=XT35U3ICBYMGBKG7AJPDO5K255QLX6HGKG5B6DFKMXAUPGIEGXPA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.215762329 (353h35m18.947029949s) [noise=true , address=104.36.82.44:4899 , piece_id=6URUBNUUNT55E37EB24U3TAENAZ53UJIN6GUDR6IQ4D4S5RVNTEQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.216257632 (353h35m18.947525262s) [noise=true , address=77.90.31.14:4688 , piece_id=ASVRBAD6VDUVEIHNQ5T3LZ2MRQ7RBNDXSXIXHMBQXO76XONYIUPQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.216649570 (353h35m18.9479172s) [noise=true , address=104.36.82.23:4468 , piece_id=QS5BTJH5SVGPPDE232B7WK7AWDXJJBJCH3YNO6ECT7UG6HASNQ6A, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.217893071 (353h35m18.949160691s) [noise=true , address=104.36.82.23:4477 , piece_id=GVPQSMCF2CKVMWJWDGT5SLWWYG4BFW7RPSTLGS7XFIDWVNYC36BA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.220804442 (353h35m18.952072072s) [noise=true , address=77.90.31.11:4580 , piece_id=T3DGRGQTY7P5NOFO2GJHJPCUKKQ7DAOSCJUGGMICDEZBE6EFUXJQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.225729044 (353h35m18.956996674s) [noise=true , address=77.90.31.10:4535 , piece_id=BHHU5RSTS7CXSMSJGSJT64KRSAMRKQMC2A6WKNX7UXLIDEQOHFCQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.234375222 (353h35m18.965642843s) [noise=true , address=77.90.31.16:4768 , piece_id=NZJBUTVSFT5A6XL3HWUNCELFW2X46IME6IFM5X3HGW6NHTPUWSJA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.273055598 (353h35m19.004323218s) [noise=true , address=104.36.82.8:4984 , piece_id=XMSGV473QN7BZZF6N73Y6Y5SJZHHSDTXR7U7BSP3JDB4I2JDAAYQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.273068242 (353h35m19.004335872s) [seg_pos={0 0}, upload=367603]: Segment reached optimal threshold of 14 pieces.
Aug 23 11:01:38.273150165 (353h35m19.004417795s) [noise=true , address=77.90.31.12:4607 , piece_id=KCALRY56PWGBC6PPNULERFUVJDJXRQS4GPT47BTQQHM45LH4MSFQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UYNy47GZEha8wG9vZNUAws5ogTBjSXLdt7T2bwqcHGsPrKFrm): protocol: expected piece hash; context canceled; EOF
Aug 23 11:01:38.273298695 (353h35m19.004566315s) [noise=true , address=77.90.31.18:4814 , piece_id=FY5HIMU3Y7QUJ24452HXIMCQLG5VELDEOS2NHCICLANDF74UXLDQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FCikLXgPYS2qM9zLTthSNHKsQNckzg9oNkKGxfvwJZZjhKkVf): protocol: expected piece hash; context canceled; EOF
Aug 23 11:01:38.273416537 (353h35m19.004684157s) [noise=true , address=79.127.201.214:4289 , piece_id=TCE5UN2PB7EFIN7SIV6ZEKCXDPRWSPEAEPSPQABOEWEIGWCM4R4A, seg_pos={0 0}, upload=367603]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YfeEiw7zKAYgUcMqMLgEiS2t1gMqdwrpuAdTb2dZouuXRBSM4): protocol: write tcp 5.161.89.252:33260->79.127.201.214:4289: use of closed network connection; write tcp 5.161.89.252:33260->79.127.201.214:4289: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:33260->79.127.201.214:4289: use of closed network connection
Aug 23 11:01:38.273454208 (353h35m19.004721838s) [noise=true , address=79.127.205.245:4220 , piece_id=6XZLJDUMRHOEQDBXSF7KBSVCJ2EYDLPSISDFRGG3KSWLFRX2YAYQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123xj8bTNShfvqNJh3mSvM6V4TeXQoxFHR5TKELoUKTJJTzDyjD): protocol: read tcp 5.161.89.252:22462->79.127.205.245:4220: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 23 11:01:38.273461833 (353h35m19.004729463s) [seg_pos={0 0}, upload=367603]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 11:01:38.273524681 (353h35m19.004792311s) [upload=367603]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 11:01:38.273528298 (353h35m19.004795918s) [upload=367603]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 11:01:39.364638553 (353h35m20.095906173s) [upload=367603]: Done uploading segments...
Aug 23 11:01:39.364652760 (353h35m20.09592039s) [upload=367603]: Upload finished. err: <nil>
Duration: 476.314176ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...X......................X...X.......X.....................] duration:
156.249706ms
FAIL (2025-08-23 11:03:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 10:48:33.463894757 (353h22m14.195162387s) [upload=367374]: Starting upload Aug 23 10:48:33.463962204 (353h22m14.195229834s) [upload=367374]: Done starting upload Aug 23 10:48:33.464008170 (353h22m14.195275791s) [upload=367374]: Uploading segments... Aug 23 10:48:33.464037165 (353h22m14.195304784s) [upload=367374]: Got next segment. Inline: true Aug 23 10:48:33.464040791 (353h22m14.195308412s) [upload=367374]: Waiting for error group managing segments... Aug 23 10:48:33.464071779 (353h22m14.1953394s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 10:48:33.464075707 (353h22m14.195343337s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 10:48:33.464078402 (353h22m14.195346032s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 10:48:33.470151547 (353h22m14.201419167s) [upload=367374]: Done uploading segments... Aug 23 10:48:33.470166876 (353h22m14.201434496s) [upload=367374]: Upload finished. err: metaclient: Too Many Requests
Duration: 156.269293ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......................................................X...X.] duration:
406.435813ms
FAIL (2025-08-23 11:02:31 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 28245251ac342c007ce1fdace53a54430147658e4c1a99d2532414b8de3a590b != before cc998e750b4b2c5f32e8fd1890a376ff1ac4cb4bb7438b3dc26e176b0e67f259
======LOGS======
Aug 23 11:01:38.064016662 (353h35m18.795284282s) [upload=367603]: Starting upload
Aug 23 11:01:38.064051468 (353h35m18.795319088s) [upload=367603]: Done starting upload
Aug 23 11:01:38.064089499 (353h35m18.795357129s) [upload=367603]: Uploading segments...
Aug 23 11:01:38.064223582 (353h35m18.795491191s) [upload=367603]: Got next segment. Inline: false
Aug 23 11:01:38.064244992 (353h35m18.795512612s) [upload=367603]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 11:01:38.064248029 (353h35m18.795515648s) [upload=367603]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 11:01:38.118468561 (353h35m18.84973617s) [seg_pos={0 0}, upload=367603]: Begin upload segment...
Aug 23 11:01:38.118511180 (353h35m18.849778801s) [seg_pos={0 0}, upload=367603]: Done begin upload segment.
Aug 23 11:01:38.118532641 (353h35m18.849800251s) [noise=true , address=79.127.201.214:4289 , piece_id=TCE5UN2PB7EFIN7SIV6ZEKCXDPRWSPEAEPSPQABOEWEIGWCM4R4A, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.118847505 (353h35m18.850115124s) [noise=true , address=77.90.31.13:4631 , piece_id=XT35U3ICBYMGBKG7AJPDO5K255QLX6HGKG5B6DFKMXAUPGIEGXPA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119057940 (353h35m18.85032556s) [noise=true , address=77.90.31.17:4780 , piece_id=74BLTPAJVDGN5CXZ2N7ZW73VVCH5PX5VXLVHTQLACVZHDQO354ZA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119248149 (353h35m18.850515769s) [noise=true , address=77.90.31.16:4768 , piece_id=NZJBUTVSFT5A6XL3HWUNCELFW2X46IME6IFM5X3HGW6NHTPUWSJA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119419431 (353h35m18.850687051s) [noise=true , address=77.90.31.10:4535 , piece_id=BHHU5RSTS7CXSMSJGSJT64KRSAMRKQMC2A6WKNX7UXLIDEQOHFCQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119729384 (353h35m18.850997005s) [noise=true , address=79.127.205.245:4220 , piece_id=6XZLJDUMRHOEQDBXSF7KBSVCJ2EYDLPSISDFRGG3KSWLFRX2YAYQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119979636 (353h35m18.851247246s) [noise=true , address=77.90.31.18:4814 , piece_id=FY5HIMU3Y7QUJ24452HXIMCQLG5VELDEOS2NHCICLANDF74UXLDQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120175233 (353h35m18.851442854s) [noise=true , address=77.90.31.12:4607 , piece_id=KCALRY56PWGBC6PPNULERFUVJDJXRQS4GPT47BTQQHM45LH4MSFQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120350535 (353h35m18.851618154s) [noise=true , address=45.91.116.14:4212 , piece_id=BTQCNNOMSETWVTURIAFQORWWB6UMKJWX4LHUZTOVDXXOF6N3WPSQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120550500 (353h35m18.85181812s) [noise=true , address=104.36.82.23:4477 , piece_id=GVPQSMCF2CKVMWJWDGT5SLWWYG4BFW7RPSTLGS7XFIDWVNYC36BA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120813255 (353h35m18.852080865s) [noise=true , address=45.91.116.12:4232 , piece_id=IPF7UNNBP6JYQ5NCVUNFBQOBEFSSUBCTIWURVVKO5PH7MYWQQGZQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120993995 (353h35m18.852261616s) [noise=true , address=79.127.219.47:4054 , piece_id=SHV6YO5TSXJKUIA6RNWI5LKJUCOJPHUDDXDJZJ7YUXTXTAWCOXDA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.121160568 (353h35m18.852428189s) [noise=true , address=45.91.116.6:4990 , piece_id=E4F7AALJ6BJCNIFXOUYWIVQAPQ5CKZ6S732IJYDFZQ2WRQJV2JCA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.121325740 (353h35m18.852593361s) [noise=true , address=77.90.31.11:4580 , piece_id=T3DGRGQTY7P5NOFO2GJHJPCUKKQ7DAOSCJUGGMICDEZBE6EFUXJQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.121498415 (353h35m18.852766035s) [noise=true , address=104.36.82.23:4468 , piece_id=QS5BTJH5SVGPPDE232B7WK7AWDXJJBJCH3YNO6ECT7UG6HASNQ6A, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.121897627 (353h35m18.853165247s) [noise=true , address=77.90.31.14:4688 , piece_id=ASVRBAD6VDUVEIHNQ5T3LZ2MRQ7RBNDXSXIXHMBQXO76XONYIUPQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.122085360 (353h35m18.85335298s) [noise=true , address=104.36.82.44:4899 , piece_id=6URUBNUUNT55E37EB24U3TAENAZ53UJIN6GUDR6IQ4D4S5RVNTEQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.122256282 (353h35m18.853523891s) [noise=true , address=104.36.82.8:4984 , piece_id=XMSGV473QN7BZZF6N73Y6Y5SJZHHSDTXR7U7BSP3JDB4I2JDAAYQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.202732788 (353h35m18.934000418s) [upload=367603]: Next returned nil segment
Aug 23 11:01:38.202743218 (353h35m18.934010848s) [upload=367603]: Waiting for error group managing segments...
Aug 23 11:01:38.211564696 (353h35m18.942832326s) [noise=true , address=79.127.219.47:4054 , piece_id=SHV6YO5TSXJKUIA6RNWI5LKJUCOJPHUDDXDJZJ7YUXTXTAWCOXDA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.212219099 (353h35m18.943486729s) [noise=true , address=45.91.116.14:4212 , piece_id=BTQCNNOMSETWVTURIAFQORWWB6UMKJWX4LHUZTOVDXXOF6N3WPSQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.212696007 (353h35m18.943963627s) [noise=true , address=45.91.116.12:4232 , piece_id=IPF7UNNBP6JYQ5NCVUNFBQOBEFSSUBCTIWURVVKO5PH7MYWQQGZQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.213187322 (353h35m18.944454952s) [noise=true , address=45.91.116.6:4990 , piece_id=E4F7AALJ6BJCNIFXOUYWIVQAPQ5CKZ6S732IJYDFZQ2WRQJV2JCA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.213614956 (353h35m18.944882586s) [noise=true , address=77.90.31.17:4780 , piece_id=74BLTPAJVDGN5CXZ2N7ZW73VVCH5PX5VXLVHTQLACVZHDQO354ZA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.214004220 (353h35m18.945271839s) [noise=true , address=77.90.31.13:4631 , piece_id=XT35U3ICBYMGBKG7AJPDO5K255QLX6HGKG5B6DFKMXAUPGIEGXPA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.215762329 (353h35m18.947029949s) [noise=true , address=104.36.82.44:4899 , piece_id=6URUBNUUNT55E37EB24U3TAENAZ53UJIN6GUDR6IQ4D4S5RVNTEQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.216257632 (353h35m18.947525262s) [noise=true , address=77.90.31.14:4688 , piece_id=ASVRBAD6VDUVEIHNQ5T3LZ2MRQ7RBNDXSXIXHMBQXO76XONYIUPQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.216649570 (353h35m18.9479172s) [noise=true , address=104.36.82.23:4468 , piece_id=QS5BTJH5SVGPPDE232B7WK7AWDXJJBJCH3YNO6ECT7UG6HASNQ6A, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.217893071 (353h35m18.949160691s) [noise=true , address=104.36.82.23:4477 , piece_id=GVPQSMCF2CKVMWJWDGT5SLWWYG4BFW7RPSTLGS7XFIDWVNYC36BA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.220804442 (353h35m18.952072072s) [noise=true , address=77.90.31.11:4580 , piece_id=T3DGRGQTY7P5NOFO2GJHJPCUKKQ7DAOSCJUGGMICDEZBE6EFUXJQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.225729044 (353h35m18.956996674s) [noise=true , address=77.90.31.10:4535 , piece_id=BHHU5RSTS7CXSMSJGSJT64KRSAMRKQMC2A6WKNX7UXLIDEQOHFCQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.234375222 (353h35m18.965642843s) [noise=true , address=77.90.31.16:4768 , piece_id=NZJBUTVSFT5A6XL3HWUNCELFW2X46IME6IFM5X3HGW6NHTPUWSJA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.273055598 (353h35m19.004323218s) [noise=true , address=104.36.82.8:4984 , piece_id=XMSGV473QN7BZZF6N73Y6Y5SJZHHSDTXR7U7BSP3JDB4I2JDAAYQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.273068242 (353h35m19.004335872s) [seg_pos={0 0}, upload=367603]: Segment reached optimal threshold of 14 pieces.
Aug 23 11:01:38.273150165 (353h35m19.004417795s) [noise=true , address=77.90.31.12:4607 , piece_id=KCALRY56PWGBC6PPNULERFUVJDJXRQS4GPT47BTQQHM45LH4MSFQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UYNy47GZEha8wG9vZNUAws5ogTBjSXLdt7T2bwqcHGsPrKFrm): protocol: expected piece hash; context canceled; EOF
Aug 23 11:01:38.273298695 (353h35m19.004566315s) [noise=true , address=77.90.31.18:4814 , piece_id=FY5HIMU3Y7QUJ24452HXIMCQLG5VELDEOS2NHCICLANDF74UXLDQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FCikLXgPYS2qM9zLTthSNHKsQNckzg9oNkKGxfvwJZZjhKkVf): protocol: expected piece hash; context canceled; EOF
Aug 23 11:01:38.273416537 (353h35m19.004684157s) [noise=true , address=79.127.201.214:4289 , piece_id=TCE5UN2PB7EFIN7SIV6ZEKCXDPRWSPEAEPSPQABOEWEIGWCM4R4A, seg_pos={0 0}, upload=367603]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YfeEiw7zKAYgUcMqMLgEiS2t1gMqdwrpuAdTb2dZouuXRBSM4): protocol: write tcp 5.161.89.252:33260->79.127.201.214:4289: use of closed network connection; write tcp 5.161.89.252:33260->79.127.201.214:4289: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:33260->79.127.201.214:4289: use of closed network connection
Aug 23 11:01:38.273454208 (353h35m19.004721838s) [noise=true , address=79.127.205.245:4220 , piece_id=6XZLJDUMRHOEQDBXSF7KBSVCJ2EYDLPSISDFRGG3KSWLFRX2YAYQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123xj8bTNShfvqNJh3mSvM6V4TeXQoxFHR5TKELoUKTJJTzDyjD): protocol: read tcp 5.161.89.252:22462->79.127.205.245:4220: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 23 11:01:38.273461833 (353h35m19.004729463s) [seg_pos={0 0}, upload=367603]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 11:01:38.273524681 (353h35m19.004792311s) [upload=367603]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 11:01:38.273528298 (353h35m19.004795918s) [upload=367603]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 11:01:39.364638553 (353h35m20.095906173s) [upload=367603]: Done uploading segments...
Aug 23 11:01:39.364652760 (353h35m20.09592039s) [upload=367603]: Upload finished. err: <nil>
Duration: 406.461921ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [....X......................X...X.......X....................] duration:
320.396955ms
FAIL (2025-08-23 11:02:10 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 10:48:33.463894757 (353h22m14.195162387s) [upload=367374]: Starting upload Aug 23 10:48:33.463962204 (353h22m14.195229834s) [upload=367374]: Done starting upload Aug 23 10:48:33.464008170 (353h22m14.195275791s) [upload=367374]: Uploading segments... Aug 23 10:48:33.464037165 (353h22m14.195304784s) [upload=367374]: Got next segment. Inline: true Aug 23 10:48:33.464040791 (353h22m14.195308412s) [upload=367374]: Waiting for error group managing segments... Aug 23 10:48:33.464071779 (353h22m14.1953394s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 10:48:33.464075707 (353h22m14.195343337s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 10:48:33.464078402 (353h22m14.195346032s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 10:48:33.470151547 (353h22m14.201419167s) [upload=367374]: Done uploading segments... Aug 23 10:48:33.470166876 (353h22m14.201434496s) [upload=367374]: Upload finished. err: metaclient: Too Many Requests
Duration: 320.425297ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......................................................X...X] duration:
1.536445775s
FAIL (2025-08-23 11:01:39 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 28245251ac342c007ce1fdace53a54430147658e4c1a99d2532414b8de3a590b != before cc998e750b4b2c5f32e8fd1890a376ff1ac4cb4bb7438b3dc26e176b0e67f259
======LOGS======
Aug 23 11:01:38.064016662 (353h35m18.795284282s) [upload=367603]: Starting upload
Aug 23 11:01:38.064051468 (353h35m18.795319088s) [upload=367603]: Done starting upload
Aug 23 11:01:38.064089499 (353h35m18.795357129s) [upload=367603]: Uploading segments...
Aug 23 11:01:38.064223582 (353h35m18.795491191s) [upload=367603]: Got next segment. Inline: false
Aug 23 11:01:38.064244992 (353h35m18.795512612s) [upload=367603]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 11:01:38.064248029 (353h35m18.795515648s) [upload=367603]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 11:01:38.118468561 (353h35m18.84973617s) [seg_pos={0 0}, upload=367603]: Begin upload segment...
Aug 23 11:01:38.118511180 (353h35m18.849778801s) [seg_pos={0 0}, upload=367603]: Done begin upload segment.
Aug 23 11:01:38.118532641 (353h35m18.849800251s) [noise=true , address=79.127.201.214:4289 , piece_id=TCE5UN2PB7EFIN7SIV6ZEKCXDPRWSPEAEPSPQABOEWEIGWCM4R4A, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.118847505 (353h35m18.850115124s) [noise=true , address=77.90.31.13:4631 , piece_id=XT35U3ICBYMGBKG7AJPDO5K255QLX6HGKG5B6DFKMXAUPGIEGXPA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119057940 (353h35m18.85032556s) [noise=true , address=77.90.31.17:4780 , piece_id=74BLTPAJVDGN5CXZ2N7ZW73VVCH5PX5VXLVHTQLACVZHDQO354ZA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119248149 (353h35m18.850515769s) [noise=true , address=77.90.31.16:4768 , piece_id=NZJBUTVSFT5A6XL3HWUNCELFW2X46IME6IFM5X3HGW6NHTPUWSJA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119419431 (353h35m18.850687051s) [noise=true , address=77.90.31.10:4535 , piece_id=BHHU5RSTS7CXSMSJGSJT64KRSAMRKQMC2A6WKNX7UXLIDEQOHFCQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119729384 (353h35m18.850997005s) [noise=true , address=79.127.205.245:4220 , piece_id=6XZLJDUMRHOEQDBXSF7KBSVCJ2EYDLPSISDFRGG3KSWLFRX2YAYQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.119979636 (353h35m18.851247246s) [noise=true , address=77.90.31.18:4814 , piece_id=FY5HIMU3Y7QUJ24452HXIMCQLG5VELDEOS2NHCICLANDF74UXLDQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120175233 (353h35m18.851442854s) [noise=true , address=77.90.31.12:4607 , piece_id=KCALRY56PWGBC6PPNULERFUVJDJXRQS4GPT47BTQQHM45LH4MSFQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120350535 (353h35m18.851618154s) [noise=true , address=45.91.116.14:4212 , piece_id=BTQCNNOMSETWVTURIAFQORWWB6UMKJWX4LHUZTOVDXXOF6N3WPSQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120550500 (353h35m18.85181812s) [noise=true , address=104.36.82.23:4477 , piece_id=GVPQSMCF2CKVMWJWDGT5SLWWYG4BFW7RPSTLGS7XFIDWVNYC36BA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120813255 (353h35m18.852080865s) [noise=true , address=45.91.116.12:4232 , piece_id=IPF7UNNBP6JYQ5NCVUNFBQOBEFSSUBCTIWURVVKO5PH7MYWQQGZQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.120993995 (353h35m18.852261616s) [noise=true , address=79.127.219.47:4054 , piece_id=SHV6YO5TSXJKUIA6RNWI5LKJUCOJPHUDDXDJZJ7YUXTXTAWCOXDA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.121160568 (353h35m18.852428189s) [noise=true , address=45.91.116.6:4990 , piece_id=E4F7AALJ6BJCNIFXOUYWIVQAPQ5CKZ6S732IJYDFZQ2WRQJV2JCA, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.121325740 (353h35m18.852593361s) [noise=true , address=77.90.31.11:4580 , piece_id=T3DGRGQTY7P5NOFO2GJHJPCUKKQ7DAOSCJUGGMICDEZBE6EFUXJQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.121498415 (353h35m18.852766035s) [noise=true , address=104.36.82.23:4468 , piece_id=QS5BTJH5SVGPPDE232B7WK7AWDXJJBJCH3YNO6ECT7UG6HASNQ6A, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.121897627 (353h35m18.853165247s) [noise=true , address=77.90.31.14:4688 , piece_id=ASVRBAD6VDUVEIHNQ5T3LZ2MRQ7RBNDXSXIXHMBQXO76XONYIUPQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.122085360 (353h35m18.85335298s) [noise=true , address=104.36.82.44:4899 , piece_id=6URUBNUUNT55E37EB24U3TAENAZ53UJIN6GUDR6IQ4D4S5RVNTEQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.122256282 (353h35m18.853523891s) [noise=true , address=104.36.82.8:4984 , piece_id=XMSGV473QN7BZZF6N73Y6Y5SJZHHSDTXR7U7BSP3JDB4I2JDAAYQ, seg_pos={0 0}, upload=367603]: Uploading piece...
Aug 23 11:01:38.202732788 (353h35m18.934000418s) [upload=367603]: Next returned nil segment
Aug 23 11:01:38.202743218 (353h35m18.934010848s) [upload=367603]: Waiting for error group managing segments...
Aug 23 11:01:38.211564696 (353h35m18.942832326s) [noise=true , address=79.127.219.47:4054 , piece_id=SHV6YO5TSXJKUIA6RNWI5LKJUCOJPHUDDXDJZJ7YUXTXTAWCOXDA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.212219099 (353h35m18.943486729s) [noise=true , address=45.91.116.14:4212 , piece_id=BTQCNNOMSETWVTURIAFQORWWB6UMKJWX4LHUZTOVDXXOF6N3WPSQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.212696007 (353h35m18.943963627s) [noise=true , address=45.91.116.12:4232 , piece_id=IPF7UNNBP6JYQ5NCVUNFBQOBEFSSUBCTIWURVVKO5PH7MYWQQGZQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.213187322 (353h35m18.944454952s) [noise=true , address=45.91.116.6:4990 , piece_id=E4F7AALJ6BJCNIFXOUYWIVQAPQ5CKZ6S732IJYDFZQ2WRQJV2JCA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.213614956 (353h35m18.944882586s) [noise=true , address=77.90.31.17:4780 , piece_id=74BLTPAJVDGN5CXZ2N7ZW73VVCH5PX5VXLVHTQLACVZHDQO354ZA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.214004220 (353h35m18.945271839s) [noise=true , address=77.90.31.13:4631 , piece_id=XT35U3ICBYMGBKG7AJPDO5K255QLX6HGKG5B6DFKMXAUPGIEGXPA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.215762329 (353h35m18.947029949s) [noise=true , address=104.36.82.44:4899 , piece_id=6URUBNUUNT55E37EB24U3TAENAZ53UJIN6GUDR6IQ4D4S5RVNTEQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.216257632 (353h35m18.947525262s) [noise=true , address=77.90.31.14:4688 , piece_id=ASVRBAD6VDUVEIHNQ5T3LZ2MRQ7RBNDXSXIXHMBQXO76XONYIUPQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.216649570 (353h35m18.9479172s) [noise=true , address=104.36.82.23:4468 , piece_id=QS5BTJH5SVGPPDE232B7WK7AWDXJJBJCH3YNO6ECT7UG6HASNQ6A, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.217893071 (353h35m18.949160691s) [noise=true , address=104.36.82.23:4477 , piece_id=GVPQSMCF2CKVMWJWDGT5SLWWYG4BFW7RPSTLGS7XFIDWVNYC36BA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.220804442 (353h35m18.952072072s) [noise=true , address=77.90.31.11:4580 , piece_id=T3DGRGQTY7P5NOFO2GJHJPCUKKQ7DAOSCJUGGMICDEZBE6EFUXJQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.225729044 (353h35m18.956996674s) [noise=true , address=77.90.31.10:4535 , piece_id=BHHU5RSTS7CXSMSJGSJT64KRSAMRKQMC2A6WKNX7UXLIDEQOHFCQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.234375222 (353h35m18.965642843s) [noise=true , address=77.90.31.16:4768 , piece_id=NZJBUTVSFT5A6XL3HWUNCELFW2X46IME6IFM5X3HGW6NHTPUWSJA, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.273055598 (353h35m19.004323218s) [noise=true , address=104.36.82.8:4984 , piece_id=XMSGV473QN7BZZF6N73Y6Y5SJZHHSDTXR7U7BSP3JDB4I2JDAAYQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: <nil>
Aug 23 11:01:38.273068242 (353h35m19.004335872s) [seg_pos={0 0}, upload=367603]: Segment reached optimal threshold of 14 pieces.
Aug 23 11:01:38.273150165 (353h35m19.004417795s) [noise=true , address=77.90.31.12:4607 , piece_id=KCALRY56PWGBC6PPNULERFUVJDJXRQS4GPT47BTQQHM45LH4MSFQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UYNy47GZEha8wG9vZNUAws5ogTBjSXLdt7T2bwqcHGsPrKFrm): protocol: expected piece hash; context canceled; EOF
Aug 23 11:01:38.273298695 (353h35m19.004566315s) [noise=true , address=77.90.31.18:4814 , piece_id=FY5HIMU3Y7QUJ24452HXIMCQLG5VELDEOS2NHCICLANDF74UXLDQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FCikLXgPYS2qM9zLTthSNHKsQNckzg9oNkKGxfvwJZZjhKkVf): protocol: expected piece hash; context canceled; EOF
Aug 23 11:01:38.273416537 (353h35m19.004684157s) [noise=true , address=79.127.201.214:4289 , piece_id=TCE5UN2PB7EFIN7SIV6ZEKCXDPRWSPEAEPSPQABOEWEIGWCM4R4A, seg_pos={0 0}, upload=367603]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YfeEiw7zKAYgUcMqMLgEiS2t1gMqdwrpuAdTb2dZouuXRBSM4): protocol: write tcp 5.161.89.252:33260->79.127.201.214:4289: use of closed network connection; write tcp 5.161.89.252:33260->79.127.201.214:4289: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:33260->79.127.201.214:4289: use of closed network connection
Aug 23 11:01:38.273454208 (353h35m19.004721838s) [noise=true , address=79.127.205.245:4220 , piece_id=6XZLJDUMRHOEQDBXSF7KBSVCJ2EYDLPSISDFRGG3KSWLFRX2YAYQ, seg_pos={0 0}, upload=367603]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123xj8bTNShfvqNJh3mSvM6V4TeXQoxFHR5TKELoUKTJJTzDyjD): protocol: read tcp 5.161.89.252:22462->79.127.205.245:4220: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 23 11:01:38.273461833 (353h35m19.004729463s) [seg_pos={0 0}, upload=367603]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 11:01:38.273524681 (353h35m19.004792311s) [upload=367603]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 11:01:38.273528298 (353h35m19.004795918s) [upload=367603]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 11:01:39.364638553 (353h35m20.095906173s) [upload=367603]: Done uploading segments...
Aug 23 11:01:39.364652760 (353h35m20.09592039s) [upload=367603]: Upload finished. err: <nil>
Duration: 1.536460503s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.....X......................X...X.......X...................] duration:
307.327248ms
FAIL (2025-08-23 11:01:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 10:48:33.463894757 (353h22m14.195162387s) [upload=367374]: Starting upload Aug 23 10:48:33.463962204 (353h22m14.195229834s) [upload=367374]: Done starting upload Aug 23 10:48:33.464008170 (353h22m14.195275791s) [upload=367374]: Uploading segments... Aug 23 10:48:33.464037165 (353h22m14.195304784s) [upload=367374]: Got next segment. Inline: true Aug 23 10:48:33.464040791 (353h22m14.195308412s) [upload=367374]: Waiting for error group managing segments... Aug 23 10:48:33.464071779 (353h22m14.1953394s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 10:48:33.464075707 (353h22m14.195343337s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 10:48:33.464078402 (353h22m14.195346032s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 10:48:33.470151547 (353h22m14.201419167s) [upload=367374]: Done uploading segments... Aug 23 10:48:33.470166876 (353h22m14.201434496s) [upload=367374]: Upload finished. err: metaclient: Too Many Requests
Duration: 307.36052ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
350.811426ms
FAIL (2025-08-23 11:01:10 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 10:59:22.470705321 (353h33m3.201972971s) [upload=367562]: Starting upload Aug 23 10:59:22.470794509 (353h33m3.202062159s) [upload=367562]: Done starting upload Aug 23 10:59:22.470919043 (353h33m3.202186694s) [upload=367562]: Uploading segments... Aug 23 10:59:22.471169394 (353h33m3.202437044s) [upload=367562]: Got next segment. Inline: false Aug 23 10:59:22.471228125 (353h33m3.202495775s) [upload=367562]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 10:59:22.471234277 (353h33m3.202501927s) [upload=367562]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 23 10:59:22.562484914 (353h33m3.293752564s) [upload=367562]: Next segment err: metaclient: Too Many Requests Aug 23 10:59:22.562506945 (353h33m3.293774595s) [upload=367562]: Done uploading segments... Aug 23 10:59:22.562549837 (353h33m3.293817487s) [upload=367562]: Upload finished. err: metaclient: Too Many Requests
Duration: 350.836896ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [......X......................X...X.......X..................] duration:
125.021802ms
FAIL (2025-08-23 11:01:03 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 10:48:33.463894757 (353h22m14.195162387s) [upload=367374]: Starting upload Aug 23 10:48:33.463962204 (353h22m14.195229834s) [upload=367374]: Done starting upload Aug 23 10:48:33.464008170 (353h22m14.195275791s) [upload=367374]: Uploading segments... Aug 23 10:48:33.464037165 (353h22m14.195304784s) [upload=367374]: Got next segment. Inline: true Aug 23 10:48:33.464040791 (353h22m14.195308412s) [upload=367374]: Waiting for error group managing segments... Aug 23 10:48:33.464071779 (353h22m14.1953394s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 10:48:33.464075707 (353h22m14.195343337s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 10:48:33.464078402 (353h22m14.195346032s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 10:48:33.470151547 (353h22m14.201419167s) [upload=367374]: Done uploading segments... Aug 23 10:48:33.470166876 (353h22m14.201434496s) [upload=367374]: Upload finished. err: metaclient: Too Many Requests
Duration: 125.039797ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.......X......................X...X.......X.................] duration:
154.622463ms
FAIL (2025-08-23 11:00:41 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 10:48:33.463894757 (353h22m14.195162387s) [upload=367374]: Starting upload Aug 23 10:48:33.463962204 (353h22m14.195229834s) [upload=367374]: Done starting upload Aug 23 10:48:33.464008170 (353h22m14.195275791s) [upload=367374]: Uploading segments... Aug 23 10:48:33.464037165 (353h22m14.195304784s) [upload=367374]: Got next segment. Inline: true Aug 23 10:48:33.464040791 (353h22m14.195308412s) [upload=367374]: Waiting for error group managing segments... Aug 23 10:48:33.464071779 (353h22m14.1953394s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 10:48:33.464075707 (353h22m14.195343337s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 10:48:33.464078402 (353h22m14.195346032s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 10:48:33.470151547 (353h22m14.201419167s) [upload=367374]: Done uploading segments... Aug 23 10:48:33.470166876 (353h22m14.201434496s) [upload=367374]: Upload finished. err: metaclient: Too Many Requests
Duration: 154.641079ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [X.......X......................X...X.......X................] duration:
246.639819ms
FAIL (2025-08-23 11:00:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 10:48:33.463894757 (353h22m14.195162387s) [upload=367374]: Starting upload Aug 23 10:48:33.463962204 (353h22m14.195229834s) [upload=367374]: Done starting upload Aug 23 10:48:33.464008170 (353h22m14.195275791s) [upload=367374]: Uploading segments... Aug 23 10:48:33.464037165 (353h22m14.195304784s) [upload=367374]: Got next segment. Inline: true Aug 23 10:48:33.464040791 (353h22m14.195308412s) [upload=367374]: Waiting for error group managing segments... Aug 23 10:48:33.464071779 (353h22m14.1953394s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 10:48:33.464075707 (353h22m14.195343337s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 10:48:33.464078402 (353h22m14.195346032s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 10:48:33.470151547 (353h22m14.201419167s) [upload=367374]: Done uploading segments... Aug 23 10:48:33.470166876 (353h22m14.201434496s) [upload=367374]: Upload finished. err: metaclient: Too Many Requests
Duration: 246.659646ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
2.068287914s
FAIL (2025-08-23 11:00:07 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 10:59:22.470705321 (353h33m3.201972971s) [upload=367562]: Starting upload Aug 23 10:59:22.470794509 (353h33m3.202062159s) [upload=367562]: Done starting upload Aug 23 10:59:22.470919043 (353h33m3.202186694s) [upload=367562]: Uploading segments... Aug 23 10:59:22.471169394 (353h33m3.202437044s) [upload=367562]: Got next segment. Inline: false Aug 23 10:59:22.471228125 (353h33m3.202495775s) [upload=367562]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 10:59:22.471234277 (353h33m3.202501927s) [upload=367562]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 23 10:59:22.562484914 (353h33m3.293752564s) [upload=367562]: Next segment err: metaclient: Too Many Requests Aug 23 10:59:22.562506945 (353h33m3.293774595s) [upload=367562]: Done uploading segments... Aug 23 10:59:22.562549837 (353h33m3.293817487s) [upload=367562]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.068313372s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.X.......X......................X...X.......X...............] duration:
321.401044ms
FAIL (2025-08-23 10:59:50 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 10:48:33.463894757 (353h22m14.195162387s) [upload=367374]: Starting upload Aug 23 10:48:33.463962204 (353h22m14.195229834s) [upload=367374]: Done starting upload Aug 23 10:48:33.464008170 (353h22m14.195275791s) [upload=367374]: Uploading segments... Aug 23 10:48:33.464037165 (353h22m14.195304784s) [upload=367374]: Got next segment. Inline: true Aug 23 10:48:33.464040791 (353h22m14.195308412s) [upload=367374]: Waiting for error group managing segments... Aug 23 10:48:33.464071779 (353h22m14.1953394s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 10:48:33.464075707 (353h22m14.195343337s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 10:48:33.464078402 (353h22m14.195346032s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 10:48:33.470151547 (353h22m14.201419167s) [upload=367374]: Done uploading segments... Aug 23 10:48:33.470166876 (353h22m14.201434496s) [upload=367374]: Upload finished. err: metaclient: Too Many Requests
Duration: 321.434336ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
1.31489255s
FAIL (2025-08-23 10:59:44 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 10:59:22.470705321 (353h33m3.201972971s) [upload=367562]: Starting upload Aug 23 10:59:22.470794509 (353h33m3.202062159s) [upload=367562]: Done starting upload Aug 23 10:59:22.470919043 (353h33m3.202186694s) [upload=367562]: Uploading segments... Aug 23 10:59:22.471169394 (353h33m3.202437044s) [upload=367562]: Got next segment. Inline: false Aug 23 10:59:22.471228125 (353h33m3.202495775s) [upload=367562]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 10:59:22.471234277 (353h33m3.202501927s) [upload=367562]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 23 10:59:22.562484914 (353h33m3.293752564s) [upload=367562]: Next segment err: metaclient: Too Many Requests Aug 23 10:59:22.562506945 (353h33m3.293774595s) [upload=367562]: Done uploading segments... Aug 23 10:59:22.562549837 (353h33m3.293817487s) [upload=367562]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.31491874s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
106.824289ms
FAIL (2025-08-23 10:59:22 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 10:59:22.470705321 (353h33m3.201972971s) [upload=367562]: Starting upload Aug 23 10:59:22.470794509 (353h33m3.202062159s) [upload=367562]: Done starting upload Aug 23 10:59:22.470919043 (353h33m3.202186694s) [upload=367562]: Uploading segments... Aug 23 10:59:22.471169394 (353h33m3.202437044s) [upload=367562]: Got next segment. Inline: false Aug 23 10:59:22.471228125 (353h33m3.202495775s) [upload=367562]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 10:59:22.471234277 (353h33m3.202501927s) [upload=367562]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 23 10:59:22.562484914 (353h33m3.293752564s) [upload=367562]: Next segment err: metaclient: Too Many Requests Aug 23 10:59:22.562506945 (353h33m3.293774595s) [upload=367562]: Done uploading segments... Aug 23 10:59:22.562549837 (353h33m3.293817487s) [upload=367562]: Upload finished. err: metaclient: Too Many Requests
Duration: 106.847293ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [..X.......X......................X...X.......X..............] duration:
153.802932ms
FAIL (2025-08-23 10:58:48 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 10:48:33.463894757 (353h22m14.195162387s) [upload=367374]: Starting upload Aug 23 10:48:33.463962204 (353h22m14.195229834s) [upload=367374]: Done starting upload Aug 23 10:48:33.464008170 (353h22m14.195275791s) [upload=367374]: Uploading segments... Aug 23 10:48:33.464037165 (353h22m14.195304784s) [upload=367374]: Got next segment. Inline: true Aug 23 10:48:33.464040791 (353h22m14.195308412s) [upload=367374]: Waiting for error group managing segments... Aug 23 10:48:33.464071779 (353h22m14.1953394s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 10:48:33.464075707 (353h22m14.195343337s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 10:48:33.464078402 (353h22m14.195346032s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 10:48:33.470151547 (353h22m14.201419167s) [upload=367374]: Done uploading segments... Aug 23 10:48:33.470166876 (353h22m14.201434496s) [upload=367374]: Upload finished. err: metaclient: Too Many Requests
Duration: 153.827709ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [...X.......X......................X...X.......X.............] duration:
342.151702ms
FAIL (2025-08-23 10:58:31 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 10:48:33.463894757 (353h22m14.195162387s) [upload=367374]: Starting upload Aug 23 10:48:33.463962204 (353h22m14.195229834s) [upload=367374]: Done starting upload Aug 23 10:48:33.464008170 (353h22m14.195275791s) [upload=367374]: Uploading segments... Aug 23 10:48:33.464037165 (353h22m14.195304784s) [upload=367374]: Got next segment. Inline: true Aug 23 10:48:33.464040791 (353h22m14.195308412s) [upload=367374]: Waiting for error group managing segments... Aug 23 10:48:33.464071779 (353h22m14.1953394s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 10:48:33.464075707 (353h22m14.195343337s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 10:48:33.464078402 (353h22m14.195346032s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 10:48:33.470151547 (353h22m14.201419167s) [upload=367374]: Done uploading segments... Aug 23 10:48:33.470166876 (353h22m14.201434496s) [upload=367374]: Upload finished. err: metaclient: Too Many Requests
Duration: 342.173142ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [....X.......X......................X...X.......X............] duration:
133.448227ms
FAIL (2025-08-23 10:58:09 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 10:48:33.463894757 (353h22m14.195162387s) [upload=367374]: Starting upload Aug 23 10:48:33.463962204 (353h22m14.195229834s) [upload=367374]: Done starting upload Aug 23 10:48:33.464008170 (353h22m14.195275791s) [upload=367374]: Uploading segments... Aug 23 10:48:33.464037165 (353h22m14.195304784s) [upload=367374]: Got next segment. Inline: true Aug 23 10:48:33.464040791 (353h22m14.195308412s) [upload=367374]: Waiting for error group managing segments... Aug 23 10:48:33.464071779 (353h22m14.1953394s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 10:48:33.464075707 (353h22m14.195343337s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 10:48:33.464078402 (353h22m14.195346032s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 10:48:33.470151547 (353h22m14.201419167s) [upload=367374]: Done uploading segments... Aug 23 10:48:33.470166876 (353h22m14.201434496s) [upload=367374]: Upload finished. err: metaclient: Too Many Requests
Duration: 133.47114ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.....X.......X......................X...X.......X...........] duration:
146.483512ms
FAIL (2025-08-23 10:57:01 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 10:48:33.463894757 (353h22m14.195162387s) [upload=367374]: Starting upload Aug 23 10:48:33.463962204 (353h22m14.195229834s) [upload=367374]: Done starting upload Aug 23 10:48:33.464008170 (353h22m14.195275791s) [upload=367374]: Uploading segments... Aug 23 10:48:33.464037165 (353h22m14.195304784s) [upload=367374]: Got next segment. Inline: true Aug 23 10:48:33.464040791 (353h22m14.195308412s) [upload=367374]: Waiting for error group managing segments... Aug 23 10:48:33.464071779 (353h22m14.1953394s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 10:48:33.464075707 (353h22m14.195343337s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 10:48:33.464078402 (353h22m14.195346032s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 10:48:33.470151547 (353h22m14.201419167s) [upload=367374]: Done uploading segments... Aug 23 10:48:33.470166876 (353h22m14.201434496s) [upload=367374]: Upload finished. err: metaclient: Too Many Requests
Duration: 146.504952ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [......X.......X......................X...X.......X..........] duration:
335.979152ms
FAIL (2025-08-23 10:56:05 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 10:48:33.463894757 (353h22m14.195162387s) [upload=367374]: Starting upload Aug 23 10:48:33.463962204 (353h22m14.195229834s) [upload=367374]: Done starting upload Aug 23 10:48:33.464008170 (353h22m14.195275791s) [upload=367374]: Uploading segments... Aug 23 10:48:33.464037165 (353h22m14.195304784s) [upload=367374]: Got next segment. Inline: true Aug 23 10:48:33.464040791 (353h22m14.195308412s) [upload=367374]: Waiting for error group managing segments... Aug 23 10:48:33.464071779 (353h22m14.1953394s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 10:48:33.464075707 (353h22m14.195343337s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 10:48:33.464078402 (353h22m14.195346032s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 10:48:33.470151547 (353h22m14.201419167s) [upload=367374]: Done uploading segments... Aug 23 10:48:33.470166876 (353h22m14.201434496s) [upload=367374]: Upload finished. err: metaclient: Too Many Requests
Duration: 336.003187ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.......X.......X......................X...X.......X.........] duration:
399.062572ms
FAIL (2025-08-23 10:55:00 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 10:48:33.463894757 (353h22m14.195162387s) [upload=367374]: Starting upload Aug 23 10:48:33.463962204 (353h22m14.195229834s) [upload=367374]: Done starting upload Aug 23 10:48:33.464008170 (353h22m14.195275791s) [upload=367374]: Uploading segments... Aug 23 10:48:33.464037165 (353h22m14.195304784s) [upload=367374]: Got next segment. Inline: true Aug 23 10:48:33.464040791 (353h22m14.195308412s) [upload=367374]: Waiting for error group managing segments... Aug 23 10:48:33.464071779 (353h22m14.1953394s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 10:48:33.464075707 (353h22m14.195343337s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 10:48:33.464078402 (353h22m14.195346032s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 10:48:33.470151547 (353h22m14.201419167s) [upload=367374]: Done uploading segments... Aug 23 10:48:33.470166876 (353h22m14.201434496s) [upload=367374]: Upload finished. err: metaclient: Too Many Requests
Duration: 399.081227ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [........X.......X......................X...X.......X........] duration:
164.488769ms
FAIL (2025-08-23 10:54:12 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 10:48:33.463894757 (353h22m14.195162387s) [upload=367374]: Starting upload Aug 23 10:48:33.463962204 (353h22m14.195229834s) [upload=367374]: Done starting upload Aug 23 10:48:33.464008170 (353h22m14.195275791s) [upload=367374]: Uploading segments... Aug 23 10:48:33.464037165 (353h22m14.195304784s) [upload=367374]: Got next segment. Inline: true Aug 23 10:48:33.464040791 (353h22m14.195308412s) [upload=367374]: Waiting for error group managing segments... Aug 23 10:48:33.464071779 (353h22m14.1953394s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 10:48:33.464075707 (353h22m14.195343337s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 10:48:33.464078402 (353h22m14.195346032s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 10:48:33.470151547 (353h22m14.201419167s) [upload=367374]: Done uploading segments... Aug 23 10:48:33.470166876 (353h22m14.201434496s) [upload=367374]: Upload finished. err: metaclient: Too Many Requests
Duration: 164.509448ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.........X.......X......................X...X.......X.......] duration:
131.352191ms
FAIL (2025-08-23 10:53:14 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 10:48:33.463894757 (353h22m14.195162387s) [upload=367374]: Starting upload Aug 23 10:48:33.463962204 (353h22m14.195229834s) [upload=367374]: Done starting upload Aug 23 10:48:33.464008170 (353h22m14.195275791s) [upload=367374]: Uploading segments... Aug 23 10:48:33.464037165 (353h22m14.195304784s) [upload=367374]: Got next segment. Inline: true Aug 23 10:48:33.464040791 (353h22m14.195308412s) [upload=367374]: Waiting for error group managing segments... Aug 23 10:48:33.464071779 (353h22m14.1953394s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 10:48:33.464075707 (353h22m14.195343337s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 10:48:33.464078402 (353h22m14.195346032s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 10:48:33.470151547 (353h22m14.201419167s) [upload=367374]: Done uploading segments... Aug 23 10:48:33.470166876 (353h22m14.201434496s) [upload=367374]: Upload finished. err: metaclient: Too Many Requests
Duration: 131.371107ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [..........X.......X......................X...X.......X......] duration:
139.435119ms
FAIL (2025-08-23 10:52:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 10:48:33.463894757 (353h22m14.195162387s) [upload=367374]: Starting upload Aug 23 10:48:33.463962204 (353h22m14.195229834s) [upload=367374]: Done starting upload Aug 23 10:48:33.464008170 (353h22m14.195275791s) [upload=367374]: Uploading segments... Aug 23 10:48:33.464037165 (353h22m14.195304784s) [upload=367374]: Got next segment. Inline: true Aug 23 10:48:33.464040791 (353h22m14.195308412s) [upload=367374]: Waiting for error group managing segments... Aug 23 10:48:33.464071779 (353h22m14.1953394s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 10:48:33.464075707 (353h22m14.195343337s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 10:48:33.464078402 (353h22m14.195346032s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 10:48:33.470151547 (353h22m14.201419167s) [upload=367374]: Done uploading segments... Aug 23 10:48:33.470166876 (353h22m14.201434496s) [upload=367374]: Upload finished. err: metaclient: Too Many Requests
Duration: 139.458302ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [...........X.......X......................X...X.......X.....] duration:
189.53254ms
FAIL (2025-08-23 10:52:07 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 10:48:33.463894757 (353h22m14.195162387s) [upload=367374]: Starting upload Aug 23 10:48:33.463962204 (353h22m14.195229834s) [upload=367374]: Done starting upload Aug 23 10:48:33.464008170 (353h22m14.195275791s) [upload=367374]: Uploading segments... Aug 23 10:48:33.464037165 (353h22m14.195304784s) [upload=367374]: Got next segment. Inline: true Aug 23 10:48:33.464040791 (353h22m14.195308412s) [upload=367374]: Waiting for error group managing segments... Aug 23 10:48:33.464071779 (353h22m14.1953394s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 10:48:33.464075707 (353h22m14.195343337s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 10:48:33.464078402 (353h22m14.195346032s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 10:48:33.470151547 (353h22m14.201419167s) [upload=367374]: Done uploading segments... Aug 23 10:48:33.470166876 (353h22m14.201434496s) [upload=367374]: Upload finished. err: metaclient: Too Many Requests
Duration: 189.554863ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [............X.......X......................X...X.......X....] duration:
114.956604ms
FAIL (2025-08-23 10:51:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 10:48:33.463894757 (353h22m14.195162387s) [upload=367374]: Starting upload Aug 23 10:48:33.463962204 (353h22m14.195229834s) [upload=367374]: Done starting upload Aug 23 10:48:33.464008170 (353h22m14.195275791s) [upload=367374]: Uploading segments... Aug 23 10:48:33.464037165 (353h22m14.195304784s) [upload=367374]: Got next segment. Inline: true Aug 23 10:48:33.464040791 (353h22m14.195308412s) [upload=367374]: Waiting for error group managing segments... Aug 23 10:48:33.464071779 (353h22m14.1953394s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 10:48:33.464075707 (353h22m14.195343337s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 10:48:33.464078402 (353h22m14.195346032s) [upload=367374]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 10:48:33.470151547 (353h22m14.201419167s) [upload=367374]: Done uploading segments... Aug 23 10:48:33.470166876 (353h22m14.201434496s) [upload=367374]: Upload finished. err: metaclient: Too Many Requests
Duration: 114.971432ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|