Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....X...............................................X.......] duration:
755.190762ms
FAIL (2025-08-23 16:14:58 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 02c623bc1bab4dcc41a3f90f9a1db7dbe283d77f717502af9f63bd0c28bdbf3e != before 02d7478e4556f5b400fdb5e53f46899b98cad3be7c387c1a6c4e11cdea7cd161
======LOGS======
Aug 23 16:08:57.456768654 (358h42m38.188036275s) [upload=372908]: Starting upload
Aug 23 16:08:57.456820962 (358h42m38.188088623s) [upload=372908]: Done starting upload
Aug 23 16:08:57.456866259 (358h42m38.188133878s) [upload=372908]: Uploading segments...
Aug 23 16:08:57.457054823 (358h42m38.188322453s) [upload=372908]: Got next segment. Inline: false
Aug 23 16:08:57.457087154 (358h42m38.188354774s) [upload=372908]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 16:08:57.457091112 (358h42m38.188358732s) [upload=372908]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 16:08:57.548658973 (358h42m38.279926594s) [seg_pos={0 0}, upload=372908]: Begin upload segment...
Aug 23 16:08:57.548687037 (358h42m38.279954657s) [seg_pos={0 0}, upload=372908]: Done begin upload segment.
Aug 23 16:08:57.548713166 (358h42m38.279980796s) [noise=true , address=104.36.82.18:4385 , piece_id=4X6RPFXKC6ZVAFOAVPERT7U36KVTKJVDJ6MRFBGLSVHYKFTNTOGA, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.548725129 (358h42m38.279992749s) [noise=true , address=45.91.116.4:4942 , piece_id=XN4ZJPMUTRUQS37TJHUR4TXG3MPJJUCXMTZG5Q5BECTRM62UPQPA, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.548780553 (358h42m38.280048173s) [noise=true , address=77.90.31.15:4709 , piece_id=6NSHEOKN4MP6XDCWLSER7BLIUCBC2X33DIP7US2N5AOVBUWDDGHA, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549015615 (358h42m38.280283225s) [noise=true , address=104.36.82.2:4739 , piece_id=R52RMNHPVWJ42BYALCJ2P6HRRADDI4GA5LLOK543T7CSVVMGNEHQ, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549032968 (358h42m38.280300598s) [noise=true , address=77.90.31.12:4599 , piece_id=5YIVHBG5L5KW5TLKWEJ6ZPOPZXZ42I4WCAKVLS4OMCGDYSAXKWBQ, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549269684 (358h42m38.280537304s) [noise=true , address=77.90.31.21:4885 , piece_id=U6WPOG4ZEC2PCLYF4CUKA74VYXPA7A7WKLX2D65NSVCHTRW4MM3Q, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549288589 (358h42m38.28055621s) [noise=true , address=104.36.82.49:4003 , piece_id=CPN32A5FSEPHWWMUO4LSRR3JYUYPTDVMREX55JCXVHCKGUQBJETQ, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549496441 (358h42m38.280764051s) [noise=true , address=104.36.82.44:4902 , piece_id=I26CMBQSW7D5VK3NGTFP5JPAOXVZECHG6VPNU7YJPKBHIFWL2KAA, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549502072 (358h42m38.280769692s) [noise=true , address=77.90.31.18:4823 , piece_id=XCQ6V7U2RLOH7CFAWGEXPNJ3IA5HUSHSDBB44MPBCG7TKYOJN32Q, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549712206 (358h42m38.280979817s) [noise=true , address=104.36.82.23:4454 , piece_id=W5XBSSFVNA25ZUI3BDYAY6ZFNC3JINP2OCX4JPORXEDXTQZJSP6A, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549775957 (358h42m38.281043577s) [noise=true , address=104.36.82.19:4401 , piece_id=7JFP2DBPOXXOR2XSDS7AZRMFBCPAGVSOOIKI66OHMAYNM4G5EI6Q, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549894340 (358h42m38.281161961s) [noise=true , address=77.90.31.13:4643 , piece_id=4DRPWRPIVUNT7WIPB7JG55ZCLHEWI43LK7LJT2FSUEQHATYLPDNQ, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.550039664 (358h42m38.281307284s) [noise=true , address=104.36.82.5:4856 , piece_id=EBVOFDU7MNAFDGBQY5BWNIRBP7ESYR4JZDY3L6SPKULWP4CY5H4A, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.550068298 (358h42m38.281335918s) [noise=true , address=104.36.82.37:4658 , piece_id=7ZNJGSQJPOTRC7H6HBI7XURZFC2NKHP2HEC2BS6RRKCCJ5FR2RXQ, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.550251393 (358h42m38.281519013s) [noise=true , address=45.91.116.9:4281 , piece_id=ZJH4MUQDLJ76SPQWTUIRS4XAOI2CXF4KN24JYJW7NE6Z63T7LR2Q, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.550321865 (358h42m38.281589495s) [noise=true , address=104.36.82.7:4915 , piece_id=5AJVDZB3F4UOGJ6N2CZSVMVE3EPVKMWERXUGKVOKG4JT2JHJIPOA, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.550591683 (358h42m38.281859313s) [noise=true , address=79.127.219.47:4054 , piece_id=KM747OPQKIZW7KT5VDMRTOEVQN5I6XF6QW65VAO3SMM3IALKECOQ, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.550864687 (358h42m38.282132317s) [noise=true , address=104.36.82.6:4902 , piece_id=SZB4T47UHYLLDMREDWSEU37DLX2VPEWK2UOTCNZRTWMGG2QGYV7Q, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.664739165 (358h42m38.396006795s) [upload=372908]: Next returned nil segment
Aug 23 16:08:57.664754735 (358h42m38.396022365s) [upload=372908]: Waiting for error group managing segments...
Aug 23 16:08:57.678607280 (358h42m38.40987492s) [noise=true , address=45.91.116.9:4281 , piece_id=ZJH4MUQDLJ76SPQWTUIRS4XAOI2CXF4KN24JYJW7NE6Z63T7LR2Q, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.680512288 (358h42m38.411779918s) [noise=true , address=104.36.82.37:4658 , piece_id=7ZNJGSQJPOTRC7H6HBI7XURZFC2NKHP2HEC2BS6RRKCCJ5FR2RXQ, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.682345740 (358h42m38.41361337s) [noise=true , address=104.36.82.23:4454 , piece_id=W5XBSSFVNA25ZUI3BDYAY6ZFNC3JINP2OCX4JPORXEDXTQZJSP6A, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.683981029 (358h42m38.415248669s) [noise=true , address=104.36.82.2:4739 , piece_id=R52RMNHPVWJ42BYALCJ2P6HRRADDI4GA5LLOK543T7CSVVMGNEHQ, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.685575582 (358h42m38.416843212s) [noise=true , address=104.36.82.49:4003 , piece_id=CPN32A5FSEPHWWMUO4LSRR3JYUYPTDVMREX55JCXVHCKGUQBJETQ, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.686141057 (358h42m38.417408687s) [noise=true , address=77.90.31.21:4885 , piece_id=U6WPOG4ZEC2PCLYF4CUKA74VYXPA7A7WKLX2D65NSVCHTRW4MM3Q, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.686632682 (358h42m38.417900312s) [noise=true , address=104.36.82.44:4902 , piece_id=I26CMBQSW7D5VK3NGTFP5JPAOXVZECHG6VPNU7YJPKBHIFWL2KAA, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.688279344 (358h42m38.419546974s) [noise=true , address=79.127.219.47:4054 , piece_id=KM747OPQKIZW7KT5VDMRTOEVQN5I6XF6QW65VAO3SMM3IALKECOQ, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.692935091 (358h42m38.424202711s) [noise=true , address=45.91.116.4:4942 , piece_id=XN4ZJPMUTRUQS37TJHUR4TXG3MPJJUCXMTZG5Q5BECTRM62UPQPA, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.693333481 (358h42m38.424601111s) [noise=true , address=104.36.82.7:4915 , piece_id=5AJVDZB3F4UOGJ6N2CZSVMVE3EPVKMWERXUGKVOKG4JT2JHJIPOA, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.694526558 (358h42m38.425794198s) [noise=true , address=77.90.31.13:4643 , piece_id=4DRPWRPIVUNT7WIPB7JG55ZCLHEWI43LK7LJT2FSUEQHATYLPDNQ, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.711494921 (358h42m38.44276257s) [noise=true , address=104.36.82.19:4401 , piece_id=7JFP2DBPOXXOR2XSDS7AZRMFBCPAGVSOOIKI66OHMAYNM4G5EI6Q, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.711640766 (358h42m38.442908396s) [noise=true , address=104.36.82.6:4902 , piece_id=SZB4T47UHYLLDMREDWSEU37DLX2VPEWK2UOTCNZRTWMGG2QGYV7Q, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.713821092 (358h42m38.445088722s) [noise=true , address=77.90.31.15:4709 , piece_id=6NSHEOKN4MP6XDCWLSER7BLIUCBC2X33DIP7US2N5AOVBUWDDGHA, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.713830168 (358h42m38.445097798s) [seg_pos={0 0}, upload=372908]: Segment reached optimal threshold of 14 pieces.
Aug 23 16:08:57.713976894 (358h42m38.445244524s) [noise=true , address=77.90.31.18:4823 , piece_id=XCQ6V7U2RLOH7CFAWGEXPNJ3IA5HUSHSDBB44MPBCG7TKYOJN32Q, seg_pos={0 0}, upload=372908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uUCUDKZDwj25UcEKQ4WiTuQFMRbWw2oymGAdUdMX8wcUSd7jS): protocol: expected piece hash; context canceled; EOF
Aug 23 16:08:57.714087132 (358h42m38.445354783s) [noise=true , address=77.90.31.12:4599 , piece_id=5YIVHBG5L5KW5TLKWEJ6ZPOPZXZ42I4WCAKVLS4OMCGDYSAXKWBQ, seg_pos={0 0}, upload=372908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124cEnKBraQScM26K7Zc8Z3cqTvrD9fPyWzWYutYryfXqmXQ3rn): protocol: expected piece hash; context canceled; EOF
Aug 23 16:08:57.714106288 (358h42m38.445373939s) [noise=true , address=104.36.82.18:4385 , piece_id=4X6RPFXKC6ZVAFOAVPERT7U36KVTKJVDJ6MRFBGLSVHYKFTNTOGA, seg_pos={0 0}, upload=372908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123PZh1ieWYoc9U5CRrRzV1ZTpGYmjLmh5CpRy1NRC8wiLkumbs): protocol: write tcp 5.161.89.252:61662->104.36.82.18:4385: use of closed network connection; write tcp 5.161.89.252:61662->104.36.82.18:4385: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:61662->104.36.82.18:4385: use of closed network connection
Aug 23 16:08:57.714164539 (358h42m38.445432169s) [noise=true , address=104.36.82.5:4856 , piece_id=EBVOFDU7MNAFDGBQY5BWNIRBP7ESYR4JZDY3L6SPKULWP4CY5H4A, seg_pos={0 0}, upload=372908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mXTGa9rxx8jU8oKLmR9obX3Utn7p5rQH2GeK6LeJ6jiNvfYZ6): protocol: expected piece hash; context canceled; EOF
Aug 23 16:08:57.714192391 (358h42m38.445460021s) [seg_pos={0 0}, upload=372908]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 16:08:57.714257122 (358h42m38.445524752s) [upload=372908]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 16:08:57.714261051 (358h42m38.445528681s) [upload=372908]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 16:08:58.051756128 (358h42m38.783023748s) [upload=372908]: Done uploading segments...
Aug 23 16:08:58.051769713 (358h42m38.783037334s) [upload=372908]: Upload finished. err: <nil>
Duration: 755.218234ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
284.292271ms
FAIL (2025-08-23 16:14:58 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 15:40:51.509312115 (358h14m32.240579766s) [upload=372416]: Starting upload Aug 23 15:40:51.509373452 (358h14m32.240641102s) [upload=372416]: Done starting upload Aug 23 15:40:51.509446459 (358h14m32.240714109s) [upload=372416]: Uploading segments... Aug 23 15:40:51.509484341 (358h14m32.240751991s) [upload=372416]: Got next segment. Inline: true Aug 23 15:40:51.509489591 (358h14m32.24075724s) [upload=372416]: Waiting for error group managing segments... Aug 23 15:40:51.509589939 (358h14m32.240857599s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 15:40:51.509596361 (358h14m32.240864011s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 15:40:51.509599737 (358h14m32.240867387s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 15:40:51.531216995 (358h14m32.262484646s) [upload=372416]: Done uploading segments... Aug 23 15:40:51.531235010 (358h14m32.26250268s) [upload=372416]: Upload finished. err: metaclient: Too Many Requests
Duration: 284.317469ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....X...............................................X......] duration:
543.598174ms
FAIL (2025-08-23 16:14:36 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 02c623bc1bab4dcc41a3f90f9a1db7dbe283d77f717502af9f63bd0c28bdbf3e != before 02d7478e4556f5b400fdb5e53f46899b98cad3be7c387c1a6c4e11cdea7cd161
======LOGS======
Aug 23 16:08:57.456768654 (358h42m38.188036275s) [upload=372908]: Starting upload
Aug 23 16:08:57.456820962 (358h42m38.188088623s) [upload=372908]: Done starting upload
Aug 23 16:08:57.456866259 (358h42m38.188133878s) [upload=372908]: Uploading segments...
Aug 23 16:08:57.457054823 (358h42m38.188322453s) [upload=372908]: Got next segment. Inline: false
Aug 23 16:08:57.457087154 (358h42m38.188354774s) [upload=372908]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 16:08:57.457091112 (358h42m38.188358732s) [upload=372908]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 16:08:57.548658973 (358h42m38.279926594s) [seg_pos={0 0}, upload=372908]: Begin upload segment...
Aug 23 16:08:57.548687037 (358h42m38.279954657s) [seg_pos={0 0}, upload=372908]: Done begin upload segment.
Aug 23 16:08:57.548713166 (358h42m38.279980796s) [noise=true , address=104.36.82.18:4385 , piece_id=4X6RPFXKC6ZVAFOAVPERT7U36KVTKJVDJ6MRFBGLSVHYKFTNTOGA, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.548725129 (358h42m38.279992749s) [noise=true , address=45.91.116.4:4942 , piece_id=XN4ZJPMUTRUQS37TJHUR4TXG3MPJJUCXMTZG5Q5BECTRM62UPQPA, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.548780553 (358h42m38.280048173s) [noise=true , address=77.90.31.15:4709 , piece_id=6NSHEOKN4MP6XDCWLSER7BLIUCBC2X33DIP7US2N5AOVBUWDDGHA, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549015615 (358h42m38.280283225s) [noise=true , address=104.36.82.2:4739 , piece_id=R52RMNHPVWJ42BYALCJ2P6HRRADDI4GA5LLOK543T7CSVVMGNEHQ, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549032968 (358h42m38.280300598s) [noise=true , address=77.90.31.12:4599 , piece_id=5YIVHBG5L5KW5TLKWEJ6ZPOPZXZ42I4WCAKVLS4OMCGDYSAXKWBQ, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549269684 (358h42m38.280537304s) [noise=true , address=77.90.31.21:4885 , piece_id=U6WPOG4ZEC2PCLYF4CUKA74VYXPA7A7WKLX2D65NSVCHTRW4MM3Q, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549288589 (358h42m38.28055621s) [noise=true , address=104.36.82.49:4003 , piece_id=CPN32A5FSEPHWWMUO4LSRR3JYUYPTDVMREX55JCXVHCKGUQBJETQ, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549496441 (358h42m38.280764051s) [noise=true , address=104.36.82.44:4902 , piece_id=I26CMBQSW7D5VK3NGTFP5JPAOXVZECHG6VPNU7YJPKBHIFWL2KAA, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549502072 (358h42m38.280769692s) [noise=true , address=77.90.31.18:4823 , piece_id=XCQ6V7U2RLOH7CFAWGEXPNJ3IA5HUSHSDBB44MPBCG7TKYOJN32Q, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549712206 (358h42m38.280979817s) [noise=true , address=104.36.82.23:4454 , piece_id=W5XBSSFVNA25ZUI3BDYAY6ZFNC3JINP2OCX4JPORXEDXTQZJSP6A, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549775957 (358h42m38.281043577s) [noise=true , address=104.36.82.19:4401 , piece_id=7JFP2DBPOXXOR2XSDS7AZRMFBCPAGVSOOIKI66OHMAYNM4G5EI6Q, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549894340 (358h42m38.281161961s) [noise=true , address=77.90.31.13:4643 , piece_id=4DRPWRPIVUNT7WIPB7JG55ZCLHEWI43LK7LJT2FSUEQHATYLPDNQ, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.550039664 (358h42m38.281307284s) [noise=true , address=104.36.82.5:4856 , piece_id=EBVOFDU7MNAFDGBQY5BWNIRBP7ESYR4JZDY3L6SPKULWP4CY5H4A, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.550068298 (358h42m38.281335918s) [noise=true , address=104.36.82.37:4658 , piece_id=7ZNJGSQJPOTRC7H6HBI7XURZFC2NKHP2HEC2BS6RRKCCJ5FR2RXQ, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.550251393 (358h42m38.281519013s) [noise=true , address=45.91.116.9:4281 , piece_id=ZJH4MUQDLJ76SPQWTUIRS4XAOI2CXF4KN24JYJW7NE6Z63T7LR2Q, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.550321865 (358h42m38.281589495s) [noise=true , address=104.36.82.7:4915 , piece_id=5AJVDZB3F4UOGJ6N2CZSVMVE3EPVKMWERXUGKVOKG4JT2JHJIPOA, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.550591683 (358h42m38.281859313s) [noise=true , address=79.127.219.47:4054 , piece_id=KM747OPQKIZW7KT5VDMRTOEVQN5I6XF6QW65VAO3SMM3IALKECOQ, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.550864687 (358h42m38.282132317s) [noise=true , address=104.36.82.6:4902 , piece_id=SZB4T47UHYLLDMREDWSEU37DLX2VPEWK2UOTCNZRTWMGG2QGYV7Q, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.664739165 (358h42m38.396006795s) [upload=372908]: Next returned nil segment
Aug 23 16:08:57.664754735 (358h42m38.396022365s) [upload=372908]: Waiting for error group managing segments...
Aug 23 16:08:57.678607280 (358h42m38.40987492s) [noise=true , address=45.91.116.9:4281 , piece_id=ZJH4MUQDLJ76SPQWTUIRS4XAOI2CXF4KN24JYJW7NE6Z63T7LR2Q, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.680512288 (358h42m38.411779918s) [noise=true , address=104.36.82.37:4658 , piece_id=7ZNJGSQJPOTRC7H6HBI7XURZFC2NKHP2HEC2BS6RRKCCJ5FR2RXQ, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.682345740 (358h42m38.41361337s) [noise=true , address=104.36.82.23:4454 , piece_id=W5XBSSFVNA25ZUI3BDYAY6ZFNC3JINP2OCX4JPORXEDXTQZJSP6A, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.683981029 (358h42m38.415248669s) [noise=true , address=104.36.82.2:4739 , piece_id=R52RMNHPVWJ42BYALCJ2P6HRRADDI4GA5LLOK543T7CSVVMGNEHQ, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.685575582 (358h42m38.416843212s) [noise=true , address=104.36.82.49:4003 , piece_id=CPN32A5FSEPHWWMUO4LSRR3JYUYPTDVMREX55JCXVHCKGUQBJETQ, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.686141057 (358h42m38.417408687s) [noise=true , address=77.90.31.21:4885 , piece_id=U6WPOG4ZEC2PCLYF4CUKA74VYXPA7A7WKLX2D65NSVCHTRW4MM3Q, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.686632682 (358h42m38.417900312s) [noise=true , address=104.36.82.44:4902 , piece_id=I26CMBQSW7D5VK3NGTFP5JPAOXVZECHG6VPNU7YJPKBHIFWL2KAA, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.688279344 (358h42m38.419546974s) [noise=true , address=79.127.219.47:4054 , piece_id=KM747OPQKIZW7KT5VDMRTOEVQN5I6XF6QW65VAO3SMM3IALKECOQ, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.692935091 (358h42m38.424202711s) [noise=true , address=45.91.116.4:4942 , piece_id=XN4ZJPMUTRUQS37TJHUR4TXG3MPJJUCXMTZG5Q5BECTRM62UPQPA, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.693333481 (358h42m38.424601111s) [noise=true , address=104.36.82.7:4915 , piece_id=5AJVDZB3F4UOGJ6N2CZSVMVE3EPVKMWERXUGKVOKG4JT2JHJIPOA, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.694526558 (358h42m38.425794198s) [noise=true , address=77.90.31.13:4643 , piece_id=4DRPWRPIVUNT7WIPB7JG55ZCLHEWI43LK7LJT2FSUEQHATYLPDNQ, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.711494921 (358h42m38.44276257s) [noise=true , address=104.36.82.19:4401 , piece_id=7JFP2DBPOXXOR2XSDS7AZRMFBCPAGVSOOIKI66OHMAYNM4G5EI6Q, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.711640766 (358h42m38.442908396s) [noise=true , address=104.36.82.6:4902 , piece_id=SZB4T47UHYLLDMREDWSEU37DLX2VPEWK2UOTCNZRTWMGG2QGYV7Q, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.713821092 (358h42m38.445088722s) [noise=true , address=77.90.31.15:4709 , piece_id=6NSHEOKN4MP6XDCWLSER7BLIUCBC2X33DIP7US2N5AOVBUWDDGHA, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.713830168 (358h42m38.445097798s) [seg_pos={0 0}, upload=372908]: Segment reached optimal threshold of 14 pieces.
Aug 23 16:08:57.713976894 (358h42m38.445244524s) [noise=true , address=77.90.31.18:4823 , piece_id=XCQ6V7U2RLOH7CFAWGEXPNJ3IA5HUSHSDBB44MPBCG7TKYOJN32Q, seg_pos={0 0}, upload=372908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uUCUDKZDwj25UcEKQ4WiTuQFMRbWw2oymGAdUdMX8wcUSd7jS): protocol: expected piece hash; context canceled; EOF
Aug 23 16:08:57.714087132 (358h42m38.445354783s) [noise=true , address=77.90.31.12:4599 , piece_id=5YIVHBG5L5KW5TLKWEJ6ZPOPZXZ42I4WCAKVLS4OMCGDYSAXKWBQ, seg_pos={0 0}, upload=372908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124cEnKBraQScM26K7Zc8Z3cqTvrD9fPyWzWYutYryfXqmXQ3rn): protocol: expected piece hash; context canceled; EOF
Aug 23 16:08:57.714106288 (358h42m38.445373939s) [noise=true , address=104.36.82.18:4385 , piece_id=4X6RPFXKC6ZVAFOAVPERT7U36KVTKJVDJ6MRFBGLSVHYKFTNTOGA, seg_pos={0 0}, upload=372908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123PZh1ieWYoc9U5CRrRzV1ZTpGYmjLmh5CpRy1NRC8wiLkumbs): protocol: write tcp 5.161.89.252:61662->104.36.82.18:4385: use of closed network connection; write tcp 5.161.89.252:61662->104.36.82.18:4385: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:61662->104.36.82.18:4385: use of closed network connection
Aug 23 16:08:57.714164539 (358h42m38.445432169s) [noise=true , address=104.36.82.5:4856 , piece_id=EBVOFDU7MNAFDGBQY5BWNIRBP7ESYR4JZDY3L6SPKULWP4CY5H4A, seg_pos={0 0}, upload=372908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mXTGa9rxx8jU8oKLmR9obX3Utn7p5rQH2GeK6LeJ6jiNvfYZ6): protocol: expected piece hash; context canceled; EOF
Aug 23 16:08:57.714192391 (358h42m38.445460021s) [seg_pos={0 0}, upload=372908]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 16:08:57.714257122 (358h42m38.445524752s) [upload=372908]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 16:08:57.714261051 (358h42m38.445528681s) [upload=372908]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 16:08:58.051756128 (358h42m38.783023748s) [upload=372908]: Done uploading segments...
Aug 23 16:08:58.051769713 (358h42m38.783037334s) [upload=372908]: Upload finished. err: <nil>
Duration: 543.626708ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
256.467746ms
FAIL (2025-08-23 16:14:08 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 15:40:51.509312115 (358h14m32.240579766s) [upload=372416]: Starting upload Aug 23 15:40:51.509373452 (358h14m32.240641102s) [upload=372416]: Done starting upload Aug 23 15:40:51.509446459 (358h14m32.240714109s) [upload=372416]: Uploading segments... Aug 23 15:40:51.509484341 (358h14m32.240751991s) [upload=372416]: Got next segment. Inline: true Aug 23 15:40:51.509489591 (358h14m32.24075724s) [upload=372416]: Waiting for error group managing segments... Aug 23 15:40:51.509589939 (358h14m32.240857599s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 15:40:51.509596361 (358h14m32.240864011s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 15:40:51.509599737 (358h14m32.240867387s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 15:40:51.531216995 (358h14m32.262484646s) [upload=372416]: Done uploading segments... Aug 23 15:40:51.531235010 (358h14m32.26250268s) [upload=372416]: Upload finished. err: metaclient: Too Many Requests
Duration: 256.492202ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
355.857075ms
FAIL (2025-08-23 16:13:30 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 15:40:51.509312115 (358h14m32.240579766s) [upload=372416]: Starting upload Aug 23 15:40:51.509373452 (358h14m32.240641102s) [upload=372416]: Done starting upload Aug 23 15:40:51.509446459 (358h14m32.240714109s) [upload=372416]: Uploading segments... Aug 23 15:40:51.509484341 (358h14m32.240751991s) [upload=372416]: Got next segment. Inline: true Aug 23 15:40:51.509489591 (358h14m32.24075724s) [upload=372416]: Waiting for error group managing segments... Aug 23 15:40:51.509589939 (358h14m32.240857599s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 15:40:51.509596361 (358h14m32.240864011s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 15:40:51.509599737 (358h14m32.240867387s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 15:40:51.531216995 (358h14m32.262484646s) [upload=372416]: Done uploading segments... Aug 23 15:40:51.531235010 (358h14m32.26250268s) [upload=372416]: Upload finished. err: metaclient: Too Many Requests
Duration: 355.900758ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......X...............................................X.....] duration:
1.822475562s
FAIL (2025-08-23 16:13:27 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 02c623bc1bab4dcc41a3f90f9a1db7dbe283d77f717502af9f63bd0c28bdbf3e != before 02d7478e4556f5b400fdb5e53f46899b98cad3be7c387c1a6c4e11cdea7cd161
======LOGS======
Aug 23 16:08:57.456768654 (358h42m38.188036275s) [upload=372908]: Starting upload
Aug 23 16:08:57.456820962 (358h42m38.188088623s) [upload=372908]: Done starting upload
Aug 23 16:08:57.456866259 (358h42m38.188133878s) [upload=372908]: Uploading segments...
Aug 23 16:08:57.457054823 (358h42m38.188322453s) [upload=372908]: Got next segment. Inline: false
Aug 23 16:08:57.457087154 (358h42m38.188354774s) [upload=372908]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 16:08:57.457091112 (358h42m38.188358732s) [upload=372908]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 16:08:57.548658973 (358h42m38.279926594s) [seg_pos={0 0}, upload=372908]: Begin upload segment...
Aug 23 16:08:57.548687037 (358h42m38.279954657s) [seg_pos={0 0}, upload=372908]: Done begin upload segment.
Aug 23 16:08:57.548713166 (358h42m38.279980796s) [noise=true , address=104.36.82.18:4385 , piece_id=4X6RPFXKC6ZVAFOAVPERT7U36KVTKJVDJ6MRFBGLSVHYKFTNTOGA, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.548725129 (358h42m38.279992749s) [noise=true , address=45.91.116.4:4942 , piece_id=XN4ZJPMUTRUQS37TJHUR4TXG3MPJJUCXMTZG5Q5BECTRM62UPQPA, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.548780553 (358h42m38.280048173s) [noise=true , address=77.90.31.15:4709 , piece_id=6NSHEOKN4MP6XDCWLSER7BLIUCBC2X33DIP7US2N5AOVBUWDDGHA, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549015615 (358h42m38.280283225s) [noise=true , address=104.36.82.2:4739 , piece_id=R52RMNHPVWJ42BYALCJ2P6HRRADDI4GA5LLOK543T7CSVVMGNEHQ, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549032968 (358h42m38.280300598s) [noise=true , address=77.90.31.12:4599 , piece_id=5YIVHBG5L5KW5TLKWEJ6ZPOPZXZ42I4WCAKVLS4OMCGDYSAXKWBQ, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549269684 (358h42m38.280537304s) [noise=true , address=77.90.31.21:4885 , piece_id=U6WPOG4ZEC2PCLYF4CUKA74VYXPA7A7WKLX2D65NSVCHTRW4MM3Q, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549288589 (358h42m38.28055621s) [noise=true , address=104.36.82.49:4003 , piece_id=CPN32A5FSEPHWWMUO4LSRR3JYUYPTDVMREX55JCXVHCKGUQBJETQ, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549496441 (358h42m38.280764051s) [noise=true , address=104.36.82.44:4902 , piece_id=I26CMBQSW7D5VK3NGTFP5JPAOXVZECHG6VPNU7YJPKBHIFWL2KAA, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549502072 (358h42m38.280769692s) [noise=true , address=77.90.31.18:4823 , piece_id=XCQ6V7U2RLOH7CFAWGEXPNJ3IA5HUSHSDBB44MPBCG7TKYOJN32Q, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549712206 (358h42m38.280979817s) [noise=true , address=104.36.82.23:4454 , piece_id=W5XBSSFVNA25ZUI3BDYAY6ZFNC3JINP2OCX4JPORXEDXTQZJSP6A, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549775957 (358h42m38.281043577s) [noise=true , address=104.36.82.19:4401 , piece_id=7JFP2DBPOXXOR2XSDS7AZRMFBCPAGVSOOIKI66OHMAYNM4G5EI6Q, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549894340 (358h42m38.281161961s) [noise=true , address=77.90.31.13:4643 , piece_id=4DRPWRPIVUNT7WIPB7JG55ZCLHEWI43LK7LJT2FSUEQHATYLPDNQ, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.550039664 (358h42m38.281307284s) [noise=true , address=104.36.82.5:4856 , piece_id=EBVOFDU7MNAFDGBQY5BWNIRBP7ESYR4JZDY3L6SPKULWP4CY5H4A, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.550068298 (358h42m38.281335918s) [noise=true , address=104.36.82.37:4658 , piece_id=7ZNJGSQJPOTRC7H6HBI7XURZFC2NKHP2HEC2BS6RRKCCJ5FR2RXQ, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.550251393 (358h42m38.281519013s) [noise=true , address=45.91.116.9:4281 , piece_id=ZJH4MUQDLJ76SPQWTUIRS4XAOI2CXF4KN24JYJW7NE6Z63T7LR2Q, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.550321865 (358h42m38.281589495s) [noise=true , address=104.36.82.7:4915 , piece_id=5AJVDZB3F4UOGJ6N2CZSVMVE3EPVKMWERXUGKVOKG4JT2JHJIPOA, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.550591683 (358h42m38.281859313s) [noise=true , address=79.127.219.47:4054 , piece_id=KM747OPQKIZW7KT5VDMRTOEVQN5I6XF6QW65VAO3SMM3IALKECOQ, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.550864687 (358h42m38.282132317s) [noise=true , address=104.36.82.6:4902 , piece_id=SZB4T47UHYLLDMREDWSEU37DLX2VPEWK2UOTCNZRTWMGG2QGYV7Q, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.664739165 (358h42m38.396006795s) [upload=372908]: Next returned nil segment
Aug 23 16:08:57.664754735 (358h42m38.396022365s) [upload=372908]: Waiting for error group managing segments...
Aug 23 16:08:57.678607280 (358h42m38.40987492s) [noise=true , address=45.91.116.9:4281 , piece_id=ZJH4MUQDLJ76SPQWTUIRS4XAOI2CXF4KN24JYJW7NE6Z63T7LR2Q, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.680512288 (358h42m38.411779918s) [noise=true , address=104.36.82.37:4658 , piece_id=7ZNJGSQJPOTRC7H6HBI7XURZFC2NKHP2HEC2BS6RRKCCJ5FR2RXQ, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.682345740 (358h42m38.41361337s) [noise=true , address=104.36.82.23:4454 , piece_id=W5XBSSFVNA25ZUI3BDYAY6ZFNC3JINP2OCX4JPORXEDXTQZJSP6A, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.683981029 (358h42m38.415248669s) [noise=true , address=104.36.82.2:4739 , piece_id=R52RMNHPVWJ42BYALCJ2P6HRRADDI4GA5LLOK543T7CSVVMGNEHQ, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.685575582 (358h42m38.416843212s) [noise=true , address=104.36.82.49:4003 , piece_id=CPN32A5FSEPHWWMUO4LSRR3JYUYPTDVMREX55JCXVHCKGUQBJETQ, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.686141057 (358h42m38.417408687s) [noise=true , address=77.90.31.21:4885 , piece_id=U6WPOG4ZEC2PCLYF4CUKA74VYXPA7A7WKLX2D65NSVCHTRW4MM3Q, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.686632682 (358h42m38.417900312s) [noise=true , address=104.36.82.44:4902 , piece_id=I26CMBQSW7D5VK3NGTFP5JPAOXVZECHG6VPNU7YJPKBHIFWL2KAA, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.688279344 (358h42m38.419546974s) [noise=true , address=79.127.219.47:4054 , piece_id=KM747OPQKIZW7KT5VDMRTOEVQN5I6XF6QW65VAO3SMM3IALKECOQ, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.692935091 (358h42m38.424202711s) [noise=true , address=45.91.116.4:4942 , piece_id=XN4ZJPMUTRUQS37TJHUR4TXG3MPJJUCXMTZG5Q5BECTRM62UPQPA, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.693333481 (358h42m38.424601111s) [noise=true , address=104.36.82.7:4915 , piece_id=5AJVDZB3F4UOGJ6N2CZSVMVE3EPVKMWERXUGKVOKG4JT2JHJIPOA, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.694526558 (358h42m38.425794198s) [noise=true , address=77.90.31.13:4643 , piece_id=4DRPWRPIVUNT7WIPB7JG55ZCLHEWI43LK7LJT2FSUEQHATYLPDNQ, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.711494921 (358h42m38.44276257s) [noise=true , address=104.36.82.19:4401 , piece_id=7JFP2DBPOXXOR2XSDS7AZRMFBCPAGVSOOIKI66OHMAYNM4G5EI6Q, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.711640766 (358h42m38.442908396s) [noise=true , address=104.36.82.6:4902 , piece_id=SZB4T47UHYLLDMREDWSEU37DLX2VPEWK2UOTCNZRTWMGG2QGYV7Q, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.713821092 (358h42m38.445088722s) [noise=true , address=77.90.31.15:4709 , piece_id=6NSHEOKN4MP6XDCWLSER7BLIUCBC2X33DIP7US2N5AOVBUWDDGHA, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.713830168 (358h42m38.445097798s) [seg_pos={0 0}, upload=372908]: Segment reached optimal threshold of 14 pieces.
Aug 23 16:08:57.713976894 (358h42m38.445244524s) [noise=true , address=77.90.31.18:4823 , piece_id=XCQ6V7U2RLOH7CFAWGEXPNJ3IA5HUSHSDBB44MPBCG7TKYOJN32Q, seg_pos={0 0}, upload=372908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uUCUDKZDwj25UcEKQ4WiTuQFMRbWw2oymGAdUdMX8wcUSd7jS): protocol: expected piece hash; context canceled; EOF
Aug 23 16:08:57.714087132 (358h42m38.445354783s) [noise=true , address=77.90.31.12:4599 , piece_id=5YIVHBG5L5KW5TLKWEJ6ZPOPZXZ42I4WCAKVLS4OMCGDYSAXKWBQ, seg_pos={0 0}, upload=372908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124cEnKBraQScM26K7Zc8Z3cqTvrD9fPyWzWYutYryfXqmXQ3rn): protocol: expected piece hash; context canceled; EOF
Aug 23 16:08:57.714106288 (358h42m38.445373939s) [noise=true , address=104.36.82.18:4385 , piece_id=4X6RPFXKC6ZVAFOAVPERT7U36KVTKJVDJ6MRFBGLSVHYKFTNTOGA, seg_pos={0 0}, upload=372908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123PZh1ieWYoc9U5CRrRzV1ZTpGYmjLmh5CpRy1NRC8wiLkumbs): protocol: write tcp 5.161.89.252:61662->104.36.82.18:4385: use of closed network connection; write tcp 5.161.89.252:61662->104.36.82.18:4385: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:61662->104.36.82.18:4385: use of closed network connection
Aug 23 16:08:57.714164539 (358h42m38.445432169s) [noise=true , address=104.36.82.5:4856 , piece_id=EBVOFDU7MNAFDGBQY5BWNIRBP7ESYR4JZDY3L6SPKULWP4CY5H4A, seg_pos={0 0}, upload=372908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mXTGa9rxx8jU8oKLmR9obX3Utn7p5rQH2GeK6LeJ6jiNvfYZ6): protocol: expected piece hash; context canceled; EOF
Aug 23 16:08:57.714192391 (358h42m38.445460021s) [seg_pos={0 0}, upload=372908]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 16:08:57.714257122 (358h42m38.445524752s) [upload=372908]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 16:08:57.714261051 (358h42m38.445528681s) [upload=372908]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 16:08:58.051756128 (358h42m38.783023748s) [upload=372908]: Done uploading segments...
Aug 23 16:08:58.051769713 (358h42m38.783037334s) [upload=372908]: Upload finished. err: <nil>
Duration: 1.822491993s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
310.441343ms
FAIL (2025-08-23 16:12:54 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 15:40:51.509312115 (358h14m32.240579766s) [upload=372416]: Starting upload Aug 23 15:40:51.509373452 (358h14m32.240641102s) [upload=372416]: Done starting upload Aug 23 15:40:51.509446459 (358h14m32.240714109s) [upload=372416]: Uploading segments... Aug 23 15:40:51.509484341 (358h14m32.240751991s) [upload=372416]: Got next segment. Inline: true Aug 23 15:40:51.509489591 (358h14m32.24075724s) [upload=372416]: Waiting for error group managing segments... Aug 23 15:40:51.509589939 (358h14m32.240857599s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 15:40:51.509596361 (358h14m32.240864011s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 15:40:51.509599737 (358h14m32.240867387s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 15:40:51.531216995 (358h14m32.262484646s) [upload=372416]: Done uploading segments... Aug 23 15:40:51.531235010 (358h14m32.26250268s) [upload=372416]: Upload finished. err: metaclient: Too Many Requests
Duration: 310.465899ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......X...............................................X....] duration:
1.841143041s
FAIL (2025-08-23 16:12:18 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 02c623bc1bab4dcc41a3f90f9a1db7dbe283d77f717502af9f63bd0c28bdbf3e != before 02d7478e4556f5b400fdb5e53f46899b98cad3be7c387c1a6c4e11cdea7cd161
======LOGS======
Aug 23 16:08:57.456768654 (358h42m38.188036275s) [upload=372908]: Starting upload
Aug 23 16:08:57.456820962 (358h42m38.188088623s) [upload=372908]: Done starting upload
Aug 23 16:08:57.456866259 (358h42m38.188133878s) [upload=372908]: Uploading segments...
Aug 23 16:08:57.457054823 (358h42m38.188322453s) [upload=372908]: Got next segment. Inline: false
Aug 23 16:08:57.457087154 (358h42m38.188354774s) [upload=372908]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 16:08:57.457091112 (358h42m38.188358732s) [upload=372908]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 16:08:57.548658973 (358h42m38.279926594s) [seg_pos={0 0}, upload=372908]: Begin upload segment...
Aug 23 16:08:57.548687037 (358h42m38.279954657s) [seg_pos={0 0}, upload=372908]: Done begin upload segment.
Aug 23 16:08:57.548713166 (358h42m38.279980796s) [noise=true , address=104.36.82.18:4385 , piece_id=4X6RPFXKC6ZVAFOAVPERT7U36KVTKJVDJ6MRFBGLSVHYKFTNTOGA, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.548725129 (358h42m38.279992749s) [noise=true , address=45.91.116.4:4942 , piece_id=XN4ZJPMUTRUQS37TJHUR4TXG3MPJJUCXMTZG5Q5BECTRM62UPQPA, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.548780553 (358h42m38.280048173s) [noise=true , address=77.90.31.15:4709 , piece_id=6NSHEOKN4MP6XDCWLSER7BLIUCBC2X33DIP7US2N5AOVBUWDDGHA, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549015615 (358h42m38.280283225s) [noise=true , address=104.36.82.2:4739 , piece_id=R52RMNHPVWJ42BYALCJ2P6HRRADDI4GA5LLOK543T7CSVVMGNEHQ, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549032968 (358h42m38.280300598s) [noise=true , address=77.90.31.12:4599 , piece_id=5YIVHBG5L5KW5TLKWEJ6ZPOPZXZ42I4WCAKVLS4OMCGDYSAXKWBQ, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549269684 (358h42m38.280537304s) [noise=true , address=77.90.31.21:4885 , piece_id=U6WPOG4ZEC2PCLYF4CUKA74VYXPA7A7WKLX2D65NSVCHTRW4MM3Q, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549288589 (358h42m38.28055621s) [noise=true , address=104.36.82.49:4003 , piece_id=CPN32A5FSEPHWWMUO4LSRR3JYUYPTDVMREX55JCXVHCKGUQBJETQ, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549496441 (358h42m38.280764051s) [noise=true , address=104.36.82.44:4902 , piece_id=I26CMBQSW7D5VK3NGTFP5JPAOXVZECHG6VPNU7YJPKBHIFWL2KAA, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549502072 (358h42m38.280769692s) [noise=true , address=77.90.31.18:4823 , piece_id=XCQ6V7U2RLOH7CFAWGEXPNJ3IA5HUSHSDBB44MPBCG7TKYOJN32Q, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549712206 (358h42m38.280979817s) [noise=true , address=104.36.82.23:4454 , piece_id=W5XBSSFVNA25ZUI3BDYAY6ZFNC3JINP2OCX4JPORXEDXTQZJSP6A, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549775957 (358h42m38.281043577s) [noise=true , address=104.36.82.19:4401 , piece_id=7JFP2DBPOXXOR2XSDS7AZRMFBCPAGVSOOIKI66OHMAYNM4G5EI6Q, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549894340 (358h42m38.281161961s) [noise=true , address=77.90.31.13:4643 , piece_id=4DRPWRPIVUNT7WIPB7JG55ZCLHEWI43LK7LJT2FSUEQHATYLPDNQ, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.550039664 (358h42m38.281307284s) [noise=true , address=104.36.82.5:4856 , piece_id=EBVOFDU7MNAFDGBQY5BWNIRBP7ESYR4JZDY3L6SPKULWP4CY5H4A, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.550068298 (358h42m38.281335918s) [noise=true , address=104.36.82.37:4658 , piece_id=7ZNJGSQJPOTRC7H6HBI7XURZFC2NKHP2HEC2BS6RRKCCJ5FR2RXQ, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.550251393 (358h42m38.281519013s) [noise=true , address=45.91.116.9:4281 , piece_id=ZJH4MUQDLJ76SPQWTUIRS4XAOI2CXF4KN24JYJW7NE6Z63T7LR2Q, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.550321865 (358h42m38.281589495s) [noise=true , address=104.36.82.7:4915 , piece_id=5AJVDZB3F4UOGJ6N2CZSVMVE3EPVKMWERXUGKVOKG4JT2JHJIPOA, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.550591683 (358h42m38.281859313s) [noise=true , address=79.127.219.47:4054 , piece_id=KM747OPQKIZW7KT5VDMRTOEVQN5I6XF6QW65VAO3SMM3IALKECOQ, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.550864687 (358h42m38.282132317s) [noise=true , address=104.36.82.6:4902 , piece_id=SZB4T47UHYLLDMREDWSEU37DLX2VPEWK2UOTCNZRTWMGG2QGYV7Q, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.664739165 (358h42m38.396006795s) [upload=372908]: Next returned nil segment
Aug 23 16:08:57.664754735 (358h42m38.396022365s) [upload=372908]: Waiting for error group managing segments...
Aug 23 16:08:57.678607280 (358h42m38.40987492s) [noise=true , address=45.91.116.9:4281 , piece_id=ZJH4MUQDLJ76SPQWTUIRS4XAOI2CXF4KN24JYJW7NE6Z63T7LR2Q, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.680512288 (358h42m38.411779918s) [noise=true , address=104.36.82.37:4658 , piece_id=7ZNJGSQJPOTRC7H6HBI7XURZFC2NKHP2HEC2BS6RRKCCJ5FR2RXQ, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.682345740 (358h42m38.41361337s) [noise=true , address=104.36.82.23:4454 , piece_id=W5XBSSFVNA25ZUI3BDYAY6ZFNC3JINP2OCX4JPORXEDXTQZJSP6A, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.683981029 (358h42m38.415248669s) [noise=true , address=104.36.82.2:4739 , piece_id=R52RMNHPVWJ42BYALCJ2P6HRRADDI4GA5LLOK543T7CSVVMGNEHQ, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.685575582 (358h42m38.416843212s) [noise=true , address=104.36.82.49:4003 , piece_id=CPN32A5FSEPHWWMUO4LSRR3JYUYPTDVMREX55JCXVHCKGUQBJETQ, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.686141057 (358h42m38.417408687s) [noise=true , address=77.90.31.21:4885 , piece_id=U6WPOG4ZEC2PCLYF4CUKA74VYXPA7A7WKLX2D65NSVCHTRW4MM3Q, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.686632682 (358h42m38.417900312s) [noise=true , address=104.36.82.44:4902 , piece_id=I26CMBQSW7D5VK3NGTFP5JPAOXVZECHG6VPNU7YJPKBHIFWL2KAA, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.688279344 (358h42m38.419546974s) [noise=true , address=79.127.219.47:4054 , piece_id=KM747OPQKIZW7KT5VDMRTOEVQN5I6XF6QW65VAO3SMM3IALKECOQ, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.692935091 (358h42m38.424202711s) [noise=true , address=45.91.116.4:4942 , piece_id=XN4ZJPMUTRUQS37TJHUR4TXG3MPJJUCXMTZG5Q5BECTRM62UPQPA, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.693333481 (358h42m38.424601111s) [noise=true , address=104.36.82.7:4915 , piece_id=5AJVDZB3F4UOGJ6N2CZSVMVE3EPVKMWERXUGKVOKG4JT2JHJIPOA, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.694526558 (358h42m38.425794198s) [noise=true , address=77.90.31.13:4643 , piece_id=4DRPWRPIVUNT7WIPB7JG55ZCLHEWI43LK7LJT2FSUEQHATYLPDNQ, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.711494921 (358h42m38.44276257s) [noise=true , address=104.36.82.19:4401 , piece_id=7JFP2DBPOXXOR2XSDS7AZRMFBCPAGVSOOIKI66OHMAYNM4G5EI6Q, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.711640766 (358h42m38.442908396s) [noise=true , address=104.36.82.6:4902 , piece_id=SZB4T47UHYLLDMREDWSEU37DLX2VPEWK2UOTCNZRTWMGG2QGYV7Q, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.713821092 (358h42m38.445088722s) [noise=true , address=77.90.31.15:4709 , piece_id=6NSHEOKN4MP6XDCWLSER7BLIUCBC2X33DIP7US2N5AOVBUWDDGHA, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.713830168 (358h42m38.445097798s) [seg_pos={0 0}, upload=372908]: Segment reached optimal threshold of 14 pieces.
Aug 23 16:08:57.713976894 (358h42m38.445244524s) [noise=true , address=77.90.31.18:4823 , piece_id=XCQ6V7U2RLOH7CFAWGEXPNJ3IA5HUSHSDBB44MPBCG7TKYOJN32Q, seg_pos={0 0}, upload=372908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uUCUDKZDwj25UcEKQ4WiTuQFMRbWw2oymGAdUdMX8wcUSd7jS): protocol: expected piece hash; context canceled; EOF
Aug 23 16:08:57.714087132 (358h42m38.445354783s) [noise=true , address=77.90.31.12:4599 , piece_id=5YIVHBG5L5KW5TLKWEJ6ZPOPZXZ42I4WCAKVLS4OMCGDYSAXKWBQ, seg_pos={0 0}, upload=372908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124cEnKBraQScM26K7Zc8Z3cqTvrD9fPyWzWYutYryfXqmXQ3rn): protocol: expected piece hash; context canceled; EOF
Aug 23 16:08:57.714106288 (358h42m38.445373939s) [noise=true , address=104.36.82.18:4385 , piece_id=4X6RPFXKC6ZVAFOAVPERT7U36KVTKJVDJ6MRFBGLSVHYKFTNTOGA, seg_pos={0 0}, upload=372908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123PZh1ieWYoc9U5CRrRzV1ZTpGYmjLmh5CpRy1NRC8wiLkumbs): protocol: write tcp 5.161.89.252:61662->104.36.82.18:4385: use of closed network connection; write tcp 5.161.89.252:61662->104.36.82.18:4385: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:61662->104.36.82.18:4385: use of closed network connection
Aug 23 16:08:57.714164539 (358h42m38.445432169s) [noise=true , address=104.36.82.5:4856 , piece_id=EBVOFDU7MNAFDGBQY5BWNIRBP7ESYR4JZDY3L6SPKULWP4CY5H4A, seg_pos={0 0}, upload=372908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mXTGa9rxx8jU8oKLmR9obX3Utn7p5rQH2GeK6LeJ6jiNvfYZ6): protocol: expected piece hash; context canceled; EOF
Aug 23 16:08:57.714192391 (358h42m38.445460021s) [seg_pos={0 0}, upload=372908]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 16:08:57.714257122 (358h42m38.445524752s) [upload=372908]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 16:08:57.714261051 (358h42m38.445528681s) [upload=372908]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 16:08:58.051756128 (358h42m38.783023748s) [upload=372908]: Done uploading segments...
Aug 23 16:08:58.051769713 (358h42m38.783037334s) [upload=372908]: Upload finished. err: <nil>
Duration: 1.841169281s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
183.12198ms
FAIL (2025-08-23 16:12:14 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 15:40:51.509312115 (358h14m32.240579766s) [upload=372416]: Starting upload Aug 23 15:40:51.509373452 (358h14m32.240641102s) [upload=372416]: Done starting upload Aug 23 15:40:51.509446459 (358h14m32.240714109s) [upload=372416]: Uploading segments... Aug 23 15:40:51.509484341 (358h14m32.240751991s) [upload=372416]: Got next segment. Inline: true Aug 23 15:40:51.509489591 (358h14m32.24075724s) [upload=372416]: Waiting for error group managing segments... Aug 23 15:40:51.509589939 (358h14m32.240857599s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 15:40:51.509596361 (358h14m32.240864011s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 15:40:51.509599737 (358h14m32.240867387s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 15:40:51.531216995 (358h14m32.262484646s) [upload=372416]: Done uploading segments... Aug 23 15:40:51.531235010 (358h14m32.26250268s) [upload=372416]: Upload finished. err: metaclient: Too Many Requests
Duration: 183.14869ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........X...............................................X...] duration:
2.04558089s
FAIL (2025-08-23 16:11:57 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 02c623bc1bab4dcc41a3f90f9a1db7dbe283d77f717502af9f63bd0c28bdbf3e != before 02d7478e4556f5b400fdb5e53f46899b98cad3be7c387c1a6c4e11cdea7cd161
======LOGS======
Aug 23 16:08:57.456768654 (358h42m38.188036275s) [upload=372908]: Starting upload
Aug 23 16:08:57.456820962 (358h42m38.188088623s) [upload=372908]: Done starting upload
Aug 23 16:08:57.456866259 (358h42m38.188133878s) [upload=372908]: Uploading segments...
Aug 23 16:08:57.457054823 (358h42m38.188322453s) [upload=372908]: Got next segment. Inline: false
Aug 23 16:08:57.457087154 (358h42m38.188354774s) [upload=372908]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 16:08:57.457091112 (358h42m38.188358732s) [upload=372908]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 16:08:57.548658973 (358h42m38.279926594s) [seg_pos={0 0}, upload=372908]: Begin upload segment...
Aug 23 16:08:57.548687037 (358h42m38.279954657s) [seg_pos={0 0}, upload=372908]: Done begin upload segment.
Aug 23 16:08:57.548713166 (358h42m38.279980796s) [noise=true , address=104.36.82.18:4385 , piece_id=4X6RPFXKC6ZVAFOAVPERT7U36KVTKJVDJ6MRFBGLSVHYKFTNTOGA, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.548725129 (358h42m38.279992749s) [noise=true , address=45.91.116.4:4942 , piece_id=XN4ZJPMUTRUQS37TJHUR4TXG3MPJJUCXMTZG5Q5BECTRM62UPQPA, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.548780553 (358h42m38.280048173s) [noise=true , address=77.90.31.15:4709 , piece_id=6NSHEOKN4MP6XDCWLSER7BLIUCBC2X33DIP7US2N5AOVBUWDDGHA, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549015615 (358h42m38.280283225s) [noise=true , address=104.36.82.2:4739 , piece_id=R52RMNHPVWJ42BYALCJ2P6HRRADDI4GA5LLOK543T7CSVVMGNEHQ, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549032968 (358h42m38.280300598s) [noise=true , address=77.90.31.12:4599 , piece_id=5YIVHBG5L5KW5TLKWEJ6ZPOPZXZ42I4WCAKVLS4OMCGDYSAXKWBQ, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549269684 (358h42m38.280537304s) [noise=true , address=77.90.31.21:4885 , piece_id=U6WPOG4ZEC2PCLYF4CUKA74VYXPA7A7WKLX2D65NSVCHTRW4MM3Q, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549288589 (358h42m38.28055621s) [noise=true , address=104.36.82.49:4003 , piece_id=CPN32A5FSEPHWWMUO4LSRR3JYUYPTDVMREX55JCXVHCKGUQBJETQ, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549496441 (358h42m38.280764051s) [noise=true , address=104.36.82.44:4902 , piece_id=I26CMBQSW7D5VK3NGTFP5JPAOXVZECHG6VPNU7YJPKBHIFWL2KAA, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549502072 (358h42m38.280769692s) [noise=true , address=77.90.31.18:4823 , piece_id=XCQ6V7U2RLOH7CFAWGEXPNJ3IA5HUSHSDBB44MPBCG7TKYOJN32Q, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549712206 (358h42m38.280979817s) [noise=true , address=104.36.82.23:4454 , piece_id=W5XBSSFVNA25ZUI3BDYAY6ZFNC3JINP2OCX4JPORXEDXTQZJSP6A, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549775957 (358h42m38.281043577s) [noise=true , address=104.36.82.19:4401 , piece_id=7JFP2DBPOXXOR2XSDS7AZRMFBCPAGVSOOIKI66OHMAYNM4G5EI6Q, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549894340 (358h42m38.281161961s) [noise=true , address=77.90.31.13:4643 , piece_id=4DRPWRPIVUNT7WIPB7JG55ZCLHEWI43LK7LJT2FSUEQHATYLPDNQ, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.550039664 (358h42m38.281307284s) [noise=true , address=104.36.82.5:4856 , piece_id=EBVOFDU7MNAFDGBQY5BWNIRBP7ESYR4JZDY3L6SPKULWP4CY5H4A, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.550068298 (358h42m38.281335918s) [noise=true , address=104.36.82.37:4658 , piece_id=7ZNJGSQJPOTRC7H6HBI7XURZFC2NKHP2HEC2BS6RRKCCJ5FR2RXQ, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.550251393 (358h42m38.281519013s) [noise=true , address=45.91.116.9:4281 , piece_id=ZJH4MUQDLJ76SPQWTUIRS4XAOI2CXF4KN24JYJW7NE6Z63T7LR2Q, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.550321865 (358h42m38.281589495s) [noise=true , address=104.36.82.7:4915 , piece_id=5AJVDZB3F4UOGJ6N2CZSVMVE3EPVKMWERXUGKVOKG4JT2JHJIPOA, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.550591683 (358h42m38.281859313s) [noise=true , address=79.127.219.47:4054 , piece_id=KM747OPQKIZW7KT5VDMRTOEVQN5I6XF6QW65VAO3SMM3IALKECOQ, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.550864687 (358h42m38.282132317s) [noise=true , address=104.36.82.6:4902 , piece_id=SZB4T47UHYLLDMREDWSEU37DLX2VPEWK2UOTCNZRTWMGG2QGYV7Q, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.664739165 (358h42m38.396006795s) [upload=372908]: Next returned nil segment
Aug 23 16:08:57.664754735 (358h42m38.396022365s) [upload=372908]: Waiting for error group managing segments...
Aug 23 16:08:57.678607280 (358h42m38.40987492s) [noise=true , address=45.91.116.9:4281 , piece_id=ZJH4MUQDLJ76SPQWTUIRS4XAOI2CXF4KN24JYJW7NE6Z63T7LR2Q, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.680512288 (358h42m38.411779918s) [noise=true , address=104.36.82.37:4658 , piece_id=7ZNJGSQJPOTRC7H6HBI7XURZFC2NKHP2HEC2BS6RRKCCJ5FR2RXQ, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.682345740 (358h42m38.41361337s) [noise=true , address=104.36.82.23:4454 , piece_id=W5XBSSFVNA25ZUI3BDYAY6ZFNC3JINP2OCX4JPORXEDXTQZJSP6A, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.683981029 (358h42m38.415248669s) [noise=true , address=104.36.82.2:4739 , piece_id=R52RMNHPVWJ42BYALCJ2P6HRRADDI4GA5LLOK543T7CSVVMGNEHQ, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.685575582 (358h42m38.416843212s) [noise=true , address=104.36.82.49:4003 , piece_id=CPN32A5FSEPHWWMUO4LSRR3JYUYPTDVMREX55JCXVHCKGUQBJETQ, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.686141057 (358h42m38.417408687s) [noise=true , address=77.90.31.21:4885 , piece_id=U6WPOG4ZEC2PCLYF4CUKA74VYXPA7A7WKLX2D65NSVCHTRW4MM3Q, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.686632682 (358h42m38.417900312s) [noise=true , address=104.36.82.44:4902 , piece_id=I26CMBQSW7D5VK3NGTFP5JPAOXVZECHG6VPNU7YJPKBHIFWL2KAA, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.688279344 (358h42m38.419546974s) [noise=true , address=79.127.219.47:4054 , piece_id=KM747OPQKIZW7KT5VDMRTOEVQN5I6XF6QW65VAO3SMM3IALKECOQ, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.692935091 (358h42m38.424202711s) [noise=true , address=45.91.116.4:4942 , piece_id=XN4ZJPMUTRUQS37TJHUR4TXG3MPJJUCXMTZG5Q5BECTRM62UPQPA, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.693333481 (358h42m38.424601111s) [noise=true , address=104.36.82.7:4915 , piece_id=5AJVDZB3F4UOGJ6N2CZSVMVE3EPVKMWERXUGKVOKG4JT2JHJIPOA, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.694526558 (358h42m38.425794198s) [noise=true , address=77.90.31.13:4643 , piece_id=4DRPWRPIVUNT7WIPB7JG55ZCLHEWI43LK7LJT2FSUEQHATYLPDNQ, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.711494921 (358h42m38.44276257s) [noise=true , address=104.36.82.19:4401 , piece_id=7JFP2DBPOXXOR2XSDS7AZRMFBCPAGVSOOIKI66OHMAYNM4G5EI6Q, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.711640766 (358h42m38.442908396s) [noise=true , address=104.36.82.6:4902 , piece_id=SZB4T47UHYLLDMREDWSEU37DLX2VPEWK2UOTCNZRTWMGG2QGYV7Q, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.713821092 (358h42m38.445088722s) [noise=true , address=77.90.31.15:4709 , piece_id=6NSHEOKN4MP6XDCWLSER7BLIUCBC2X33DIP7US2N5AOVBUWDDGHA, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.713830168 (358h42m38.445097798s) [seg_pos={0 0}, upload=372908]: Segment reached optimal threshold of 14 pieces.
Aug 23 16:08:57.713976894 (358h42m38.445244524s) [noise=true , address=77.90.31.18:4823 , piece_id=XCQ6V7U2RLOH7CFAWGEXPNJ3IA5HUSHSDBB44MPBCG7TKYOJN32Q, seg_pos={0 0}, upload=372908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uUCUDKZDwj25UcEKQ4WiTuQFMRbWw2oymGAdUdMX8wcUSd7jS): protocol: expected piece hash; context canceled; EOF
Aug 23 16:08:57.714087132 (358h42m38.445354783s) [noise=true , address=77.90.31.12:4599 , piece_id=5YIVHBG5L5KW5TLKWEJ6ZPOPZXZ42I4WCAKVLS4OMCGDYSAXKWBQ, seg_pos={0 0}, upload=372908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124cEnKBraQScM26K7Zc8Z3cqTvrD9fPyWzWYutYryfXqmXQ3rn): protocol: expected piece hash; context canceled; EOF
Aug 23 16:08:57.714106288 (358h42m38.445373939s) [noise=true , address=104.36.82.18:4385 , piece_id=4X6RPFXKC6ZVAFOAVPERT7U36KVTKJVDJ6MRFBGLSVHYKFTNTOGA, seg_pos={0 0}, upload=372908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123PZh1ieWYoc9U5CRrRzV1ZTpGYmjLmh5CpRy1NRC8wiLkumbs): protocol: write tcp 5.161.89.252:61662->104.36.82.18:4385: use of closed network connection; write tcp 5.161.89.252:61662->104.36.82.18:4385: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:61662->104.36.82.18:4385: use of closed network connection
Aug 23 16:08:57.714164539 (358h42m38.445432169s) [noise=true , address=104.36.82.5:4856 , piece_id=EBVOFDU7MNAFDGBQY5BWNIRBP7ESYR4JZDY3L6SPKULWP4CY5H4A, seg_pos={0 0}, upload=372908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mXTGa9rxx8jU8oKLmR9obX3Utn7p5rQH2GeK6LeJ6jiNvfYZ6): protocol: expected piece hash; context canceled; EOF
Aug 23 16:08:57.714192391 (358h42m38.445460021s) [seg_pos={0 0}, upload=372908]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 16:08:57.714257122 (358h42m38.445524752s) [upload=372908]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 16:08:57.714261051 (358h42m38.445528681s) [upload=372908]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 16:08:58.051756128 (358h42m38.783023748s) [upload=372908]: Done uploading segments...
Aug 23 16:08:58.051769713 (358h42m38.783037334s) [upload=372908]: Upload finished. err: <nil>
Duration: 2.045603814s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
275.620246ms
FAIL (2025-08-23 16:11:51 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 15:40:51.509312115 (358h14m32.240579766s) [upload=372416]: Starting upload Aug 23 15:40:51.509373452 (358h14m32.240641102s) [upload=372416]: Done starting upload Aug 23 15:40:51.509446459 (358h14m32.240714109s) [upload=372416]: Uploading segments... Aug 23 15:40:51.509484341 (358h14m32.240751991s) [upload=372416]: Got next segment. Inline: true Aug 23 15:40:51.509489591 (358h14m32.24075724s) [upload=372416]: Waiting for error group managing segments... Aug 23 15:40:51.509589939 (358h14m32.240857599s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 15:40:51.509596361 (358h14m32.240864011s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 15:40:51.509599737 (358h14m32.240867387s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 15:40:51.531216995 (358h14m32.262484646s) [upload=372416]: Done uploading segments... Aug 23 15:40:51.531235010 (358h14m32.26250268s) [upload=372416]: Upload finished. err: metaclient: Too Many Requests
Duration: 275.646784ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
620.258561ms
FAIL (2025-08-23 16:10:46 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 15:40:51.509312115 (358h14m32.240579766s) [upload=372416]: Starting upload Aug 23 15:40:51.509373452 (358h14m32.240641102s) [upload=372416]: Done starting upload Aug 23 15:40:51.509446459 (358h14m32.240714109s) [upload=372416]: Uploading segments... Aug 23 15:40:51.509484341 (358h14m32.240751991s) [upload=372416]: Got next segment. Inline: true Aug 23 15:40:51.509489591 (358h14m32.24075724s) [upload=372416]: Waiting for error group managing segments... Aug 23 15:40:51.509589939 (358h14m32.240857599s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 15:40:51.509596361 (358h14m32.240864011s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 15:40:51.509599737 (358h14m32.240867387s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 15:40:51.531216995 (358h14m32.262484646s) [upload=372416]: Done uploading segments... Aug 23 15:40:51.531235010 (358h14m32.26250268s) [upload=372416]: Upload finished. err: metaclient: Too Many Requests
Duration: 620.276817ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........X...............................................X..] duration:
1.576900407s
FAIL (2025-08-23 16:10:41 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 02c623bc1bab4dcc41a3f90f9a1db7dbe283d77f717502af9f63bd0c28bdbf3e != before 02d7478e4556f5b400fdb5e53f46899b98cad3be7c387c1a6c4e11cdea7cd161
======LOGS======
Aug 23 16:08:57.456768654 (358h42m38.188036275s) [upload=372908]: Starting upload
Aug 23 16:08:57.456820962 (358h42m38.188088623s) [upload=372908]: Done starting upload
Aug 23 16:08:57.456866259 (358h42m38.188133878s) [upload=372908]: Uploading segments...
Aug 23 16:08:57.457054823 (358h42m38.188322453s) [upload=372908]: Got next segment. Inline: false
Aug 23 16:08:57.457087154 (358h42m38.188354774s) [upload=372908]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 16:08:57.457091112 (358h42m38.188358732s) [upload=372908]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 16:08:57.548658973 (358h42m38.279926594s) [seg_pos={0 0}, upload=372908]: Begin upload segment...
Aug 23 16:08:57.548687037 (358h42m38.279954657s) [seg_pos={0 0}, upload=372908]: Done begin upload segment.
Aug 23 16:08:57.548713166 (358h42m38.279980796s) [noise=true , address=104.36.82.18:4385 , piece_id=4X6RPFXKC6ZVAFOAVPERT7U36KVTKJVDJ6MRFBGLSVHYKFTNTOGA, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.548725129 (358h42m38.279992749s) [noise=true , address=45.91.116.4:4942 , piece_id=XN4ZJPMUTRUQS37TJHUR4TXG3MPJJUCXMTZG5Q5BECTRM62UPQPA, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.548780553 (358h42m38.280048173s) [noise=true , address=77.90.31.15:4709 , piece_id=6NSHEOKN4MP6XDCWLSER7BLIUCBC2X33DIP7US2N5AOVBUWDDGHA, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549015615 (358h42m38.280283225s) [noise=true , address=104.36.82.2:4739 , piece_id=R52RMNHPVWJ42BYALCJ2P6HRRADDI4GA5LLOK543T7CSVVMGNEHQ, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549032968 (358h42m38.280300598s) [noise=true , address=77.90.31.12:4599 , piece_id=5YIVHBG5L5KW5TLKWEJ6ZPOPZXZ42I4WCAKVLS4OMCGDYSAXKWBQ, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549269684 (358h42m38.280537304s) [noise=true , address=77.90.31.21:4885 , piece_id=U6WPOG4ZEC2PCLYF4CUKA74VYXPA7A7WKLX2D65NSVCHTRW4MM3Q, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549288589 (358h42m38.28055621s) [noise=true , address=104.36.82.49:4003 , piece_id=CPN32A5FSEPHWWMUO4LSRR3JYUYPTDVMREX55JCXVHCKGUQBJETQ, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549496441 (358h42m38.280764051s) [noise=true , address=104.36.82.44:4902 , piece_id=I26CMBQSW7D5VK3NGTFP5JPAOXVZECHG6VPNU7YJPKBHIFWL2KAA, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549502072 (358h42m38.280769692s) [noise=true , address=77.90.31.18:4823 , piece_id=XCQ6V7U2RLOH7CFAWGEXPNJ3IA5HUSHSDBB44MPBCG7TKYOJN32Q, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549712206 (358h42m38.280979817s) [noise=true , address=104.36.82.23:4454 , piece_id=W5XBSSFVNA25ZUI3BDYAY6ZFNC3JINP2OCX4JPORXEDXTQZJSP6A, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549775957 (358h42m38.281043577s) [noise=true , address=104.36.82.19:4401 , piece_id=7JFP2DBPOXXOR2XSDS7AZRMFBCPAGVSOOIKI66OHMAYNM4G5EI6Q, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549894340 (358h42m38.281161961s) [noise=true , address=77.90.31.13:4643 , piece_id=4DRPWRPIVUNT7WIPB7JG55ZCLHEWI43LK7LJT2FSUEQHATYLPDNQ, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.550039664 (358h42m38.281307284s) [noise=true , address=104.36.82.5:4856 , piece_id=EBVOFDU7MNAFDGBQY5BWNIRBP7ESYR4JZDY3L6SPKULWP4CY5H4A, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.550068298 (358h42m38.281335918s) [noise=true , address=104.36.82.37:4658 , piece_id=7ZNJGSQJPOTRC7H6HBI7XURZFC2NKHP2HEC2BS6RRKCCJ5FR2RXQ, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.550251393 (358h42m38.281519013s) [noise=true , address=45.91.116.9:4281 , piece_id=ZJH4MUQDLJ76SPQWTUIRS4XAOI2CXF4KN24JYJW7NE6Z63T7LR2Q, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.550321865 (358h42m38.281589495s) [noise=true , address=104.36.82.7:4915 , piece_id=5AJVDZB3F4UOGJ6N2CZSVMVE3EPVKMWERXUGKVOKG4JT2JHJIPOA, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.550591683 (358h42m38.281859313s) [noise=true , address=79.127.219.47:4054 , piece_id=KM747OPQKIZW7KT5VDMRTOEVQN5I6XF6QW65VAO3SMM3IALKECOQ, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.550864687 (358h42m38.282132317s) [noise=true , address=104.36.82.6:4902 , piece_id=SZB4T47UHYLLDMREDWSEU37DLX2VPEWK2UOTCNZRTWMGG2QGYV7Q, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.664739165 (358h42m38.396006795s) [upload=372908]: Next returned nil segment
Aug 23 16:08:57.664754735 (358h42m38.396022365s) [upload=372908]: Waiting for error group managing segments...
Aug 23 16:08:57.678607280 (358h42m38.40987492s) [noise=true , address=45.91.116.9:4281 , piece_id=ZJH4MUQDLJ76SPQWTUIRS4XAOI2CXF4KN24JYJW7NE6Z63T7LR2Q, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.680512288 (358h42m38.411779918s) [noise=true , address=104.36.82.37:4658 , piece_id=7ZNJGSQJPOTRC7H6HBI7XURZFC2NKHP2HEC2BS6RRKCCJ5FR2RXQ, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.682345740 (358h42m38.41361337s) [noise=true , address=104.36.82.23:4454 , piece_id=W5XBSSFVNA25ZUI3BDYAY6ZFNC3JINP2OCX4JPORXEDXTQZJSP6A, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.683981029 (358h42m38.415248669s) [noise=true , address=104.36.82.2:4739 , piece_id=R52RMNHPVWJ42BYALCJ2P6HRRADDI4GA5LLOK543T7CSVVMGNEHQ, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.685575582 (358h42m38.416843212s) [noise=true , address=104.36.82.49:4003 , piece_id=CPN32A5FSEPHWWMUO4LSRR3JYUYPTDVMREX55JCXVHCKGUQBJETQ, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.686141057 (358h42m38.417408687s) [noise=true , address=77.90.31.21:4885 , piece_id=U6WPOG4ZEC2PCLYF4CUKA74VYXPA7A7WKLX2D65NSVCHTRW4MM3Q, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.686632682 (358h42m38.417900312s) [noise=true , address=104.36.82.44:4902 , piece_id=I26CMBQSW7D5VK3NGTFP5JPAOXVZECHG6VPNU7YJPKBHIFWL2KAA, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.688279344 (358h42m38.419546974s) [noise=true , address=79.127.219.47:4054 , piece_id=KM747OPQKIZW7KT5VDMRTOEVQN5I6XF6QW65VAO3SMM3IALKECOQ, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.692935091 (358h42m38.424202711s) [noise=true , address=45.91.116.4:4942 , piece_id=XN4ZJPMUTRUQS37TJHUR4TXG3MPJJUCXMTZG5Q5BECTRM62UPQPA, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.693333481 (358h42m38.424601111s) [noise=true , address=104.36.82.7:4915 , piece_id=5AJVDZB3F4UOGJ6N2CZSVMVE3EPVKMWERXUGKVOKG4JT2JHJIPOA, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.694526558 (358h42m38.425794198s) [noise=true , address=77.90.31.13:4643 , piece_id=4DRPWRPIVUNT7WIPB7JG55ZCLHEWI43LK7LJT2FSUEQHATYLPDNQ, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.711494921 (358h42m38.44276257s) [noise=true , address=104.36.82.19:4401 , piece_id=7JFP2DBPOXXOR2XSDS7AZRMFBCPAGVSOOIKI66OHMAYNM4G5EI6Q, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.711640766 (358h42m38.442908396s) [noise=true , address=104.36.82.6:4902 , piece_id=SZB4T47UHYLLDMREDWSEU37DLX2VPEWK2UOTCNZRTWMGG2QGYV7Q, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.713821092 (358h42m38.445088722s) [noise=true , address=77.90.31.15:4709 , piece_id=6NSHEOKN4MP6XDCWLSER7BLIUCBC2X33DIP7US2N5AOVBUWDDGHA, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.713830168 (358h42m38.445097798s) [seg_pos={0 0}, upload=372908]: Segment reached optimal threshold of 14 pieces.
Aug 23 16:08:57.713976894 (358h42m38.445244524s) [noise=true , address=77.90.31.18:4823 , piece_id=XCQ6V7U2RLOH7CFAWGEXPNJ3IA5HUSHSDBB44MPBCG7TKYOJN32Q, seg_pos={0 0}, upload=372908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uUCUDKZDwj25UcEKQ4WiTuQFMRbWw2oymGAdUdMX8wcUSd7jS): protocol: expected piece hash; context canceled; EOF
Aug 23 16:08:57.714087132 (358h42m38.445354783s) [noise=true , address=77.90.31.12:4599 , piece_id=5YIVHBG5L5KW5TLKWEJ6ZPOPZXZ42I4WCAKVLS4OMCGDYSAXKWBQ, seg_pos={0 0}, upload=372908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124cEnKBraQScM26K7Zc8Z3cqTvrD9fPyWzWYutYryfXqmXQ3rn): protocol: expected piece hash; context canceled; EOF
Aug 23 16:08:57.714106288 (358h42m38.445373939s) [noise=true , address=104.36.82.18:4385 , piece_id=4X6RPFXKC6ZVAFOAVPERT7U36KVTKJVDJ6MRFBGLSVHYKFTNTOGA, seg_pos={0 0}, upload=372908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123PZh1ieWYoc9U5CRrRzV1ZTpGYmjLmh5CpRy1NRC8wiLkumbs): protocol: write tcp 5.161.89.252:61662->104.36.82.18:4385: use of closed network connection; write tcp 5.161.89.252:61662->104.36.82.18:4385: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:61662->104.36.82.18:4385: use of closed network connection
Aug 23 16:08:57.714164539 (358h42m38.445432169s) [noise=true , address=104.36.82.5:4856 , piece_id=EBVOFDU7MNAFDGBQY5BWNIRBP7ESYR4JZDY3L6SPKULWP4CY5H4A, seg_pos={0 0}, upload=372908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mXTGa9rxx8jU8oKLmR9obX3Utn7p5rQH2GeK6LeJ6jiNvfYZ6): protocol: expected piece hash; context canceled; EOF
Aug 23 16:08:57.714192391 (358h42m38.445460021s) [seg_pos={0 0}, upload=372908]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 16:08:57.714257122 (358h42m38.445524752s) [upload=372908]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 16:08:57.714261051 (358h42m38.445528681s) [upload=372908]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 16:08:58.051756128 (358h42m38.783023748s) [upload=372908]: Done uploading segments...
Aug 23 16:08:58.051769713 (358h42m38.783037334s) [upload=372908]: Upload finished. err: <nil>
Duration: 1.576914523s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
196.768065ms
FAIL (2025-08-23 16:10:12 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 15:40:51.509312115 (358h14m32.240579766s) [upload=372416]: Starting upload Aug 23 15:40:51.509373452 (358h14m32.240641102s) [upload=372416]: Done starting upload Aug 23 15:40:51.509446459 (358h14m32.240714109s) [upload=372416]: Uploading segments... Aug 23 15:40:51.509484341 (358h14m32.240751991s) [upload=372416]: Got next segment. Inline: true Aug 23 15:40:51.509489591 (358h14m32.24075724s) [upload=372416]: Waiting for error group managing segments... Aug 23 15:40:51.509589939 (358h14m32.240857599s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 15:40:51.509596361 (358h14m32.240864011s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 15:40:51.509599737 (358h14m32.240867387s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 15:40:51.531216995 (358h14m32.262484646s) [upload=372416]: Done uploading segments... Aug 23 15:40:51.531235010 (358h14m32.26250268s) [upload=372416]: Upload finished. err: metaclient: Too Many Requests
Duration: 196.789215ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........X...............................................X.] duration:
1.289276073s
FAIL (2025-08-23 16:10:00 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 02c623bc1bab4dcc41a3f90f9a1db7dbe283d77f717502af9f63bd0c28bdbf3e != before 02d7478e4556f5b400fdb5e53f46899b98cad3be7c387c1a6c4e11cdea7cd161
======LOGS======
Aug 23 16:08:57.456768654 (358h42m38.188036275s) [upload=372908]: Starting upload
Aug 23 16:08:57.456820962 (358h42m38.188088623s) [upload=372908]: Done starting upload
Aug 23 16:08:57.456866259 (358h42m38.188133878s) [upload=372908]: Uploading segments...
Aug 23 16:08:57.457054823 (358h42m38.188322453s) [upload=372908]: Got next segment. Inline: false
Aug 23 16:08:57.457087154 (358h42m38.188354774s) [upload=372908]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 16:08:57.457091112 (358h42m38.188358732s) [upload=372908]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 16:08:57.548658973 (358h42m38.279926594s) [seg_pos={0 0}, upload=372908]: Begin upload segment...
Aug 23 16:08:57.548687037 (358h42m38.279954657s) [seg_pos={0 0}, upload=372908]: Done begin upload segment.
Aug 23 16:08:57.548713166 (358h42m38.279980796s) [noise=true , address=104.36.82.18:4385 , piece_id=4X6RPFXKC6ZVAFOAVPERT7U36KVTKJVDJ6MRFBGLSVHYKFTNTOGA, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.548725129 (358h42m38.279992749s) [noise=true , address=45.91.116.4:4942 , piece_id=XN4ZJPMUTRUQS37TJHUR4TXG3MPJJUCXMTZG5Q5BECTRM62UPQPA, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.548780553 (358h42m38.280048173s) [noise=true , address=77.90.31.15:4709 , piece_id=6NSHEOKN4MP6XDCWLSER7BLIUCBC2X33DIP7US2N5AOVBUWDDGHA, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549015615 (358h42m38.280283225s) [noise=true , address=104.36.82.2:4739 , piece_id=R52RMNHPVWJ42BYALCJ2P6HRRADDI4GA5LLOK543T7CSVVMGNEHQ, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549032968 (358h42m38.280300598s) [noise=true , address=77.90.31.12:4599 , piece_id=5YIVHBG5L5KW5TLKWEJ6ZPOPZXZ42I4WCAKVLS4OMCGDYSAXKWBQ, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549269684 (358h42m38.280537304s) [noise=true , address=77.90.31.21:4885 , piece_id=U6WPOG4ZEC2PCLYF4CUKA74VYXPA7A7WKLX2D65NSVCHTRW4MM3Q, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549288589 (358h42m38.28055621s) [noise=true , address=104.36.82.49:4003 , piece_id=CPN32A5FSEPHWWMUO4LSRR3JYUYPTDVMREX55JCXVHCKGUQBJETQ, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549496441 (358h42m38.280764051s) [noise=true , address=104.36.82.44:4902 , piece_id=I26CMBQSW7D5VK3NGTFP5JPAOXVZECHG6VPNU7YJPKBHIFWL2KAA, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549502072 (358h42m38.280769692s) [noise=true , address=77.90.31.18:4823 , piece_id=XCQ6V7U2RLOH7CFAWGEXPNJ3IA5HUSHSDBB44MPBCG7TKYOJN32Q, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549712206 (358h42m38.280979817s) [noise=true , address=104.36.82.23:4454 , piece_id=W5XBSSFVNA25ZUI3BDYAY6ZFNC3JINP2OCX4JPORXEDXTQZJSP6A, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549775957 (358h42m38.281043577s) [noise=true , address=104.36.82.19:4401 , piece_id=7JFP2DBPOXXOR2XSDS7AZRMFBCPAGVSOOIKI66OHMAYNM4G5EI6Q, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549894340 (358h42m38.281161961s) [noise=true , address=77.90.31.13:4643 , piece_id=4DRPWRPIVUNT7WIPB7JG55ZCLHEWI43LK7LJT2FSUEQHATYLPDNQ, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.550039664 (358h42m38.281307284s) [noise=true , address=104.36.82.5:4856 , piece_id=EBVOFDU7MNAFDGBQY5BWNIRBP7ESYR4JZDY3L6SPKULWP4CY5H4A, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.550068298 (358h42m38.281335918s) [noise=true , address=104.36.82.37:4658 , piece_id=7ZNJGSQJPOTRC7H6HBI7XURZFC2NKHP2HEC2BS6RRKCCJ5FR2RXQ, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.550251393 (358h42m38.281519013s) [noise=true , address=45.91.116.9:4281 , piece_id=ZJH4MUQDLJ76SPQWTUIRS4XAOI2CXF4KN24JYJW7NE6Z63T7LR2Q, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.550321865 (358h42m38.281589495s) [noise=true , address=104.36.82.7:4915 , piece_id=5AJVDZB3F4UOGJ6N2CZSVMVE3EPVKMWERXUGKVOKG4JT2JHJIPOA, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.550591683 (358h42m38.281859313s) [noise=true , address=79.127.219.47:4054 , piece_id=KM747OPQKIZW7KT5VDMRTOEVQN5I6XF6QW65VAO3SMM3IALKECOQ, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.550864687 (358h42m38.282132317s) [noise=true , address=104.36.82.6:4902 , piece_id=SZB4T47UHYLLDMREDWSEU37DLX2VPEWK2UOTCNZRTWMGG2QGYV7Q, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.664739165 (358h42m38.396006795s) [upload=372908]: Next returned nil segment
Aug 23 16:08:57.664754735 (358h42m38.396022365s) [upload=372908]: Waiting for error group managing segments...
Aug 23 16:08:57.678607280 (358h42m38.40987492s) [noise=true , address=45.91.116.9:4281 , piece_id=ZJH4MUQDLJ76SPQWTUIRS4XAOI2CXF4KN24JYJW7NE6Z63T7LR2Q, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.680512288 (358h42m38.411779918s) [noise=true , address=104.36.82.37:4658 , piece_id=7ZNJGSQJPOTRC7H6HBI7XURZFC2NKHP2HEC2BS6RRKCCJ5FR2RXQ, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.682345740 (358h42m38.41361337s) [noise=true , address=104.36.82.23:4454 , piece_id=W5XBSSFVNA25ZUI3BDYAY6ZFNC3JINP2OCX4JPORXEDXTQZJSP6A, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.683981029 (358h42m38.415248669s) [noise=true , address=104.36.82.2:4739 , piece_id=R52RMNHPVWJ42BYALCJ2P6HRRADDI4GA5LLOK543T7CSVVMGNEHQ, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.685575582 (358h42m38.416843212s) [noise=true , address=104.36.82.49:4003 , piece_id=CPN32A5FSEPHWWMUO4LSRR3JYUYPTDVMREX55JCXVHCKGUQBJETQ, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.686141057 (358h42m38.417408687s) [noise=true , address=77.90.31.21:4885 , piece_id=U6WPOG4ZEC2PCLYF4CUKA74VYXPA7A7WKLX2D65NSVCHTRW4MM3Q, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.686632682 (358h42m38.417900312s) [noise=true , address=104.36.82.44:4902 , piece_id=I26CMBQSW7D5VK3NGTFP5JPAOXVZECHG6VPNU7YJPKBHIFWL2KAA, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.688279344 (358h42m38.419546974s) [noise=true , address=79.127.219.47:4054 , piece_id=KM747OPQKIZW7KT5VDMRTOEVQN5I6XF6QW65VAO3SMM3IALKECOQ, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.692935091 (358h42m38.424202711s) [noise=true , address=45.91.116.4:4942 , piece_id=XN4ZJPMUTRUQS37TJHUR4TXG3MPJJUCXMTZG5Q5BECTRM62UPQPA, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.693333481 (358h42m38.424601111s) [noise=true , address=104.36.82.7:4915 , piece_id=5AJVDZB3F4UOGJ6N2CZSVMVE3EPVKMWERXUGKVOKG4JT2JHJIPOA, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.694526558 (358h42m38.425794198s) [noise=true , address=77.90.31.13:4643 , piece_id=4DRPWRPIVUNT7WIPB7JG55ZCLHEWI43LK7LJT2FSUEQHATYLPDNQ, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.711494921 (358h42m38.44276257s) [noise=true , address=104.36.82.19:4401 , piece_id=7JFP2DBPOXXOR2XSDS7AZRMFBCPAGVSOOIKI66OHMAYNM4G5EI6Q, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.711640766 (358h42m38.442908396s) [noise=true , address=104.36.82.6:4902 , piece_id=SZB4T47UHYLLDMREDWSEU37DLX2VPEWK2UOTCNZRTWMGG2QGYV7Q, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.713821092 (358h42m38.445088722s) [noise=true , address=77.90.31.15:4709 , piece_id=6NSHEOKN4MP6XDCWLSER7BLIUCBC2X33DIP7US2N5AOVBUWDDGHA, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.713830168 (358h42m38.445097798s) [seg_pos={0 0}, upload=372908]: Segment reached optimal threshold of 14 pieces.
Aug 23 16:08:57.713976894 (358h42m38.445244524s) [noise=true , address=77.90.31.18:4823 , piece_id=XCQ6V7U2RLOH7CFAWGEXPNJ3IA5HUSHSDBB44MPBCG7TKYOJN32Q, seg_pos={0 0}, upload=372908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uUCUDKZDwj25UcEKQ4WiTuQFMRbWw2oymGAdUdMX8wcUSd7jS): protocol: expected piece hash; context canceled; EOF
Aug 23 16:08:57.714087132 (358h42m38.445354783s) [noise=true , address=77.90.31.12:4599 , piece_id=5YIVHBG5L5KW5TLKWEJ6ZPOPZXZ42I4WCAKVLS4OMCGDYSAXKWBQ, seg_pos={0 0}, upload=372908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124cEnKBraQScM26K7Zc8Z3cqTvrD9fPyWzWYutYryfXqmXQ3rn): protocol: expected piece hash; context canceled; EOF
Aug 23 16:08:57.714106288 (358h42m38.445373939s) [noise=true , address=104.36.82.18:4385 , piece_id=4X6RPFXKC6ZVAFOAVPERT7U36KVTKJVDJ6MRFBGLSVHYKFTNTOGA, seg_pos={0 0}, upload=372908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123PZh1ieWYoc9U5CRrRzV1ZTpGYmjLmh5CpRy1NRC8wiLkumbs): protocol: write tcp 5.161.89.252:61662->104.36.82.18:4385: use of closed network connection; write tcp 5.161.89.252:61662->104.36.82.18:4385: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:61662->104.36.82.18:4385: use of closed network connection
Aug 23 16:08:57.714164539 (358h42m38.445432169s) [noise=true , address=104.36.82.5:4856 , piece_id=EBVOFDU7MNAFDGBQY5BWNIRBP7ESYR4JZDY3L6SPKULWP4CY5H4A, seg_pos={0 0}, upload=372908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mXTGa9rxx8jU8oKLmR9obX3Utn7p5rQH2GeK6LeJ6jiNvfYZ6): protocol: expected piece hash; context canceled; EOF
Aug 23 16:08:57.714192391 (358h42m38.445460021s) [seg_pos={0 0}, upload=372908]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 16:08:57.714257122 (358h42m38.445524752s) [upload=372908]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 16:08:57.714261051 (358h42m38.445528681s) [upload=372908]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 16:08:58.051756128 (358h42m38.783023748s) [upload=372908]: Done uploading segments...
Aug 23 16:08:58.051769713 (358h42m38.783037334s) [upload=372908]: Upload finished. err: <nil>
Duration: 1.289334122s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
472.76687ms
FAIL (2025-08-23 16:09:17 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 15:40:51.509312115 (358h14m32.240579766s) [upload=372416]: Starting upload Aug 23 15:40:51.509373452 (358h14m32.240641102s) [upload=372416]: Done starting upload Aug 23 15:40:51.509446459 (358h14m32.240714109s) [upload=372416]: Uploading segments... Aug 23 15:40:51.509484341 (358h14m32.240751991s) [upload=372416]: Got next segment. Inline: true Aug 23 15:40:51.509489591 (358h14m32.24075724s) [upload=372416]: Waiting for error group managing segments... Aug 23 15:40:51.509589939 (358h14m32.240857599s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 15:40:51.509596361 (358h14m32.240864011s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 15:40:51.509599737 (358h14m32.240867387s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 15:40:51.531216995 (358h14m32.262484646s) [upload=372416]: Done uploading segments... Aug 23 15:40:51.531235010 (358h14m32.26250268s) [upload=372416]: Upload finished. err: metaclient: Too Many Requests
Duration: 472.78837ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........X...............................................X] duration:
2.014002517s
FAIL (2025-08-23 16:08:59 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 02c623bc1bab4dcc41a3f90f9a1db7dbe283d77f717502af9f63bd0c28bdbf3e != before 02d7478e4556f5b400fdb5e53f46899b98cad3be7c387c1a6c4e11cdea7cd161
======LOGS======
Aug 23 16:08:57.456768654 (358h42m38.188036275s) [upload=372908]: Starting upload
Aug 23 16:08:57.456820962 (358h42m38.188088623s) [upload=372908]: Done starting upload
Aug 23 16:08:57.456866259 (358h42m38.188133878s) [upload=372908]: Uploading segments...
Aug 23 16:08:57.457054823 (358h42m38.188322453s) [upload=372908]: Got next segment. Inline: false
Aug 23 16:08:57.457087154 (358h42m38.188354774s) [upload=372908]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 16:08:57.457091112 (358h42m38.188358732s) [upload=372908]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 16:08:57.548658973 (358h42m38.279926594s) [seg_pos={0 0}, upload=372908]: Begin upload segment...
Aug 23 16:08:57.548687037 (358h42m38.279954657s) [seg_pos={0 0}, upload=372908]: Done begin upload segment.
Aug 23 16:08:57.548713166 (358h42m38.279980796s) [noise=true , address=104.36.82.18:4385 , piece_id=4X6RPFXKC6ZVAFOAVPERT7U36KVTKJVDJ6MRFBGLSVHYKFTNTOGA, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.548725129 (358h42m38.279992749s) [noise=true , address=45.91.116.4:4942 , piece_id=XN4ZJPMUTRUQS37TJHUR4TXG3MPJJUCXMTZG5Q5BECTRM62UPQPA, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.548780553 (358h42m38.280048173s) [noise=true , address=77.90.31.15:4709 , piece_id=6NSHEOKN4MP6XDCWLSER7BLIUCBC2X33DIP7US2N5AOVBUWDDGHA, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549015615 (358h42m38.280283225s) [noise=true , address=104.36.82.2:4739 , piece_id=R52RMNHPVWJ42BYALCJ2P6HRRADDI4GA5LLOK543T7CSVVMGNEHQ, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549032968 (358h42m38.280300598s) [noise=true , address=77.90.31.12:4599 , piece_id=5YIVHBG5L5KW5TLKWEJ6ZPOPZXZ42I4WCAKVLS4OMCGDYSAXKWBQ, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549269684 (358h42m38.280537304s) [noise=true , address=77.90.31.21:4885 , piece_id=U6WPOG4ZEC2PCLYF4CUKA74VYXPA7A7WKLX2D65NSVCHTRW4MM3Q, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549288589 (358h42m38.28055621s) [noise=true , address=104.36.82.49:4003 , piece_id=CPN32A5FSEPHWWMUO4LSRR3JYUYPTDVMREX55JCXVHCKGUQBJETQ, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549496441 (358h42m38.280764051s) [noise=true , address=104.36.82.44:4902 , piece_id=I26CMBQSW7D5VK3NGTFP5JPAOXVZECHG6VPNU7YJPKBHIFWL2KAA, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549502072 (358h42m38.280769692s) [noise=true , address=77.90.31.18:4823 , piece_id=XCQ6V7U2RLOH7CFAWGEXPNJ3IA5HUSHSDBB44MPBCG7TKYOJN32Q, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549712206 (358h42m38.280979817s) [noise=true , address=104.36.82.23:4454 , piece_id=W5XBSSFVNA25ZUI3BDYAY6ZFNC3JINP2OCX4JPORXEDXTQZJSP6A, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549775957 (358h42m38.281043577s) [noise=true , address=104.36.82.19:4401 , piece_id=7JFP2DBPOXXOR2XSDS7AZRMFBCPAGVSOOIKI66OHMAYNM4G5EI6Q, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.549894340 (358h42m38.281161961s) [noise=true , address=77.90.31.13:4643 , piece_id=4DRPWRPIVUNT7WIPB7JG55ZCLHEWI43LK7LJT2FSUEQHATYLPDNQ, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.550039664 (358h42m38.281307284s) [noise=true , address=104.36.82.5:4856 , piece_id=EBVOFDU7MNAFDGBQY5BWNIRBP7ESYR4JZDY3L6SPKULWP4CY5H4A, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.550068298 (358h42m38.281335918s) [noise=true , address=104.36.82.37:4658 , piece_id=7ZNJGSQJPOTRC7H6HBI7XURZFC2NKHP2HEC2BS6RRKCCJ5FR2RXQ, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.550251393 (358h42m38.281519013s) [noise=true , address=45.91.116.9:4281 , piece_id=ZJH4MUQDLJ76SPQWTUIRS4XAOI2CXF4KN24JYJW7NE6Z63T7LR2Q, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.550321865 (358h42m38.281589495s) [noise=true , address=104.36.82.7:4915 , piece_id=5AJVDZB3F4UOGJ6N2CZSVMVE3EPVKMWERXUGKVOKG4JT2JHJIPOA, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.550591683 (358h42m38.281859313s) [noise=true , address=79.127.219.47:4054 , piece_id=KM747OPQKIZW7KT5VDMRTOEVQN5I6XF6QW65VAO3SMM3IALKECOQ, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.550864687 (358h42m38.282132317s) [noise=true , address=104.36.82.6:4902 , piece_id=SZB4T47UHYLLDMREDWSEU37DLX2VPEWK2UOTCNZRTWMGG2QGYV7Q, seg_pos={0 0}, upload=372908]: Uploading piece...
Aug 23 16:08:57.664739165 (358h42m38.396006795s) [upload=372908]: Next returned nil segment
Aug 23 16:08:57.664754735 (358h42m38.396022365s) [upload=372908]: Waiting for error group managing segments...
Aug 23 16:08:57.678607280 (358h42m38.40987492s) [noise=true , address=45.91.116.9:4281 , piece_id=ZJH4MUQDLJ76SPQWTUIRS4XAOI2CXF4KN24JYJW7NE6Z63T7LR2Q, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.680512288 (358h42m38.411779918s) [noise=true , address=104.36.82.37:4658 , piece_id=7ZNJGSQJPOTRC7H6HBI7XURZFC2NKHP2HEC2BS6RRKCCJ5FR2RXQ, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.682345740 (358h42m38.41361337s) [noise=true , address=104.36.82.23:4454 , piece_id=W5XBSSFVNA25ZUI3BDYAY6ZFNC3JINP2OCX4JPORXEDXTQZJSP6A, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.683981029 (358h42m38.415248669s) [noise=true , address=104.36.82.2:4739 , piece_id=R52RMNHPVWJ42BYALCJ2P6HRRADDI4GA5LLOK543T7CSVVMGNEHQ, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.685575582 (358h42m38.416843212s) [noise=true , address=104.36.82.49:4003 , piece_id=CPN32A5FSEPHWWMUO4LSRR3JYUYPTDVMREX55JCXVHCKGUQBJETQ, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.686141057 (358h42m38.417408687s) [noise=true , address=77.90.31.21:4885 , piece_id=U6WPOG4ZEC2PCLYF4CUKA74VYXPA7A7WKLX2D65NSVCHTRW4MM3Q, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.686632682 (358h42m38.417900312s) [noise=true , address=104.36.82.44:4902 , piece_id=I26CMBQSW7D5VK3NGTFP5JPAOXVZECHG6VPNU7YJPKBHIFWL2KAA, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.688279344 (358h42m38.419546974s) [noise=true , address=79.127.219.47:4054 , piece_id=KM747OPQKIZW7KT5VDMRTOEVQN5I6XF6QW65VAO3SMM3IALKECOQ, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.692935091 (358h42m38.424202711s) [noise=true , address=45.91.116.4:4942 , piece_id=XN4ZJPMUTRUQS37TJHUR4TXG3MPJJUCXMTZG5Q5BECTRM62UPQPA, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.693333481 (358h42m38.424601111s) [noise=true , address=104.36.82.7:4915 , piece_id=5AJVDZB3F4UOGJ6N2CZSVMVE3EPVKMWERXUGKVOKG4JT2JHJIPOA, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.694526558 (358h42m38.425794198s) [noise=true , address=77.90.31.13:4643 , piece_id=4DRPWRPIVUNT7WIPB7JG55ZCLHEWI43LK7LJT2FSUEQHATYLPDNQ, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.711494921 (358h42m38.44276257s) [noise=true , address=104.36.82.19:4401 , piece_id=7JFP2DBPOXXOR2XSDS7AZRMFBCPAGVSOOIKI66OHMAYNM4G5EI6Q, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.711640766 (358h42m38.442908396s) [noise=true , address=104.36.82.6:4902 , piece_id=SZB4T47UHYLLDMREDWSEU37DLX2VPEWK2UOTCNZRTWMGG2QGYV7Q, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.713821092 (358h42m38.445088722s) [noise=true , address=77.90.31.15:4709 , piece_id=6NSHEOKN4MP6XDCWLSER7BLIUCBC2X33DIP7US2N5AOVBUWDDGHA, seg_pos={0 0}, upload=372908]: Done uploading piece. err: <nil>
Aug 23 16:08:57.713830168 (358h42m38.445097798s) [seg_pos={0 0}, upload=372908]: Segment reached optimal threshold of 14 pieces.
Aug 23 16:08:57.713976894 (358h42m38.445244524s) [noise=true , address=77.90.31.18:4823 , piece_id=XCQ6V7U2RLOH7CFAWGEXPNJ3IA5HUSHSDBB44MPBCG7TKYOJN32Q, seg_pos={0 0}, upload=372908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uUCUDKZDwj25UcEKQ4WiTuQFMRbWw2oymGAdUdMX8wcUSd7jS): protocol: expected piece hash; context canceled; EOF
Aug 23 16:08:57.714087132 (358h42m38.445354783s) [noise=true , address=77.90.31.12:4599 , piece_id=5YIVHBG5L5KW5TLKWEJ6ZPOPZXZ42I4WCAKVLS4OMCGDYSAXKWBQ, seg_pos={0 0}, upload=372908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124cEnKBraQScM26K7Zc8Z3cqTvrD9fPyWzWYutYryfXqmXQ3rn): protocol: expected piece hash; context canceled; EOF
Aug 23 16:08:57.714106288 (358h42m38.445373939s) [noise=true , address=104.36.82.18:4385 , piece_id=4X6RPFXKC6ZVAFOAVPERT7U36KVTKJVDJ6MRFBGLSVHYKFTNTOGA, seg_pos={0 0}, upload=372908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123PZh1ieWYoc9U5CRrRzV1ZTpGYmjLmh5CpRy1NRC8wiLkumbs): protocol: write tcp 5.161.89.252:61662->104.36.82.18:4385: use of closed network connection; write tcp 5.161.89.252:61662->104.36.82.18:4385: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:61662->104.36.82.18:4385: use of closed network connection
Aug 23 16:08:57.714164539 (358h42m38.445432169s) [noise=true , address=104.36.82.5:4856 , piece_id=EBVOFDU7MNAFDGBQY5BWNIRBP7ESYR4JZDY3L6SPKULWP4CY5H4A, seg_pos={0 0}, upload=372908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mXTGa9rxx8jU8oKLmR9obX3Utn7p5rQH2GeK6LeJ6jiNvfYZ6): protocol: expected piece hash; context canceled; EOF
Aug 23 16:08:57.714192391 (358h42m38.445460021s) [seg_pos={0 0}, upload=372908]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 16:08:57.714257122 (358h42m38.445524752s) [upload=372908]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 16:08:57.714261051 (358h42m38.445528681s) [upload=372908]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 16:08:58.051756128 (358h42m38.783023748s) [upload=372908]: Done uploading segments...
Aug 23 16:08:58.051769713 (358h42m38.783037334s) [upload=372908]: Upload finished. err: <nil>
Duration: 2.014027793s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
397.456172ms
FAIL (2025-08-23 16:08:53 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 15:40:51.509312115 (358h14m32.240579766s) [upload=372416]: Starting upload Aug 23 15:40:51.509373452 (358h14m32.240641102s) [upload=372416]: Done starting upload Aug 23 15:40:51.509446459 (358h14m32.240714109s) [upload=372416]: Uploading segments... Aug 23 15:40:51.509484341 (358h14m32.240751991s) [upload=372416]: Got next segment. Inline: true Aug 23 15:40:51.509489591 (358h14m32.24075724s) [upload=372416]: Waiting for error group managing segments... Aug 23 15:40:51.509589939 (358h14m32.240857599s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 15:40:51.509596361 (358h14m32.240864011s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 15:40:51.509599737 (358h14m32.240867387s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 15:40:51.531216995 (358h14m32.262484646s) [upload=372416]: Done uploading segments... Aug 23 15:40:51.531235010 (358h14m32.26250268s) [upload=372416]: Upload finished. err: metaclient: Too Many Requests
Duration: 397.476841ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
713.240345ms
FAIL (2025-08-23 16:08:16 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 15:34:13.673887314 (358h7m54.405154965s) [upload=372301]: Starting upload Aug 23 15:34:13.673975380 (358h7m54.40524303s) [upload=372301]: Done starting upload Aug 23 15:34:13.674099273 (358h7m54.405366893s) [upload=372301]: Uploading segments... Aug 23 15:34:13.674346529 (358h7m54.405614178s) [upload=372301]: Got next segment. Inline: false Aug 23 15:34:13.674393697 (358h7m54.405661347s) [upload=372301]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 15:34:13.674398708 (358h7m54.405666357s) [upload=372301]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 23 15:34:13.679684551 (358h7m54.410952181s) [upload=372301]: Next segment err: metaclient: Too Many Requests Aug 23 15:34:13.679711351 (358h7m54.410978981s) [upload=372301]: Done uploading segments... Aug 23 15:34:13.679733853 (358h7m54.411001473s) [upload=372301]: Upload finished. err: metaclient: Too Many Requests
Duration: 713.260614ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
252.029617ms
FAIL (2025-08-23 16:07:40 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 15:40:51.509312115 (358h14m32.240579766s) [upload=372416]: Starting upload Aug 23 15:40:51.509373452 (358h14m32.240641102s) [upload=372416]: Done starting upload Aug 23 15:40:51.509446459 (358h14m32.240714109s) [upload=372416]: Uploading segments... Aug 23 15:40:51.509484341 (358h14m32.240751991s) [upload=372416]: Got next segment. Inline: true Aug 23 15:40:51.509489591 (358h14m32.24075724s) [upload=372416]: Waiting for error group managing segments... Aug 23 15:40:51.509589939 (358h14m32.240857599s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 15:40:51.509596361 (358h14m32.240864011s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 15:40:51.509599737 (358h14m32.240867387s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 15:40:51.531216995 (358h14m32.262484646s) [upload=372416]: Done uploading segments... Aug 23 15:40:51.531235010 (358h14m32.26250268s) [upload=372416]: Upload finished. err: metaclient: Too Many Requests
Duration: 252.059193ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
1.708267655s
FAIL (2025-08-23 16:07:05 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 15:34:13.673887314 (358h7m54.405154965s) [upload=372301]: Starting upload Aug 23 15:34:13.673975380 (358h7m54.40524303s) [upload=372301]: Done starting upload Aug 23 15:34:13.674099273 (358h7m54.405366893s) [upload=372301]: Uploading segments... Aug 23 15:34:13.674346529 (358h7m54.405614178s) [upload=372301]: Got next segment. Inline: false Aug 23 15:34:13.674393697 (358h7m54.405661347s) [upload=372301]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 15:34:13.674398708 (358h7m54.405666357s) [upload=372301]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 23 15:34:13.679684551 (358h7m54.410952181s) [upload=372301]: Next segment err: metaclient: Too Many Requests Aug 23 15:34:13.679711351 (358h7m54.410978981s) [upload=372301]: Done uploading segments... Aug 23 15:34:13.679733853 (358h7m54.411001473s) [upload=372301]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.708293603s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
298.233885ms
FAIL (2025-08-23 16:06:29 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 15:40:51.509312115 (358h14m32.240579766s) [upload=372416]: Starting upload Aug 23 15:40:51.509373452 (358h14m32.240641102s) [upload=372416]: Done starting upload Aug 23 15:40:51.509446459 (358h14m32.240714109s) [upload=372416]: Uploading segments... Aug 23 15:40:51.509484341 (358h14m32.240751991s) [upload=372416]: Got next segment. Inline: true Aug 23 15:40:51.509489591 (358h14m32.24075724s) [upload=372416]: Waiting for error group managing segments... Aug 23 15:40:51.509589939 (358h14m32.240857599s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 15:40:51.509596361 (358h14m32.240864011s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 15:40:51.509599737 (358h14m32.240867387s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 15:40:51.531216995 (358h14m32.262484646s) [upload=372416]: Done uploading segments... Aug 23 15:40:51.531235010 (358h14m32.26250268s) [upload=372416]: Upload finished. err: metaclient: Too Many Requests
Duration: 298.257751ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
542.420506ms
FAIL (2025-08-23 16:06:17 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 15:34:13.673887314 (358h7m54.405154965s) [upload=372301]: Starting upload Aug 23 15:34:13.673975380 (358h7m54.40524303s) [upload=372301]: Done starting upload Aug 23 15:34:13.674099273 (358h7m54.405366893s) [upload=372301]: Uploading segments... Aug 23 15:34:13.674346529 (358h7m54.405614178s) [upload=372301]: Got next segment. Inline: false Aug 23 15:34:13.674393697 (358h7m54.405661347s) [upload=372301]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 15:34:13.674398708 (358h7m54.405666357s) [upload=372301]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 23 15:34:13.679684551 (358h7m54.410952181s) [upload=372301]: Next segment err: metaclient: Too Many Requests Aug 23 15:34:13.679711351 (358h7m54.410978981s) [upload=372301]: Done uploading segments... Aug 23 15:34:13.679733853 (358h7m54.411001473s) [upload=372301]: Upload finished. err: metaclient: Too Many Requests
Duration: 542.445132ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
206.865319ms
FAIL (2025-08-23 16:05:36 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 15:40:51.509312115 (358h14m32.240579766s) [upload=372416]: Starting upload Aug 23 15:40:51.509373452 (358h14m32.240641102s) [upload=372416]: Done starting upload Aug 23 15:40:51.509446459 (358h14m32.240714109s) [upload=372416]: Uploading segments... Aug 23 15:40:51.509484341 (358h14m32.240751991s) [upload=372416]: Got next segment. Inline: true Aug 23 15:40:51.509489591 (358h14m32.24075724s) [upload=372416]: Waiting for error group managing segments... Aug 23 15:40:51.509589939 (358h14m32.240857599s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 15:40:51.509596361 (358h14m32.240864011s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 15:40:51.509599737 (358h14m32.240867387s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 15:40:51.531216995 (358h14m32.262484646s) [upload=372416]: Done uploading segments... Aug 23 15:40:51.531235010 (358h14m32.26250268s) [upload=372416]: Upload finished. err: metaclient: Too Many Requests
Duration: 206.888273ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
1.590532976s
FAIL (2025-08-23 16:05:31 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 15:34:13.673887314 (358h7m54.405154965s) [upload=372301]: Starting upload Aug 23 15:34:13.673975380 (358h7m54.40524303s) [upload=372301]: Done starting upload Aug 23 15:34:13.674099273 (358h7m54.405366893s) [upload=372301]: Uploading segments... Aug 23 15:34:13.674346529 (358h7m54.405614178s) [upload=372301]: Got next segment. Inline: false Aug 23 15:34:13.674393697 (358h7m54.405661347s) [upload=372301]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 15:34:13.674398708 (358h7m54.405666357s) [upload=372301]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 23 15:34:13.679684551 (358h7m54.410952181s) [upload=372301]: Next segment err: metaclient: Too Many Requests Aug 23 15:34:13.679711351 (358h7m54.410978981s) [upload=372301]: Done uploading segments... Aug 23 15:34:13.679733853 (358h7m54.411001473s) [upload=372301]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.590552423s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
205.399949ms
FAIL (2025-08-23 16:05:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 15:40:51.509312115 (358h14m32.240579766s) [upload=372416]: Starting upload Aug 23 15:40:51.509373452 (358h14m32.240641102s) [upload=372416]: Done starting upload Aug 23 15:40:51.509446459 (358h14m32.240714109s) [upload=372416]: Uploading segments... Aug 23 15:40:51.509484341 (358h14m32.240751991s) [upload=372416]: Got next segment. Inline: true Aug 23 15:40:51.509489591 (358h14m32.24075724s) [upload=372416]: Waiting for error group managing segments... Aug 23 15:40:51.509589939 (358h14m32.240857599s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 15:40:51.509596361 (358h14m32.240864011s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 15:40:51.509599737 (358h14m32.240867387s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 15:40:51.531216995 (358h14m32.262484646s) [upload=372416]: Done uploading segments... Aug 23 15:40:51.531235010 (358h14m32.26250268s) [upload=372416]: Upload finished. err: metaclient: Too Many Requests
Duration: 205.420719ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
510.861907ms
FAIL (2025-08-23 16:05:11 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 15:34:13.673887314 (358h7m54.405154965s) [upload=372301]: Starting upload Aug 23 15:34:13.673975380 (358h7m54.40524303s) [upload=372301]: Done starting upload Aug 23 15:34:13.674099273 (358h7m54.405366893s) [upload=372301]: Uploading segments... Aug 23 15:34:13.674346529 (358h7m54.405614178s) [upload=372301]: Got next segment. Inline: false Aug 23 15:34:13.674393697 (358h7m54.405661347s) [upload=372301]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 15:34:13.674398708 (358h7m54.405666357s) [upload=372301]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 23 15:34:13.679684551 (358h7m54.410952181s) [upload=372301]: Next segment err: metaclient: Too Many Requests Aug 23 15:34:13.679711351 (358h7m54.410978981s) [upload=372301]: Done uploading segments... Aug 23 15:34:13.679733853 (358h7m54.411001473s) [upload=372301]: Upload finished. err: metaclient: Too Many Requests
Duration: 510.885941ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
1.591807968s
FAIL (2025-08-23 16:04:38 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 15:34:13.673887314 (358h7m54.405154965s) [upload=372301]: Starting upload Aug 23 15:34:13.673975380 (358h7m54.40524303s) [upload=372301]: Done starting upload Aug 23 15:34:13.674099273 (358h7m54.405366893s) [upload=372301]: Uploading segments... Aug 23 15:34:13.674346529 (358h7m54.405614178s) [upload=372301]: Got next segment. Inline: false Aug 23 15:34:13.674393697 (358h7m54.405661347s) [upload=372301]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 15:34:13.674398708 (358h7m54.405666357s) [upload=372301]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 23 15:34:13.679684551 (358h7m54.410952181s) [upload=372301]: Next segment err: metaclient: Too Many Requests Aug 23 15:34:13.679711351 (358h7m54.410978981s) [upload=372301]: Done uploading segments... Aug 23 15:34:13.679733853 (358h7m54.411001473s) [upload=372301]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.591833655s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
612.039162ms
FAIL (2025-08-23 16:04:10 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 15:40:51.509312115 (358h14m32.240579766s) [upload=372416]: Starting upload Aug 23 15:40:51.509373452 (358h14m32.240641102s) [upload=372416]: Done starting upload Aug 23 15:40:51.509446459 (358h14m32.240714109s) [upload=372416]: Uploading segments... Aug 23 15:40:51.509484341 (358h14m32.240751991s) [upload=372416]: Got next segment. Inline: true Aug 23 15:40:51.509489591 (358h14m32.24075724s) [upload=372416]: Waiting for error group managing segments... Aug 23 15:40:51.509589939 (358h14m32.240857599s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 15:40:51.509596361 (358h14m32.240864011s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 15:40:51.509599737 (358h14m32.240867387s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 15:40:51.531216995 (358h14m32.262484646s) [upload=372416]: Done uploading segments... Aug 23 15:40:51.531235010 (358h14m32.26250268s) [upload=372416]: Upload finished. err: metaclient: Too Many Requests
Duration: 612.062877ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
823.515063ms
FAIL (2025-08-23 16:03:25 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 15:34:13.673887314 (358h7m54.405154965s) [upload=372301]: Starting upload Aug 23 15:34:13.673975380 (358h7m54.40524303s) [upload=372301]: Done starting upload Aug 23 15:34:13.674099273 (358h7m54.405366893s) [upload=372301]: Uploading segments... Aug 23 15:34:13.674346529 (358h7m54.405614178s) [upload=372301]: Got next segment. Inline: false Aug 23 15:34:13.674393697 (358h7m54.405661347s) [upload=372301]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 15:34:13.674398708 (358h7m54.405666357s) [upload=372301]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 23 15:34:13.679684551 (358h7m54.410952181s) [upload=372301]: Next segment err: metaclient: Too Many Requests Aug 23 15:34:13.679711351 (358h7m54.410978981s) [upload=372301]: Done uploading segments... Aug 23 15:34:13.679733853 (358h7m54.411001473s) [upload=372301]: Upload finished. err: metaclient: Too Many Requests
Duration: 823.541393ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
294.108458ms
FAIL (2025-08-23 16:03:17 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 15:40:51.509312115 (358h14m32.240579766s) [upload=372416]: Starting upload Aug 23 15:40:51.509373452 (358h14m32.240641102s) [upload=372416]: Done starting upload Aug 23 15:40:51.509446459 (358h14m32.240714109s) [upload=372416]: Uploading segments... Aug 23 15:40:51.509484341 (358h14m32.240751991s) [upload=372416]: Got next segment. Inline: true Aug 23 15:40:51.509489591 (358h14m32.24075724s) [upload=372416]: Waiting for error group managing segments... Aug 23 15:40:51.509589939 (358h14m32.240857599s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 15:40:51.509596361 (358h14m32.240864011s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 15:40:51.509599737 (358h14m32.240867387s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 15:40:51.531216995 (358h14m32.262484646s) [upload=372416]: Done uploading segments... Aug 23 15:40:51.531235010 (358h14m32.26250268s) [upload=372416]: Upload finished. err: metaclient: Too Many Requests
Duration: 294.13159ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
2.268008385s
FAIL (2025-08-23 16:02:59 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 15:34:13.673887314 (358h7m54.405154965s) [upload=372301]: Starting upload Aug 23 15:34:13.673975380 (358h7m54.40524303s) [upload=372301]: Done starting upload Aug 23 15:34:13.674099273 (358h7m54.405366893s) [upload=372301]: Uploading segments... Aug 23 15:34:13.674346529 (358h7m54.405614178s) [upload=372301]: Got next segment. Inline: false Aug 23 15:34:13.674393697 (358h7m54.405661347s) [upload=372301]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 15:34:13.674398708 (358h7m54.405666357s) [upload=372301]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 23 15:34:13.679684551 (358h7m54.410952181s) [upload=372301]: Next segment err: metaclient: Too Many Requests Aug 23 15:34:13.679711351 (358h7m54.410978981s) [upload=372301]: Done uploading segments... Aug 23 15:34:13.679733853 (358h7m54.411001473s) [upload=372301]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.268034154s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
2.508458349s
FAIL (2025-08-23 16:02:33 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 15:34:13.673887314 (358h7m54.405154965s) [upload=372301]: Starting upload Aug 23 15:34:13.673975380 (358h7m54.40524303s) [upload=372301]: Done starting upload Aug 23 15:34:13.674099273 (358h7m54.405366893s) [upload=372301]: Uploading segments... Aug 23 15:34:13.674346529 (358h7m54.405614178s) [upload=372301]: Got next segment. Inline: false Aug 23 15:34:13.674393697 (358h7m54.405661347s) [upload=372301]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 15:34:13.674398708 (358h7m54.405666357s) [upload=372301]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 23 15:34:13.679684551 (358h7m54.410952181s) [upload=372301]: Next segment err: metaclient: Too Many Requests Aug 23 15:34:13.679711351 (358h7m54.410978981s) [upload=372301]: Done uploading segments... Aug 23 15:34:13.679733853 (358h7m54.411001473s) [upload=372301]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.508506649s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
307.415177ms
FAIL (2025-08-23 16:02:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 15:40:51.509312115 (358h14m32.240579766s) [upload=372416]: Starting upload Aug 23 15:40:51.509373452 (358h14m32.240641102s) [upload=372416]: Done starting upload Aug 23 15:40:51.509446459 (358h14m32.240714109s) [upload=372416]: Uploading segments... Aug 23 15:40:51.509484341 (358h14m32.240751991s) [upload=372416]: Got next segment. Inline: true Aug 23 15:40:51.509489591 (358h14m32.24075724s) [upload=372416]: Waiting for error group managing segments... Aug 23 15:40:51.509589939 (358h14m32.240857599s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 15:40:51.509596361 (358h14m32.240864011s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 15:40:51.509599737 (358h14m32.240867387s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 15:40:51.531216995 (358h14m32.262484646s) [upload=372416]: Done uploading segments... Aug 23 15:40:51.531235010 (358h14m32.26250268s) [upload=372416]: Upload finished. err: metaclient: Too Many Requests
Duration: 307.43824ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
598.669818ms
FAIL (2025-08-23 16:01:36 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 15:34:13.673887314 (358h7m54.405154965s) [upload=372301]: Starting upload Aug 23 15:34:13.673975380 (358h7m54.40524303s) [upload=372301]: Done starting upload Aug 23 15:34:13.674099273 (358h7m54.405366893s) [upload=372301]: Uploading segments... Aug 23 15:34:13.674346529 (358h7m54.405614178s) [upload=372301]: Got next segment. Inline: false Aug 23 15:34:13.674393697 (358h7m54.405661347s) [upload=372301]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 15:34:13.674398708 (358h7m54.405666357s) [upload=372301]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 23 15:34:13.679684551 (358h7m54.410952181s) [upload=372301]: Next segment err: metaclient: Too Many Requests Aug 23 15:34:13.679711351 (358h7m54.410978981s) [upload=372301]: Done uploading segments... Aug 23 15:34:13.679733853 (358h7m54.411001473s) [upload=372301]: Upload finished. err: metaclient: Too Many Requests
Duration: 598.700706ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
436.240304ms
FAIL (2025-08-23 16:01:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 15:40:51.509312115 (358h14m32.240579766s) [upload=372416]: Starting upload Aug 23 15:40:51.509373452 (358h14m32.240641102s) [upload=372416]: Done starting upload Aug 23 15:40:51.509446459 (358h14m32.240714109s) [upload=372416]: Uploading segments... Aug 23 15:40:51.509484341 (358h14m32.240751991s) [upload=372416]: Got next segment. Inline: true Aug 23 15:40:51.509489591 (358h14m32.24075724s) [upload=372416]: Waiting for error group managing segments... Aug 23 15:40:51.509589939 (358h14m32.240857599s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 15:40:51.509596361 (358h14m32.240864011s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 15:40:51.509599737 (358h14m32.240867387s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 15:40:51.531216995 (358h14m32.262484646s) [upload=372416]: Done uploading segments... Aug 23 15:40:51.531235010 (358h14m32.26250268s) [upload=372416]: Upload finished. err: metaclient: Too Many Requests
Duration: 436.264781ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
955.892415ms
FAIL (2025-08-23 16:01:05 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 15:34:13.673887314 (358h7m54.405154965s) [upload=372301]: Starting upload Aug 23 15:34:13.673975380 (358h7m54.40524303s) [upload=372301]: Done starting upload Aug 23 15:34:13.674099273 (358h7m54.405366893s) [upload=372301]: Uploading segments... Aug 23 15:34:13.674346529 (358h7m54.405614178s) [upload=372301]: Got next segment. Inline: false Aug 23 15:34:13.674393697 (358h7m54.405661347s) [upload=372301]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 15:34:13.674398708 (358h7m54.405666357s) [upload=372301]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 23 15:34:13.679684551 (358h7m54.410952181s) [upload=372301]: Next segment err: metaclient: Too Many Requests Aug 23 15:34:13.679711351 (358h7m54.410978981s) [upload=372301]: Done uploading segments... Aug 23 15:34:13.679733853 (358h7m54.411001473s) [upload=372301]: Upload finished. err: metaclient: Too Many Requests
Duration: 955.917201ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
511.928011ms
FAIL (2025-08-23 16:00:27 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 15:40:51.509312115 (358h14m32.240579766s) [upload=372416]: Starting upload Aug 23 15:40:51.509373452 (358h14m32.240641102s) [upload=372416]: Done starting upload Aug 23 15:40:51.509446459 (358h14m32.240714109s) [upload=372416]: Uploading segments... Aug 23 15:40:51.509484341 (358h14m32.240751991s) [upload=372416]: Got next segment. Inline: true Aug 23 15:40:51.509489591 (358h14m32.24075724s) [upload=372416]: Waiting for error group managing segments... Aug 23 15:40:51.509589939 (358h14m32.240857599s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 15:40:51.509596361 (358h14m32.240864011s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 15:40:51.509599737 (358h14m32.240867387s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 15:40:51.531216995 (358h14m32.262484646s) [upload=372416]: Done uploading segments... Aug 23 15:40:51.531235010 (358h14m32.26250268s) [upload=372416]: Upload finished. err: metaclient: Too Many Requests
Duration: 511.95412ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
1.037713871s
FAIL (2025-08-23 16:00:15 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 15:34:13.673887314 (358h7m54.405154965s) [upload=372301]: Starting upload Aug 23 15:34:13.673975380 (358h7m54.40524303s) [upload=372301]: Done starting upload Aug 23 15:34:13.674099273 (358h7m54.405366893s) [upload=372301]: Uploading segments... Aug 23 15:34:13.674346529 (358h7m54.405614178s) [upload=372301]: Got next segment. Inline: false Aug 23 15:34:13.674393697 (358h7m54.405661347s) [upload=372301]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 15:34:13.674398708 (358h7m54.405666357s) [upload=372301]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 23 15:34:13.679684551 (358h7m54.410952181s) [upload=372301]: Next segment err: metaclient: Too Many Requests Aug 23 15:34:13.679711351 (358h7m54.410978981s) [upload=372301]: Done uploading segments... Aug 23 15:34:13.679733853 (358h7m54.411001473s) [upload=372301]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.037741233s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
165.182457ms
FAIL (2025-08-23 15:59:30 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 15:40:51.509312115 (358h14m32.240579766s) [upload=372416]: Starting upload Aug 23 15:40:51.509373452 (358h14m32.240641102s) [upload=372416]: Done starting upload Aug 23 15:40:51.509446459 (358h14m32.240714109s) [upload=372416]: Uploading segments... Aug 23 15:40:51.509484341 (358h14m32.240751991s) [upload=372416]: Got next segment. Inline: true Aug 23 15:40:51.509489591 (358h14m32.24075724s) [upload=372416]: Waiting for error group managing segments... Aug 23 15:40:51.509589939 (358h14m32.240857599s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 15:40:51.509596361 (358h14m32.240864011s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 15:40:51.509599737 (358h14m32.240867387s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 15:40:51.531216995 (358h14m32.262484646s) [upload=372416]: Done uploading segments... Aug 23 15:40:51.531235010 (358h14m32.26250268s) [upload=372416]: Upload finished. err: metaclient: Too Many Requests
Duration: 165.204088ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
1.964418624s
FAIL (2025-08-23 15:59:20 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 15:34:13.673887314 (358h7m54.405154965s) [upload=372301]: Starting upload Aug 23 15:34:13.673975380 (358h7m54.40524303s) [upload=372301]: Done starting upload Aug 23 15:34:13.674099273 (358h7m54.405366893s) [upload=372301]: Uploading segments... Aug 23 15:34:13.674346529 (358h7m54.405614178s) [upload=372301]: Got next segment. Inline: false Aug 23 15:34:13.674393697 (358h7m54.405661347s) [upload=372301]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 15:34:13.674398708 (358h7m54.405666357s) [upload=372301]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 23 15:34:13.679684551 (358h7m54.410952181s) [upload=372301]: Next segment err: metaclient: Too Many Requests Aug 23 15:34:13.679711351 (358h7m54.410978981s) [upload=372301]: Done uploading segments... Aug 23 15:34:13.679733853 (358h7m54.411001473s) [upload=372301]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.964433601s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
153.002472ms
FAIL (2025-08-23 15:58:56 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 15:40:51.509312115 (358h14m32.240579766s) [upload=372416]: Starting upload Aug 23 15:40:51.509373452 (358h14m32.240641102s) [upload=372416]: Done starting upload Aug 23 15:40:51.509446459 (358h14m32.240714109s) [upload=372416]: Uploading segments... Aug 23 15:40:51.509484341 (358h14m32.240751991s) [upload=372416]: Got next segment. Inline: true Aug 23 15:40:51.509489591 (358h14m32.24075724s) [upload=372416]: Waiting for error group managing segments... Aug 23 15:40:51.509589939 (358h14m32.240857599s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 15:40:51.509596361 (358h14m32.240864011s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 15:40:51.509599737 (358h14m32.240867387s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 15:40:51.531216995 (358h14m32.262484646s) [upload=372416]: Done uploading segments... Aug 23 15:40:51.531235010 (358h14m32.26250268s) [upload=372416]: Upload finished. err: metaclient: Too Many Requests
Duration: 153.03353ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
2.188771371s
FAIL (2025-08-23 15:58:44 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 15:34:13.673887314 (358h7m54.405154965s) [upload=372301]: Starting upload Aug 23 15:34:13.673975380 (358h7m54.40524303s) [upload=372301]: Done starting upload Aug 23 15:34:13.674099273 (358h7m54.405366893s) [upload=372301]: Uploading segments... Aug 23 15:34:13.674346529 (358h7m54.405614178s) [upload=372301]: Got next segment. Inline: false Aug 23 15:34:13.674393697 (358h7m54.405661347s) [upload=372301]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 15:34:13.674398708 (358h7m54.405666357s) [upload=372301]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 23 15:34:13.679684551 (358h7m54.410952181s) [upload=372301]: Next segment err: metaclient: Too Many Requests Aug 23 15:34:13.679711351 (358h7m54.410978981s) [upload=372301]: Done uploading segments... Aug 23 15:34:13.679733853 (358h7m54.411001473s) [upload=372301]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.188889443s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
1.271526711s
FAIL (2025-08-23 15:58:14 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 15:34:13.673887314 (358h7m54.405154965s) [upload=372301]: Starting upload Aug 23 15:34:13.673975380 (358h7m54.40524303s) [upload=372301]: Done starting upload Aug 23 15:34:13.674099273 (358h7m54.405366893s) [upload=372301]: Uploading segments... Aug 23 15:34:13.674346529 (358h7m54.405614178s) [upload=372301]: Got next segment. Inline: false Aug 23 15:34:13.674393697 (358h7m54.405661347s) [upload=372301]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 15:34:13.674398708 (358h7m54.405666357s) [upload=372301]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 23 15:34:13.679684551 (358h7m54.410952181s) [upload=372301]: Next segment err: metaclient: Too Many Requests Aug 23 15:34:13.679711351 (358h7m54.410978981s) [upload=372301]: Done uploading segments... Aug 23 15:34:13.679733853 (358h7m54.411001473s) [upload=372301]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.271554423s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
489.16341ms
FAIL (2025-08-23 15:58:01 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 15:40:51.509312115 (358h14m32.240579766s) [upload=372416]: Starting upload Aug 23 15:40:51.509373452 (358h14m32.240641102s) [upload=372416]: Done starting upload Aug 23 15:40:51.509446459 (358h14m32.240714109s) [upload=372416]: Uploading segments... Aug 23 15:40:51.509484341 (358h14m32.240751991s) [upload=372416]: Got next segment. Inline: true Aug 23 15:40:51.509489591 (358h14m32.24075724s) [upload=372416]: Waiting for error group managing segments... Aug 23 15:40:51.509589939 (358h14m32.240857599s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 15:40:51.509596361 (358h14m32.240864011s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 15:40:51.509599737 (358h14m32.240867387s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 15:40:51.531216995 (358h14m32.262484646s) [upload=372416]: Done uploading segments... Aug 23 15:40:51.531235010 (358h14m32.26250268s) [upload=372416]: Upload finished. err: metaclient: Too Many Requests
Duration: 489.177577ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
7.947278163s
FAIL (2025-08-23 15:57:15 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 15:34:13.673887314 (358h7m54.405154965s) [upload=372301]: Starting upload Aug 23 15:34:13.673975380 (358h7m54.40524303s) [upload=372301]: Done starting upload Aug 23 15:34:13.674099273 (358h7m54.405366893s) [upload=372301]: Uploading segments... Aug 23 15:34:13.674346529 (358h7m54.405614178s) [upload=372301]: Got next segment. Inline: false Aug 23 15:34:13.674393697 (358h7m54.405661347s) [upload=372301]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 15:34:13.674398708 (358h7m54.405666357s) [upload=372301]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 23 15:34:13.679684551 (358h7m54.410952181s) [upload=372301]: Next segment err: metaclient: Too Many Requests Aug 23 15:34:13.679711351 (358h7m54.410978981s) [upload=372301]: Done uploading segments... Aug 23 15:34:13.679733853 (358h7m54.411001473s) [upload=372301]: Upload finished. err: metaclient: Too Many Requests
Duration: 7.947298751s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
164.88063ms
FAIL (2025-08-23 15:56:49 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 15:40:51.509312115 (358h14m32.240579766s) [upload=372416]: Starting upload Aug 23 15:40:51.509373452 (358h14m32.240641102s) [upload=372416]: Done starting upload Aug 23 15:40:51.509446459 (358h14m32.240714109s) [upload=372416]: Uploading segments... Aug 23 15:40:51.509484341 (358h14m32.240751991s) [upload=372416]: Got next segment. Inline: true Aug 23 15:40:51.509489591 (358h14m32.24075724s) [upload=372416]: Waiting for error group managing segments... Aug 23 15:40:51.509589939 (358h14m32.240857599s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 15:40:51.509596361 (358h14m32.240864011s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 15:40:51.509599737 (358h14m32.240867387s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 15:40:51.531216995 (358h14m32.262484646s) [upload=372416]: Done uploading segments... Aug 23 15:40:51.531235010 (358h14m32.26250268s) [upload=372416]: Upload finished. err: metaclient: Too Many Requests
Duration: 164.898584ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
3.259407895s
FAIL (2025-08-23 15:56:29 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 15:34:13.673887314 (358h7m54.405154965s) [upload=372301]: Starting upload Aug 23 15:34:13.673975380 (358h7m54.40524303s) [upload=372301]: Done starting upload Aug 23 15:34:13.674099273 (358h7m54.405366893s) [upload=372301]: Uploading segments... Aug 23 15:34:13.674346529 (358h7m54.405614178s) [upload=372301]: Got next segment. Inline: false Aug 23 15:34:13.674393697 (358h7m54.405661347s) [upload=372301]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 15:34:13.674398708 (358h7m54.405666357s) [upload=372301]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 23 15:34:13.679684551 (358h7m54.410952181s) [upload=372301]: Next segment err: metaclient: Too Many Requests Aug 23 15:34:13.679711351 (358h7m54.410978981s) [upload=372301]: Done uploading segments... Aug 23 15:34:13.679733853 (358h7m54.411001473s) [upload=372301]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.259428314s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
190.333888ms
FAIL (2025-08-23 15:55:44 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 15:40:51.509312115 (358h14m32.240579766s) [upload=372416]: Starting upload Aug 23 15:40:51.509373452 (358h14m32.240641102s) [upload=372416]: Done starting upload Aug 23 15:40:51.509446459 (358h14m32.240714109s) [upload=372416]: Uploading segments... Aug 23 15:40:51.509484341 (358h14m32.240751991s) [upload=372416]: Got next segment. Inline: true Aug 23 15:40:51.509489591 (358h14m32.24075724s) [upload=372416]: Waiting for error group managing segments... Aug 23 15:40:51.509589939 (358h14m32.240857599s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 15:40:51.509596361 (358h14m32.240864011s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 15:40:51.509599737 (358h14m32.240867387s) [upload=372416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 15:40:51.531216995 (358h14m32.262484646s) [upload=372416]: Done uploading segments... Aug 23 15:40:51.531235010 (358h14m32.26250268s) [upload=372416]: Upload finished. err: metaclient: Too Many Requests
Duration: 190.356741ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
6.279161136s
FAIL (2025-08-23 15:55:26 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 15:34:13.673887314 (358h7m54.405154965s) [upload=372301]: Starting upload Aug 23 15:34:13.673975380 (358h7m54.40524303s) [upload=372301]: Done starting upload Aug 23 15:34:13.674099273 (358h7m54.405366893s) [upload=372301]: Uploading segments... Aug 23 15:34:13.674346529 (358h7m54.405614178s) [upload=372301]: Got next segment. Inline: false Aug 23 15:34:13.674393697 (358h7m54.405661347s) [upload=372301]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 15:34:13.674398708 (358h7m54.405666357s) [upload=372301]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 23 15:34:13.679684551 (358h7m54.410952181s) [upload=372301]: Next segment err: metaclient: Too Many Requests Aug 23 15:34:13.679711351 (358h7m54.410978981s) [upload=372301]: Done uploading segments... Aug 23 15:34:13.679733853 (358h7m54.411001473s) [upload=372301]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.279181595s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|