Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
507.263949ms
FAIL (2025-08-17 18:52:06 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 18:33:16.400923957 (217h6m57.132191577s) [upload=225900]: Starting upload Aug 17 18:33:16.400969883 (217h6m57.132237513s) [upload=225900]: Done starting upload Aug 17 18:33:16.401014718 (217h6m57.132282338s) [upload=225900]: Uploading segments... Aug 17 18:33:16.401046027 (217h6m57.132313647s) [upload=225900]: Got next segment. Inline: true Aug 17 18:33:16.401050014 (217h6m57.132317645s) [upload=225900]: Waiting for error group managing segments... Aug 17 18:33:16.401081874 (217h6m57.132349504s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:33:16.401085992 (217h6m57.132353622s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 18:33:16.401088517 (217h6m57.132356147s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 18:33:16.418323930 (217h6m57.149591591s) [upload=225900]: Done uploading segments... Aug 17 18:33:16.418334601 (217h6m57.149602231s) [upload=225900]: Upload finished. err: metaclient: Too Many Requests
Duration: 507.282644ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [X...............................X...........................] duration:
136.727719ms
FAIL (2025-08-17 18:51:31 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 18:33:16.400923957 (217h6m57.132191577s) [upload=225900]: Starting upload Aug 17 18:33:16.400969883 (217h6m57.132237513s) [upload=225900]: Done starting upload Aug 17 18:33:16.401014718 (217h6m57.132282338s) [upload=225900]: Uploading segments... Aug 17 18:33:16.401046027 (217h6m57.132313647s) [upload=225900]: Got next segment. Inline: true Aug 17 18:33:16.401050014 (217h6m57.132317645s) [upload=225900]: Waiting for error group managing segments... Aug 17 18:33:16.401081874 (217h6m57.132349504s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:33:16.401085992 (217h6m57.132353622s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 18:33:16.401088517 (217h6m57.132356147s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 18:33:16.418323930 (217h6m57.149591591s) [upload=225900]: Done uploading segments... Aug 17 18:33:16.418334601 (217h6m57.149602231s) [upload=225900]: Upload finished. err: metaclient: Too Many Requests
Duration: 136.753128ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
661.424946ms
FAIL (2025-08-17 18:51:18 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 17 18:08:40.777064912 (216h42m21.508332542s) [upload=225459]: Starting upload
Aug 17 18:08:40.777115086 (216h42m21.508382716s) [upload=225459]: Done starting upload
Aug 17 18:08:40.777269627 (216h42m21.508537287s) [upload=225459]: Uploading segments...
Aug 17 18:08:40.777454013 (216h42m21.508721673s) [upload=225459]: Got next segment. Inline: false
Aug 17 18:08:40.777510961 (216h42m21.508778611s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 18:08:40.777517212 (216h42m21.508784863s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 18:08:40.852095643 (216h42m21.583363283s) [seg_pos={0 0}, upload=225459]: Begin upload segment...
Aug 17 18:08:40.852138052 (216h42m21.583405692s) [seg_pos={0 0}, upload=225459]: Done begin upload segment.
Aug 17 18:08:40.852171765 (216h42m21.583439416s) [noise=true , address=104.36.82.35:4614 , piece_id=45LILLUGTP77755UK2BJS7ZQT2KFGCZ4IM2LXXA4NARZLNZQZK5A, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.852266774 (216h42m21.583534444s) [noise=true , address=104.36.82.51:4077 , piece_id=DHAWXMJWOMEV57K5W4WCMFDRHW4L32OSSRN2VA2O4S4BLB4ULMKQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.852610419 (216h42m21.583878059s) [noise=true , address=104.36.82.17:4336 , piece_id=A7UARNTYXQNF47MOPK7UNWWRZNCHBCMRMIMZQ6D53GVVPH6XZLHA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853024428 (216h42m21.584292077s) [noise=true , address=77.90.31.11:4567 , piece_id=AOYPMJE7T6RDIS2ZV5UIAXF7BS2PHHIPZNGCTX7J2VEQIA5WOUGQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853326185 (216h42m21.584593844s) [noise=true , address=45.91.116.13:4168 , piece_id=VTT3MS2UIVXODCPZOJXHADVTDHW6S4HUTSEREFN7F6T75GMSRYNA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853425190 (216h42m21.584692841s) [noise=true , address=104.36.82.44:4899 , piece_id=LQQ7J5HK3LTHARNZIULHU3RKYL252NGGHZXIXP3TFVE32KKGXG6A, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853793371 (216h42m21.585061022s) [noise=true , address=104.36.82.39:4738 , piece_id=5A6MDJG5PEHXNAEEDBHP6ZMV45KWTBRAK5OIVRUL2SOE4NEJPI5Q, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854181972 (216h42m21.585449623s) [noise=true , address=77.90.31.19:4844 , piece_id=ZSISRMQJ3URFB6YZWSO23SMU7BI2QLEHCHADY4PZFNXIUOT5N2FA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854317537 (216h42m21.585585197s) [noise=true , address=77.90.31.15:4713 , piece_id=IBPJ2XQI6TD5SIGBFJIEDEMMX6WH37P6ECFFUCD5F3MWPQR6HYHQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854538112 (216h42m21.585805761s) [noise=true , address=104.36.82.60:4363 , piece_id=CIXNGIAGIFAHZUH5V5A6BTRZT4ANYEITZ6XBKJKX4RMZQKURIIMA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854888400 (216h42m21.586156049s) [noise=true , address=104.36.82.18:4368 , piece_id=L5ZIXJFLLUXJLSLTMURQOOFYGRKGW3BD3XNF3MK362FTZYU2ICVQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.855236013 (216h42m21.586503662s) [noise=true , address=104.36.82.34:4566 , piece_id=TKRYBM75X63T6VDRPYN6ZNT5FEKROIVA5NZAELVPRGAQL6XVXU7Q, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.855379192 (216h42m21.586646842s) [noise=true , address=45.91.116.8:4059 , piece_id=DEDZA2DR33EK3URR27H6DKURMDDTWT65SCS3UGECCWM5BKVD4QHQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.855570652 (216h42m21.586838302s) [noise=true , address=77.90.31.10:4529 , piece_id=VZSQBU6PUYIP7XNBN5JQFZ5VI4WXHLSQUCGQNDRRRGU6TETCGQBQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.856194745 (216h42m21.587462415s) [noise=true , address=79.127.201.215:4359 , piece_id=DJVGXMVZA6JI35GVPHBGRMIEDS6OBOOFT74DNVZWUGTUQMKV6WKA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.857030525 (216h42m21.588298175s) [noise=true , address=45.91.116.7:4019 , piece_id=QK25YOV3HUQGIMGM4IGMLDVPLLNUR3KQMHQOIH4GU3PJVFQUPTKQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.857816381 (216h42m21.589084091s) [noise=true , address=104.36.82.58:4276 , piece_id=SMD2BUAUTWDS33QOWM3HQFYHQS5V33BLFRO4RZ2S6TC2GR5YGX3A, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.857978566 (216h42m21.589246216s) [noise=true , address=104.36.82.11:4127 , piece_id=U6JDUSEWROCLEHVG2ZATIVLD2ELN5M6JYUVZREWQWAA7BG3DI6UQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.974500804 (216h42m21.705768454s) [upload=225459]: Next returned nil segment
Aug 17 18:08:40.974518928 (216h42m21.705786568s) [upload=225459]: Waiting for error group managing segments...
Aug 17 18:08:40.987516869 (216h42m21.71878452s) [noise=true , address=104.36.82.11:4127 , piece_id=U6JDUSEWROCLEHVG2ZATIVLD2ELN5M6JYUVZREWQWAA7BG3DI6UQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:40.988549711 (216h42m21.719817331s) [noise=true , address=104.36.82.44:4899 , piece_id=LQQ7J5HK3LTHARNZIULHU3RKYL252NGGHZXIXP3TFVE32KKGXG6A, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.000082720 (216h42m21.73135034s) [noise=true , address=104.36.82.34:4566 , piece_id=TKRYBM75X63T6VDRPYN6ZNT5FEKROIVA5NZAELVPRGAQL6XVXU7Q, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.004638781 (216h42m21.735906401s) [noise=true , address=104.36.82.39:4738 , piece_id=5A6MDJG5PEHXNAEEDBHP6ZMV45KWTBRAK5OIVRUL2SOE4NEJPI5Q, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.004918978 (216h42m21.736186608s) [noise=true , address=104.36.82.58:4276 , piece_id=SMD2BUAUTWDS33QOWM3HQFYHQS5V33BLFRO4RZ2S6TC2GR5YGX3A, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.017616555 (216h42m21.748884185s) [noise=true , address=45.91.116.13:4168 , piece_id=VTT3MS2UIVXODCPZOJXHADVTDHW6S4HUTSEREFN7F6T75GMSRYNA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.026705041 (216h42m21.757972671s) [noise=true , address=104.36.82.60:4363 , piece_id=CIXNGIAGIFAHZUH5V5A6BTRZT4ANYEITZ6XBKJKX4RMZQKURIIMA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.029172177 (216h42m21.760439807s) [noise=true , address=45.91.116.7:4019 , piece_id=QK25YOV3HUQGIMGM4IGMLDVPLLNUR3KQMHQOIH4GU3PJVFQUPTKQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.032674628 (216h42m21.763942248s) [noise=true , address=77.90.31.15:4713 , piece_id=IBPJ2XQI6TD5SIGBFJIEDEMMX6WH37P6ECFFUCD5F3MWPQR6HYHQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.049253778 (216h42m21.780521408s) [noise=true , address=104.36.82.17:4336 , piece_id=A7UARNTYXQNF47MOPK7UNWWRZNCHBCMRMIMZQ6D53GVVPH6XZLHA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.049498879 (216h42m21.780766509s) [noise=true , address=104.36.82.35:4614 , piece_id=45LILLUGTP77755UK2BJS7ZQT2KFGCZ4IM2LXXA4NARZLNZQZK5A, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.068541098 (216h42m21.799808718s) [noise=true , address=77.90.31.11:4567 , piece_id=AOYPMJE7T6RDIS2ZV5UIAXF7BS2PHHIPZNGCTX7J2VEQIA5WOUGQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.070945586 (216h42m21.802213216s) [noise=true , address=77.90.31.19:4844 , piece_id=ZSISRMQJ3URFB6YZWSO23SMU7BI2QLEHCHADY4PZFNXIUOT5N2FA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.090207367 (216h42m21.821474997s) [noise=true , address=79.127.201.215:4359 , piece_id=DJVGXMVZA6JI35GVPHBGRMIEDS6OBOOFT74DNVZWUGTUQMKV6WKA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.090233866 (216h42m21.821501487s) [seg_pos={0 0}, upload=225459]: Segment reached optimal threshold of 14 pieces.
Aug 17 18:08:41.090351558 (216h42m21.821619179s) [noise=true , address=77.90.31.10:4529 , piece_id=VZSQBU6PUYIP7XNBN5JQFZ5VI4WXHLSQUCGQNDRRRGU6TETCGQBQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm): protocol: expected piece hash; context canceled; EOF
Aug 17 18:08:41.090444122 (216h42m21.821711752s) [noise=true , address=104.36.82.51:4077 , piece_id=DHAWXMJWOMEV57K5W4WCMFDRHW4L32OSSRN2VA2O4S4BLB4ULMKQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Njt39WE2REJivSU8fuzUReFN1n6BbRH78kJWaurrMK3Xh6PpS): protocol: expected piece hash; context canceled; EOF
Aug 17 18:08:41.090452788 (216h42m21.821720418s) [noise=true , address=45.91.116.8:4059 , piece_id=DEDZA2DR33EK3URR27H6DKURMDDTWT65SCS3UGECCWM5BKVD4QHQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YzYcwyVJqZywPJt9tYXXHMrjfjeziu6fobhHjt6sRf3utaror): protocol: expected piece hash; context canceled; EOF
Aug 17 18:08:41.090529141 (216h42m21.821796771s) [noise=true , address=104.36.82.18:4368 , piece_id=L5ZIXJFLLUXJLSLTMURQOOFYGRKGW3BD3XNF3MK362FTZYU2ICVQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ByhoW6Effjs8acfsvdF1xzDwBVqggsBK53oRZ8bYhEYYPChKz): protocol: write tcp 5.161.89.252:13580->104.36.82.18:4368: use of closed network connection; write tcp 5.161.89.252:13580->104.36.82.18:4368: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:13580->104.36.82.18:4368: use of closed network connection
Aug 17 18:08:41.090549199 (216h42m21.82181686s) [seg_pos={0 0}, upload=225459]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 18:08:41.090665598 (216h42m21.821933279s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 18:08:41.090672481 (216h42m21.821940102s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 18:08:41.259395157 (216h42m21.990662806s) [upload=225459]: Done uploading segments...
Aug 17 18:08:41.259414002 (216h42m21.990681662s) [upload=225459]: Upload finished. err: <nil>
Duration: 661.446034ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.X...............................X..........................] duration:
475.020446ms
FAIL (2025-08-17 18:51:06 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 18:33:16.400923957 (217h6m57.132191577s) [upload=225900]: Starting upload Aug 17 18:33:16.400969883 (217h6m57.132237513s) [upload=225900]: Done starting upload Aug 17 18:33:16.401014718 (217h6m57.132282338s) [upload=225900]: Uploading segments... Aug 17 18:33:16.401046027 (217h6m57.132313647s) [upload=225900]: Got next segment. Inline: true Aug 17 18:33:16.401050014 (217h6m57.132317645s) [upload=225900]: Waiting for error group managing segments... Aug 17 18:33:16.401081874 (217h6m57.132349504s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:33:16.401085992 (217h6m57.132353622s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 18:33:16.401088517 (217h6m57.132356147s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 18:33:16.418323930 (217h6m57.149591591s) [upload=225900]: Done uploading segments... Aug 17 18:33:16.418334601 (217h6m57.149602231s) [upload=225900]: Upload finished. err: metaclient: Too Many Requests
Duration: 475.06028ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
1.090666853s
FAIL (2025-08-17 18:50:10 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 17 18:08:40.777064912 (216h42m21.508332542s) [upload=225459]: Starting upload
Aug 17 18:08:40.777115086 (216h42m21.508382716s) [upload=225459]: Done starting upload
Aug 17 18:08:40.777269627 (216h42m21.508537287s) [upload=225459]: Uploading segments...
Aug 17 18:08:40.777454013 (216h42m21.508721673s) [upload=225459]: Got next segment. Inline: false
Aug 17 18:08:40.777510961 (216h42m21.508778611s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 18:08:40.777517212 (216h42m21.508784863s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 18:08:40.852095643 (216h42m21.583363283s) [seg_pos={0 0}, upload=225459]: Begin upload segment...
Aug 17 18:08:40.852138052 (216h42m21.583405692s) [seg_pos={0 0}, upload=225459]: Done begin upload segment.
Aug 17 18:08:40.852171765 (216h42m21.583439416s) [noise=true , address=104.36.82.35:4614 , piece_id=45LILLUGTP77755UK2BJS7ZQT2KFGCZ4IM2LXXA4NARZLNZQZK5A, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.852266774 (216h42m21.583534444s) [noise=true , address=104.36.82.51:4077 , piece_id=DHAWXMJWOMEV57K5W4WCMFDRHW4L32OSSRN2VA2O4S4BLB4ULMKQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.852610419 (216h42m21.583878059s) [noise=true , address=104.36.82.17:4336 , piece_id=A7UARNTYXQNF47MOPK7UNWWRZNCHBCMRMIMZQ6D53GVVPH6XZLHA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853024428 (216h42m21.584292077s) [noise=true , address=77.90.31.11:4567 , piece_id=AOYPMJE7T6RDIS2ZV5UIAXF7BS2PHHIPZNGCTX7J2VEQIA5WOUGQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853326185 (216h42m21.584593844s) [noise=true , address=45.91.116.13:4168 , piece_id=VTT3MS2UIVXODCPZOJXHADVTDHW6S4HUTSEREFN7F6T75GMSRYNA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853425190 (216h42m21.584692841s) [noise=true , address=104.36.82.44:4899 , piece_id=LQQ7J5HK3LTHARNZIULHU3RKYL252NGGHZXIXP3TFVE32KKGXG6A, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853793371 (216h42m21.585061022s) [noise=true , address=104.36.82.39:4738 , piece_id=5A6MDJG5PEHXNAEEDBHP6ZMV45KWTBRAK5OIVRUL2SOE4NEJPI5Q, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854181972 (216h42m21.585449623s) [noise=true , address=77.90.31.19:4844 , piece_id=ZSISRMQJ3URFB6YZWSO23SMU7BI2QLEHCHADY4PZFNXIUOT5N2FA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854317537 (216h42m21.585585197s) [noise=true , address=77.90.31.15:4713 , piece_id=IBPJ2XQI6TD5SIGBFJIEDEMMX6WH37P6ECFFUCD5F3MWPQR6HYHQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854538112 (216h42m21.585805761s) [noise=true , address=104.36.82.60:4363 , piece_id=CIXNGIAGIFAHZUH5V5A6BTRZT4ANYEITZ6XBKJKX4RMZQKURIIMA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854888400 (216h42m21.586156049s) [noise=true , address=104.36.82.18:4368 , piece_id=L5ZIXJFLLUXJLSLTMURQOOFYGRKGW3BD3XNF3MK362FTZYU2ICVQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.855236013 (216h42m21.586503662s) [noise=true , address=104.36.82.34:4566 , piece_id=TKRYBM75X63T6VDRPYN6ZNT5FEKROIVA5NZAELVPRGAQL6XVXU7Q, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.855379192 (216h42m21.586646842s) [noise=true , address=45.91.116.8:4059 , piece_id=DEDZA2DR33EK3URR27H6DKURMDDTWT65SCS3UGECCWM5BKVD4QHQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.855570652 (216h42m21.586838302s) [noise=true , address=77.90.31.10:4529 , piece_id=VZSQBU6PUYIP7XNBN5JQFZ5VI4WXHLSQUCGQNDRRRGU6TETCGQBQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.856194745 (216h42m21.587462415s) [noise=true , address=79.127.201.215:4359 , piece_id=DJVGXMVZA6JI35GVPHBGRMIEDS6OBOOFT74DNVZWUGTUQMKV6WKA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.857030525 (216h42m21.588298175s) [noise=true , address=45.91.116.7:4019 , piece_id=QK25YOV3HUQGIMGM4IGMLDVPLLNUR3KQMHQOIH4GU3PJVFQUPTKQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.857816381 (216h42m21.589084091s) [noise=true , address=104.36.82.58:4276 , piece_id=SMD2BUAUTWDS33QOWM3HQFYHQS5V33BLFRO4RZ2S6TC2GR5YGX3A, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.857978566 (216h42m21.589246216s) [noise=true , address=104.36.82.11:4127 , piece_id=U6JDUSEWROCLEHVG2ZATIVLD2ELN5M6JYUVZREWQWAA7BG3DI6UQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.974500804 (216h42m21.705768454s) [upload=225459]: Next returned nil segment
Aug 17 18:08:40.974518928 (216h42m21.705786568s) [upload=225459]: Waiting for error group managing segments...
Aug 17 18:08:40.987516869 (216h42m21.71878452s) [noise=true , address=104.36.82.11:4127 , piece_id=U6JDUSEWROCLEHVG2ZATIVLD2ELN5M6JYUVZREWQWAA7BG3DI6UQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:40.988549711 (216h42m21.719817331s) [noise=true , address=104.36.82.44:4899 , piece_id=LQQ7J5HK3LTHARNZIULHU3RKYL252NGGHZXIXP3TFVE32KKGXG6A, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.000082720 (216h42m21.73135034s) [noise=true , address=104.36.82.34:4566 , piece_id=TKRYBM75X63T6VDRPYN6ZNT5FEKROIVA5NZAELVPRGAQL6XVXU7Q, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.004638781 (216h42m21.735906401s) [noise=true , address=104.36.82.39:4738 , piece_id=5A6MDJG5PEHXNAEEDBHP6ZMV45KWTBRAK5OIVRUL2SOE4NEJPI5Q, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.004918978 (216h42m21.736186608s) [noise=true , address=104.36.82.58:4276 , piece_id=SMD2BUAUTWDS33QOWM3HQFYHQS5V33BLFRO4RZ2S6TC2GR5YGX3A, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.017616555 (216h42m21.748884185s) [noise=true , address=45.91.116.13:4168 , piece_id=VTT3MS2UIVXODCPZOJXHADVTDHW6S4HUTSEREFN7F6T75GMSRYNA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.026705041 (216h42m21.757972671s) [noise=true , address=104.36.82.60:4363 , piece_id=CIXNGIAGIFAHZUH5V5A6BTRZT4ANYEITZ6XBKJKX4RMZQKURIIMA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.029172177 (216h42m21.760439807s) [noise=true , address=45.91.116.7:4019 , piece_id=QK25YOV3HUQGIMGM4IGMLDVPLLNUR3KQMHQOIH4GU3PJVFQUPTKQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.032674628 (216h42m21.763942248s) [noise=true , address=77.90.31.15:4713 , piece_id=IBPJ2XQI6TD5SIGBFJIEDEMMX6WH37P6ECFFUCD5F3MWPQR6HYHQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.049253778 (216h42m21.780521408s) [noise=true , address=104.36.82.17:4336 , piece_id=A7UARNTYXQNF47MOPK7UNWWRZNCHBCMRMIMZQ6D53GVVPH6XZLHA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.049498879 (216h42m21.780766509s) [noise=true , address=104.36.82.35:4614 , piece_id=45LILLUGTP77755UK2BJS7ZQT2KFGCZ4IM2LXXA4NARZLNZQZK5A, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.068541098 (216h42m21.799808718s) [noise=true , address=77.90.31.11:4567 , piece_id=AOYPMJE7T6RDIS2ZV5UIAXF7BS2PHHIPZNGCTX7J2VEQIA5WOUGQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.070945586 (216h42m21.802213216s) [noise=true , address=77.90.31.19:4844 , piece_id=ZSISRMQJ3URFB6YZWSO23SMU7BI2QLEHCHADY4PZFNXIUOT5N2FA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.090207367 (216h42m21.821474997s) [noise=true , address=79.127.201.215:4359 , piece_id=DJVGXMVZA6JI35GVPHBGRMIEDS6OBOOFT74DNVZWUGTUQMKV6WKA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.090233866 (216h42m21.821501487s) [seg_pos={0 0}, upload=225459]: Segment reached optimal threshold of 14 pieces.
Aug 17 18:08:41.090351558 (216h42m21.821619179s) [noise=true , address=77.90.31.10:4529 , piece_id=VZSQBU6PUYIP7XNBN5JQFZ5VI4WXHLSQUCGQNDRRRGU6TETCGQBQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm): protocol: expected piece hash; context canceled; EOF
Aug 17 18:08:41.090444122 (216h42m21.821711752s) [noise=true , address=104.36.82.51:4077 , piece_id=DHAWXMJWOMEV57K5W4WCMFDRHW4L32OSSRN2VA2O4S4BLB4ULMKQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Njt39WE2REJivSU8fuzUReFN1n6BbRH78kJWaurrMK3Xh6PpS): protocol: expected piece hash; context canceled; EOF
Aug 17 18:08:41.090452788 (216h42m21.821720418s) [noise=true , address=45.91.116.8:4059 , piece_id=DEDZA2DR33EK3URR27H6DKURMDDTWT65SCS3UGECCWM5BKVD4QHQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YzYcwyVJqZywPJt9tYXXHMrjfjeziu6fobhHjt6sRf3utaror): protocol: expected piece hash; context canceled; EOF
Aug 17 18:08:41.090529141 (216h42m21.821796771s) [noise=true , address=104.36.82.18:4368 , piece_id=L5ZIXJFLLUXJLSLTMURQOOFYGRKGW3BD3XNF3MK362FTZYU2ICVQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ByhoW6Effjs8acfsvdF1xzDwBVqggsBK53oRZ8bYhEYYPChKz): protocol: write tcp 5.161.89.252:13580->104.36.82.18:4368: use of closed network connection; write tcp 5.161.89.252:13580->104.36.82.18:4368: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:13580->104.36.82.18:4368: use of closed network connection
Aug 17 18:08:41.090549199 (216h42m21.82181686s) [seg_pos={0 0}, upload=225459]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 18:08:41.090665598 (216h42m21.821933279s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 18:08:41.090672481 (216h42m21.821940102s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 18:08:41.259395157 (216h42m21.990662806s) [upload=225459]: Done uploading segments...
Aug 17 18:08:41.259414002 (216h42m21.990681662s) [upload=225459]: Upload finished. err: <nil>
Duration: 1.09069156s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..X...............................X.........................] duration:
1.147803372s
FAIL (2025-08-17 18:49:59 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 18:33:16.400923957 (217h6m57.132191577s) [upload=225900]: Starting upload Aug 17 18:33:16.400969883 (217h6m57.132237513s) [upload=225900]: Done starting upload Aug 17 18:33:16.401014718 (217h6m57.132282338s) [upload=225900]: Uploading segments... Aug 17 18:33:16.401046027 (217h6m57.132313647s) [upload=225900]: Got next segment. Inline: true Aug 17 18:33:16.401050014 (217h6m57.132317645s) [upload=225900]: Waiting for error group managing segments... Aug 17 18:33:16.401081874 (217h6m57.132349504s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:33:16.401085992 (217h6m57.132353622s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 18:33:16.401088517 (217h6m57.132356147s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 18:33:16.418323930 (217h6m57.149591591s) [upload=225900]: Done uploading segments... Aug 17 18:33:16.418334601 (217h6m57.149602231s) [upload=225900]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.147826574s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
448.271794ms
FAIL (2025-08-17 18:49:20 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 17 18:08:40.777064912 (216h42m21.508332542s) [upload=225459]: Starting upload
Aug 17 18:08:40.777115086 (216h42m21.508382716s) [upload=225459]: Done starting upload
Aug 17 18:08:40.777269627 (216h42m21.508537287s) [upload=225459]: Uploading segments...
Aug 17 18:08:40.777454013 (216h42m21.508721673s) [upload=225459]: Got next segment. Inline: false
Aug 17 18:08:40.777510961 (216h42m21.508778611s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 18:08:40.777517212 (216h42m21.508784863s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 18:08:40.852095643 (216h42m21.583363283s) [seg_pos={0 0}, upload=225459]: Begin upload segment...
Aug 17 18:08:40.852138052 (216h42m21.583405692s) [seg_pos={0 0}, upload=225459]: Done begin upload segment.
Aug 17 18:08:40.852171765 (216h42m21.583439416s) [noise=true , address=104.36.82.35:4614 , piece_id=45LILLUGTP77755UK2BJS7ZQT2KFGCZ4IM2LXXA4NARZLNZQZK5A, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.852266774 (216h42m21.583534444s) [noise=true , address=104.36.82.51:4077 , piece_id=DHAWXMJWOMEV57K5W4WCMFDRHW4L32OSSRN2VA2O4S4BLB4ULMKQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.852610419 (216h42m21.583878059s) [noise=true , address=104.36.82.17:4336 , piece_id=A7UARNTYXQNF47MOPK7UNWWRZNCHBCMRMIMZQ6D53GVVPH6XZLHA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853024428 (216h42m21.584292077s) [noise=true , address=77.90.31.11:4567 , piece_id=AOYPMJE7T6RDIS2ZV5UIAXF7BS2PHHIPZNGCTX7J2VEQIA5WOUGQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853326185 (216h42m21.584593844s) [noise=true , address=45.91.116.13:4168 , piece_id=VTT3MS2UIVXODCPZOJXHADVTDHW6S4HUTSEREFN7F6T75GMSRYNA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853425190 (216h42m21.584692841s) [noise=true , address=104.36.82.44:4899 , piece_id=LQQ7J5HK3LTHARNZIULHU3RKYL252NGGHZXIXP3TFVE32KKGXG6A, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853793371 (216h42m21.585061022s) [noise=true , address=104.36.82.39:4738 , piece_id=5A6MDJG5PEHXNAEEDBHP6ZMV45KWTBRAK5OIVRUL2SOE4NEJPI5Q, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854181972 (216h42m21.585449623s) [noise=true , address=77.90.31.19:4844 , piece_id=ZSISRMQJ3URFB6YZWSO23SMU7BI2QLEHCHADY4PZFNXIUOT5N2FA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854317537 (216h42m21.585585197s) [noise=true , address=77.90.31.15:4713 , piece_id=IBPJ2XQI6TD5SIGBFJIEDEMMX6WH37P6ECFFUCD5F3MWPQR6HYHQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854538112 (216h42m21.585805761s) [noise=true , address=104.36.82.60:4363 , piece_id=CIXNGIAGIFAHZUH5V5A6BTRZT4ANYEITZ6XBKJKX4RMZQKURIIMA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854888400 (216h42m21.586156049s) [noise=true , address=104.36.82.18:4368 , piece_id=L5ZIXJFLLUXJLSLTMURQOOFYGRKGW3BD3XNF3MK362FTZYU2ICVQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.855236013 (216h42m21.586503662s) [noise=true , address=104.36.82.34:4566 , piece_id=TKRYBM75X63T6VDRPYN6ZNT5FEKROIVA5NZAELVPRGAQL6XVXU7Q, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.855379192 (216h42m21.586646842s) [noise=true , address=45.91.116.8:4059 , piece_id=DEDZA2DR33EK3URR27H6DKURMDDTWT65SCS3UGECCWM5BKVD4QHQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.855570652 (216h42m21.586838302s) [noise=true , address=77.90.31.10:4529 , piece_id=VZSQBU6PUYIP7XNBN5JQFZ5VI4WXHLSQUCGQNDRRRGU6TETCGQBQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.856194745 (216h42m21.587462415s) [noise=true , address=79.127.201.215:4359 , piece_id=DJVGXMVZA6JI35GVPHBGRMIEDS6OBOOFT74DNVZWUGTUQMKV6WKA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.857030525 (216h42m21.588298175s) [noise=true , address=45.91.116.7:4019 , piece_id=QK25YOV3HUQGIMGM4IGMLDVPLLNUR3KQMHQOIH4GU3PJVFQUPTKQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.857816381 (216h42m21.589084091s) [noise=true , address=104.36.82.58:4276 , piece_id=SMD2BUAUTWDS33QOWM3HQFYHQS5V33BLFRO4RZ2S6TC2GR5YGX3A, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.857978566 (216h42m21.589246216s) [noise=true , address=104.36.82.11:4127 , piece_id=U6JDUSEWROCLEHVG2ZATIVLD2ELN5M6JYUVZREWQWAA7BG3DI6UQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.974500804 (216h42m21.705768454s) [upload=225459]: Next returned nil segment
Aug 17 18:08:40.974518928 (216h42m21.705786568s) [upload=225459]: Waiting for error group managing segments...
Aug 17 18:08:40.987516869 (216h42m21.71878452s) [noise=true , address=104.36.82.11:4127 , piece_id=U6JDUSEWROCLEHVG2ZATIVLD2ELN5M6JYUVZREWQWAA7BG3DI6UQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:40.988549711 (216h42m21.719817331s) [noise=true , address=104.36.82.44:4899 , piece_id=LQQ7J5HK3LTHARNZIULHU3RKYL252NGGHZXIXP3TFVE32KKGXG6A, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.000082720 (216h42m21.73135034s) [noise=true , address=104.36.82.34:4566 , piece_id=TKRYBM75X63T6VDRPYN6ZNT5FEKROIVA5NZAELVPRGAQL6XVXU7Q, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.004638781 (216h42m21.735906401s) [noise=true , address=104.36.82.39:4738 , piece_id=5A6MDJG5PEHXNAEEDBHP6ZMV45KWTBRAK5OIVRUL2SOE4NEJPI5Q, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.004918978 (216h42m21.736186608s) [noise=true , address=104.36.82.58:4276 , piece_id=SMD2BUAUTWDS33QOWM3HQFYHQS5V33BLFRO4RZ2S6TC2GR5YGX3A, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.017616555 (216h42m21.748884185s) [noise=true , address=45.91.116.13:4168 , piece_id=VTT3MS2UIVXODCPZOJXHADVTDHW6S4HUTSEREFN7F6T75GMSRYNA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.026705041 (216h42m21.757972671s) [noise=true , address=104.36.82.60:4363 , piece_id=CIXNGIAGIFAHZUH5V5A6BTRZT4ANYEITZ6XBKJKX4RMZQKURIIMA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.029172177 (216h42m21.760439807s) [noise=true , address=45.91.116.7:4019 , piece_id=QK25YOV3HUQGIMGM4IGMLDVPLLNUR3KQMHQOIH4GU3PJVFQUPTKQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.032674628 (216h42m21.763942248s) [noise=true , address=77.90.31.15:4713 , piece_id=IBPJ2XQI6TD5SIGBFJIEDEMMX6WH37P6ECFFUCD5F3MWPQR6HYHQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.049253778 (216h42m21.780521408s) [noise=true , address=104.36.82.17:4336 , piece_id=A7UARNTYXQNF47MOPK7UNWWRZNCHBCMRMIMZQ6D53GVVPH6XZLHA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.049498879 (216h42m21.780766509s) [noise=true , address=104.36.82.35:4614 , piece_id=45LILLUGTP77755UK2BJS7ZQT2KFGCZ4IM2LXXA4NARZLNZQZK5A, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.068541098 (216h42m21.799808718s) [noise=true , address=77.90.31.11:4567 , piece_id=AOYPMJE7T6RDIS2ZV5UIAXF7BS2PHHIPZNGCTX7J2VEQIA5WOUGQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.070945586 (216h42m21.802213216s) [noise=true , address=77.90.31.19:4844 , piece_id=ZSISRMQJ3URFB6YZWSO23SMU7BI2QLEHCHADY4PZFNXIUOT5N2FA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.090207367 (216h42m21.821474997s) [noise=true , address=79.127.201.215:4359 , piece_id=DJVGXMVZA6JI35GVPHBGRMIEDS6OBOOFT74DNVZWUGTUQMKV6WKA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.090233866 (216h42m21.821501487s) [seg_pos={0 0}, upload=225459]: Segment reached optimal threshold of 14 pieces.
Aug 17 18:08:41.090351558 (216h42m21.821619179s) [noise=true , address=77.90.31.10:4529 , piece_id=VZSQBU6PUYIP7XNBN5JQFZ5VI4WXHLSQUCGQNDRRRGU6TETCGQBQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm): protocol: expected piece hash; context canceled; EOF
Aug 17 18:08:41.090444122 (216h42m21.821711752s) [noise=true , address=104.36.82.51:4077 , piece_id=DHAWXMJWOMEV57K5W4WCMFDRHW4L32OSSRN2VA2O4S4BLB4ULMKQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Njt39WE2REJivSU8fuzUReFN1n6BbRH78kJWaurrMK3Xh6PpS): protocol: expected piece hash; context canceled; EOF
Aug 17 18:08:41.090452788 (216h42m21.821720418s) [noise=true , address=45.91.116.8:4059 , piece_id=DEDZA2DR33EK3URR27H6DKURMDDTWT65SCS3UGECCWM5BKVD4QHQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YzYcwyVJqZywPJt9tYXXHMrjfjeziu6fobhHjt6sRf3utaror): protocol: expected piece hash; context canceled; EOF
Aug 17 18:08:41.090529141 (216h42m21.821796771s) [noise=true , address=104.36.82.18:4368 , piece_id=L5ZIXJFLLUXJLSLTMURQOOFYGRKGW3BD3XNF3MK362FTZYU2ICVQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ByhoW6Effjs8acfsvdF1xzDwBVqggsBK53oRZ8bYhEYYPChKz): protocol: write tcp 5.161.89.252:13580->104.36.82.18:4368: use of closed network connection; write tcp 5.161.89.252:13580->104.36.82.18:4368: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:13580->104.36.82.18:4368: use of closed network connection
Aug 17 18:08:41.090549199 (216h42m21.82181686s) [seg_pos={0 0}, upload=225459]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 18:08:41.090665598 (216h42m21.821933279s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 18:08:41.090672481 (216h42m21.821940102s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 18:08:41.259395157 (216h42m21.990662806s) [upload=225459]: Done uploading segments...
Aug 17 18:08:41.259414002 (216h42m21.990681662s) [upload=225459]: Upload finished. err: <nil>
Duration: 448.302211ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...X...............................X........................] duration:
164.002566ms
FAIL (2025-08-17 18:49:17 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 18:33:16.400923957 (217h6m57.132191577s) [upload=225900]: Starting upload Aug 17 18:33:16.400969883 (217h6m57.132237513s) [upload=225900]: Done starting upload Aug 17 18:33:16.401014718 (217h6m57.132282338s) [upload=225900]: Uploading segments... Aug 17 18:33:16.401046027 (217h6m57.132313647s) [upload=225900]: Got next segment. Inline: true Aug 17 18:33:16.401050014 (217h6m57.132317645s) [upload=225900]: Waiting for error group managing segments... Aug 17 18:33:16.401081874 (217h6m57.132349504s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:33:16.401085992 (217h6m57.132353622s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 18:33:16.401088517 (217h6m57.132356147s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 18:33:16.418323930 (217h6m57.149591591s) [upload=225900]: Done uploading segments... Aug 17 18:33:16.418334601 (217h6m57.149602231s) [upload=225900]: Upload finished. err: metaclient: Too Many Requests
Duration: 164.040056ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....X...............................X.......................] duration:
212.536462ms
FAIL (2025-08-17 18:48:25 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 18:33:16.400923957 (217h6m57.132191577s) [upload=225900]: Starting upload Aug 17 18:33:16.400969883 (217h6m57.132237513s) [upload=225900]: Done starting upload Aug 17 18:33:16.401014718 (217h6m57.132282338s) [upload=225900]: Uploading segments... Aug 17 18:33:16.401046027 (217h6m57.132313647s) [upload=225900]: Got next segment. Inline: true Aug 17 18:33:16.401050014 (217h6m57.132317645s) [upload=225900]: Waiting for error group managing segments... Aug 17 18:33:16.401081874 (217h6m57.132349504s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:33:16.401085992 (217h6m57.132353622s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 18:33:16.401088517 (217h6m57.132356147s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 18:33:16.418323930 (217h6m57.149591591s) [upload=225900]: Done uploading segments... Aug 17 18:33:16.418334601 (217h6m57.149602231s) [upload=225900]: Upload finished. err: metaclient: Too Many Requests
Duration: 212.564405ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
549.975875ms
FAIL (2025-08-17 18:48:12 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 17 18:08:40.777064912 (216h42m21.508332542s) [upload=225459]: Starting upload
Aug 17 18:08:40.777115086 (216h42m21.508382716s) [upload=225459]: Done starting upload
Aug 17 18:08:40.777269627 (216h42m21.508537287s) [upload=225459]: Uploading segments...
Aug 17 18:08:40.777454013 (216h42m21.508721673s) [upload=225459]: Got next segment. Inline: false
Aug 17 18:08:40.777510961 (216h42m21.508778611s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 18:08:40.777517212 (216h42m21.508784863s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 18:08:40.852095643 (216h42m21.583363283s) [seg_pos={0 0}, upload=225459]: Begin upload segment...
Aug 17 18:08:40.852138052 (216h42m21.583405692s) [seg_pos={0 0}, upload=225459]: Done begin upload segment.
Aug 17 18:08:40.852171765 (216h42m21.583439416s) [noise=true , address=104.36.82.35:4614 , piece_id=45LILLUGTP77755UK2BJS7ZQT2KFGCZ4IM2LXXA4NARZLNZQZK5A, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.852266774 (216h42m21.583534444s) [noise=true , address=104.36.82.51:4077 , piece_id=DHAWXMJWOMEV57K5W4WCMFDRHW4L32OSSRN2VA2O4S4BLB4ULMKQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.852610419 (216h42m21.583878059s) [noise=true , address=104.36.82.17:4336 , piece_id=A7UARNTYXQNF47MOPK7UNWWRZNCHBCMRMIMZQ6D53GVVPH6XZLHA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853024428 (216h42m21.584292077s) [noise=true , address=77.90.31.11:4567 , piece_id=AOYPMJE7T6RDIS2ZV5UIAXF7BS2PHHIPZNGCTX7J2VEQIA5WOUGQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853326185 (216h42m21.584593844s) [noise=true , address=45.91.116.13:4168 , piece_id=VTT3MS2UIVXODCPZOJXHADVTDHW6S4HUTSEREFN7F6T75GMSRYNA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853425190 (216h42m21.584692841s) [noise=true , address=104.36.82.44:4899 , piece_id=LQQ7J5HK3LTHARNZIULHU3RKYL252NGGHZXIXP3TFVE32KKGXG6A, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853793371 (216h42m21.585061022s) [noise=true , address=104.36.82.39:4738 , piece_id=5A6MDJG5PEHXNAEEDBHP6ZMV45KWTBRAK5OIVRUL2SOE4NEJPI5Q, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854181972 (216h42m21.585449623s) [noise=true , address=77.90.31.19:4844 , piece_id=ZSISRMQJ3URFB6YZWSO23SMU7BI2QLEHCHADY4PZFNXIUOT5N2FA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854317537 (216h42m21.585585197s) [noise=true , address=77.90.31.15:4713 , piece_id=IBPJ2XQI6TD5SIGBFJIEDEMMX6WH37P6ECFFUCD5F3MWPQR6HYHQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854538112 (216h42m21.585805761s) [noise=true , address=104.36.82.60:4363 , piece_id=CIXNGIAGIFAHZUH5V5A6BTRZT4ANYEITZ6XBKJKX4RMZQKURIIMA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854888400 (216h42m21.586156049s) [noise=true , address=104.36.82.18:4368 , piece_id=L5ZIXJFLLUXJLSLTMURQOOFYGRKGW3BD3XNF3MK362FTZYU2ICVQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.855236013 (216h42m21.586503662s) [noise=true , address=104.36.82.34:4566 , piece_id=TKRYBM75X63T6VDRPYN6ZNT5FEKROIVA5NZAELVPRGAQL6XVXU7Q, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.855379192 (216h42m21.586646842s) [noise=true , address=45.91.116.8:4059 , piece_id=DEDZA2DR33EK3URR27H6DKURMDDTWT65SCS3UGECCWM5BKVD4QHQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.855570652 (216h42m21.586838302s) [noise=true , address=77.90.31.10:4529 , piece_id=VZSQBU6PUYIP7XNBN5JQFZ5VI4WXHLSQUCGQNDRRRGU6TETCGQBQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.856194745 (216h42m21.587462415s) [noise=true , address=79.127.201.215:4359 , piece_id=DJVGXMVZA6JI35GVPHBGRMIEDS6OBOOFT74DNVZWUGTUQMKV6WKA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.857030525 (216h42m21.588298175s) [noise=true , address=45.91.116.7:4019 , piece_id=QK25YOV3HUQGIMGM4IGMLDVPLLNUR3KQMHQOIH4GU3PJVFQUPTKQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.857816381 (216h42m21.589084091s) [noise=true , address=104.36.82.58:4276 , piece_id=SMD2BUAUTWDS33QOWM3HQFYHQS5V33BLFRO4RZ2S6TC2GR5YGX3A, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.857978566 (216h42m21.589246216s) [noise=true , address=104.36.82.11:4127 , piece_id=U6JDUSEWROCLEHVG2ZATIVLD2ELN5M6JYUVZREWQWAA7BG3DI6UQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.974500804 (216h42m21.705768454s) [upload=225459]: Next returned nil segment
Aug 17 18:08:40.974518928 (216h42m21.705786568s) [upload=225459]: Waiting for error group managing segments...
Aug 17 18:08:40.987516869 (216h42m21.71878452s) [noise=true , address=104.36.82.11:4127 , piece_id=U6JDUSEWROCLEHVG2ZATIVLD2ELN5M6JYUVZREWQWAA7BG3DI6UQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:40.988549711 (216h42m21.719817331s) [noise=true , address=104.36.82.44:4899 , piece_id=LQQ7J5HK3LTHARNZIULHU3RKYL252NGGHZXIXP3TFVE32KKGXG6A, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.000082720 (216h42m21.73135034s) [noise=true , address=104.36.82.34:4566 , piece_id=TKRYBM75X63T6VDRPYN6ZNT5FEKROIVA5NZAELVPRGAQL6XVXU7Q, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.004638781 (216h42m21.735906401s) [noise=true , address=104.36.82.39:4738 , piece_id=5A6MDJG5PEHXNAEEDBHP6ZMV45KWTBRAK5OIVRUL2SOE4NEJPI5Q, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.004918978 (216h42m21.736186608s) [noise=true , address=104.36.82.58:4276 , piece_id=SMD2BUAUTWDS33QOWM3HQFYHQS5V33BLFRO4RZ2S6TC2GR5YGX3A, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.017616555 (216h42m21.748884185s) [noise=true , address=45.91.116.13:4168 , piece_id=VTT3MS2UIVXODCPZOJXHADVTDHW6S4HUTSEREFN7F6T75GMSRYNA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.026705041 (216h42m21.757972671s) [noise=true , address=104.36.82.60:4363 , piece_id=CIXNGIAGIFAHZUH5V5A6BTRZT4ANYEITZ6XBKJKX4RMZQKURIIMA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.029172177 (216h42m21.760439807s) [noise=true , address=45.91.116.7:4019 , piece_id=QK25YOV3HUQGIMGM4IGMLDVPLLNUR3KQMHQOIH4GU3PJVFQUPTKQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.032674628 (216h42m21.763942248s) [noise=true , address=77.90.31.15:4713 , piece_id=IBPJ2XQI6TD5SIGBFJIEDEMMX6WH37P6ECFFUCD5F3MWPQR6HYHQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.049253778 (216h42m21.780521408s) [noise=true , address=104.36.82.17:4336 , piece_id=A7UARNTYXQNF47MOPK7UNWWRZNCHBCMRMIMZQ6D53GVVPH6XZLHA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.049498879 (216h42m21.780766509s) [noise=true , address=104.36.82.35:4614 , piece_id=45LILLUGTP77755UK2BJS7ZQT2KFGCZ4IM2LXXA4NARZLNZQZK5A, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.068541098 (216h42m21.799808718s) [noise=true , address=77.90.31.11:4567 , piece_id=AOYPMJE7T6RDIS2ZV5UIAXF7BS2PHHIPZNGCTX7J2VEQIA5WOUGQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.070945586 (216h42m21.802213216s) [noise=true , address=77.90.31.19:4844 , piece_id=ZSISRMQJ3URFB6YZWSO23SMU7BI2QLEHCHADY4PZFNXIUOT5N2FA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.090207367 (216h42m21.821474997s) [noise=true , address=79.127.201.215:4359 , piece_id=DJVGXMVZA6JI35GVPHBGRMIEDS6OBOOFT74DNVZWUGTUQMKV6WKA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.090233866 (216h42m21.821501487s) [seg_pos={0 0}, upload=225459]: Segment reached optimal threshold of 14 pieces.
Aug 17 18:08:41.090351558 (216h42m21.821619179s) [noise=true , address=77.90.31.10:4529 , piece_id=VZSQBU6PUYIP7XNBN5JQFZ5VI4WXHLSQUCGQNDRRRGU6TETCGQBQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm): protocol: expected piece hash; context canceled; EOF
Aug 17 18:08:41.090444122 (216h42m21.821711752s) [noise=true , address=104.36.82.51:4077 , piece_id=DHAWXMJWOMEV57K5W4WCMFDRHW4L32OSSRN2VA2O4S4BLB4ULMKQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Njt39WE2REJivSU8fuzUReFN1n6BbRH78kJWaurrMK3Xh6PpS): protocol: expected piece hash; context canceled; EOF
Aug 17 18:08:41.090452788 (216h42m21.821720418s) [noise=true , address=45.91.116.8:4059 , piece_id=DEDZA2DR33EK3URR27H6DKURMDDTWT65SCS3UGECCWM5BKVD4QHQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YzYcwyVJqZywPJt9tYXXHMrjfjeziu6fobhHjt6sRf3utaror): protocol: expected piece hash; context canceled; EOF
Aug 17 18:08:41.090529141 (216h42m21.821796771s) [noise=true , address=104.36.82.18:4368 , piece_id=L5ZIXJFLLUXJLSLTMURQOOFYGRKGW3BD3XNF3MK362FTZYU2ICVQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ByhoW6Effjs8acfsvdF1xzDwBVqggsBK53oRZ8bYhEYYPChKz): protocol: write tcp 5.161.89.252:13580->104.36.82.18:4368: use of closed network connection; write tcp 5.161.89.252:13580->104.36.82.18:4368: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:13580->104.36.82.18:4368: use of closed network connection
Aug 17 18:08:41.090549199 (216h42m21.82181686s) [seg_pos={0 0}, upload=225459]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 18:08:41.090665598 (216h42m21.821933279s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 18:08:41.090672481 (216h42m21.821940102s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 18:08:41.259395157 (216h42m21.990662806s) [upload=225459]: Done uploading segments...
Aug 17 18:08:41.259414002 (216h42m21.990681662s) [upload=225459]: Upload finished. err: <nil>
Duration: 549.99979ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....X...............................X......................] duration:
186.672563ms
FAIL (2025-08-17 18:47:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 18:33:16.400923957 (217h6m57.132191577s) [upload=225900]: Starting upload Aug 17 18:33:16.400969883 (217h6m57.132237513s) [upload=225900]: Done starting upload Aug 17 18:33:16.401014718 (217h6m57.132282338s) [upload=225900]: Uploading segments... Aug 17 18:33:16.401046027 (217h6m57.132313647s) [upload=225900]: Got next segment. Inline: true Aug 17 18:33:16.401050014 (217h6m57.132317645s) [upload=225900]: Waiting for error group managing segments... Aug 17 18:33:16.401081874 (217h6m57.132349504s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:33:16.401085992 (217h6m57.132353622s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 18:33:16.401088517 (217h6m57.132356147s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 18:33:16.418323930 (217h6m57.149591591s) [upload=225900]: Done uploading segments... Aug 17 18:33:16.418334601 (217h6m57.149602231s) [upload=225900]: Upload finished. err: metaclient: Too Many Requests
Duration: 186.693683ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
534.42147ms
FAIL (2025-08-17 18:47:18 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 17 18:08:40.777064912 (216h42m21.508332542s) [upload=225459]: Starting upload
Aug 17 18:08:40.777115086 (216h42m21.508382716s) [upload=225459]: Done starting upload
Aug 17 18:08:40.777269627 (216h42m21.508537287s) [upload=225459]: Uploading segments...
Aug 17 18:08:40.777454013 (216h42m21.508721673s) [upload=225459]: Got next segment. Inline: false
Aug 17 18:08:40.777510961 (216h42m21.508778611s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 18:08:40.777517212 (216h42m21.508784863s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 18:08:40.852095643 (216h42m21.583363283s) [seg_pos={0 0}, upload=225459]: Begin upload segment...
Aug 17 18:08:40.852138052 (216h42m21.583405692s) [seg_pos={0 0}, upload=225459]: Done begin upload segment.
Aug 17 18:08:40.852171765 (216h42m21.583439416s) [noise=true , address=104.36.82.35:4614 , piece_id=45LILLUGTP77755UK2BJS7ZQT2KFGCZ4IM2LXXA4NARZLNZQZK5A, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.852266774 (216h42m21.583534444s) [noise=true , address=104.36.82.51:4077 , piece_id=DHAWXMJWOMEV57K5W4WCMFDRHW4L32OSSRN2VA2O4S4BLB4ULMKQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.852610419 (216h42m21.583878059s) [noise=true , address=104.36.82.17:4336 , piece_id=A7UARNTYXQNF47MOPK7UNWWRZNCHBCMRMIMZQ6D53GVVPH6XZLHA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853024428 (216h42m21.584292077s) [noise=true , address=77.90.31.11:4567 , piece_id=AOYPMJE7T6RDIS2ZV5UIAXF7BS2PHHIPZNGCTX7J2VEQIA5WOUGQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853326185 (216h42m21.584593844s) [noise=true , address=45.91.116.13:4168 , piece_id=VTT3MS2UIVXODCPZOJXHADVTDHW6S4HUTSEREFN7F6T75GMSRYNA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853425190 (216h42m21.584692841s) [noise=true , address=104.36.82.44:4899 , piece_id=LQQ7J5HK3LTHARNZIULHU3RKYL252NGGHZXIXP3TFVE32KKGXG6A, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853793371 (216h42m21.585061022s) [noise=true , address=104.36.82.39:4738 , piece_id=5A6MDJG5PEHXNAEEDBHP6ZMV45KWTBRAK5OIVRUL2SOE4NEJPI5Q, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854181972 (216h42m21.585449623s) [noise=true , address=77.90.31.19:4844 , piece_id=ZSISRMQJ3URFB6YZWSO23SMU7BI2QLEHCHADY4PZFNXIUOT5N2FA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854317537 (216h42m21.585585197s) [noise=true , address=77.90.31.15:4713 , piece_id=IBPJ2XQI6TD5SIGBFJIEDEMMX6WH37P6ECFFUCD5F3MWPQR6HYHQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854538112 (216h42m21.585805761s) [noise=true , address=104.36.82.60:4363 , piece_id=CIXNGIAGIFAHZUH5V5A6BTRZT4ANYEITZ6XBKJKX4RMZQKURIIMA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854888400 (216h42m21.586156049s) [noise=true , address=104.36.82.18:4368 , piece_id=L5ZIXJFLLUXJLSLTMURQOOFYGRKGW3BD3XNF3MK362FTZYU2ICVQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.855236013 (216h42m21.586503662s) [noise=true , address=104.36.82.34:4566 , piece_id=TKRYBM75X63T6VDRPYN6ZNT5FEKROIVA5NZAELVPRGAQL6XVXU7Q, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.855379192 (216h42m21.586646842s) [noise=true , address=45.91.116.8:4059 , piece_id=DEDZA2DR33EK3URR27H6DKURMDDTWT65SCS3UGECCWM5BKVD4QHQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.855570652 (216h42m21.586838302s) [noise=true , address=77.90.31.10:4529 , piece_id=VZSQBU6PUYIP7XNBN5JQFZ5VI4WXHLSQUCGQNDRRRGU6TETCGQBQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.856194745 (216h42m21.587462415s) [noise=true , address=79.127.201.215:4359 , piece_id=DJVGXMVZA6JI35GVPHBGRMIEDS6OBOOFT74DNVZWUGTUQMKV6WKA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.857030525 (216h42m21.588298175s) [noise=true , address=45.91.116.7:4019 , piece_id=QK25YOV3HUQGIMGM4IGMLDVPLLNUR3KQMHQOIH4GU3PJVFQUPTKQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.857816381 (216h42m21.589084091s) [noise=true , address=104.36.82.58:4276 , piece_id=SMD2BUAUTWDS33QOWM3HQFYHQS5V33BLFRO4RZ2S6TC2GR5YGX3A, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.857978566 (216h42m21.589246216s) [noise=true , address=104.36.82.11:4127 , piece_id=U6JDUSEWROCLEHVG2ZATIVLD2ELN5M6JYUVZREWQWAA7BG3DI6UQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.974500804 (216h42m21.705768454s) [upload=225459]: Next returned nil segment
Aug 17 18:08:40.974518928 (216h42m21.705786568s) [upload=225459]: Waiting for error group managing segments...
Aug 17 18:08:40.987516869 (216h42m21.71878452s) [noise=true , address=104.36.82.11:4127 , piece_id=U6JDUSEWROCLEHVG2ZATIVLD2ELN5M6JYUVZREWQWAA7BG3DI6UQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:40.988549711 (216h42m21.719817331s) [noise=true , address=104.36.82.44:4899 , piece_id=LQQ7J5HK3LTHARNZIULHU3RKYL252NGGHZXIXP3TFVE32KKGXG6A, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.000082720 (216h42m21.73135034s) [noise=true , address=104.36.82.34:4566 , piece_id=TKRYBM75X63T6VDRPYN6ZNT5FEKROIVA5NZAELVPRGAQL6XVXU7Q, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.004638781 (216h42m21.735906401s) [noise=true , address=104.36.82.39:4738 , piece_id=5A6MDJG5PEHXNAEEDBHP6ZMV45KWTBRAK5OIVRUL2SOE4NEJPI5Q, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.004918978 (216h42m21.736186608s) [noise=true , address=104.36.82.58:4276 , piece_id=SMD2BUAUTWDS33QOWM3HQFYHQS5V33BLFRO4RZ2S6TC2GR5YGX3A, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.017616555 (216h42m21.748884185s) [noise=true , address=45.91.116.13:4168 , piece_id=VTT3MS2UIVXODCPZOJXHADVTDHW6S4HUTSEREFN7F6T75GMSRYNA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.026705041 (216h42m21.757972671s) [noise=true , address=104.36.82.60:4363 , piece_id=CIXNGIAGIFAHZUH5V5A6BTRZT4ANYEITZ6XBKJKX4RMZQKURIIMA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.029172177 (216h42m21.760439807s) [noise=true , address=45.91.116.7:4019 , piece_id=QK25YOV3HUQGIMGM4IGMLDVPLLNUR3KQMHQOIH4GU3PJVFQUPTKQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.032674628 (216h42m21.763942248s) [noise=true , address=77.90.31.15:4713 , piece_id=IBPJ2XQI6TD5SIGBFJIEDEMMX6WH37P6ECFFUCD5F3MWPQR6HYHQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.049253778 (216h42m21.780521408s) [noise=true , address=104.36.82.17:4336 , piece_id=A7UARNTYXQNF47MOPK7UNWWRZNCHBCMRMIMZQ6D53GVVPH6XZLHA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.049498879 (216h42m21.780766509s) [noise=true , address=104.36.82.35:4614 , piece_id=45LILLUGTP77755UK2BJS7ZQT2KFGCZ4IM2LXXA4NARZLNZQZK5A, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.068541098 (216h42m21.799808718s) [noise=true , address=77.90.31.11:4567 , piece_id=AOYPMJE7T6RDIS2ZV5UIAXF7BS2PHHIPZNGCTX7J2VEQIA5WOUGQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.070945586 (216h42m21.802213216s) [noise=true , address=77.90.31.19:4844 , piece_id=ZSISRMQJ3URFB6YZWSO23SMU7BI2QLEHCHADY4PZFNXIUOT5N2FA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.090207367 (216h42m21.821474997s) [noise=true , address=79.127.201.215:4359 , piece_id=DJVGXMVZA6JI35GVPHBGRMIEDS6OBOOFT74DNVZWUGTUQMKV6WKA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.090233866 (216h42m21.821501487s) [seg_pos={0 0}, upload=225459]: Segment reached optimal threshold of 14 pieces.
Aug 17 18:08:41.090351558 (216h42m21.821619179s) [noise=true , address=77.90.31.10:4529 , piece_id=VZSQBU6PUYIP7XNBN5JQFZ5VI4WXHLSQUCGQNDRRRGU6TETCGQBQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm): protocol: expected piece hash; context canceled; EOF
Aug 17 18:08:41.090444122 (216h42m21.821711752s) [noise=true , address=104.36.82.51:4077 , piece_id=DHAWXMJWOMEV57K5W4WCMFDRHW4L32OSSRN2VA2O4S4BLB4ULMKQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Njt39WE2REJivSU8fuzUReFN1n6BbRH78kJWaurrMK3Xh6PpS): protocol: expected piece hash; context canceled; EOF
Aug 17 18:08:41.090452788 (216h42m21.821720418s) [noise=true , address=45.91.116.8:4059 , piece_id=DEDZA2DR33EK3URR27H6DKURMDDTWT65SCS3UGECCWM5BKVD4QHQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YzYcwyVJqZywPJt9tYXXHMrjfjeziu6fobhHjt6sRf3utaror): protocol: expected piece hash; context canceled; EOF
Aug 17 18:08:41.090529141 (216h42m21.821796771s) [noise=true , address=104.36.82.18:4368 , piece_id=L5ZIXJFLLUXJLSLTMURQOOFYGRKGW3BD3XNF3MK362FTZYU2ICVQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ByhoW6Effjs8acfsvdF1xzDwBVqggsBK53oRZ8bYhEYYPChKz): protocol: write tcp 5.161.89.252:13580->104.36.82.18:4368: use of closed network connection; write tcp 5.161.89.252:13580->104.36.82.18:4368: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:13580->104.36.82.18:4368: use of closed network connection
Aug 17 18:08:41.090549199 (216h42m21.82181686s) [seg_pos={0 0}, upload=225459]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 18:08:41.090665598 (216h42m21.821933279s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 18:08:41.090672481 (216h42m21.821940102s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 18:08:41.259395157 (216h42m21.990662806s) [upload=225459]: Done uploading segments...
Aug 17 18:08:41.259414002 (216h42m21.990681662s) [upload=225459]: Upload finished. err: <nil>
Duration: 534.441828ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......X...............................X.....................] duration:
260.345465ms
FAIL (2025-08-17 18:46:46 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 18:33:16.400923957 (217h6m57.132191577s) [upload=225900]: Starting upload Aug 17 18:33:16.400969883 (217h6m57.132237513s) [upload=225900]: Done starting upload Aug 17 18:33:16.401014718 (217h6m57.132282338s) [upload=225900]: Uploading segments... Aug 17 18:33:16.401046027 (217h6m57.132313647s) [upload=225900]: Got next segment. Inline: true Aug 17 18:33:16.401050014 (217h6m57.132317645s) [upload=225900]: Waiting for error group managing segments... Aug 17 18:33:16.401081874 (217h6m57.132349504s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:33:16.401085992 (217h6m57.132353622s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 18:33:16.401088517 (217h6m57.132356147s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 18:33:16.418323930 (217h6m57.149591591s) [upload=225900]: Done uploading segments... Aug 17 18:33:16.418334601 (217h6m57.149602231s) [upload=225900]: Upload finished. err: metaclient: Too Many Requests
Duration: 260.367888ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
1.115359763s
FAIL (2025-08-17 18:46:10 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 17 18:08:40.777064912 (216h42m21.508332542s) [upload=225459]: Starting upload
Aug 17 18:08:40.777115086 (216h42m21.508382716s) [upload=225459]: Done starting upload
Aug 17 18:08:40.777269627 (216h42m21.508537287s) [upload=225459]: Uploading segments...
Aug 17 18:08:40.777454013 (216h42m21.508721673s) [upload=225459]: Got next segment. Inline: false
Aug 17 18:08:40.777510961 (216h42m21.508778611s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 18:08:40.777517212 (216h42m21.508784863s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 18:08:40.852095643 (216h42m21.583363283s) [seg_pos={0 0}, upload=225459]: Begin upload segment...
Aug 17 18:08:40.852138052 (216h42m21.583405692s) [seg_pos={0 0}, upload=225459]: Done begin upload segment.
Aug 17 18:08:40.852171765 (216h42m21.583439416s) [noise=true , address=104.36.82.35:4614 , piece_id=45LILLUGTP77755UK2BJS7ZQT2KFGCZ4IM2LXXA4NARZLNZQZK5A, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.852266774 (216h42m21.583534444s) [noise=true , address=104.36.82.51:4077 , piece_id=DHAWXMJWOMEV57K5W4WCMFDRHW4L32OSSRN2VA2O4S4BLB4ULMKQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.852610419 (216h42m21.583878059s) [noise=true , address=104.36.82.17:4336 , piece_id=A7UARNTYXQNF47MOPK7UNWWRZNCHBCMRMIMZQ6D53GVVPH6XZLHA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853024428 (216h42m21.584292077s) [noise=true , address=77.90.31.11:4567 , piece_id=AOYPMJE7T6RDIS2ZV5UIAXF7BS2PHHIPZNGCTX7J2VEQIA5WOUGQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853326185 (216h42m21.584593844s) [noise=true , address=45.91.116.13:4168 , piece_id=VTT3MS2UIVXODCPZOJXHADVTDHW6S4HUTSEREFN7F6T75GMSRYNA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853425190 (216h42m21.584692841s) [noise=true , address=104.36.82.44:4899 , piece_id=LQQ7J5HK3LTHARNZIULHU3RKYL252NGGHZXIXP3TFVE32KKGXG6A, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853793371 (216h42m21.585061022s) [noise=true , address=104.36.82.39:4738 , piece_id=5A6MDJG5PEHXNAEEDBHP6ZMV45KWTBRAK5OIVRUL2SOE4NEJPI5Q, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854181972 (216h42m21.585449623s) [noise=true , address=77.90.31.19:4844 , piece_id=ZSISRMQJ3URFB6YZWSO23SMU7BI2QLEHCHADY4PZFNXIUOT5N2FA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854317537 (216h42m21.585585197s) [noise=true , address=77.90.31.15:4713 , piece_id=IBPJ2XQI6TD5SIGBFJIEDEMMX6WH37P6ECFFUCD5F3MWPQR6HYHQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854538112 (216h42m21.585805761s) [noise=true , address=104.36.82.60:4363 , piece_id=CIXNGIAGIFAHZUH5V5A6BTRZT4ANYEITZ6XBKJKX4RMZQKURIIMA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854888400 (216h42m21.586156049s) [noise=true , address=104.36.82.18:4368 , piece_id=L5ZIXJFLLUXJLSLTMURQOOFYGRKGW3BD3XNF3MK362FTZYU2ICVQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.855236013 (216h42m21.586503662s) [noise=true , address=104.36.82.34:4566 , piece_id=TKRYBM75X63T6VDRPYN6ZNT5FEKROIVA5NZAELVPRGAQL6XVXU7Q, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.855379192 (216h42m21.586646842s) [noise=true , address=45.91.116.8:4059 , piece_id=DEDZA2DR33EK3URR27H6DKURMDDTWT65SCS3UGECCWM5BKVD4QHQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.855570652 (216h42m21.586838302s) [noise=true , address=77.90.31.10:4529 , piece_id=VZSQBU6PUYIP7XNBN5JQFZ5VI4WXHLSQUCGQNDRRRGU6TETCGQBQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.856194745 (216h42m21.587462415s) [noise=true , address=79.127.201.215:4359 , piece_id=DJVGXMVZA6JI35GVPHBGRMIEDS6OBOOFT74DNVZWUGTUQMKV6WKA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.857030525 (216h42m21.588298175s) [noise=true , address=45.91.116.7:4019 , piece_id=QK25YOV3HUQGIMGM4IGMLDVPLLNUR3KQMHQOIH4GU3PJVFQUPTKQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.857816381 (216h42m21.589084091s) [noise=true , address=104.36.82.58:4276 , piece_id=SMD2BUAUTWDS33QOWM3HQFYHQS5V33BLFRO4RZ2S6TC2GR5YGX3A, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.857978566 (216h42m21.589246216s) [noise=true , address=104.36.82.11:4127 , piece_id=U6JDUSEWROCLEHVG2ZATIVLD2ELN5M6JYUVZREWQWAA7BG3DI6UQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.974500804 (216h42m21.705768454s) [upload=225459]: Next returned nil segment
Aug 17 18:08:40.974518928 (216h42m21.705786568s) [upload=225459]: Waiting for error group managing segments...
Aug 17 18:08:40.987516869 (216h42m21.71878452s) [noise=true , address=104.36.82.11:4127 , piece_id=U6JDUSEWROCLEHVG2ZATIVLD2ELN5M6JYUVZREWQWAA7BG3DI6UQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:40.988549711 (216h42m21.719817331s) [noise=true , address=104.36.82.44:4899 , piece_id=LQQ7J5HK3LTHARNZIULHU3RKYL252NGGHZXIXP3TFVE32KKGXG6A, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.000082720 (216h42m21.73135034s) [noise=true , address=104.36.82.34:4566 , piece_id=TKRYBM75X63T6VDRPYN6ZNT5FEKROIVA5NZAELVPRGAQL6XVXU7Q, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.004638781 (216h42m21.735906401s) [noise=true , address=104.36.82.39:4738 , piece_id=5A6MDJG5PEHXNAEEDBHP6ZMV45KWTBRAK5OIVRUL2SOE4NEJPI5Q, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.004918978 (216h42m21.736186608s) [noise=true , address=104.36.82.58:4276 , piece_id=SMD2BUAUTWDS33QOWM3HQFYHQS5V33BLFRO4RZ2S6TC2GR5YGX3A, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.017616555 (216h42m21.748884185s) [noise=true , address=45.91.116.13:4168 , piece_id=VTT3MS2UIVXODCPZOJXHADVTDHW6S4HUTSEREFN7F6T75GMSRYNA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.026705041 (216h42m21.757972671s) [noise=true , address=104.36.82.60:4363 , piece_id=CIXNGIAGIFAHZUH5V5A6BTRZT4ANYEITZ6XBKJKX4RMZQKURIIMA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.029172177 (216h42m21.760439807s) [noise=true , address=45.91.116.7:4019 , piece_id=QK25YOV3HUQGIMGM4IGMLDVPLLNUR3KQMHQOIH4GU3PJVFQUPTKQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.032674628 (216h42m21.763942248s) [noise=true , address=77.90.31.15:4713 , piece_id=IBPJ2XQI6TD5SIGBFJIEDEMMX6WH37P6ECFFUCD5F3MWPQR6HYHQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.049253778 (216h42m21.780521408s) [noise=true , address=104.36.82.17:4336 , piece_id=A7UARNTYXQNF47MOPK7UNWWRZNCHBCMRMIMZQ6D53GVVPH6XZLHA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.049498879 (216h42m21.780766509s) [noise=true , address=104.36.82.35:4614 , piece_id=45LILLUGTP77755UK2BJS7ZQT2KFGCZ4IM2LXXA4NARZLNZQZK5A, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.068541098 (216h42m21.799808718s) [noise=true , address=77.90.31.11:4567 , piece_id=AOYPMJE7T6RDIS2ZV5UIAXF7BS2PHHIPZNGCTX7J2VEQIA5WOUGQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.070945586 (216h42m21.802213216s) [noise=true , address=77.90.31.19:4844 , piece_id=ZSISRMQJ3URFB6YZWSO23SMU7BI2QLEHCHADY4PZFNXIUOT5N2FA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.090207367 (216h42m21.821474997s) [noise=true , address=79.127.201.215:4359 , piece_id=DJVGXMVZA6JI35GVPHBGRMIEDS6OBOOFT74DNVZWUGTUQMKV6WKA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.090233866 (216h42m21.821501487s) [seg_pos={0 0}, upload=225459]: Segment reached optimal threshold of 14 pieces.
Aug 17 18:08:41.090351558 (216h42m21.821619179s) [noise=true , address=77.90.31.10:4529 , piece_id=VZSQBU6PUYIP7XNBN5JQFZ5VI4WXHLSQUCGQNDRRRGU6TETCGQBQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm): protocol: expected piece hash; context canceled; EOF
Aug 17 18:08:41.090444122 (216h42m21.821711752s) [noise=true , address=104.36.82.51:4077 , piece_id=DHAWXMJWOMEV57K5W4WCMFDRHW4L32OSSRN2VA2O4S4BLB4ULMKQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Njt39WE2REJivSU8fuzUReFN1n6BbRH78kJWaurrMK3Xh6PpS): protocol: expected piece hash; context canceled; EOF
Aug 17 18:08:41.090452788 (216h42m21.821720418s) [noise=true , address=45.91.116.8:4059 , piece_id=DEDZA2DR33EK3URR27H6DKURMDDTWT65SCS3UGECCWM5BKVD4QHQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YzYcwyVJqZywPJt9tYXXHMrjfjeziu6fobhHjt6sRf3utaror): protocol: expected piece hash; context canceled; EOF
Aug 17 18:08:41.090529141 (216h42m21.821796771s) [noise=true , address=104.36.82.18:4368 , piece_id=L5ZIXJFLLUXJLSLTMURQOOFYGRKGW3BD3XNF3MK362FTZYU2ICVQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ByhoW6Effjs8acfsvdF1xzDwBVqggsBK53oRZ8bYhEYYPChKz): protocol: write tcp 5.161.89.252:13580->104.36.82.18:4368: use of closed network connection; write tcp 5.161.89.252:13580->104.36.82.18:4368: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:13580->104.36.82.18:4368: use of closed network connection
Aug 17 18:08:41.090549199 (216h42m21.82181686s) [seg_pos={0 0}, upload=225459]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 18:08:41.090665598 (216h42m21.821933279s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 18:08:41.090672481 (216h42m21.821940102s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 18:08:41.259395157 (216h42m21.990662806s) [upload=225459]: Done uploading segments...
Aug 17 18:08:41.259414002 (216h42m21.990681662s) [upload=225459]: Upload finished. err: <nil>
Duration: 1.115382806s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......X...............................X....................] duration:
164.205449ms
FAIL (2025-08-17 18:45:42 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 18:33:16.400923957 (217h6m57.132191577s) [upload=225900]: Starting upload Aug 17 18:33:16.400969883 (217h6m57.132237513s) [upload=225900]: Done starting upload Aug 17 18:33:16.401014718 (217h6m57.132282338s) [upload=225900]: Uploading segments... Aug 17 18:33:16.401046027 (217h6m57.132313647s) [upload=225900]: Got next segment. Inline: true Aug 17 18:33:16.401050014 (217h6m57.132317645s) [upload=225900]: Waiting for error group managing segments... Aug 17 18:33:16.401081874 (217h6m57.132349504s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:33:16.401085992 (217h6m57.132353622s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 18:33:16.401088517 (217h6m57.132356147s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 18:33:16.418323930 (217h6m57.149591591s) [upload=225900]: Done uploading segments... Aug 17 18:33:16.418334601 (217h6m57.149602231s) [upload=225900]: Upload finished. err: metaclient: Too Many Requests
Duration: 164.23251ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........X...............................X...................] duration:
254.06294ms
FAIL (2025-08-17 18:45:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 18:33:16.400923957 (217h6m57.132191577s) [upload=225900]: Starting upload Aug 17 18:33:16.400969883 (217h6m57.132237513s) [upload=225900]: Done starting upload Aug 17 18:33:16.401014718 (217h6m57.132282338s) [upload=225900]: Uploading segments... Aug 17 18:33:16.401046027 (217h6m57.132313647s) [upload=225900]: Got next segment. Inline: true Aug 17 18:33:16.401050014 (217h6m57.132317645s) [upload=225900]: Waiting for error group managing segments... Aug 17 18:33:16.401081874 (217h6m57.132349504s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:33:16.401085992 (217h6m57.132353622s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 18:33:16.401088517 (217h6m57.132356147s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 18:33:16.418323930 (217h6m57.149591591s) [upload=225900]: Done uploading segments... Aug 17 18:33:16.418334601 (217h6m57.149602231s) [upload=225900]: Upload finished. err: metaclient: Too Many Requests
Duration: 254.090351ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
493.68723ms
FAIL (2025-08-17 18:45:02 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 17 18:08:40.777064912 (216h42m21.508332542s) [upload=225459]: Starting upload
Aug 17 18:08:40.777115086 (216h42m21.508382716s) [upload=225459]: Done starting upload
Aug 17 18:08:40.777269627 (216h42m21.508537287s) [upload=225459]: Uploading segments...
Aug 17 18:08:40.777454013 (216h42m21.508721673s) [upload=225459]: Got next segment. Inline: false
Aug 17 18:08:40.777510961 (216h42m21.508778611s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 18:08:40.777517212 (216h42m21.508784863s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 18:08:40.852095643 (216h42m21.583363283s) [seg_pos={0 0}, upload=225459]: Begin upload segment...
Aug 17 18:08:40.852138052 (216h42m21.583405692s) [seg_pos={0 0}, upload=225459]: Done begin upload segment.
Aug 17 18:08:40.852171765 (216h42m21.583439416s) [noise=true , address=104.36.82.35:4614 , piece_id=45LILLUGTP77755UK2BJS7ZQT2KFGCZ4IM2LXXA4NARZLNZQZK5A, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.852266774 (216h42m21.583534444s) [noise=true , address=104.36.82.51:4077 , piece_id=DHAWXMJWOMEV57K5W4WCMFDRHW4L32OSSRN2VA2O4S4BLB4ULMKQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.852610419 (216h42m21.583878059s) [noise=true , address=104.36.82.17:4336 , piece_id=A7UARNTYXQNF47MOPK7UNWWRZNCHBCMRMIMZQ6D53GVVPH6XZLHA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853024428 (216h42m21.584292077s) [noise=true , address=77.90.31.11:4567 , piece_id=AOYPMJE7T6RDIS2ZV5UIAXF7BS2PHHIPZNGCTX7J2VEQIA5WOUGQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853326185 (216h42m21.584593844s) [noise=true , address=45.91.116.13:4168 , piece_id=VTT3MS2UIVXODCPZOJXHADVTDHW6S4HUTSEREFN7F6T75GMSRYNA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853425190 (216h42m21.584692841s) [noise=true , address=104.36.82.44:4899 , piece_id=LQQ7J5HK3LTHARNZIULHU3RKYL252NGGHZXIXP3TFVE32KKGXG6A, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853793371 (216h42m21.585061022s) [noise=true , address=104.36.82.39:4738 , piece_id=5A6MDJG5PEHXNAEEDBHP6ZMV45KWTBRAK5OIVRUL2SOE4NEJPI5Q, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854181972 (216h42m21.585449623s) [noise=true , address=77.90.31.19:4844 , piece_id=ZSISRMQJ3URFB6YZWSO23SMU7BI2QLEHCHADY4PZFNXIUOT5N2FA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854317537 (216h42m21.585585197s) [noise=true , address=77.90.31.15:4713 , piece_id=IBPJ2XQI6TD5SIGBFJIEDEMMX6WH37P6ECFFUCD5F3MWPQR6HYHQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854538112 (216h42m21.585805761s) [noise=true , address=104.36.82.60:4363 , piece_id=CIXNGIAGIFAHZUH5V5A6BTRZT4ANYEITZ6XBKJKX4RMZQKURIIMA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854888400 (216h42m21.586156049s) [noise=true , address=104.36.82.18:4368 , piece_id=L5ZIXJFLLUXJLSLTMURQOOFYGRKGW3BD3XNF3MK362FTZYU2ICVQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.855236013 (216h42m21.586503662s) [noise=true , address=104.36.82.34:4566 , piece_id=TKRYBM75X63T6VDRPYN6ZNT5FEKROIVA5NZAELVPRGAQL6XVXU7Q, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.855379192 (216h42m21.586646842s) [noise=true , address=45.91.116.8:4059 , piece_id=DEDZA2DR33EK3URR27H6DKURMDDTWT65SCS3UGECCWM5BKVD4QHQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.855570652 (216h42m21.586838302s) [noise=true , address=77.90.31.10:4529 , piece_id=VZSQBU6PUYIP7XNBN5JQFZ5VI4WXHLSQUCGQNDRRRGU6TETCGQBQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.856194745 (216h42m21.587462415s) [noise=true , address=79.127.201.215:4359 , piece_id=DJVGXMVZA6JI35GVPHBGRMIEDS6OBOOFT74DNVZWUGTUQMKV6WKA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.857030525 (216h42m21.588298175s) [noise=true , address=45.91.116.7:4019 , piece_id=QK25YOV3HUQGIMGM4IGMLDVPLLNUR3KQMHQOIH4GU3PJVFQUPTKQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.857816381 (216h42m21.589084091s) [noise=true , address=104.36.82.58:4276 , piece_id=SMD2BUAUTWDS33QOWM3HQFYHQS5V33BLFRO4RZ2S6TC2GR5YGX3A, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.857978566 (216h42m21.589246216s) [noise=true , address=104.36.82.11:4127 , piece_id=U6JDUSEWROCLEHVG2ZATIVLD2ELN5M6JYUVZREWQWAA7BG3DI6UQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.974500804 (216h42m21.705768454s) [upload=225459]: Next returned nil segment
Aug 17 18:08:40.974518928 (216h42m21.705786568s) [upload=225459]: Waiting for error group managing segments...
Aug 17 18:08:40.987516869 (216h42m21.71878452s) [noise=true , address=104.36.82.11:4127 , piece_id=U6JDUSEWROCLEHVG2ZATIVLD2ELN5M6JYUVZREWQWAA7BG3DI6UQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:40.988549711 (216h42m21.719817331s) [noise=true , address=104.36.82.44:4899 , piece_id=LQQ7J5HK3LTHARNZIULHU3RKYL252NGGHZXIXP3TFVE32KKGXG6A, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.000082720 (216h42m21.73135034s) [noise=true , address=104.36.82.34:4566 , piece_id=TKRYBM75X63T6VDRPYN6ZNT5FEKROIVA5NZAELVPRGAQL6XVXU7Q, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.004638781 (216h42m21.735906401s) [noise=true , address=104.36.82.39:4738 , piece_id=5A6MDJG5PEHXNAEEDBHP6ZMV45KWTBRAK5OIVRUL2SOE4NEJPI5Q, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.004918978 (216h42m21.736186608s) [noise=true , address=104.36.82.58:4276 , piece_id=SMD2BUAUTWDS33QOWM3HQFYHQS5V33BLFRO4RZ2S6TC2GR5YGX3A, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.017616555 (216h42m21.748884185s) [noise=true , address=45.91.116.13:4168 , piece_id=VTT3MS2UIVXODCPZOJXHADVTDHW6S4HUTSEREFN7F6T75GMSRYNA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.026705041 (216h42m21.757972671s) [noise=true , address=104.36.82.60:4363 , piece_id=CIXNGIAGIFAHZUH5V5A6BTRZT4ANYEITZ6XBKJKX4RMZQKURIIMA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.029172177 (216h42m21.760439807s) [noise=true , address=45.91.116.7:4019 , piece_id=QK25YOV3HUQGIMGM4IGMLDVPLLNUR3KQMHQOIH4GU3PJVFQUPTKQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.032674628 (216h42m21.763942248s) [noise=true , address=77.90.31.15:4713 , piece_id=IBPJ2XQI6TD5SIGBFJIEDEMMX6WH37P6ECFFUCD5F3MWPQR6HYHQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.049253778 (216h42m21.780521408s) [noise=true , address=104.36.82.17:4336 , piece_id=A7UARNTYXQNF47MOPK7UNWWRZNCHBCMRMIMZQ6D53GVVPH6XZLHA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.049498879 (216h42m21.780766509s) [noise=true , address=104.36.82.35:4614 , piece_id=45LILLUGTP77755UK2BJS7ZQT2KFGCZ4IM2LXXA4NARZLNZQZK5A, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.068541098 (216h42m21.799808718s) [noise=true , address=77.90.31.11:4567 , piece_id=AOYPMJE7T6RDIS2ZV5UIAXF7BS2PHHIPZNGCTX7J2VEQIA5WOUGQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.070945586 (216h42m21.802213216s) [noise=true , address=77.90.31.19:4844 , piece_id=ZSISRMQJ3URFB6YZWSO23SMU7BI2QLEHCHADY4PZFNXIUOT5N2FA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.090207367 (216h42m21.821474997s) [noise=true , address=79.127.201.215:4359 , piece_id=DJVGXMVZA6JI35GVPHBGRMIEDS6OBOOFT74DNVZWUGTUQMKV6WKA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.090233866 (216h42m21.821501487s) [seg_pos={0 0}, upload=225459]: Segment reached optimal threshold of 14 pieces.
Aug 17 18:08:41.090351558 (216h42m21.821619179s) [noise=true , address=77.90.31.10:4529 , piece_id=VZSQBU6PUYIP7XNBN5JQFZ5VI4WXHLSQUCGQNDRRRGU6TETCGQBQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm): protocol: expected piece hash; context canceled; EOF
Aug 17 18:08:41.090444122 (216h42m21.821711752s) [noise=true , address=104.36.82.51:4077 , piece_id=DHAWXMJWOMEV57K5W4WCMFDRHW4L32OSSRN2VA2O4S4BLB4ULMKQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Njt39WE2REJivSU8fuzUReFN1n6BbRH78kJWaurrMK3Xh6PpS): protocol: expected piece hash; context canceled; EOF
Aug 17 18:08:41.090452788 (216h42m21.821720418s) [noise=true , address=45.91.116.8:4059 , piece_id=DEDZA2DR33EK3URR27H6DKURMDDTWT65SCS3UGECCWM5BKVD4QHQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YzYcwyVJqZywPJt9tYXXHMrjfjeziu6fobhHjt6sRf3utaror): protocol: expected piece hash; context canceled; EOF
Aug 17 18:08:41.090529141 (216h42m21.821796771s) [noise=true , address=104.36.82.18:4368 , piece_id=L5ZIXJFLLUXJLSLTMURQOOFYGRKGW3BD3XNF3MK362FTZYU2ICVQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ByhoW6Effjs8acfsvdF1xzDwBVqggsBK53oRZ8bYhEYYPChKz): protocol: write tcp 5.161.89.252:13580->104.36.82.18:4368: use of closed network connection; write tcp 5.161.89.252:13580->104.36.82.18:4368: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:13580->104.36.82.18:4368: use of closed network connection
Aug 17 18:08:41.090549199 (216h42m21.82181686s) [seg_pos={0 0}, upload=225459]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 18:08:41.090665598 (216h42m21.821933279s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 18:08:41.090672481 (216h42m21.821940102s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 18:08:41.259395157 (216h42m21.990662806s) [upload=225459]: Done uploading segments...
Aug 17 18:08:41.259414002 (216h42m21.990681662s) [upload=225459]: Upload finished. err: <nil>
Duration: 493.71381ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........X...............................X..................] duration:
318.020625ms
FAIL (2025-08-17 18:44:43 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 18:33:16.400923957 (217h6m57.132191577s) [upload=225900]: Starting upload Aug 17 18:33:16.400969883 (217h6m57.132237513s) [upload=225900]: Done starting upload Aug 17 18:33:16.401014718 (217h6m57.132282338s) [upload=225900]: Uploading segments... Aug 17 18:33:16.401046027 (217h6m57.132313647s) [upload=225900]: Got next segment. Inline: true Aug 17 18:33:16.401050014 (217h6m57.132317645s) [upload=225900]: Waiting for error group managing segments... Aug 17 18:33:16.401081874 (217h6m57.132349504s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:33:16.401085992 (217h6m57.132353622s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 18:33:16.401088517 (217h6m57.132356147s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 18:33:16.418323930 (217h6m57.149591591s) [upload=225900]: Done uploading segments... Aug 17 18:33:16.418334601 (217h6m57.149602231s) [upload=225900]: Upload finished. err: metaclient: Too Many Requests
Duration: 318.043027ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
544.581259ms
FAIL (2025-08-17 18:44:28 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 17 18:08:40.777064912 (216h42m21.508332542s) [upload=225459]: Starting upload
Aug 17 18:08:40.777115086 (216h42m21.508382716s) [upload=225459]: Done starting upload
Aug 17 18:08:40.777269627 (216h42m21.508537287s) [upload=225459]: Uploading segments...
Aug 17 18:08:40.777454013 (216h42m21.508721673s) [upload=225459]: Got next segment. Inline: false
Aug 17 18:08:40.777510961 (216h42m21.508778611s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 18:08:40.777517212 (216h42m21.508784863s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 18:08:40.852095643 (216h42m21.583363283s) [seg_pos={0 0}, upload=225459]: Begin upload segment...
Aug 17 18:08:40.852138052 (216h42m21.583405692s) [seg_pos={0 0}, upload=225459]: Done begin upload segment.
Aug 17 18:08:40.852171765 (216h42m21.583439416s) [noise=true , address=104.36.82.35:4614 , piece_id=45LILLUGTP77755UK2BJS7ZQT2KFGCZ4IM2LXXA4NARZLNZQZK5A, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.852266774 (216h42m21.583534444s) [noise=true , address=104.36.82.51:4077 , piece_id=DHAWXMJWOMEV57K5W4WCMFDRHW4L32OSSRN2VA2O4S4BLB4ULMKQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.852610419 (216h42m21.583878059s) [noise=true , address=104.36.82.17:4336 , piece_id=A7UARNTYXQNF47MOPK7UNWWRZNCHBCMRMIMZQ6D53GVVPH6XZLHA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853024428 (216h42m21.584292077s) [noise=true , address=77.90.31.11:4567 , piece_id=AOYPMJE7T6RDIS2ZV5UIAXF7BS2PHHIPZNGCTX7J2VEQIA5WOUGQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853326185 (216h42m21.584593844s) [noise=true , address=45.91.116.13:4168 , piece_id=VTT3MS2UIVXODCPZOJXHADVTDHW6S4HUTSEREFN7F6T75GMSRYNA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853425190 (216h42m21.584692841s) [noise=true , address=104.36.82.44:4899 , piece_id=LQQ7J5HK3LTHARNZIULHU3RKYL252NGGHZXIXP3TFVE32KKGXG6A, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853793371 (216h42m21.585061022s) [noise=true , address=104.36.82.39:4738 , piece_id=5A6MDJG5PEHXNAEEDBHP6ZMV45KWTBRAK5OIVRUL2SOE4NEJPI5Q, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854181972 (216h42m21.585449623s) [noise=true , address=77.90.31.19:4844 , piece_id=ZSISRMQJ3URFB6YZWSO23SMU7BI2QLEHCHADY4PZFNXIUOT5N2FA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854317537 (216h42m21.585585197s) [noise=true , address=77.90.31.15:4713 , piece_id=IBPJ2XQI6TD5SIGBFJIEDEMMX6WH37P6ECFFUCD5F3MWPQR6HYHQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854538112 (216h42m21.585805761s) [noise=true , address=104.36.82.60:4363 , piece_id=CIXNGIAGIFAHZUH5V5A6BTRZT4ANYEITZ6XBKJKX4RMZQKURIIMA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854888400 (216h42m21.586156049s) [noise=true , address=104.36.82.18:4368 , piece_id=L5ZIXJFLLUXJLSLTMURQOOFYGRKGW3BD3XNF3MK362FTZYU2ICVQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.855236013 (216h42m21.586503662s) [noise=true , address=104.36.82.34:4566 , piece_id=TKRYBM75X63T6VDRPYN6ZNT5FEKROIVA5NZAELVPRGAQL6XVXU7Q, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.855379192 (216h42m21.586646842s) [noise=true , address=45.91.116.8:4059 , piece_id=DEDZA2DR33EK3URR27H6DKURMDDTWT65SCS3UGECCWM5BKVD4QHQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.855570652 (216h42m21.586838302s) [noise=true , address=77.90.31.10:4529 , piece_id=VZSQBU6PUYIP7XNBN5JQFZ5VI4WXHLSQUCGQNDRRRGU6TETCGQBQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.856194745 (216h42m21.587462415s) [noise=true , address=79.127.201.215:4359 , piece_id=DJVGXMVZA6JI35GVPHBGRMIEDS6OBOOFT74DNVZWUGTUQMKV6WKA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.857030525 (216h42m21.588298175s) [noise=true , address=45.91.116.7:4019 , piece_id=QK25YOV3HUQGIMGM4IGMLDVPLLNUR3KQMHQOIH4GU3PJVFQUPTKQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.857816381 (216h42m21.589084091s) [noise=true , address=104.36.82.58:4276 , piece_id=SMD2BUAUTWDS33QOWM3HQFYHQS5V33BLFRO4RZ2S6TC2GR5YGX3A, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.857978566 (216h42m21.589246216s) [noise=true , address=104.36.82.11:4127 , piece_id=U6JDUSEWROCLEHVG2ZATIVLD2ELN5M6JYUVZREWQWAA7BG3DI6UQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.974500804 (216h42m21.705768454s) [upload=225459]: Next returned nil segment
Aug 17 18:08:40.974518928 (216h42m21.705786568s) [upload=225459]: Waiting for error group managing segments...
Aug 17 18:08:40.987516869 (216h42m21.71878452s) [noise=true , address=104.36.82.11:4127 , piece_id=U6JDUSEWROCLEHVG2ZATIVLD2ELN5M6JYUVZREWQWAA7BG3DI6UQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:40.988549711 (216h42m21.719817331s) [noise=true , address=104.36.82.44:4899 , piece_id=LQQ7J5HK3LTHARNZIULHU3RKYL252NGGHZXIXP3TFVE32KKGXG6A, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.000082720 (216h42m21.73135034s) [noise=true , address=104.36.82.34:4566 , piece_id=TKRYBM75X63T6VDRPYN6ZNT5FEKROIVA5NZAELVPRGAQL6XVXU7Q, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.004638781 (216h42m21.735906401s) [noise=true , address=104.36.82.39:4738 , piece_id=5A6MDJG5PEHXNAEEDBHP6ZMV45KWTBRAK5OIVRUL2SOE4NEJPI5Q, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.004918978 (216h42m21.736186608s) [noise=true , address=104.36.82.58:4276 , piece_id=SMD2BUAUTWDS33QOWM3HQFYHQS5V33BLFRO4RZ2S6TC2GR5YGX3A, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.017616555 (216h42m21.748884185s) [noise=true , address=45.91.116.13:4168 , piece_id=VTT3MS2UIVXODCPZOJXHADVTDHW6S4HUTSEREFN7F6T75GMSRYNA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.026705041 (216h42m21.757972671s) [noise=true , address=104.36.82.60:4363 , piece_id=CIXNGIAGIFAHZUH5V5A6BTRZT4ANYEITZ6XBKJKX4RMZQKURIIMA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.029172177 (216h42m21.760439807s) [noise=true , address=45.91.116.7:4019 , piece_id=QK25YOV3HUQGIMGM4IGMLDVPLLNUR3KQMHQOIH4GU3PJVFQUPTKQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.032674628 (216h42m21.763942248s) [noise=true , address=77.90.31.15:4713 , piece_id=IBPJ2XQI6TD5SIGBFJIEDEMMX6WH37P6ECFFUCD5F3MWPQR6HYHQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.049253778 (216h42m21.780521408s) [noise=true , address=104.36.82.17:4336 , piece_id=A7UARNTYXQNF47MOPK7UNWWRZNCHBCMRMIMZQ6D53GVVPH6XZLHA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.049498879 (216h42m21.780766509s) [noise=true , address=104.36.82.35:4614 , piece_id=45LILLUGTP77755UK2BJS7ZQT2KFGCZ4IM2LXXA4NARZLNZQZK5A, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.068541098 (216h42m21.799808718s) [noise=true , address=77.90.31.11:4567 , piece_id=AOYPMJE7T6RDIS2ZV5UIAXF7BS2PHHIPZNGCTX7J2VEQIA5WOUGQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.070945586 (216h42m21.802213216s) [noise=true , address=77.90.31.19:4844 , piece_id=ZSISRMQJ3URFB6YZWSO23SMU7BI2QLEHCHADY4PZFNXIUOT5N2FA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.090207367 (216h42m21.821474997s) [noise=true , address=79.127.201.215:4359 , piece_id=DJVGXMVZA6JI35GVPHBGRMIEDS6OBOOFT74DNVZWUGTUQMKV6WKA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.090233866 (216h42m21.821501487s) [seg_pos={0 0}, upload=225459]: Segment reached optimal threshold of 14 pieces.
Aug 17 18:08:41.090351558 (216h42m21.821619179s) [noise=true , address=77.90.31.10:4529 , piece_id=VZSQBU6PUYIP7XNBN5JQFZ5VI4WXHLSQUCGQNDRRRGU6TETCGQBQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm): protocol: expected piece hash; context canceled; EOF
Aug 17 18:08:41.090444122 (216h42m21.821711752s) [noise=true , address=104.36.82.51:4077 , piece_id=DHAWXMJWOMEV57K5W4WCMFDRHW4L32OSSRN2VA2O4S4BLB4ULMKQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Njt39WE2REJivSU8fuzUReFN1n6BbRH78kJWaurrMK3Xh6PpS): protocol: expected piece hash; context canceled; EOF
Aug 17 18:08:41.090452788 (216h42m21.821720418s) [noise=true , address=45.91.116.8:4059 , piece_id=DEDZA2DR33EK3URR27H6DKURMDDTWT65SCS3UGECCWM5BKVD4QHQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YzYcwyVJqZywPJt9tYXXHMrjfjeziu6fobhHjt6sRf3utaror): protocol: expected piece hash; context canceled; EOF
Aug 17 18:08:41.090529141 (216h42m21.821796771s) [noise=true , address=104.36.82.18:4368 , piece_id=L5ZIXJFLLUXJLSLTMURQOOFYGRKGW3BD3XNF3MK362FTZYU2ICVQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ByhoW6Effjs8acfsvdF1xzDwBVqggsBK53oRZ8bYhEYYPChKz): protocol: write tcp 5.161.89.252:13580->104.36.82.18:4368: use of closed network connection; write tcp 5.161.89.252:13580->104.36.82.18:4368: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:13580->104.36.82.18:4368: use of closed network connection
Aug 17 18:08:41.090549199 (216h42m21.82181686s) [seg_pos={0 0}, upload=225459]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 18:08:41.090665598 (216h42m21.821933279s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 18:08:41.090672481 (216h42m21.821940102s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 18:08:41.259395157 (216h42m21.990662806s) [upload=225459]: Done uploading segments...
Aug 17 18:08:41.259414002 (216h42m21.990681662s) [upload=225459]: Upload finished. err: <nil>
Duration: 544.598301ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........X...............................X.................] duration:
184.979622ms
FAIL (2025-08-17 18:44:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 18:33:16.400923957 (217h6m57.132191577s) [upload=225900]: Starting upload Aug 17 18:33:16.400969883 (217h6m57.132237513s) [upload=225900]: Done starting upload Aug 17 18:33:16.401014718 (217h6m57.132282338s) [upload=225900]: Uploading segments... Aug 17 18:33:16.401046027 (217h6m57.132313647s) [upload=225900]: Got next segment. Inline: true Aug 17 18:33:16.401050014 (217h6m57.132317645s) [upload=225900]: Waiting for error group managing segments... Aug 17 18:33:16.401081874 (217h6m57.132349504s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:33:16.401085992 (217h6m57.132353622s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 18:33:16.401088517 (217h6m57.132356147s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 18:33:16.418323930 (217h6m57.149591591s) [upload=225900]: Done uploading segments... Aug 17 18:33:16.418334601 (217h6m57.149602231s) [upload=225900]: Upload finished. err: metaclient: Too Many Requests
Duration: 184.998157ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
675.022444ms
FAIL (2025-08-17 18:44:12 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 17 18:08:40.777064912 (216h42m21.508332542s) [upload=225459]: Starting upload
Aug 17 18:08:40.777115086 (216h42m21.508382716s) [upload=225459]: Done starting upload
Aug 17 18:08:40.777269627 (216h42m21.508537287s) [upload=225459]: Uploading segments...
Aug 17 18:08:40.777454013 (216h42m21.508721673s) [upload=225459]: Got next segment. Inline: false
Aug 17 18:08:40.777510961 (216h42m21.508778611s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 18:08:40.777517212 (216h42m21.508784863s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 18:08:40.852095643 (216h42m21.583363283s) [seg_pos={0 0}, upload=225459]: Begin upload segment...
Aug 17 18:08:40.852138052 (216h42m21.583405692s) [seg_pos={0 0}, upload=225459]: Done begin upload segment.
Aug 17 18:08:40.852171765 (216h42m21.583439416s) [noise=true , address=104.36.82.35:4614 , piece_id=45LILLUGTP77755UK2BJS7ZQT2KFGCZ4IM2LXXA4NARZLNZQZK5A, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.852266774 (216h42m21.583534444s) [noise=true , address=104.36.82.51:4077 , piece_id=DHAWXMJWOMEV57K5W4WCMFDRHW4L32OSSRN2VA2O4S4BLB4ULMKQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.852610419 (216h42m21.583878059s) [noise=true , address=104.36.82.17:4336 , piece_id=A7UARNTYXQNF47MOPK7UNWWRZNCHBCMRMIMZQ6D53GVVPH6XZLHA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853024428 (216h42m21.584292077s) [noise=true , address=77.90.31.11:4567 , piece_id=AOYPMJE7T6RDIS2ZV5UIAXF7BS2PHHIPZNGCTX7J2VEQIA5WOUGQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853326185 (216h42m21.584593844s) [noise=true , address=45.91.116.13:4168 , piece_id=VTT3MS2UIVXODCPZOJXHADVTDHW6S4HUTSEREFN7F6T75GMSRYNA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853425190 (216h42m21.584692841s) [noise=true , address=104.36.82.44:4899 , piece_id=LQQ7J5HK3LTHARNZIULHU3RKYL252NGGHZXIXP3TFVE32KKGXG6A, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853793371 (216h42m21.585061022s) [noise=true , address=104.36.82.39:4738 , piece_id=5A6MDJG5PEHXNAEEDBHP6ZMV45KWTBRAK5OIVRUL2SOE4NEJPI5Q, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854181972 (216h42m21.585449623s) [noise=true , address=77.90.31.19:4844 , piece_id=ZSISRMQJ3URFB6YZWSO23SMU7BI2QLEHCHADY4PZFNXIUOT5N2FA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854317537 (216h42m21.585585197s) [noise=true , address=77.90.31.15:4713 , piece_id=IBPJ2XQI6TD5SIGBFJIEDEMMX6WH37P6ECFFUCD5F3MWPQR6HYHQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854538112 (216h42m21.585805761s) [noise=true , address=104.36.82.60:4363 , piece_id=CIXNGIAGIFAHZUH5V5A6BTRZT4ANYEITZ6XBKJKX4RMZQKURIIMA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854888400 (216h42m21.586156049s) [noise=true , address=104.36.82.18:4368 , piece_id=L5ZIXJFLLUXJLSLTMURQOOFYGRKGW3BD3XNF3MK362FTZYU2ICVQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.855236013 (216h42m21.586503662s) [noise=true , address=104.36.82.34:4566 , piece_id=TKRYBM75X63T6VDRPYN6ZNT5FEKROIVA5NZAELVPRGAQL6XVXU7Q, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.855379192 (216h42m21.586646842s) [noise=true , address=45.91.116.8:4059 , piece_id=DEDZA2DR33EK3URR27H6DKURMDDTWT65SCS3UGECCWM5BKVD4QHQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.855570652 (216h42m21.586838302s) [noise=true , address=77.90.31.10:4529 , piece_id=VZSQBU6PUYIP7XNBN5JQFZ5VI4WXHLSQUCGQNDRRRGU6TETCGQBQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.856194745 (216h42m21.587462415s) [noise=true , address=79.127.201.215:4359 , piece_id=DJVGXMVZA6JI35GVPHBGRMIEDS6OBOOFT74DNVZWUGTUQMKV6WKA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.857030525 (216h42m21.588298175s) [noise=true , address=45.91.116.7:4019 , piece_id=QK25YOV3HUQGIMGM4IGMLDVPLLNUR3KQMHQOIH4GU3PJVFQUPTKQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.857816381 (216h42m21.589084091s) [noise=true , address=104.36.82.58:4276 , piece_id=SMD2BUAUTWDS33QOWM3HQFYHQS5V33BLFRO4RZ2S6TC2GR5YGX3A, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.857978566 (216h42m21.589246216s) [noise=true , address=104.36.82.11:4127 , piece_id=U6JDUSEWROCLEHVG2ZATIVLD2ELN5M6JYUVZREWQWAA7BG3DI6UQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.974500804 (216h42m21.705768454s) [upload=225459]: Next returned nil segment
Aug 17 18:08:40.974518928 (216h42m21.705786568s) [upload=225459]: Waiting for error group managing segments...
Aug 17 18:08:40.987516869 (216h42m21.71878452s) [noise=true , address=104.36.82.11:4127 , piece_id=U6JDUSEWROCLEHVG2ZATIVLD2ELN5M6JYUVZREWQWAA7BG3DI6UQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:40.988549711 (216h42m21.719817331s) [noise=true , address=104.36.82.44:4899 , piece_id=LQQ7J5HK3LTHARNZIULHU3RKYL252NGGHZXIXP3TFVE32KKGXG6A, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.000082720 (216h42m21.73135034s) [noise=true , address=104.36.82.34:4566 , piece_id=TKRYBM75X63T6VDRPYN6ZNT5FEKROIVA5NZAELVPRGAQL6XVXU7Q, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.004638781 (216h42m21.735906401s) [noise=true , address=104.36.82.39:4738 , piece_id=5A6MDJG5PEHXNAEEDBHP6ZMV45KWTBRAK5OIVRUL2SOE4NEJPI5Q, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.004918978 (216h42m21.736186608s) [noise=true , address=104.36.82.58:4276 , piece_id=SMD2BUAUTWDS33QOWM3HQFYHQS5V33BLFRO4RZ2S6TC2GR5YGX3A, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.017616555 (216h42m21.748884185s) [noise=true , address=45.91.116.13:4168 , piece_id=VTT3MS2UIVXODCPZOJXHADVTDHW6S4HUTSEREFN7F6T75GMSRYNA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.026705041 (216h42m21.757972671s) [noise=true , address=104.36.82.60:4363 , piece_id=CIXNGIAGIFAHZUH5V5A6BTRZT4ANYEITZ6XBKJKX4RMZQKURIIMA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.029172177 (216h42m21.760439807s) [noise=true , address=45.91.116.7:4019 , piece_id=QK25YOV3HUQGIMGM4IGMLDVPLLNUR3KQMHQOIH4GU3PJVFQUPTKQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.032674628 (216h42m21.763942248s) [noise=true , address=77.90.31.15:4713 , piece_id=IBPJ2XQI6TD5SIGBFJIEDEMMX6WH37P6ECFFUCD5F3MWPQR6HYHQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.049253778 (216h42m21.780521408s) [noise=true , address=104.36.82.17:4336 , piece_id=A7UARNTYXQNF47MOPK7UNWWRZNCHBCMRMIMZQ6D53GVVPH6XZLHA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.049498879 (216h42m21.780766509s) [noise=true , address=104.36.82.35:4614 , piece_id=45LILLUGTP77755UK2BJS7ZQT2KFGCZ4IM2LXXA4NARZLNZQZK5A, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.068541098 (216h42m21.799808718s) [noise=true , address=77.90.31.11:4567 , piece_id=AOYPMJE7T6RDIS2ZV5UIAXF7BS2PHHIPZNGCTX7J2VEQIA5WOUGQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.070945586 (216h42m21.802213216s) [noise=true , address=77.90.31.19:4844 , piece_id=ZSISRMQJ3URFB6YZWSO23SMU7BI2QLEHCHADY4PZFNXIUOT5N2FA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.090207367 (216h42m21.821474997s) [noise=true , address=79.127.201.215:4359 , piece_id=DJVGXMVZA6JI35GVPHBGRMIEDS6OBOOFT74DNVZWUGTUQMKV6WKA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.090233866 (216h42m21.821501487s) [seg_pos={0 0}, upload=225459]: Segment reached optimal threshold of 14 pieces.
Aug 17 18:08:41.090351558 (216h42m21.821619179s) [noise=true , address=77.90.31.10:4529 , piece_id=VZSQBU6PUYIP7XNBN5JQFZ5VI4WXHLSQUCGQNDRRRGU6TETCGQBQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm): protocol: expected piece hash; context canceled; EOF
Aug 17 18:08:41.090444122 (216h42m21.821711752s) [noise=true , address=104.36.82.51:4077 , piece_id=DHAWXMJWOMEV57K5W4WCMFDRHW4L32OSSRN2VA2O4S4BLB4ULMKQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Njt39WE2REJivSU8fuzUReFN1n6BbRH78kJWaurrMK3Xh6PpS): protocol: expected piece hash; context canceled; EOF
Aug 17 18:08:41.090452788 (216h42m21.821720418s) [noise=true , address=45.91.116.8:4059 , piece_id=DEDZA2DR33EK3URR27H6DKURMDDTWT65SCS3UGECCWM5BKVD4QHQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YzYcwyVJqZywPJt9tYXXHMrjfjeziu6fobhHjt6sRf3utaror): protocol: expected piece hash; context canceled; EOF
Aug 17 18:08:41.090529141 (216h42m21.821796771s) [noise=true , address=104.36.82.18:4368 , piece_id=L5ZIXJFLLUXJLSLTMURQOOFYGRKGW3BD3XNF3MK362FTZYU2ICVQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ByhoW6Effjs8acfsvdF1xzDwBVqggsBK53oRZ8bYhEYYPChKz): protocol: write tcp 5.161.89.252:13580->104.36.82.18:4368: use of closed network connection; write tcp 5.161.89.252:13580->104.36.82.18:4368: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:13580->104.36.82.18:4368: use of closed network connection
Aug 17 18:08:41.090549199 (216h42m21.82181686s) [seg_pos={0 0}, upload=225459]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 18:08:41.090665598 (216h42m21.821933279s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 18:08:41.090672481 (216h42m21.821940102s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 18:08:41.259395157 (216h42m21.990662806s) [upload=225459]: Done uploading segments...
Aug 17 18:08:41.259414002 (216h42m21.990681662s) [upload=225459]: Upload finished. err: <nil>
Duration: 675.076585ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
743.767248ms
FAIL (2025-08-17 18:43:36 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 17 18:08:40.777064912 (216h42m21.508332542s) [upload=225459]: Starting upload
Aug 17 18:08:40.777115086 (216h42m21.508382716s) [upload=225459]: Done starting upload
Aug 17 18:08:40.777269627 (216h42m21.508537287s) [upload=225459]: Uploading segments...
Aug 17 18:08:40.777454013 (216h42m21.508721673s) [upload=225459]: Got next segment. Inline: false
Aug 17 18:08:40.777510961 (216h42m21.508778611s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 18:08:40.777517212 (216h42m21.508784863s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 18:08:40.852095643 (216h42m21.583363283s) [seg_pos={0 0}, upload=225459]: Begin upload segment...
Aug 17 18:08:40.852138052 (216h42m21.583405692s) [seg_pos={0 0}, upload=225459]: Done begin upload segment.
Aug 17 18:08:40.852171765 (216h42m21.583439416s) [noise=true , address=104.36.82.35:4614 , piece_id=45LILLUGTP77755UK2BJS7ZQT2KFGCZ4IM2LXXA4NARZLNZQZK5A, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.852266774 (216h42m21.583534444s) [noise=true , address=104.36.82.51:4077 , piece_id=DHAWXMJWOMEV57K5W4WCMFDRHW4L32OSSRN2VA2O4S4BLB4ULMKQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.852610419 (216h42m21.583878059s) [noise=true , address=104.36.82.17:4336 , piece_id=A7UARNTYXQNF47MOPK7UNWWRZNCHBCMRMIMZQ6D53GVVPH6XZLHA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853024428 (216h42m21.584292077s) [noise=true , address=77.90.31.11:4567 , piece_id=AOYPMJE7T6RDIS2ZV5UIAXF7BS2PHHIPZNGCTX7J2VEQIA5WOUGQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853326185 (216h42m21.584593844s) [noise=true , address=45.91.116.13:4168 , piece_id=VTT3MS2UIVXODCPZOJXHADVTDHW6S4HUTSEREFN7F6T75GMSRYNA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853425190 (216h42m21.584692841s) [noise=true , address=104.36.82.44:4899 , piece_id=LQQ7J5HK3LTHARNZIULHU3RKYL252NGGHZXIXP3TFVE32KKGXG6A, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853793371 (216h42m21.585061022s) [noise=true , address=104.36.82.39:4738 , piece_id=5A6MDJG5PEHXNAEEDBHP6ZMV45KWTBRAK5OIVRUL2SOE4NEJPI5Q, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854181972 (216h42m21.585449623s) [noise=true , address=77.90.31.19:4844 , piece_id=ZSISRMQJ3URFB6YZWSO23SMU7BI2QLEHCHADY4PZFNXIUOT5N2FA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854317537 (216h42m21.585585197s) [noise=true , address=77.90.31.15:4713 , piece_id=IBPJ2XQI6TD5SIGBFJIEDEMMX6WH37P6ECFFUCD5F3MWPQR6HYHQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854538112 (216h42m21.585805761s) [noise=true , address=104.36.82.60:4363 , piece_id=CIXNGIAGIFAHZUH5V5A6BTRZT4ANYEITZ6XBKJKX4RMZQKURIIMA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854888400 (216h42m21.586156049s) [noise=true , address=104.36.82.18:4368 , piece_id=L5ZIXJFLLUXJLSLTMURQOOFYGRKGW3BD3XNF3MK362FTZYU2ICVQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.855236013 (216h42m21.586503662s) [noise=true , address=104.36.82.34:4566 , piece_id=TKRYBM75X63T6VDRPYN6ZNT5FEKROIVA5NZAELVPRGAQL6XVXU7Q, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.855379192 (216h42m21.586646842s) [noise=true , address=45.91.116.8:4059 , piece_id=DEDZA2DR33EK3URR27H6DKURMDDTWT65SCS3UGECCWM5BKVD4QHQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.855570652 (216h42m21.586838302s) [noise=true , address=77.90.31.10:4529 , piece_id=VZSQBU6PUYIP7XNBN5JQFZ5VI4WXHLSQUCGQNDRRRGU6TETCGQBQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.856194745 (216h42m21.587462415s) [noise=true , address=79.127.201.215:4359 , piece_id=DJVGXMVZA6JI35GVPHBGRMIEDS6OBOOFT74DNVZWUGTUQMKV6WKA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.857030525 (216h42m21.588298175s) [noise=true , address=45.91.116.7:4019 , piece_id=QK25YOV3HUQGIMGM4IGMLDVPLLNUR3KQMHQOIH4GU3PJVFQUPTKQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.857816381 (216h42m21.589084091s) [noise=true , address=104.36.82.58:4276 , piece_id=SMD2BUAUTWDS33QOWM3HQFYHQS5V33BLFRO4RZ2S6TC2GR5YGX3A, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.857978566 (216h42m21.589246216s) [noise=true , address=104.36.82.11:4127 , piece_id=U6JDUSEWROCLEHVG2ZATIVLD2ELN5M6JYUVZREWQWAA7BG3DI6UQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.974500804 (216h42m21.705768454s) [upload=225459]: Next returned nil segment
Aug 17 18:08:40.974518928 (216h42m21.705786568s) [upload=225459]: Waiting for error group managing segments...
Aug 17 18:08:40.987516869 (216h42m21.71878452s) [noise=true , address=104.36.82.11:4127 , piece_id=U6JDUSEWROCLEHVG2ZATIVLD2ELN5M6JYUVZREWQWAA7BG3DI6UQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:40.988549711 (216h42m21.719817331s) [noise=true , address=104.36.82.44:4899 , piece_id=LQQ7J5HK3LTHARNZIULHU3RKYL252NGGHZXIXP3TFVE32KKGXG6A, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.000082720 (216h42m21.73135034s) [noise=true , address=104.36.82.34:4566 , piece_id=TKRYBM75X63T6VDRPYN6ZNT5FEKROIVA5NZAELVPRGAQL6XVXU7Q, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.004638781 (216h42m21.735906401s) [noise=true , address=104.36.82.39:4738 , piece_id=5A6MDJG5PEHXNAEEDBHP6ZMV45KWTBRAK5OIVRUL2SOE4NEJPI5Q, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.004918978 (216h42m21.736186608s) [noise=true , address=104.36.82.58:4276 , piece_id=SMD2BUAUTWDS33QOWM3HQFYHQS5V33BLFRO4RZ2S6TC2GR5YGX3A, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.017616555 (216h42m21.748884185s) [noise=true , address=45.91.116.13:4168 , piece_id=VTT3MS2UIVXODCPZOJXHADVTDHW6S4HUTSEREFN7F6T75GMSRYNA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.026705041 (216h42m21.757972671s) [noise=true , address=104.36.82.60:4363 , piece_id=CIXNGIAGIFAHZUH5V5A6BTRZT4ANYEITZ6XBKJKX4RMZQKURIIMA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.029172177 (216h42m21.760439807s) [noise=true , address=45.91.116.7:4019 , piece_id=QK25YOV3HUQGIMGM4IGMLDVPLLNUR3KQMHQOIH4GU3PJVFQUPTKQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.032674628 (216h42m21.763942248s) [noise=true , address=77.90.31.15:4713 , piece_id=IBPJ2XQI6TD5SIGBFJIEDEMMX6WH37P6ECFFUCD5F3MWPQR6HYHQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.049253778 (216h42m21.780521408s) [noise=true , address=104.36.82.17:4336 , piece_id=A7UARNTYXQNF47MOPK7UNWWRZNCHBCMRMIMZQ6D53GVVPH6XZLHA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.049498879 (216h42m21.780766509s) [noise=true , address=104.36.82.35:4614 , piece_id=45LILLUGTP77755UK2BJS7ZQT2KFGCZ4IM2LXXA4NARZLNZQZK5A, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.068541098 (216h42m21.799808718s) [noise=true , address=77.90.31.11:4567 , piece_id=AOYPMJE7T6RDIS2ZV5UIAXF7BS2PHHIPZNGCTX7J2VEQIA5WOUGQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.070945586 (216h42m21.802213216s) [noise=true , address=77.90.31.19:4844 , piece_id=ZSISRMQJ3URFB6YZWSO23SMU7BI2QLEHCHADY4PZFNXIUOT5N2FA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.090207367 (216h42m21.821474997s) [noise=true , address=79.127.201.215:4359 , piece_id=DJVGXMVZA6JI35GVPHBGRMIEDS6OBOOFT74DNVZWUGTUQMKV6WKA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.090233866 (216h42m21.821501487s) [seg_pos={0 0}, upload=225459]: Segment reached optimal threshold of 14 pieces.
Aug 17 18:08:41.090351558 (216h42m21.821619179s) [noise=true , address=77.90.31.10:4529 , piece_id=VZSQBU6PUYIP7XNBN5JQFZ5VI4WXHLSQUCGQNDRRRGU6TETCGQBQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm): protocol: expected piece hash; context canceled; EOF
Aug 17 18:08:41.090444122 (216h42m21.821711752s) [noise=true , address=104.36.82.51:4077 , piece_id=DHAWXMJWOMEV57K5W4WCMFDRHW4L32OSSRN2VA2O4S4BLB4ULMKQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Njt39WE2REJivSU8fuzUReFN1n6BbRH78kJWaurrMK3Xh6PpS): protocol: expected piece hash; context canceled; EOF
Aug 17 18:08:41.090452788 (216h42m21.821720418s) [noise=true , address=45.91.116.8:4059 , piece_id=DEDZA2DR33EK3URR27H6DKURMDDTWT65SCS3UGECCWM5BKVD4QHQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YzYcwyVJqZywPJt9tYXXHMrjfjeziu6fobhHjt6sRf3utaror): protocol: expected piece hash; context canceled; EOF
Aug 17 18:08:41.090529141 (216h42m21.821796771s) [noise=true , address=104.36.82.18:4368 , piece_id=L5ZIXJFLLUXJLSLTMURQOOFYGRKGW3BD3XNF3MK362FTZYU2ICVQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ByhoW6Effjs8acfsvdF1xzDwBVqggsBK53oRZ8bYhEYYPChKz): protocol: write tcp 5.161.89.252:13580->104.36.82.18:4368: use of closed network connection; write tcp 5.161.89.252:13580->104.36.82.18:4368: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:13580->104.36.82.18:4368: use of closed network connection
Aug 17 18:08:41.090549199 (216h42m21.82181686s) [seg_pos={0 0}, upload=225459]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 18:08:41.090665598 (216h42m21.821933279s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 18:08:41.090672481 (216h42m21.821940102s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 18:08:41.259395157 (216h42m21.990662806s) [upload=225459]: Done uploading segments...
Aug 17 18:08:41.259414002 (216h42m21.990681662s) [upload=225459]: Upload finished. err: <nil>
Duration: 743.797806ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........X...............................X................] duration:
163.078242ms
FAIL (2025-08-17 18:43:27 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 18:33:16.400923957 (217h6m57.132191577s) [upload=225900]: Starting upload Aug 17 18:33:16.400969883 (217h6m57.132237513s) [upload=225900]: Done starting upload Aug 17 18:33:16.401014718 (217h6m57.132282338s) [upload=225900]: Uploading segments... Aug 17 18:33:16.401046027 (217h6m57.132313647s) [upload=225900]: Got next segment. Inline: true Aug 17 18:33:16.401050014 (217h6m57.132317645s) [upload=225900]: Waiting for error group managing segments... Aug 17 18:33:16.401081874 (217h6m57.132349504s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:33:16.401085992 (217h6m57.132353622s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 18:33:16.401088517 (217h6m57.132356147s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 18:33:16.418323930 (217h6m57.149591591s) [upload=225900]: Done uploading segments... Aug 17 18:33:16.418334601 (217h6m57.149602231s) [upload=225900]: Upload finished. err: metaclient: Too Many Requests
Duration: 163.103749ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [............X...............................X...............] duration:
253.353244ms
FAIL (2025-08-17 18:43:05 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 18:33:16.400923957 (217h6m57.132191577s) [upload=225900]: Starting upload Aug 17 18:33:16.400969883 (217h6m57.132237513s) [upload=225900]: Done starting upload Aug 17 18:33:16.401014718 (217h6m57.132282338s) [upload=225900]: Uploading segments... Aug 17 18:33:16.401046027 (217h6m57.132313647s) [upload=225900]: Got next segment. Inline: true Aug 17 18:33:16.401050014 (217h6m57.132317645s) [upload=225900]: Waiting for error group managing segments... Aug 17 18:33:16.401081874 (217h6m57.132349504s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:33:16.401085992 (217h6m57.132353622s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 18:33:16.401088517 (217h6m57.132356147s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 18:33:16.418323930 (217h6m57.149591591s) [upload=225900]: Done uploading segments... Aug 17 18:33:16.418334601 (217h6m57.149602231s) [upload=225900]: Upload finished. err: metaclient: Too Many Requests
Duration: 253.372951ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
1.040274295s
FAIL (2025-08-17 18:42:33 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 17 18:08:40.777064912 (216h42m21.508332542s) [upload=225459]: Starting upload
Aug 17 18:08:40.777115086 (216h42m21.508382716s) [upload=225459]: Done starting upload
Aug 17 18:08:40.777269627 (216h42m21.508537287s) [upload=225459]: Uploading segments...
Aug 17 18:08:40.777454013 (216h42m21.508721673s) [upload=225459]: Got next segment. Inline: false
Aug 17 18:08:40.777510961 (216h42m21.508778611s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 18:08:40.777517212 (216h42m21.508784863s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 18:08:40.852095643 (216h42m21.583363283s) [seg_pos={0 0}, upload=225459]: Begin upload segment...
Aug 17 18:08:40.852138052 (216h42m21.583405692s) [seg_pos={0 0}, upload=225459]: Done begin upload segment.
Aug 17 18:08:40.852171765 (216h42m21.583439416s) [noise=true , address=104.36.82.35:4614 , piece_id=45LILLUGTP77755UK2BJS7ZQT2KFGCZ4IM2LXXA4NARZLNZQZK5A, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.852266774 (216h42m21.583534444s) [noise=true , address=104.36.82.51:4077 , piece_id=DHAWXMJWOMEV57K5W4WCMFDRHW4L32OSSRN2VA2O4S4BLB4ULMKQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.852610419 (216h42m21.583878059s) [noise=true , address=104.36.82.17:4336 , piece_id=A7UARNTYXQNF47MOPK7UNWWRZNCHBCMRMIMZQ6D53GVVPH6XZLHA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853024428 (216h42m21.584292077s) [noise=true , address=77.90.31.11:4567 , piece_id=AOYPMJE7T6RDIS2ZV5UIAXF7BS2PHHIPZNGCTX7J2VEQIA5WOUGQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853326185 (216h42m21.584593844s) [noise=true , address=45.91.116.13:4168 , piece_id=VTT3MS2UIVXODCPZOJXHADVTDHW6S4HUTSEREFN7F6T75GMSRYNA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853425190 (216h42m21.584692841s) [noise=true , address=104.36.82.44:4899 , piece_id=LQQ7J5HK3LTHARNZIULHU3RKYL252NGGHZXIXP3TFVE32KKGXG6A, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853793371 (216h42m21.585061022s) [noise=true , address=104.36.82.39:4738 , piece_id=5A6MDJG5PEHXNAEEDBHP6ZMV45KWTBRAK5OIVRUL2SOE4NEJPI5Q, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854181972 (216h42m21.585449623s) [noise=true , address=77.90.31.19:4844 , piece_id=ZSISRMQJ3URFB6YZWSO23SMU7BI2QLEHCHADY4PZFNXIUOT5N2FA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854317537 (216h42m21.585585197s) [noise=true , address=77.90.31.15:4713 , piece_id=IBPJ2XQI6TD5SIGBFJIEDEMMX6WH37P6ECFFUCD5F3MWPQR6HYHQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854538112 (216h42m21.585805761s) [noise=true , address=104.36.82.60:4363 , piece_id=CIXNGIAGIFAHZUH5V5A6BTRZT4ANYEITZ6XBKJKX4RMZQKURIIMA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854888400 (216h42m21.586156049s) [noise=true , address=104.36.82.18:4368 , piece_id=L5ZIXJFLLUXJLSLTMURQOOFYGRKGW3BD3XNF3MK362FTZYU2ICVQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.855236013 (216h42m21.586503662s) [noise=true , address=104.36.82.34:4566 , piece_id=TKRYBM75X63T6VDRPYN6ZNT5FEKROIVA5NZAELVPRGAQL6XVXU7Q, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.855379192 (216h42m21.586646842s) [noise=true , address=45.91.116.8:4059 , piece_id=DEDZA2DR33EK3URR27H6DKURMDDTWT65SCS3UGECCWM5BKVD4QHQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.855570652 (216h42m21.586838302s) [noise=true , address=77.90.31.10:4529 , piece_id=VZSQBU6PUYIP7XNBN5JQFZ5VI4WXHLSQUCGQNDRRRGU6TETCGQBQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.856194745 (216h42m21.587462415s) [noise=true , address=79.127.201.215:4359 , piece_id=DJVGXMVZA6JI35GVPHBGRMIEDS6OBOOFT74DNVZWUGTUQMKV6WKA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.857030525 (216h42m21.588298175s) [noise=true , address=45.91.116.7:4019 , piece_id=QK25YOV3HUQGIMGM4IGMLDVPLLNUR3KQMHQOIH4GU3PJVFQUPTKQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.857816381 (216h42m21.589084091s) [noise=true , address=104.36.82.58:4276 , piece_id=SMD2BUAUTWDS33QOWM3HQFYHQS5V33BLFRO4RZ2S6TC2GR5YGX3A, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.857978566 (216h42m21.589246216s) [noise=true , address=104.36.82.11:4127 , piece_id=U6JDUSEWROCLEHVG2ZATIVLD2ELN5M6JYUVZREWQWAA7BG3DI6UQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.974500804 (216h42m21.705768454s) [upload=225459]: Next returned nil segment
Aug 17 18:08:40.974518928 (216h42m21.705786568s) [upload=225459]: Waiting for error group managing segments...
Aug 17 18:08:40.987516869 (216h42m21.71878452s) [noise=true , address=104.36.82.11:4127 , piece_id=U6JDUSEWROCLEHVG2ZATIVLD2ELN5M6JYUVZREWQWAA7BG3DI6UQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:40.988549711 (216h42m21.719817331s) [noise=true , address=104.36.82.44:4899 , piece_id=LQQ7J5HK3LTHARNZIULHU3RKYL252NGGHZXIXP3TFVE32KKGXG6A, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.000082720 (216h42m21.73135034s) [noise=true , address=104.36.82.34:4566 , piece_id=TKRYBM75X63T6VDRPYN6ZNT5FEKROIVA5NZAELVPRGAQL6XVXU7Q, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.004638781 (216h42m21.735906401s) [noise=true , address=104.36.82.39:4738 , piece_id=5A6MDJG5PEHXNAEEDBHP6ZMV45KWTBRAK5OIVRUL2SOE4NEJPI5Q, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.004918978 (216h42m21.736186608s) [noise=true , address=104.36.82.58:4276 , piece_id=SMD2BUAUTWDS33QOWM3HQFYHQS5V33BLFRO4RZ2S6TC2GR5YGX3A, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.017616555 (216h42m21.748884185s) [noise=true , address=45.91.116.13:4168 , piece_id=VTT3MS2UIVXODCPZOJXHADVTDHW6S4HUTSEREFN7F6T75GMSRYNA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.026705041 (216h42m21.757972671s) [noise=true , address=104.36.82.60:4363 , piece_id=CIXNGIAGIFAHZUH5V5A6BTRZT4ANYEITZ6XBKJKX4RMZQKURIIMA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.029172177 (216h42m21.760439807s) [noise=true , address=45.91.116.7:4019 , piece_id=QK25YOV3HUQGIMGM4IGMLDVPLLNUR3KQMHQOIH4GU3PJVFQUPTKQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.032674628 (216h42m21.763942248s) [noise=true , address=77.90.31.15:4713 , piece_id=IBPJ2XQI6TD5SIGBFJIEDEMMX6WH37P6ECFFUCD5F3MWPQR6HYHQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.049253778 (216h42m21.780521408s) [noise=true , address=104.36.82.17:4336 , piece_id=A7UARNTYXQNF47MOPK7UNWWRZNCHBCMRMIMZQ6D53GVVPH6XZLHA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.049498879 (216h42m21.780766509s) [noise=true , address=104.36.82.35:4614 , piece_id=45LILLUGTP77755UK2BJS7ZQT2KFGCZ4IM2LXXA4NARZLNZQZK5A, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.068541098 (216h42m21.799808718s) [noise=true , address=77.90.31.11:4567 , piece_id=AOYPMJE7T6RDIS2ZV5UIAXF7BS2PHHIPZNGCTX7J2VEQIA5WOUGQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.070945586 (216h42m21.802213216s) [noise=true , address=77.90.31.19:4844 , piece_id=ZSISRMQJ3URFB6YZWSO23SMU7BI2QLEHCHADY4PZFNXIUOT5N2FA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.090207367 (216h42m21.821474997s) [noise=true , address=79.127.201.215:4359 , piece_id=DJVGXMVZA6JI35GVPHBGRMIEDS6OBOOFT74DNVZWUGTUQMKV6WKA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.090233866 (216h42m21.821501487s) [seg_pos={0 0}, upload=225459]: Segment reached optimal threshold of 14 pieces.
Aug 17 18:08:41.090351558 (216h42m21.821619179s) [noise=true , address=77.90.31.10:4529 , piece_id=VZSQBU6PUYIP7XNBN5JQFZ5VI4WXHLSQUCGQNDRRRGU6TETCGQBQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm): protocol: expected piece hash; context canceled; EOF
Aug 17 18:08:41.090444122 (216h42m21.821711752s) [noise=true , address=104.36.82.51:4077 , piece_id=DHAWXMJWOMEV57K5W4WCMFDRHW4L32OSSRN2VA2O4S4BLB4ULMKQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Njt39WE2REJivSU8fuzUReFN1n6BbRH78kJWaurrMK3Xh6PpS): protocol: expected piece hash; context canceled; EOF
Aug 17 18:08:41.090452788 (216h42m21.821720418s) [noise=true , address=45.91.116.8:4059 , piece_id=DEDZA2DR33EK3URR27H6DKURMDDTWT65SCS3UGECCWM5BKVD4QHQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YzYcwyVJqZywPJt9tYXXHMrjfjeziu6fobhHjt6sRf3utaror): protocol: expected piece hash; context canceled; EOF
Aug 17 18:08:41.090529141 (216h42m21.821796771s) [noise=true , address=104.36.82.18:4368 , piece_id=L5ZIXJFLLUXJLSLTMURQOOFYGRKGW3BD3XNF3MK362FTZYU2ICVQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ByhoW6Effjs8acfsvdF1xzDwBVqggsBK53oRZ8bYhEYYPChKz): protocol: write tcp 5.161.89.252:13580->104.36.82.18:4368: use of closed network connection; write tcp 5.161.89.252:13580->104.36.82.18:4368: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:13580->104.36.82.18:4368: use of closed network connection
Aug 17 18:08:41.090549199 (216h42m21.82181686s) [seg_pos={0 0}, upload=225459]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 18:08:41.090665598 (216h42m21.821933279s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 18:08:41.090672481 (216h42m21.821940102s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 18:08:41.259395157 (216h42m21.990662806s) [upload=225459]: Done uploading segments...
Aug 17 18:08:41.259414002 (216h42m21.990681662s) [upload=225459]: Upload finished. err: <nil>
Duration: 1.040294033s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............X...............................X..............] duration:
281.974697ms
FAIL (2025-08-17 18:41:52 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 18:33:16.400923957 (217h6m57.132191577s) [upload=225900]: Starting upload Aug 17 18:33:16.400969883 (217h6m57.132237513s) [upload=225900]: Done starting upload Aug 17 18:33:16.401014718 (217h6m57.132282338s) [upload=225900]: Uploading segments... Aug 17 18:33:16.401046027 (217h6m57.132313647s) [upload=225900]: Got next segment. Inline: true Aug 17 18:33:16.401050014 (217h6m57.132317645s) [upload=225900]: Waiting for error group managing segments... Aug 17 18:33:16.401081874 (217h6m57.132349504s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:33:16.401085992 (217h6m57.132353622s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 18:33:16.401088517 (217h6m57.132356147s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 18:33:16.418323930 (217h6m57.149591591s) [upload=225900]: Done uploading segments... Aug 17 18:33:16.418334601 (217h6m57.149602231s) [upload=225900]: Upload finished. err: metaclient: Too Many Requests
Duration: 281.996799ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
826.775907ms
FAIL (2025-08-17 18:41:47 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 17 18:08:40.777064912 (216h42m21.508332542s) [upload=225459]: Starting upload
Aug 17 18:08:40.777115086 (216h42m21.508382716s) [upload=225459]: Done starting upload
Aug 17 18:08:40.777269627 (216h42m21.508537287s) [upload=225459]: Uploading segments...
Aug 17 18:08:40.777454013 (216h42m21.508721673s) [upload=225459]: Got next segment. Inline: false
Aug 17 18:08:40.777510961 (216h42m21.508778611s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 18:08:40.777517212 (216h42m21.508784863s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 18:08:40.852095643 (216h42m21.583363283s) [seg_pos={0 0}, upload=225459]: Begin upload segment...
Aug 17 18:08:40.852138052 (216h42m21.583405692s) [seg_pos={0 0}, upload=225459]: Done begin upload segment.
Aug 17 18:08:40.852171765 (216h42m21.583439416s) [noise=true , address=104.36.82.35:4614 , piece_id=45LILLUGTP77755UK2BJS7ZQT2KFGCZ4IM2LXXA4NARZLNZQZK5A, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.852266774 (216h42m21.583534444s) [noise=true , address=104.36.82.51:4077 , piece_id=DHAWXMJWOMEV57K5W4WCMFDRHW4L32OSSRN2VA2O4S4BLB4ULMKQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.852610419 (216h42m21.583878059s) [noise=true , address=104.36.82.17:4336 , piece_id=A7UARNTYXQNF47MOPK7UNWWRZNCHBCMRMIMZQ6D53GVVPH6XZLHA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853024428 (216h42m21.584292077s) [noise=true , address=77.90.31.11:4567 , piece_id=AOYPMJE7T6RDIS2ZV5UIAXF7BS2PHHIPZNGCTX7J2VEQIA5WOUGQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853326185 (216h42m21.584593844s) [noise=true , address=45.91.116.13:4168 , piece_id=VTT3MS2UIVXODCPZOJXHADVTDHW6S4HUTSEREFN7F6T75GMSRYNA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853425190 (216h42m21.584692841s) [noise=true , address=104.36.82.44:4899 , piece_id=LQQ7J5HK3LTHARNZIULHU3RKYL252NGGHZXIXP3TFVE32KKGXG6A, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853793371 (216h42m21.585061022s) [noise=true , address=104.36.82.39:4738 , piece_id=5A6MDJG5PEHXNAEEDBHP6ZMV45KWTBRAK5OIVRUL2SOE4NEJPI5Q, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854181972 (216h42m21.585449623s) [noise=true , address=77.90.31.19:4844 , piece_id=ZSISRMQJ3URFB6YZWSO23SMU7BI2QLEHCHADY4PZFNXIUOT5N2FA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854317537 (216h42m21.585585197s) [noise=true , address=77.90.31.15:4713 , piece_id=IBPJ2XQI6TD5SIGBFJIEDEMMX6WH37P6ECFFUCD5F3MWPQR6HYHQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854538112 (216h42m21.585805761s) [noise=true , address=104.36.82.60:4363 , piece_id=CIXNGIAGIFAHZUH5V5A6BTRZT4ANYEITZ6XBKJKX4RMZQKURIIMA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854888400 (216h42m21.586156049s) [noise=true , address=104.36.82.18:4368 , piece_id=L5ZIXJFLLUXJLSLTMURQOOFYGRKGW3BD3XNF3MK362FTZYU2ICVQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.855236013 (216h42m21.586503662s) [noise=true , address=104.36.82.34:4566 , piece_id=TKRYBM75X63T6VDRPYN6ZNT5FEKROIVA5NZAELVPRGAQL6XVXU7Q, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.855379192 (216h42m21.586646842s) [noise=true , address=45.91.116.8:4059 , piece_id=DEDZA2DR33EK3URR27H6DKURMDDTWT65SCS3UGECCWM5BKVD4QHQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.855570652 (216h42m21.586838302s) [noise=true , address=77.90.31.10:4529 , piece_id=VZSQBU6PUYIP7XNBN5JQFZ5VI4WXHLSQUCGQNDRRRGU6TETCGQBQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.856194745 (216h42m21.587462415s) [noise=true , address=79.127.201.215:4359 , piece_id=DJVGXMVZA6JI35GVPHBGRMIEDS6OBOOFT74DNVZWUGTUQMKV6WKA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.857030525 (216h42m21.588298175s) [noise=true , address=45.91.116.7:4019 , piece_id=QK25YOV3HUQGIMGM4IGMLDVPLLNUR3KQMHQOIH4GU3PJVFQUPTKQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.857816381 (216h42m21.589084091s) [noise=true , address=104.36.82.58:4276 , piece_id=SMD2BUAUTWDS33QOWM3HQFYHQS5V33BLFRO4RZ2S6TC2GR5YGX3A, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.857978566 (216h42m21.589246216s) [noise=true , address=104.36.82.11:4127 , piece_id=U6JDUSEWROCLEHVG2ZATIVLD2ELN5M6JYUVZREWQWAA7BG3DI6UQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.974500804 (216h42m21.705768454s) [upload=225459]: Next returned nil segment
Aug 17 18:08:40.974518928 (216h42m21.705786568s) [upload=225459]: Waiting for error group managing segments...
Aug 17 18:08:40.987516869 (216h42m21.71878452s) [noise=true , address=104.36.82.11:4127 , piece_id=U6JDUSEWROCLEHVG2ZATIVLD2ELN5M6JYUVZREWQWAA7BG3DI6UQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:40.988549711 (216h42m21.719817331s) [noise=true , address=104.36.82.44:4899 , piece_id=LQQ7J5HK3LTHARNZIULHU3RKYL252NGGHZXIXP3TFVE32KKGXG6A, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.000082720 (216h42m21.73135034s) [noise=true , address=104.36.82.34:4566 , piece_id=TKRYBM75X63T6VDRPYN6ZNT5FEKROIVA5NZAELVPRGAQL6XVXU7Q, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.004638781 (216h42m21.735906401s) [noise=true , address=104.36.82.39:4738 , piece_id=5A6MDJG5PEHXNAEEDBHP6ZMV45KWTBRAK5OIVRUL2SOE4NEJPI5Q, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.004918978 (216h42m21.736186608s) [noise=true , address=104.36.82.58:4276 , piece_id=SMD2BUAUTWDS33QOWM3HQFYHQS5V33BLFRO4RZ2S6TC2GR5YGX3A, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.017616555 (216h42m21.748884185s) [noise=true , address=45.91.116.13:4168 , piece_id=VTT3MS2UIVXODCPZOJXHADVTDHW6S4HUTSEREFN7F6T75GMSRYNA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.026705041 (216h42m21.757972671s) [noise=true , address=104.36.82.60:4363 , piece_id=CIXNGIAGIFAHZUH5V5A6BTRZT4ANYEITZ6XBKJKX4RMZQKURIIMA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.029172177 (216h42m21.760439807s) [noise=true , address=45.91.116.7:4019 , piece_id=QK25YOV3HUQGIMGM4IGMLDVPLLNUR3KQMHQOIH4GU3PJVFQUPTKQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.032674628 (216h42m21.763942248s) [noise=true , address=77.90.31.15:4713 , piece_id=IBPJ2XQI6TD5SIGBFJIEDEMMX6WH37P6ECFFUCD5F3MWPQR6HYHQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.049253778 (216h42m21.780521408s) [noise=true , address=104.36.82.17:4336 , piece_id=A7UARNTYXQNF47MOPK7UNWWRZNCHBCMRMIMZQ6D53GVVPH6XZLHA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.049498879 (216h42m21.780766509s) [noise=true , address=104.36.82.35:4614 , piece_id=45LILLUGTP77755UK2BJS7ZQT2KFGCZ4IM2LXXA4NARZLNZQZK5A, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.068541098 (216h42m21.799808718s) [noise=true , address=77.90.31.11:4567 , piece_id=AOYPMJE7T6RDIS2ZV5UIAXF7BS2PHHIPZNGCTX7J2VEQIA5WOUGQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.070945586 (216h42m21.802213216s) [noise=true , address=77.90.31.19:4844 , piece_id=ZSISRMQJ3URFB6YZWSO23SMU7BI2QLEHCHADY4PZFNXIUOT5N2FA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.090207367 (216h42m21.821474997s) [noise=true , address=79.127.201.215:4359 , piece_id=DJVGXMVZA6JI35GVPHBGRMIEDS6OBOOFT74DNVZWUGTUQMKV6WKA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.090233866 (216h42m21.821501487s) [seg_pos={0 0}, upload=225459]: Segment reached optimal threshold of 14 pieces.
Aug 17 18:08:41.090351558 (216h42m21.821619179s) [noise=true , address=77.90.31.10:4529 , piece_id=VZSQBU6PUYIP7XNBN5JQFZ5VI4WXHLSQUCGQNDRRRGU6TETCGQBQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm): protocol: expected piece hash; context canceled; EOF
Aug 17 18:08:41.090444122 (216h42m21.821711752s) [noise=true , address=104.36.82.51:4077 , piece_id=DHAWXMJWOMEV57K5W4WCMFDRHW4L32OSSRN2VA2O4S4BLB4ULMKQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Njt39WE2REJivSU8fuzUReFN1n6BbRH78kJWaurrMK3Xh6PpS): protocol: expected piece hash; context canceled; EOF
Aug 17 18:08:41.090452788 (216h42m21.821720418s) [noise=true , address=45.91.116.8:4059 , piece_id=DEDZA2DR33EK3URR27H6DKURMDDTWT65SCS3UGECCWM5BKVD4QHQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YzYcwyVJqZywPJt9tYXXHMrjfjeziu6fobhHjt6sRf3utaror): protocol: expected piece hash; context canceled; EOF
Aug 17 18:08:41.090529141 (216h42m21.821796771s) [noise=true , address=104.36.82.18:4368 , piece_id=L5ZIXJFLLUXJLSLTMURQOOFYGRKGW3BD3XNF3MK362FTZYU2ICVQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ByhoW6Effjs8acfsvdF1xzDwBVqggsBK53oRZ8bYhEYYPChKz): protocol: write tcp 5.161.89.252:13580->104.36.82.18:4368: use of closed network connection; write tcp 5.161.89.252:13580->104.36.82.18:4368: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:13580->104.36.82.18:4368: use of closed network connection
Aug 17 18:08:41.090549199 (216h42m21.82181686s) [seg_pos={0 0}, upload=225459]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 18:08:41.090665598 (216h42m21.821933279s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 18:08:41.090672481 (216h42m21.821940102s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 18:08:41.259395157 (216h42m21.990662806s) [upload=225459]: Done uploading segments...
Aug 17 18:08:41.259414002 (216h42m21.990681662s) [upload=225459]: Upload finished. err: <nil>
Duration: 826.801935ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
797.544941ms
FAIL (2025-08-17 18:41:26 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 17 18:08:40.777064912 (216h42m21.508332542s) [upload=225459]: Starting upload
Aug 17 18:08:40.777115086 (216h42m21.508382716s) [upload=225459]: Done starting upload
Aug 17 18:08:40.777269627 (216h42m21.508537287s) [upload=225459]: Uploading segments...
Aug 17 18:08:40.777454013 (216h42m21.508721673s) [upload=225459]: Got next segment. Inline: false
Aug 17 18:08:40.777510961 (216h42m21.508778611s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 18:08:40.777517212 (216h42m21.508784863s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 18:08:40.852095643 (216h42m21.583363283s) [seg_pos={0 0}, upload=225459]: Begin upload segment...
Aug 17 18:08:40.852138052 (216h42m21.583405692s) [seg_pos={0 0}, upload=225459]: Done begin upload segment.
Aug 17 18:08:40.852171765 (216h42m21.583439416s) [noise=true , address=104.36.82.35:4614 , piece_id=45LILLUGTP77755UK2BJS7ZQT2KFGCZ4IM2LXXA4NARZLNZQZK5A, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.852266774 (216h42m21.583534444s) [noise=true , address=104.36.82.51:4077 , piece_id=DHAWXMJWOMEV57K5W4WCMFDRHW4L32OSSRN2VA2O4S4BLB4ULMKQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.852610419 (216h42m21.583878059s) [noise=true , address=104.36.82.17:4336 , piece_id=A7UARNTYXQNF47MOPK7UNWWRZNCHBCMRMIMZQ6D53GVVPH6XZLHA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853024428 (216h42m21.584292077s) [noise=true , address=77.90.31.11:4567 , piece_id=AOYPMJE7T6RDIS2ZV5UIAXF7BS2PHHIPZNGCTX7J2VEQIA5WOUGQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853326185 (216h42m21.584593844s) [noise=true , address=45.91.116.13:4168 , piece_id=VTT3MS2UIVXODCPZOJXHADVTDHW6S4HUTSEREFN7F6T75GMSRYNA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853425190 (216h42m21.584692841s) [noise=true , address=104.36.82.44:4899 , piece_id=LQQ7J5HK3LTHARNZIULHU3RKYL252NGGHZXIXP3TFVE32KKGXG6A, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853793371 (216h42m21.585061022s) [noise=true , address=104.36.82.39:4738 , piece_id=5A6MDJG5PEHXNAEEDBHP6ZMV45KWTBRAK5OIVRUL2SOE4NEJPI5Q, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854181972 (216h42m21.585449623s) [noise=true , address=77.90.31.19:4844 , piece_id=ZSISRMQJ3URFB6YZWSO23SMU7BI2QLEHCHADY4PZFNXIUOT5N2FA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854317537 (216h42m21.585585197s) [noise=true , address=77.90.31.15:4713 , piece_id=IBPJ2XQI6TD5SIGBFJIEDEMMX6WH37P6ECFFUCD5F3MWPQR6HYHQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854538112 (216h42m21.585805761s) [noise=true , address=104.36.82.60:4363 , piece_id=CIXNGIAGIFAHZUH5V5A6BTRZT4ANYEITZ6XBKJKX4RMZQKURIIMA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854888400 (216h42m21.586156049s) [noise=true , address=104.36.82.18:4368 , piece_id=L5ZIXJFLLUXJLSLTMURQOOFYGRKGW3BD3XNF3MK362FTZYU2ICVQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.855236013 (216h42m21.586503662s) [noise=true , address=104.36.82.34:4566 , piece_id=TKRYBM75X63T6VDRPYN6ZNT5FEKROIVA5NZAELVPRGAQL6XVXU7Q, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.855379192 (216h42m21.586646842s) [noise=true , address=45.91.116.8:4059 , piece_id=DEDZA2DR33EK3URR27H6DKURMDDTWT65SCS3UGECCWM5BKVD4QHQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.855570652 (216h42m21.586838302s) [noise=true , address=77.90.31.10:4529 , piece_id=VZSQBU6PUYIP7XNBN5JQFZ5VI4WXHLSQUCGQNDRRRGU6TETCGQBQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.856194745 (216h42m21.587462415s) [noise=true , address=79.127.201.215:4359 , piece_id=DJVGXMVZA6JI35GVPHBGRMIEDS6OBOOFT74DNVZWUGTUQMKV6WKA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.857030525 (216h42m21.588298175s) [noise=true , address=45.91.116.7:4019 , piece_id=QK25YOV3HUQGIMGM4IGMLDVPLLNUR3KQMHQOIH4GU3PJVFQUPTKQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.857816381 (216h42m21.589084091s) [noise=true , address=104.36.82.58:4276 , piece_id=SMD2BUAUTWDS33QOWM3HQFYHQS5V33BLFRO4RZ2S6TC2GR5YGX3A, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.857978566 (216h42m21.589246216s) [noise=true , address=104.36.82.11:4127 , piece_id=U6JDUSEWROCLEHVG2ZATIVLD2ELN5M6JYUVZREWQWAA7BG3DI6UQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.974500804 (216h42m21.705768454s) [upload=225459]: Next returned nil segment
Aug 17 18:08:40.974518928 (216h42m21.705786568s) [upload=225459]: Waiting for error group managing segments...
Aug 17 18:08:40.987516869 (216h42m21.71878452s) [noise=true , address=104.36.82.11:4127 , piece_id=U6JDUSEWROCLEHVG2ZATIVLD2ELN5M6JYUVZREWQWAA7BG3DI6UQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:40.988549711 (216h42m21.719817331s) [noise=true , address=104.36.82.44:4899 , piece_id=LQQ7J5HK3LTHARNZIULHU3RKYL252NGGHZXIXP3TFVE32KKGXG6A, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.000082720 (216h42m21.73135034s) [noise=true , address=104.36.82.34:4566 , piece_id=TKRYBM75X63T6VDRPYN6ZNT5FEKROIVA5NZAELVPRGAQL6XVXU7Q, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.004638781 (216h42m21.735906401s) [noise=true , address=104.36.82.39:4738 , piece_id=5A6MDJG5PEHXNAEEDBHP6ZMV45KWTBRAK5OIVRUL2SOE4NEJPI5Q, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.004918978 (216h42m21.736186608s) [noise=true , address=104.36.82.58:4276 , piece_id=SMD2BUAUTWDS33QOWM3HQFYHQS5V33BLFRO4RZ2S6TC2GR5YGX3A, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.017616555 (216h42m21.748884185s) [noise=true , address=45.91.116.13:4168 , piece_id=VTT3MS2UIVXODCPZOJXHADVTDHW6S4HUTSEREFN7F6T75GMSRYNA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.026705041 (216h42m21.757972671s) [noise=true , address=104.36.82.60:4363 , piece_id=CIXNGIAGIFAHZUH5V5A6BTRZT4ANYEITZ6XBKJKX4RMZQKURIIMA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.029172177 (216h42m21.760439807s) [noise=true , address=45.91.116.7:4019 , piece_id=QK25YOV3HUQGIMGM4IGMLDVPLLNUR3KQMHQOIH4GU3PJVFQUPTKQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.032674628 (216h42m21.763942248s) [noise=true , address=77.90.31.15:4713 , piece_id=IBPJ2XQI6TD5SIGBFJIEDEMMX6WH37P6ECFFUCD5F3MWPQR6HYHQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.049253778 (216h42m21.780521408s) [noise=true , address=104.36.82.17:4336 , piece_id=A7UARNTYXQNF47MOPK7UNWWRZNCHBCMRMIMZQ6D53GVVPH6XZLHA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.049498879 (216h42m21.780766509s) [noise=true , address=104.36.82.35:4614 , piece_id=45LILLUGTP77755UK2BJS7ZQT2KFGCZ4IM2LXXA4NARZLNZQZK5A, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.068541098 (216h42m21.799808718s) [noise=true , address=77.90.31.11:4567 , piece_id=AOYPMJE7T6RDIS2ZV5UIAXF7BS2PHHIPZNGCTX7J2VEQIA5WOUGQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.070945586 (216h42m21.802213216s) [noise=true , address=77.90.31.19:4844 , piece_id=ZSISRMQJ3URFB6YZWSO23SMU7BI2QLEHCHADY4PZFNXIUOT5N2FA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.090207367 (216h42m21.821474997s) [noise=true , address=79.127.201.215:4359 , piece_id=DJVGXMVZA6JI35GVPHBGRMIEDS6OBOOFT74DNVZWUGTUQMKV6WKA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.090233866 (216h42m21.821501487s) [seg_pos={0 0}, upload=225459]: Segment reached optimal threshold of 14 pieces.
Aug 17 18:08:41.090351558 (216h42m21.821619179s) [noise=true , address=77.90.31.10:4529 , piece_id=VZSQBU6PUYIP7XNBN5JQFZ5VI4WXHLSQUCGQNDRRRGU6TETCGQBQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm): protocol: expected piece hash; context canceled; EOF
Aug 17 18:08:41.090444122 (216h42m21.821711752s) [noise=true , address=104.36.82.51:4077 , piece_id=DHAWXMJWOMEV57K5W4WCMFDRHW4L32OSSRN2VA2O4S4BLB4ULMKQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Njt39WE2REJivSU8fuzUReFN1n6BbRH78kJWaurrMK3Xh6PpS): protocol: expected piece hash; context canceled; EOF
Aug 17 18:08:41.090452788 (216h42m21.821720418s) [noise=true , address=45.91.116.8:4059 , piece_id=DEDZA2DR33EK3URR27H6DKURMDDTWT65SCS3UGECCWM5BKVD4QHQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YzYcwyVJqZywPJt9tYXXHMrjfjeziu6fobhHjt6sRf3utaror): protocol: expected piece hash; context canceled; EOF
Aug 17 18:08:41.090529141 (216h42m21.821796771s) [noise=true , address=104.36.82.18:4368 , piece_id=L5ZIXJFLLUXJLSLTMURQOOFYGRKGW3BD3XNF3MK362FTZYU2ICVQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ByhoW6Effjs8acfsvdF1xzDwBVqggsBK53oRZ8bYhEYYPChKz): protocol: write tcp 5.161.89.252:13580->104.36.82.18:4368: use of closed network connection; write tcp 5.161.89.252:13580->104.36.82.18:4368: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:13580->104.36.82.18:4368: use of closed network connection
Aug 17 18:08:41.090549199 (216h42m21.82181686s) [seg_pos={0 0}, upload=225459]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 18:08:41.090665598 (216h42m21.821933279s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 18:08:41.090672481 (216h42m21.821940102s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 18:08:41.259395157 (216h42m21.990662806s) [upload=225459]: Done uploading segments...
Aug 17 18:08:41.259414002 (216h42m21.990681662s) [upload=225459]: Upload finished. err: <nil>
Duration: 797.570459ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............X...............................X.............] duration:
182.813365ms
FAIL (2025-08-17 18:41:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 18:33:16.400923957 (217h6m57.132191577s) [upload=225900]: Starting upload Aug 17 18:33:16.400969883 (217h6m57.132237513s) [upload=225900]: Done starting upload Aug 17 18:33:16.401014718 (217h6m57.132282338s) [upload=225900]: Uploading segments... Aug 17 18:33:16.401046027 (217h6m57.132313647s) [upload=225900]: Got next segment. Inline: true Aug 17 18:33:16.401050014 (217h6m57.132317645s) [upload=225900]: Waiting for error group managing segments... Aug 17 18:33:16.401081874 (217h6m57.132349504s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:33:16.401085992 (217h6m57.132353622s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 18:33:16.401088517 (217h6m57.132356147s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 18:33:16.418323930 (217h6m57.149591591s) [upload=225900]: Done uploading segments... Aug 17 18:33:16.418334601 (217h6m57.149602231s) [upload=225900]: Upload finished. err: metaclient: Too Many Requests
Duration: 182.835517ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
667.697021ms
FAIL (2025-08-17 18:41:10 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 17 18:08:40.777064912 (216h42m21.508332542s) [upload=225459]: Starting upload
Aug 17 18:08:40.777115086 (216h42m21.508382716s) [upload=225459]: Done starting upload
Aug 17 18:08:40.777269627 (216h42m21.508537287s) [upload=225459]: Uploading segments...
Aug 17 18:08:40.777454013 (216h42m21.508721673s) [upload=225459]: Got next segment. Inline: false
Aug 17 18:08:40.777510961 (216h42m21.508778611s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 18:08:40.777517212 (216h42m21.508784863s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 18:08:40.852095643 (216h42m21.583363283s) [seg_pos={0 0}, upload=225459]: Begin upload segment...
Aug 17 18:08:40.852138052 (216h42m21.583405692s) [seg_pos={0 0}, upload=225459]: Done begin upload segment.
Aug 17 18:08:40.852171765 (216h42m21.583439416s) [noise=true , address=104.36.82.35:4614 , piece_id=45LILLUGTP77755UK2BJS7ZQT2KFGCZ4IM2LXXA4NARZLNZQZK5A, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.852266774 (216h42m21.583534444s) [noise=true , address=104.36.82.51:4077 , piece_id=DHAWXMJWOMEV57K5W4WCMFDRHW4L32OSSRN2VA2O4S4BLB4ULMKQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.852610419 (216h42m21.583878059s) [noise=true , address=104.36.82.17:4336 , piece_id=A7UARNTYXQNF47MOPK7UNWWRZNCHBCMRMIMZQ6D53GVVPH6XZLHA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853024428 (216h42m21.584292077s) [noise=true , address=77.90.31.11:4567 , piece_id=AOYPMJE7T6RDIS2ZV5UIAXF7BS2PHHIPZNGCTX7J2VEQIA5WOUGQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853326185 (216h42m21.584593844s) [noise=true , address=45.91.116.13:4168 , piece_id=VTT3MS2UIVXODCPZOJXHADVTDHW6S4HUTSEREFN7F6T75GMSRYNA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853425190 (216h42m21.584692841s) [noise=true , address=104.36.82.44:4899 , piece_id=LQQ7J5HK3LTHARNZIULHU3RKYL252NGGHZXIXP3TFVE32KKGXG6A, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853793371 (216h42m21.585061022s) [noise=true , address=104.36.82.39:4738 , piece_id=5A6MDJG5PEHXNAEEDBHP6ZMV45KWTBRAK5OIVRUL2SOE4NEJPI5Q, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854181972 (216h42m21.585449623s) [noise=true , address=77.90.31.19:4844 , piece_id=ZSISRMQJ3URFB6YZWSO23SMU7BI2QLEHCHADY4PZFNXIUOT5N2FA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854317537 (216h42m21.585585197s) [noise=true , address=77.90.31.15:4713 , piece_id=IBPJ2XQI6TD5SIGBFJIEDEMMX6WH37P6ECFFUCD5F3MWPQR6HYHQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854538112 (216h42m21.585805761s) [noise=true , address=104.36.82.60:4363 , piece_id=CIXNGIAGIFAHZUH5V5A6BTRZT4ANYEITZ6XBKJKX4RMZQKURIIMA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854888400 (216h42m21.586156049s) [noise=true , address=104.36.82.18:4368 , piece_id=L5ZIXJFLLUXJLSLTMURQOOFYGRKGW3BD3XNF3MK362FTZYU2ICVQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.855236013 (216h42m21.586503662s) [noise=true , address=104.36.82.34:4566 , piece_id=TKRYBM75X63T6VDRPYN6ZNT5FEKROIVA5NZAELVPRGAQL6XVXU7Q, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.855379192 (216h42m21.586646842s) [noise=true , address=45.91.116.8:4059 , piece_id=DEDZA2DR33EK3URR27H6DKURMDDTWT65SCS3UGECCWM5BKVD4QHQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.855570652 (216h42m21.586838302s) [noise=true , address=77.90.31.10:4529 , piece_id=VZSQBU6PUYIP7XNBN5JQFZ5VI4WXHLSQUCGQNDRRRGU6TETCGQBQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.856194745 (216h42m21.587462415s) [noise=true , address=79.127.201.215:4359 , piece_id=DJVGXMVZA6JI35GVPHBGRMIEDS6OBOOFT74DNVZWUGTUQMKV6WKA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.857030525 (216h42m21.588298175s) [noise=true , address=45.91.116.7:4019 , piece_id=QK25YOV3HUQGIMGM4IGMLDVPLLNUR3KQMHQOIH4GU3PJVFQUPTKQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.857816381 (216h42m21.589084091s) [noise=true , address=104.36.82.58:4276 , piece_id=SMD2BUAUTWDS33QOWM3HQFYHQS5V33BLFRO4RZ2S6TC2GR5YGX3A, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.857978566 (216h42m21.589246216s) [noise=true , address=104.36.82.11:4127 , piece_id=U6JDUSEWROCLEHVG2ZATIVLD2ELN5M6JYUVZREWQWAA7BG3DI6UQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.974500804 (216h42m21.705768454s) [upload=225459]: Next returned nil segment
Aug 17 18:08:40.974518928 (216h42m21.705786568s) [upload=225459]: Waiting for error group managing segments...
Aug 17 18:08:40.987516869 (216h42m21.71878452s) [noise=true , address=104.36.82.11:4127 , piece_id=U6JDUSEWROCLEHVG2ZATIVLD2ELN5M6JYUVZREWQWAA7BG3DI6UQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:40.988549711 (216h42m21.719817331s) [noise=true , address=104.36.82.44:4899 , piece_id=LQQ7J5HK3LTHARNZIULHU3RKYL252NGGHZXIXP3TFVE32KKGXG6A, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.000082720 (216h42m21.73135034s) [noise=true , address=104.36.82.34:4566 , piece_id=TKRYBM75X63T6VDRPYN6ZNT5FEKROIVA5NZAELVPRGAQL6XVXU7Q, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.004638781 (216h42m21.735906401s) [noise=true , address=104.36.82.39:4738 , piece_id=5A6MDJG5PEHXNAEEDBHP6ZMV45KWTBRAK5OIVRUL2SOE4NEJPI5Q, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.004918978 (216h42m21.736186608s) [noise=true , address=104.36.82.58:4276 , piece_id=SMD2BUAUTWDS33QOWM3HQFYHQS5V33BLFRO4RZ2S6TC2GR5YGX3A, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.017616555 (216h42m21.748884185s) [noise=true , address=45.91.116.13:4168 , piece_id=VTT3MS2UIVXODCPZOJXHADVTDHW6S4HUTSEREFN7F6T75GMSRYNA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.026705041 (216h42m21.757972671s) [noise=true , address=104.36.82.60:4363 , piece_id=CIXNGIAGIFAHZUH5V5A6BTRZT4ANYEITZ6XBKJKX4RMZQKURIIMA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.029172177 (216h42m21.760439807s) [noise=true , address=45.91.116.7:4019 , piece_id=QK25YOV3HUQGIMGM4IGMLDVPLLNUR3KQMHQOIH4GU3PJVFQUPTKQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.032674628 (216h42m21.763942248s) [noise=true , address=77.90.31.15:4713 , piece_id=IBPJ2XQI6TD5SIGBFJIEDEMMX6WH37P6ECFFUCD5F3MWPQR6HYHQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.049253778 (216h42m21.780521408s) [noise=true , address=104.36.82.17:4336 , piece_id=A7UARNTYXQNF47MOPK7UNWWRZNCHBCMRMIMZQ6D53GVVPH6XZLHA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.049498879 (216h42m21.780766509s) [noise=true , address=104.36.82.35:4614 , piece_id=45LILLUGTP77755UK2BJS7ZQT2KFGCZ4IM2LXXA4NARZLNZQZK5A, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.068541098 (216h42m21.799808718s) [noise=true , address=77.90.31.11:4567 , piece_id=AOYPMJE7T6RDIS2ZV5UIAXF7BS2PHHIPZNGCTX7J2VEQIA5WOUGQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.070945586 (216h42m21.802213216s) [noise=true , address=77.90.31.19:4844 , piece_id=ZSISRMQJ3URFB6YZWSO23SMU7BI2QLEHCHADY4PZFNXIUOT5N2FA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.090207367 (216h42m21.821474997s) [noise=true , address=79.127.201.215:4359 , piece_id=DJVGXMVZA6JI35GVPHBGRMIEDS6OBOOFT74DNVZWUGTUQMKV6WKA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.090233866 (216h42m21.821501487s) [seg_pos={0 0}, upload=225459]: Segment reached optimal threshold of 14 pieces.
Aug 17 18:08:41.090351558 (216h42m21.821619179s) [noise=true , address=77.90.31.10:4529 , piece_id=VZSQBU6PUYIP7XNBN5JQFZ5VI4WXHLSQUCGQNDRRRGU6TETCGQBQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm): protocol: expected piece hash; context canceled; EOF
Aug 17 18:08:41.090444122 (216h42m21.821711752s) [noise=true , address=104.36.82.51:4077 , piece_id=DHAWXMJWOMEV57K5W4WCMFDRHW4L32OSSRN2VA2O4S4BLB4ULMKQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Njt39WE2REJivSU8fuzUReFN1n6BbRH78kJWaurrMK3Xh6PpS): protocol: expected piece hash; context canceled; EOF
Aug 17 18:08:41.090452788 (216h42m21.821720418s) [noise=true , address=45.91.116.8:4059 , piece_id=DEDZA2DR33EK3URR27H6DKURMDDTWT65SCS3UGECCWM5BKVD4QHQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YzYcwyVJqZywPJt9tYXXHMrjfjeziu6fobhHjt6sRf3utaror): protocol: expected piece hash; context canceled; EOF
Aug 17 18:08:41.090529141 (216h42m21.821796771s) [noise=true , address=104.36.82.18:4368 , piece_id=L5ZIXJFLLUXJLSLTMURQOOFYGRKGW3BD3XNF3MK362FTZYU2ICVQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ByhoW6Effjs8acfsvdF1xzDwBVqggsBK53oRZ8bYhEYYPChKz): protocol: write tcp 5.161.89.252:13580->104.36.82.18:4368: use of closed network connection; write tcp 5.161.89.252:13580->104.36.82.18:4368: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:13580->104.36.82.18:4368: use of closed network connection
Aug 17 18:08:41.090549199 (216h42m21.82181686s) [seg_pos={0 0}, upload=225459]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 18:08:41.090665598 (216h42m21.821933279s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 18:08:41.090672481 (216h42m21.821940102s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 18:08:41.259395157 (216h42m21.990662806s) [upload=225459]: Done uploading segments...
Aug 17 18:08:41.259414002 (216h42m21.990681662s) [upload=225459]: Upload finished. err: <nil>
Duration: 667.718841ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............X...............................X............] duration:
174.887519ms
FAIL (2025-08-17 18:40:59 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 18:33:16.400923957 (217h6m57.132191577s) [upload=225900]: Starting upload Aug 17 18:33:16.400969883 (217h6m57.132237513s) [upload=225900]: Done starting upload Aug 17 18:33:16.401014718 (217h6m57.132282338s) [upload=225900]: Uploading segments... Aug 17 18:33:16.401046027 (217h6m57.132313647s) [upload=225900]: Got next segment. Inline: true Aug 17 18:33:16.401050014 (217h6m57.132317645s) [upload=225900]: Waiting for error group managing segments... Aug 17 18:33:16.401081874 (217h6m57.132349504s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:33:16.401085992 (217h6m57.132353622s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 18:33:16.401088517 (217h6m57.132356147s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 18:33:16.418323930 (217h6m57.149591591s) [upload=225900]: Done uploading segments... Aug 17 18:33:16.418334601 (217h6m57.149602231s) [upload=225900]: Upload finished. err: metaclient: Too Many Requests
Duration: 174.907928ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
546.405927ms
FAIL (2025-08-17 18:40:46 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 17 18:08:40.777064912 (216h42m21.508332542s) [upload=225459]: Starting upload
Aug 17 18:08:40.777115086 (216h42m21.508382716s) [upload=225459]: Done starting upload
Aug 17 18:08:40.777269627 (216h42m21.508537287s) [upload=225459]: Uploading segments...
Aug 17 18:08:40.777454013 (216h42m21.508721673s) [upload=225459]: Got next segment. Inline: false
Aug 17 18:08:40.777510961 (216h42m21.508778611s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 18:08:40.777517212 (216h42m21.508784863s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 18:08:40.852095643 (216h42m21.583363283s) [seg_pos={0 0}, upload=225459]: Begin upload segment...
Aug 17 18:08:40.852138052 (216h42m21.583405692s) [seg_pos={0 0}, upload=225459]: Done begin upload segment.
Aug 17 18:08:40.852171765 (216h42m21.583439416s) [noise=true , address=104.36.82.35:4614 , piece_id=45LILLUGTP77755UK2BJS7ZQT2KFGCZ4IM2LXXA4NARZLNZQZK5A, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.852266774 (216h42m21.583534444s) [noise=true , address=104.36.82.51:4077 , piece_id=DHAWXMJWOMEV57K5W4WCMFDRHW4L32OSSRN2VA2O4S4BLB4ULMKQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.852610419 (216h42m21.583878059s) [noise=true , address=104.36.82.17:4336 , piece_id=A7UARNTYXQNF47MOPK7UNWWRZNCHBCMRMIMZQ6D53GVVPH6XZLHA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853024428 (216h42m21.584292077s) [noise=true , address=77.90.31.11:4567 , piece_id=AOYPMJE7T6RDIS2ZV5UIAXF7BS2PHHIPZNGCTX7J2VEQIA5WOUGQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853326185 (216h42m21.584593844s) [noise=true , address=45.91.116.13:4168 , piece_id=VTT3MS2UIVXODCPZOJXHADVTDHW6S4HUTSEREFN7F6T75GMSRYNA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853425190 (216h42m21.584692841s) [noise=true , address=104.36.82.44:4899 , piece_id=LQQ7J5HK3LTHARNZIULHU3RKYL252NGGHZXIXP3TFVE32KKGXG6A, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853793371 (216h42m21.585061022s) [noise=true , address=104.36.82.39:4738 , piece_id=5A6MDJG5PEHXNAEEDBHP6ZMV45KWTBRAK5OIVRUL2SOE4NEJPI5Q, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854181972 (216h42m21.585449623s) [noise=true , address=77.90.31.19:4844 , piece_id=ZSISRMQJ3URFB6YZWSO23SMU7BI2QLEHCHADY4PZFNXIUOT5N2FA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854317537 (216h42m21.585585197s) [noise=true , address=77.90.31.15:4713 , piece_id=IBPJ2XQI6TD5SIGBFJIEDEMMX6WH37P6ECFFUCD5F3MWPQR6HYHQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854538112 (216h42m21.585805761s) [noise=true , address=104.36.82.60:4363 , piece_id=CIXNGIAGIFAHZUH5V5A6BTRZT4ANYEITZ6XBKJKX4RMZQKURIIMA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854888400 (216h42m21.586156049s) [noise=true , address=104.36.82.18:4368 , piece_id=L5ZIXJFLLUXJLSLTMURQOOFYGRKGW3BD3XNF3MK362FTZYU2ICVQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.855236013 (216h42m21.586503662s) [noise=true , address=104.36.82.34:4566 , piece_id=TKRYBM75X63T6VDRPYN6ZNT5FEKROIVA5NZAELVPRGAQL6XVXU7Q, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.855379192 (216h42m21.586646842s) [noise=true , address=45.91.116.8:4059 , piece_id=DEDZA2DR33EK3URR27H6DKURMDDTWT65SCS3UGECCWM5BKVD4QHQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.855570652 (216h42m21.586838302s) [noise=true , address=77.90.31.10:4529 , piece_id=VZSQBU6PUYIP7XNBN5JQFZ5VI4WXHLSQUCGQNDRRRGU6TETCGQBQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.856194745 (216h42m21.587462415s) [noise=true , address=79.127.201.215:4359 , piece_id=DJVGXMVZA6JI35GVPHBGRMIEDS6OBOOFT74DNVZWUGTUQMKV6WKA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.857030525 (216h42m21.588298175s) [noise=true , address=45.91.116.7:4019 , piece_id=QK25YOV3HUQGIMGM4IGMLDVPLLNUR3KQMHQOIH4GU3PJVFQUPTKQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.857816381 (216h42m21.589084091s) [noise=true , address=104.36.82.58:4276 , piece_id=SMD2BUAUTWDS33QOWM3HQFYHQS5V33BLFRO4RZ2S6TC2GR5YGX3A, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.857978566 (216h42m21.589246216s) [noise=true , address=104.36.82.11:4127 , piece_id=U6JDUSEWROCLEHVG2ZATIVLD2ELN5M6JYUVZREWQWAA7BG3DI6UQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.974500804 (216h42m21.705768454s) [upload=225459]: Next returned nil segment
Aug 17 18:08:40.974518928 (216h42m21.705786568s) [upload=225459]: Waiting for error group managing segments...
Aug 17 18:08:40.987516869 (216h42m21.71878452s) [noise=true , address=104.36.82.11:4127 , piece_id=U6JDUSEWROCLEHVG2ZATIVLD2ELN5M6JYUVZREWQWAA7BG3DI6UQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:40.988549711 (216h42m21.719817331s) [noise=true , address=104.36.82.44:4899 , piece_id=LQQ7J5HK3LTHARNZIULHU3RKYL252NGGHZXIXP3TFVE32KKGXG6A, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.000082720 (216h42m21.73135034s) [noise=true , address=104.36.82.34:4566 , piece_id=TKRYBM75X63T6VDRPYN6ZNT5FEKROIVA5NZAELVPRGAQL6XVXU7Q, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.004638781 (216h42m21.735906401s) [noise=true , address=104.36.82.39:4738 , piece_id=5A6MDJG5PEHXNAEEDBHP6ZMV45KWTBRAK5OIVRUL2SOE4NEJPI5Q, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.004918978 (216h42m21.736186608s) [noise=true , address=104.36.82.58:4276 , piece_id=SMD2BUAUTWDS33QOWM3HQFYHQS5V33BLFRO4RZ2S6TC2GR5YGX3A, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.017616555 (216h42m21.748884185s) [noise=true , address=45.91.116.13:4168 , piece_id=VTT3MS2UIVXODCPZOJXHADVTDHW6S4HUTSEREFN7F6T75GMSRYNA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.026705041 (216h42m21.757972671s) [noise=true , address=104.36.82.60:4363 , piece_id=CIXNGIAGIFAHZUH5V5A6BTRZT4ANYEITZ6XBKJKX4RMZQKURIIMA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.029172177 (216h42m21.760439807s) [noise=true , address=45.91.116.7:4019 , piece_id=QK25YOV3HUQGIMGM4IGMLDVPLLNUR3KQMHQOIH4GU3PJVFQUPTKQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.032674628 (216h42m21.763942248s) [noise=true , address=77.90.31.15:4713 , piece_id=IBPJ2XQI6TD5SIGBFJIEDEMMX6WH37P6ECFFUCD5F3MWPQR6HYHQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.049253778 (216h42m21.780521408s) [noise=true , address=104.36.82.17:4336 , piece_id=A7UARNTYXQNF47MOPK7UNWWRZNCHBCMRMIMZQ6D53GVVPH6XZLHA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.049498879 (216h42m21.780766509s) [noise=true , address=104.36.82.35:4614 , piece_id=45LILLUGTP77755UK2BJS7ZQT2KFGCZ4IM2LXXA4NARZLNZQZK5A, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.068541098 (216h42m21.799808718s) [noise=true , address=77.90.31.11:4567 , piece_id=AOYPMJE7T6RDIS2ZV5UIAXF7BS2PHHIPZNGCTX7J2VEQIA5WOUGQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.070945586 (216h42m21.802213216s) [noise=true , address=77.90.31.19:4844 , piece_id=ZSISRMQJ3URFB6YZWSO23SMU7BI2QLEHCHADY4PZFNXIUOT5N2FA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.090207367 (216h42m21.821474997s) [noise=true , address=79.127.201.215:4359 , piece_id=DJVGXMVZA6JI35GVPHBGRMIEDS6OBOOFT74DNVZWUGTUQMKV6WKA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.090233866 (216h42m21.821501487s) [seg_pos={0 0}, upload=225459]: Segment reached optimal threshold of 14 pieces.
Aug 17 18:08:41.090351558 (216h42m21.821619179s) [noise=true , address=77.90.31.10:4529 , piece_id=VZSQBU6PUYIP7XNBN5JQFZ5VI4WXHLSQUCGQNDRRRGU6TETCGQBQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm): protocol: expected piece hash; context canceled; EOF
Aug 17 18:08:41.090444122 (216h42m21.821711752s) [noise=true , address=104.36.82.51:4077 , piece_id=DHAWXMJWOMEV57K5W4WCMFDRHW4L32OSSRN2VA2O4S4BLB4ULMKQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Njt39WE2REJivSU8fuzUReFN1n6BbRH78kJWaurrMK3Xh6PpS): protocol: expected piece hash; context canceled; EOF
Aug 17 18:08:41.090452788 (216h42m21.821720418s) [noise=true , address=45.91.116.8:4059 , piece_id=DEDZA2DR33EK3URR27H6DKURMDDTWT65SCS3UGECCWM5BKVD4QHQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YzYcwyVJqZywPJt9tYXXHMrjfjeziu6fobhHjt6sRf3utaror): protocol: expected piece hash; context canceled; EOF
Aug 17 18:08:41.090529141 (216h42m21.821796771s) [noise=true , address=104.36.82.18:4368 , piece_id=L5ZIXJFLLUXJLSLTMURQOOFYGRKGW3BD3XNF3MK362FTZYU2ICVQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ByhoW6Effjs8acfsvdF1xzDwBVqggsBK53oRZ8bYhEYYPChKz): protocol: write tcp 5.161.89.252:13580->104.36.82.18:4368: use of closed network connection; write tcp 5.161.89.252:13580->104.36.82.18:4368: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:13580->104.36.82.18:4368: use of closed network connection
Aug 17 18:08:41.090549199 (216h42m21.82181686s) [seg_pos={0 0}, upload=225459]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 18:08:41.090665598 (216h42m21.821933279s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 18:08:41.090672481 (216h42m21.821940102s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 18:08:41.259395157 (216h42m21.990662806s) [upload=225459]: Done uploading segments...
Aug 17 18:08:41.259414002 (216h42m21.990681662s) [upload=225459]: Upload finished. err: <nil>
Duration: 546.426506ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [................X...............................X...........] duration:
212.076076ms
FAIL (2025-08-17 18:40:43 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 18:33:16.400923957 (217h6m57.132191577s) [upload=225900]: Starting upload Aug 17 18:33:16.400969883 (217h6m57.132237513s) [upload=225900]: Done starting upload Aug 17 18:33:16.401014718 (217h6m57.132282338s) [upload=225900]: Uploading segments... Aug 17 18:33:16.401046027 (217h6m57.132313647s) [upload=225900]: Got next segment. Inline: true Aug 17 18:33:16.401050014 (217h6m57.132317645s) [upload=225900]: Waiting for error group managing segments... Aug 17 18:33:16.401081874 (217h6m57.132349504s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:33:16.401085992 (217h6m57.132353622s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 18:33:16.401088517 (217h6m57.132356147s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 18:33:16.418323930 (217h6m57.149591591s) [upload=225900]: Done uploading segments... Aug 17 18:33:16.418334601 (217h6m57.149602231s) [upload=225900]: Upload finished. err: metaclient: Too Many Requests
Duration: 212.090083ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
1.195941663s
FAIL (2025-08-17 18:39:48 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 17 18:08:40.777064912 (216h42m21.508332542s) [upload=225459]: Starting upload
Aug 17 18:08:40.777115086 (216h42m21.508382716s) [upload=225459]: Done starting upload
Aug 17 18:08:40.777269627 (216h42m21.508537287s) [upload=225459]: Uploading segments...
Aug 17 18:08:40.777454013 (216h42m21.508721673s) [upload=225459]: Got next segment. Inline: false
Aug 17 18:08:40.777510961 (216h42m21.508778611s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 18:08:40.777517212 (216h42m21.508784863s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 18:08:40.852095643 (216h42m21.583363283s) [seg_pos={0 0}, upload=225459]: Begin upload segment...
Aug 17 18:08:40.852138052 (216h42m21.583405692s) [seg_pos={0 0}, upload=225459]: Done begin upload segment.
Aug 17 18:08:40.852171765 (216h42m21.583439416s) [noise=true , address=104.36.82.35:4614 , piece_id=45LILLUGTP77755UK2BJS7ZQT2KFGCZ4IM2LXXA4NARZLNZQZK5A, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.852266774 (216h42m21.583534444s) [noise=true , address=104.36.82.51:4077 , piece_id=DHAWXMJWOMEV57K5W4WCMFDRHW4L32OSSRN2VA2O4S4BLB4ULMKQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.852610419 (216h42m21.583878059s) [noise=true , address=104.36.82.17:4336 , piece_id=A7UARNTYXQNF47MOPK7UNWWRZNCHBCMRMIMZQ6D53GVVPH6XZLHA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853024428 (216h42m21.584292077s) [noise=true , address=77.90.31.11:4567 , piece_id=AOYPMJE7T6RDIS2ZV5UIAXF7BS2PHHIPZNGCTX7J2VEQIA5WOUGQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853326185 (216h42m21.584593844s) [noise=true , address=45.91.116.13:4168 , piece_id=VTT3MS2UIVXODCPZOJXHADVTDHW6S4HUTSEREFN7F6T75GMSRYNA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853425190 (216h42m21.584692841s) [noise=true , address=104.36.82.44:4899 , piece_id=LQQ7J5HK3LTHARNZIULHU3RKYL252NGGHZXIXP3TFVE32KKGXG6A, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853793371 (216h42m21.585061022s) [noise=true , address=104.36.82.39:4738 , piece_id=5A6MDJG5PEHXNAEEDBHP6ZMV45KWTBRAK5OIVRUL2SOE4NEJPI5Q, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854181972 (216h42m21.585449623s) [noise=true , address=77.90.31.19:4844 , piece_id=ZSISRMQJ3URFB6YZWSO23SMU7BI2QLEHCHADY4PZFNXIUOT5N2FA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854317537 (216h42m21.585585197s) [noise=true , address=77.90.31.15:4713 , piece_id=IBPJ2XQI6TD5SIGBFJIEDEMMX6WH37P6ECFFUCD5F3MWPQR6HYHQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854538112 (216h42m21.585805761s) [noise=true , address=104.36.82.60:4363 , piece_id=CIXNGIAGIFAHZUH5V5A6BTRZT4ANYEITZ6XBKJKX4RMZQKURIIMA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854888400 (216h42m21.586156049s) [noise=true , address=104.36.82.18:4368 , piece_id=L5ZIXJFLLUXJLSLTMURQOOFYGRKGW3BD3XNF3MK362FTZYU2ICVQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.855236013 (216h42m21.586503662s) [noise=true , address=104.36.82.34:4566 , piece_id=TKRYBM75X63T6VDRPYN6ZNT5FEKROIVA5NZAELVPRGAQL6XVXU7Q, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.855379192 (216h42m21.586646842s) [noise=true , address=45.91.116.8:4059 , piece_id=DEDZA2DR33EK3URR27H6DKURMDDTWT65SCS3UGECCWM5BKVD4QHQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.855570652 (216h42m21.586838302s) [noise=true , address=77.90.31.10:4529 , piece_id=VZSQBU6PUYIP7XNBN5JQFZ5VI4WXHLSQUCGQNDRRRGU6TETCGQBQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.856194745 (216h42m21.587462415s) [noise=true , address=79.127.201.215:4359 , piece_id=DJVGXMVZA6JI35GVPHBGRMIEDS6OBOOFT74DNVZWUGTUQMKV6WKA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.857030525 (216h42m21.588298175s) [noise=true , address=45.91.116.7:4019 , piece_id=QK25YOV3HUQGIMGM4IGMLDVPLLNUR3KQMHQOIH4GU3PJVFQUPTKQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.857816381 (216h42m21.589084091s) [noise=true , address=104.36.82.58:4276 , piece_id=SMD2BUAUTWDS33QOWM3HQFYHQS5V33BLFRO4RZ2S6TC2GR5YGX3A, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.857978566 (216h42m21.589246216s) [noise=true , address=104.36.82.11:4127 , piece_id=U6JDUSEWROCLEHVG2ZATIVLD2ELN5M6JYUVZREWQWAA7BG3DI6UQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.974500804 (216h42m21.705768454s) [upload=225459]: Next returned nil segment
Aug 17 18:08:40.974518928 (216h42m21.705786568s) [upload=225459]: Waiting for error group managing segments...
Aug 17 18:08:40.987516869 (216h42m21.71878452s) [noise=true , address=104.36.82.11:4127 , piece_id=U6JDUSEWROCLEHVG2ZATIVLD2ELN5M6JYUVZREWQWAA7BG3DI6UQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:40.988549711 (216h42m21.719817331s) [noise=true , address=104.36.82.44:4899 , piece_id=LQQ7J5HK3LTHARNZIULHU3RKYL252NGGHZXIXP3TFVE32KKGXG6A, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.000082720 (216h42m21.73135034s) [noise=true , address=104.36.82.34:4566 , piece_id=TKRYBM75X63T6VDRPYN6ZNT5FEKROIVA5NZAELVPRGAQL6XVXU7Q, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.004638781 (216h42m21.735906401s) [noise=true , address=104.36.82.39:4738 , piece_id=5A6MDJG5PEHXNAEEDBHP6ZMV45KWTBRAK5OIVRUL2SOE4NEJPI5Q, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.004918978 (216h42m21.736186608s) [noise=true , address=104.36.82.58:4276 , piece_id=SMD2BUAUTWDS33QOWM3HQFYHQS5V33BLFRO4RZ2S6TC2GR5YGX3A, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.017616555 (216h42m21.748884185s) [noise=true , address=45.91.116.13:4168 , piece_id=VTT3MS2UIVXODCPZOJXHADVTDHW6S4HUTSEREFN7F6T75GMSRYNA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.026705041 (216h42m21.757972671s) [noise=true , address=104.36.82.60:4363 , piece_id=CIXNGIAGIFAHZUH5V5A6BTRZT4ANYEITZ6XBKJKX4RMZQKURIIMA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.029172177 (216h42m21.760439807s) [noise=true , address=45.91.116.7:4019 , piece_id=QK25YOV3HUQGIMGM4IGMLDVPLLNUR3KQMHQOIH4GU3PJVFQUPTKQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.032674628 (216h42m21.763942248s) [noise=true , address=77.90.31.15:4713 , piece_id=IBPJ2XQI6TD5SIGBFJIEDEMMX6WH37P6ECFFUCD5F3MWPQR6HYHQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.049253778 (216h42m21.780521408s) [noise=true , address=104.36.82.17:4336 , piece_id=A7UARNTYXQNF47MOPK7UNWWRZNCHBCMRMIMZQ6D53GVVPH6XZLHA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.049498879 (216h42m21.780766509s) [noise=true , address=104.36.82.35:4614 , piece_id=45LILLUGTP77755UK2BJS7ZQT2KFGCZ4IM2LXXA4NARZLNZQZK5A, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.068541098 (216h42m21.799808718s) [noise=true , address=77.90.31.11:4567 , piece_id=AOYPMJE7T6RDIS2ZV5UIAXF7BS2PHHIPZNGCTX7J2VEQIA5WOUGQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.070945586 (216h42m21.802213216s) [noise=true , address=77.90.31.19:4844 , piece_id=ZSISRMQJ3URFB6YZWSO23SMU7BI2QLEHCHADY4PZFNXIUOT5N2FA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.090207367 (216h42m21.821474997s) [noise=true , address=79.127.201.215:4359 , piece_id=DJVGXMVZA6JI35GVPHBGRMIEDS6OBOOFT74DNVZWUGTUQMKV6WKA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.090233866 (216h42m21.821501487s) [seg_pos={0 0}, upload=225459]: Segment reached optimal threshold of 14 pieces.
Aug 17 18:08:41.090351558 (216h42m21.821619179s) [noise=true , address=77.90.31.10:4529 , piece_id=VZSQBU6PUYIP7XNBN5JQFZ5VI4WXHLSQUCGQNDRRRGU6TETCGQBQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm): protocol: expected piece hash; context canceled; EOF
Aug 17 18:08:41.090444122 (216h42m21.821711752s) [noise=true , address=104.36.82.51:4077 , piece_id=DHAWXMJWOMEV57K5W4WCMFDRHW4L32OSSRN2VA2O4S4BLB4ULMKQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Njt39WE2REJivSU8fuzUReFN1n6BbRH78kJWaurrMK3Xh6PpS): protocol: expected piece hash; context canceled; EOF
Aug 17 18:08:41.090452788 (216h42m21.821720418s) [noise=true , address=45.91.116.8:4059 , piece_id=DEDZA2DR33EK3URR27H6DKURMDDTWT65SCS3UGECCWM5BKVD4QHQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YzYcwyVJqZywPJt9tYXXHMrjfjeziu6fobhHjt6sRf3utaror): protocol: expected piece hash; context canceled; EOF
Aug 17 18:08:41.090529141 (216h42m21.821796771s) [noise=true , address=104.36.82.18:4368 , piece_id=L5ZIXJFLLUXJLSLTMURQOOFYGRKGW3BD3XNF3MK362FTZYU2ICVQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ByhoW6Effjs8acfsvdF1xzDwBVqggsBK53oRZ8bYhEYYPChKz): protocol: write tcp 5.161.89.252:13580->104.36.82.18:4368: use of closed network connection; write tcp 5.161.89.252:13580->104.36.82.18:4368: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:13580->104.36.82.18:4368: use of closed network connection
Aug 17 18:08:41.090549199 (216h42m21.82181686s) [seg_pos={0 0}, upload=225459]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 18:08:41.090665598 (216h42m21.821933279s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 18:08:41.090672481 (216h42m21.821940102s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 18:08:41.259395157 (216h42m21.990662806s) [upload=225459]: Done uploading segments...
Aug 17 18:08:41.259414002 (216h42m21.990681662s) [upload=225459]: Upload finished. err: <nil>
Duration: 1.195969334s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................X...............................X..........] duration:
606.522466ms
FAIL (2025-08-17 18:39:46 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 18:33:16.400923957 (217h6m57.132191577s) [upload=225900]: Starting upload Aug 17 18:33:16.400969883 (217h6m57.132237513s) [upload=225900]: Done starting upload Aug 17 18:33:16.401014718 (217h6m57.132282338s) [upload=225900]: Uploading segments... Aug 17 18:33:16.401046027 (217h6m57.132313647s) [upload=225900]: Got next segment. Inline: true Aug 17 18:33:16.401050014 (217h6m57.132317645s) [upload=225900]: Waiting for error group managing segments... Aug 17 18:33:16.401081874 (217h6m57.132349504s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:33:16.401085992 (217h6m57.132353622s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 18:33:16.401088517 (217h6m57.132356147s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 18:33:16.418323930 (217h6m57.149591591s) [upload=225900]: Done uploading segments... Aug 17 18:33:16.418334601 (217h6m57.149602231s) [upload=225900]: Upload finished. err: metaclient: Too Many Requests
Duration: 606.547452ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
470.511903ms
FAIL (2025-08-17 18:38:49 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 17 18:08:40.777064912 (216h42m21.508332542s) [upload=225459]: Starting upload
Aug 17 18:08:40.777115086 (216h42m21.508382716s) [upload=225459]: Done starting upload
Aug 17 18:08:40.777269627 (216h42m21.508537287s) [upload=225459]: Uploading segments...
Aug 17 18:08:40.777454013 (216h42m21.508721673s) [upload=225459]: Got next segment. Inline: false
Aug 17 18:08:40.777510961 (216h42m21.508778611s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 18:08:40.777517212 (216h42m21.508784863s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 18:08:40.852095643 (216h42m21.583363283s) [seg_pos={0 0}, upload=225459]: Begin upload segment...
Aug 17 18:08:40.852138052 (216h42m21.583405692s) [seg_pos={0 0}, upload=225459]: Done begin upload segment.
Aug 17 18:08:40.852171765 (216h42m21.583439416s) [noise=true , address=104.36.82.35:4614 , piece_id=45LILLUGTP77755UK2BJS7ZQT2KFGCZ4IM2LXXA4NARZLNZQZK5A, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.852266774 (216h42m21.583534444s) [noise=true , address=104.36.82.51:4077 , piece_id=DHAWXMJWOMEV57K5W4WCMFDRHW4L32OSSRN2VA2O4S4BLB4ULMKQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.852610419 (216h42m21.583878059s) [noise=true , address=104.36.82.17:4336 , piece_id=A7UARNTYXQNF47MOPK7UNWWRZNCHBCMRMIMZQ6D53GVVPH6XZLHA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853024428 (216h42m21.584292077s) [noise=true , address=77.90.31.11:4567 , piece_id=AOYPMJE7T6RDIS2ZV5UIAXF7BS2PHHIPZNGCTX7J2VEQIA5WOUGQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853326185 (216h42m21.584593844s) [noise=true , address=45.91.116.13:4168 , piece_id=VTT3MS2UIVXODCPZOJXHADVTDHW6S4HUTSEREFN7F6T75GMSRYNA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853425190 (216h42m21.584692841s) [noise=true , address=104.36.82.44:4899 , piece_id=LQQ7J5HK3LTHARNZIULHU3RKYL252NGGHZXIXP3TFVE32KKGXG6A, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853793371 (216h42m21.585061022s) [noise=true , address=104.36.82.39:4738 , piece_id=5A6MDJG5PEHXNAEEDBHP6ZMV45KWTBRAK5OIVRUL2SOE4NEJPI5Q, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854181972 (216h42m21.585449623s) [noise=true , address=77.90.31.19:4844 , piece_id=ZSISRMQJ3URFB6YZWSO23SMU7BI2QLEHCHADY4PZFNXIUOT5N2FA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854317537 (216h42m21.585585197s) [noise=true , address=77.90.31.15:4713 , piece_id=IBPJ2XQI6TD5SIGBFJIEDEMMX6WH37P6ECFFUCD5F3MWPQR6HYHQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854538112 (216h42m21.585805761s) [noise=true , address=104.36.82.60:4363 , piece_id=CIXNGIAGIFAHZUH5V5A6BTRZT4ANYEITZ6XBKJKX4RMZQKURIIMA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854888400 (216h42m21.586156049s) [noise=true , address=104.36.82.18:4368 , piece_id=L5ZIXJFLLUXJLSLTMURQOOFYGRKGW3BD3XNF3MK362FTZYU2ICVQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.855236013 (216h42m21.586503662s) [noise=true , address=104.36.82.34:4566 , piece_id=TKRYBM75X63T6VDRPYN6ZNT5FEKROIVA5NZAELVPRGAQL6XVXU7Q, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.855379192 (216h42m21.586646842s) [noise=true , address=45.91.116.8:4059 , piece_id=DEDZA2DR33EK3URR27H6DKURMDDTWT65SCS3UGECCWM5BKVD4QHQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.855570652 (216h42m21.586838302s) [noise=true , address=77.90.31.10:4529 , piece_id=VZSQBU6PUYIP7XNBN5JQFZ5VI4WXHLSQUCGQNDRRRGU6TETCGQBQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.856194745 (216h42m21.587462415s) [noise=true , address=79.127.201.215:4359 , piece_id=DJVGXMVZA6JI35GVPHBGRMIEDS6OBOOFT74DNVZWUGTUQMKV6WKA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.857030525 (216h42m21.588298175s) [noise=true , address=45.91.116.7:4019 , piece_id=QK25YOV3HUQGIMGM4IGMLDVPLLNUR3KQMHQOIH4GU3PJVFQUPTKQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.857816381 (216h42m21.589084091s) [noise=true , address=104.36.82.58:4276 , piece_id=SMD2BUAUTWDS33QOWM3HQFYHQS5V33BLFRO4RZ2S6TC2GR5YGX3A, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.857978566 (216h42m21.589246216s) [noise=true , address=104.36.82.11:4127 , piece_id=U6JDUSEWROCLEHVG2ZATIVLD2ELN5M6JYUVZREWQWAA7BG3DI6UQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.974500804 (216h42m21.705768454s) [upload=225459]: Next returned nil segment
Aug 17 18:08:40.974518928 (216h42m21.705786568s) [upload=225459]: Waiting for error group managing segments...
Aug 17 18:08:40.987516869 (216h42m21.71878452s) [noise=true , address=104.36.82.11:4127 , piece_id=U6JDUSEWROCLEHVG2ZATIVLD2ELN5M6JYUVZREWQWAA7BG3DI6UQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:40.988549711 (216h42m21.719817331s) [noise=true , address=104.36.82.44:4899 , piece_id=LQQ7J5HK3LTHARNZIULHU3RKYL252NGGHZXIXP3TFVE32KKGXG6A, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.000082720 (216h42m21.73135034s) [noise=true , address=104.36.82.34:4566 , piece_id=TKRYBM75X63T6VDRPYN6ZNT5FEKROIVA5NZAELVPRGAQL6XVXU7Q, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.004638781 (216h42m21.735906401s) [noise=true , address=104.36.82.39:4738 , piece_id=5A6MDJG5PEHXNAEEDBHP6ZMV45KWTBRAK5OIVRUL2SOE4NEJPI5Q, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.004918978 (216h42m21.736186608s) [noise=true , address=104.36.82.58:4276 , piece_id=SMD2BUAUTWDS33QOWM3HQFYHQS5V33BLFRO4RZ2S6TC2GR5YGX3A, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.017616555 (216h42m21.748884185s) [noise=true , address=45.91.116.13:4168 , piece_id=VTT3MS2UIVXODCPZOJXHADVTDHW6S4HUTSEREFN7F6T75GMSRYNA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.026705041 (216h42m21.757972671s) [noise=true , address=104.36.82.60:4363 , piece_id=CIXNGIAGIFAHZUH5V5A6BTRZT4ANYEITZ6XBKJKX4RMZQKURIIMA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.029172177 (216h42m21.760439807s) [noise=true , address=45.91.116.7:4019 , piece_id=QK25YOV3HUQGIMGM4IGMLDVPLLNUR3KQMHQOIH4GU3PJVFQUPTKQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.032674628 (216h42m21.763942248s) [noise=true , address=77.90.31.15:4713 , piece_id=IBPJ2XQI6TD5SIGBFJIEDEMMX6WH37P6ECFFUCD5F3MWPQR6HYHQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.049253778 (216h42m21.780521408s) [noise=true , address=104.36.82.17:4336 , piece_id=A7UARNTYXQNF47MOPK7UNWWRZNCHBCMRMIMZQ6D53GVVPH6XZLHA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.049498879 (216h42m21.780766509s) [noise=true , address=104.36.82.35:4614 , piece_id=45LILLUGTP77755UK2BJS7ZQT2KFGCZ4IM2LXXA4NARZLNZQZK5A, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.068541098 (216h42m21.799808718s) [noise=true , address=77.90.31.11:4567 , piece_id=AOYPMJE7T6RDIS2ZV5UIAXF7BS2PHHIPZNGCTX7J2VEQIA5WOUGQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.070945586 (216h42m21.802213216s) [noise=true , address=77.90.31.19:4844 , piece_id=ZSISRMQJ3URFB6YZWSO23SMU7BI2QLEHCHADY4PZFNXIUOT5N2FA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.090207367 (216h42m21.821474997s) [noise=true , address=79.127.201.215:4359 , piece_id=DJVGXMVZA6JI35GVPHBGRMIEDS6OBOOFT74DNVZWUGTUQMKV6WKA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.090233866 (216h42m21.821501487s) [seg_pos={0 0}, upload=225459]: Segment reached optimal threshold of 14 pieces.
Aug 17 18:08:41.090351558 (216h42m21.821619179s) [noise=true , address=77.90.31.10:4529 , piece_id=VZSQBU6PUYIP7XNBN5JQFZ5VI4WXHLSQUCGQNDRRRGU6TETCGQBQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm): protocol: expected piece hash; context canceled; EOF
Aug 17 18:08:41.090444122 (216h42m21.821711752s) [noise=true , address=104.36.82.51:4077 , piece_id=DHAWXMJWOMEV57K5W4WCMFDRHW4L32OSSRN2VA2O4S4BLB4ULMKQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Njt39WE2REJivSU8fuzUReFN1n6BbRH78kJWaurrMK3Xh6PpS): protocol: expected piece hash; context canceled; EOF
Aug 17 18:08:41.090452788 (216h42m21.821720418s) [noise=true , address=45.91.116.8:4059 , piece_id=DEDZA2DR33EK3URR27H6DKURMDDTWT65SCS3UGECCWM5BKVD4QHQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YzYcwyVJqZywPJt9tYXXHMrjfjeziu6fobhHjt6sRf3utaror): protocol: expected piece hash; context canceled; EOF
Aug 17 18:08:41.090529141 (216h42m21.821796771s) [noise=true , address=104.36.82.18:4368 , piece_id=L5ZIXJFLLUXJLSLTMURQOOFYGRKGW3BD3XNF3MK362FTZYU2ICVQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ByhoW6Effjs8acfsvdF1xzDwBVqggsBK53oRZ8bYhEYYPChKz): protocol: write tcp 5.161.89.252:13580->104.36.82.18:4368: use of closed network connection; write tcp 5.161.89.252:13580->104.36.82.18:4368: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:13580->104.36.82.18:4368: use of closed network connection
Aug 17 18:08:41.090549199 (216h42m21.82181686s) [seg_pos={0 0}, upload=225459]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 18:08:41.090665598 (216h42m21.821933279s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 18:08:41.090672481 (216h42m21.821940102s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 18:08:41.259395157 (216h42m21.990662806s) [upload=225459]: Done uploading segments...
Aug 17 18:08:41.259414002 (216h42m21.990681662s) [upload=225459]: Upload finished. err: <nil>
Duration: 470.542923ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................X...............................X.........] duration:
168.324725ms
FAIL (2025-08-17 18:38:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 18:33:16.400923957 (217h6m57.132191577s) [upload=225900]: Starting upload Aug 17 18:33:16.400969883 (217h6m57.132237513s) [upload=225900]: Done starting upload Aug 17 18:33:16.401014718 (217h6m57.132282338s) [upload=225900]: Uploading segments... Aug 17 18:33:16.401046027 (217h6m57.132313647s) [upload=225900]: Got next segment. Inline: true Aug 17 18:33:16.401050014 (217h6m57.132317645s) [upload=225900]: Waiting for error group managing segments... Aug 17 18:33:16.401081874 (217h6m57.132349504s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:33:16.401085992 (217h6m57.132353622s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 18:33:16.401088517 (217h6m57.132356147s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 18:33:16.418323930 (217h6m57.149591591s) [upload=225900]: Done uploading segments... Aug 17 18:33:16.418334601 (217h6m57.149602231s) [upload=225900]: Upload finished. err: metaclient: Too Many Requests
Duration: 168.342779ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
474.314119ms
FAIL (2025-08-17 18:38:23 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 17 18:08:40.777064912 (216h42m21.508332542s) [upload=225459]: Starting upload
Aug 17 18:08:40.777115086 (216h42m21.508382716s) [upload=225459]: Done starting upload
Aug 17 18:08:40.777269627 (216h42m21.508537287s) [upload=225459]: Uploading segments...
Aug 17 18:08:40.777454013 (216h42m21.508721673s) [upload=225459]: Got next segment. Inline: false
Aug 17 18:08:40.777510961 (216h42m21.508778611s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 18:08:40.777517212 (216h42m21.508784863s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 18:08:40.852095643 (216h42m21.583363283s) [seg_pos={0 0}, upload=225459]: Begin upload segment...
Aug 17 18:08:40.852138052 (216h42m21.583405692s) [seg_pos={0 0}, upload=225459]: Done begin upload segment.
Aug 17 18:08:40.852171765 (216h42m21.583439416s) [noise=true , address=104.36.82.35:4614 , piece_id=45LILLUGTP77755UK2BJS7ZQT2KFGCZ4IM2LXXA4NARZLNZQZK5A, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.852266774 (216h42m21.583534444s) [noise=true , address=104.36.82.51:4077 , piece_id=DHAWXMJWOMEV57K5W4WCMFDRHW4L32OSSRN2VA2O4S4BLB4ULMKQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.852610419 (216h42m21.583878059s) [noise=true , address=104.36.82.17:4336 , piece_id=A7UARNTYXQNF47MOPK7UNWWRZNCHBCMRMIMZQ6D53GVVPH6XZLHA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853024428 (216h42m21.584292077s) [noise=true , address=77.90.31.11:4567 , piece_id=AOYPMJE7T6RDIS2ZV5UIAXF7BS2PHHIPZNGCTX7J2VEQIA5WOUGQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853326185 (216h42m21.584593844s) [noise=true , address=45.91.116.13:4168 , piece_id=VTT3MS2UIVXODCPZOJXHADVTDHW6S4HUTSEREFN7F6T75GMSRYNA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853425190 (216h42m21.584692841s) [noise=true , address=104.36.82.44:4899 , piece_id=LQQ7J5HK3LTHARNZIULHU3RKYL252NGGHZXIXP3TFVE32KKGXG6A, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853793371 (216h42m21.585061022s) [noise=true , address=104.36.82.39:4738 , piece_id=5A6MDJG5PEHXNAEEDBHP6ZMV45KWTBRAK5OIVRUL2SOE4NEJPI5Q, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854181972 (216h42m21.585449623s) [noise=true , address=77.90.31.19:4844 , piece_id=ZSISRMQJ3URFB6YZWSO23SMU7BI2QLEHCHADY4PZFNXIUOT5N2FA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854317537 (216h42m21.585585197s) [noise=true , address=77.90.31.15:4713 , piece_id=IBPJ2XQI6TD5SIGBFJIEDEMMX6WH37P6ECFFUCD5F3MWPQR6HYHQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854538112 (216h42m21.585805761s) [noise=true , address=104.36.82.60:4363 , piece_id=CIXNGIAGIFAHZUH5V5A6BTRZT4ANYEITZ6XBKJKX4RMZQKURIIMA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854888400 (216h42m21.586156049s) [noise=true , address=104.36.82.18:4368 , piece_id=L5ZIXJFLLUXJLSLTMURQOOFYGRKGW3BD3XNF3MK362FTZYU2ICVQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.855236013 (216h42m21.586503662s) [noise=true , address=104.36.82.34:4566 , piece_id=TKRYBM75X63T6VDRPYN6ZNT5FEKROIVA5NZAELVPRGAQL6XVXU7Q, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.855379192 (216h42m21.586646842s) [noise=true , address=45.91.116.8:4059 , piece_id=DEDZA2DR33EK3URR27H6DKURMDDTWT65SCS3UGECCWM5BKVD4QHQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.855570652 (216h42m21.586838302s) [noise=true , address=77.90.31.10:4529 , piece_id=VZSQBU6PUYIP7XNBN5JQFZ5VI4WXHLSQUCGQNDRRRGU6TETCGQBQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.856194745 (216h42m21.587462415s) [noise=true , address=79.127.201.215:4359 , piece_id=DJVGXMVZA6JI35GVPHBGRMIEDS6OBOOFT74DNVZWUGTUQMKV6WKA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.857030525 (216h42m21.588298175s) [noise=true , address=45.91.116.7:4019 , piece_id=QK25YOV3HUQGIMGM4IGMLDVPLLNUR3KQMHQOIH4GU3PJVFQUPTKQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.857816381 (216h42m21.589084091s) [noise=true , address=104.36.82.58:4276 , piece_id=SMD2BUAUTWDS33QOWM3HQFYHQS5V33BLFRO4RZ2S6TC2GR5YGX3A, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.857978566 (216h42m21.589246216s) [noise=true , address=104.36.82.11:4127 , piece_id=U6JDUSEWROCLEHVG2ZATIVLD2ELN5M6JYUVZREWQWAA7BG3DI6UQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.974500804 (216h42m21.705768454s) [upload=225459]: Next returned nil segment
Aug 17 18:08:40.974518928 (216h42m21.705786568s) [upload=225459]: Waiting for error group managing segments...
Aug 17 18:08:40.987516869 (216h42m21.71878452s) [noise=true , address=104.36.82.11:4127 , piece_id=U6JDUSEWROCLEHVG2ZATIVLD2ELN5M6JYUVZREWQWAA7BG3DI6UQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:40.988549711 (216h42m21.719817331s) [noise=true , address=104.36.82.44:4899 , piece_id=LQQ7J5HK3LTHARNZIULHU3RKYL252NGGHZXIXP3TFVE32KKGXG6A, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.000082720 (216h42m21.73135034s) [noise=true , address=104.36.82.34:4566 , piece_id=TKRYBM75X63T6VDRPYN6ZNT5FEKROIVA5NZAELVPRGAQL6XVXU7Q, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.004638781 (216h42m21.735906401s) [noise=true , address=104.36.82.39:4738 , piece_id=5A6MDJG5PEHXNAEEDBHP6ZMV45KWTBRAK5OIVRUL2SOE4NEJPI5Q, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.004918978 (216h42m21.736186608s) [noise=true , address=104.36.82.58:4276 , piece_id=SMD2BUAUTWDS33QOWM3HQFYHQS5V33BLFRO4RZ2S6TC2GR5YGX3A, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.017616555 (216h42m21.748884185s) [noise=true , address=45.91.116.13:4168 , piece_id=VTT3MS2UIVXODCPZOJXHADVTDHW6S4HUTSEREFN7F6T75GMSRYNA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.026705041 (216h42m21.757972671s) [noise=true , address=104.36.82.60:4363 , piece_id=CIXNGIAGIFAHZUH5V5A6BTRZT4ANYEITZ6XBKJKX4RMZQKURIIMA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.029172177 (216h42m21.760439807s) [noise=true , address=45.91.116.7:4019 , piece_id=QK25YOV3HUQGIMGM4IGMLDVPLLNUR3KQMHQOIH4GU3PJVFQUPTKQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.032674628 (216h42m21.763942248s) [noise=true , address=77.90.31.15:4713 , piece_id=IBPJ2XQI6TD5SIGBFJIEDEMMX6WH37P6ECFFUCD5F3MWPQR6HYHQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.049253778 (216h42m21.780521408s) [noise=true , address=104.36.82.17:4336 , piece_id=A7UARNTYXQNF47MOPK7UNWWRZNCHBCMRMIMZQ6D53GVVPH6XZLHA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.049498879 (216h42m21.780766509s) [noise=true , address=104.36.82.35:4614 , piece_id=45LILLUGTP77755UK2BJS7ZQT2KFGCZ4IM2LXXA4NARZLNZQZK5A, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.068541098 (216h42m21.799808718s) [noise=true , address=77.90.31.11:4567 , piece_id=AOYPMJE7T6RDIS2ZV5UIAXF7BS2PHHIPZNGCTX7J2VEQIA5WOUGQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.070945586 (216h42m21.802213216s) [noise=true , address=77.90.31.19:4844 , piece_id=ZSISRMQJ3URFB6YZWSO23SMU7BI2QLEHCHADY4PZFNXIUOT5N2FA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.090207367 (216h42m21.821474997s) [noise=true , address=79.127.201.215:4359 , piece_id=DJVGXMVZA6JI35GVPHBGRMIEDS6OBOOFT74DNVZWUGTUQMKV6WKA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.090233866 (216h42m21.821501487s) [seg_pos={0 0}, upload=225459]: Segment reached optimal threshold of 14 pieces.
Aug 17 18:08:41.090351558 (216h42m21.821619179s) [noise=true , address=77.90.31.10:4529 , piece_id=VZSQBU6PUYIP7XNBN5JQFZ5VI4WXHLSQUCGQNDRRRGU6TETCGQBQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm): protocol: expected piece hash; context canceled; EOF
Aug 17 18:08:41.090444122 (216h42m21.821711752s) [noise=true , address=104.36.82.51:4077 , piece_id=DHAWXMJWOMEV57K5W4WCMFDRHW4L32OSSRN2VA2O4S4BLB4ULMKQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Njt39WE2REJivSU8fuzUReFN1n6BbRH78kJWaurrMK3Xh6PpS): protocol: expected piece hash; context canceled; EOF
Aug 17 18:08:41.090452788 (216h42m21.821720418s) [noise=true , address=45.91.116.8:4059 , piece_id=DEDZA2DR33EK3URR27H6DKURMDDTWT65SCS3UGECCWM5BKVD4QHQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YzYcwyVJqZywPJt9tYXXHMrjfjeziu6fobhHjt6sRf3utaror): protocol: expected piece hash; context canceled; EOF
Aug 17 18:08:41.090529141 (216h42m21.821796771s) [noise=true , address=104.36.82.18:4368 , piece_id=L5ZIXJFLLUXJLSLTMURQOOFYGRKGW3BD3XNF3MK362FTZYU2ICVQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ByhoW6Effjs8acfsvdF1xzDwBVqggsBK53oRZ8bYhEYYPChKz): protocol: write tcp 5.161.89.252:13580->104.36.82.18:4368: use of closed network connection; write tcp 5.161.89.252:13580->104.36.82.18:4368: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:13580->104.36.82.18:4368: use of closed network connection
Aug 17 18:08:41.090549199 (216h42m21.82181686s) [seg_pos={0 0}, upload=225459]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 18:08:41.090665598 (216h42m21.821933279s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 18:08:41.090672481 (216h42m21.821940102s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 18:08:41.259395157 (216h42m21.990662806s) [upload=225459]: Done uploading segments...
Aug 17 18:08:41.259414002 (216h42m21.990681662s) [upload=225459]: Upload finished. err: <nil>
Duration: 474.333064ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
588.292018ms
FAIL (2025-08-17 18:38:01 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 17 18:08:40.777064912 (216h42m21.508332542s) [upload=225459]: Starting upload
Aug 17 18:08:40.777115086 (216h42m21.508382716s) [upload=225459]: Done starting upload
Aug 17 18:08:40.777269627 (216h42m21.508537287s) [upload=225459]: Uploading segments...
Aug 17 18:08:40.777454013 (216h42m21.508721673s) [upload=225459]: Got next segment. Inline: false
Aug 17 18:08:40.777510961 (216h42m21.508778611s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 18:08:40.777517212 (216h42m21.508784863s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 18:08:40.852095643 (216h42m21.583363283s) [seg_pos={0 0}, upload=225459]: Begin upload segment...
Aug 17 18:08:40.852138052 (216h42m21.583405692s) [seg_pos={0 0}, upload=225459]: Done begin upload segment.
Aug 17 18:08:40.852171765 (216h42m21.583439416s) [noise=true , address=104.36.82.35:4614 , piece_id=45LILLUGTP77755UK2BJS7ZQT2KFGCZ4IM2LXXA4NARZLNZQZK5A, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.852266774 (216h42m21.583534444s) [noise=true , address=104.36.82.51:4077 , piece_id=DHAWXMJWOMEV57K5W4WCMFDRHW4L32OSSRN2VA2O4S4BLB4ULMKQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.852610419 (216h42m21.583878059s) [noise=true , address=104.36.82.17:4336 , piece_id=A7UARNTYXQNF47MOPK7UNWWRZNCHBCMRMIMZQ6D53GVVPH6XZLHA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853024428 (216h42m21.584292077s) [noise=true , address=77.90.31.11:4567 , piece_id=AOYPMJE7T6RDIS2ZV5UIAXF7BS2PHHIPZNGCTX7J2VEQIA5WOUGQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853326185 (216h42m21.584593844s) [noise=true , address=45.91.116.13:4168 , piece_id=VTT3MS2UIVXODCPZOJXHADVTDHW6S4HUTSEREFN7F6T75GMSRYNA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853425190 (216h42m21.584692841s) [noise=true , address=104.36.82.44:4899 , piece_id=LQQ7J5HK3LTHARNZIULHU3RKYL252NGGHZXIXP3TFVE32KKGXG6A, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853793371 (216h42m21.585061022s) [noise=true , address=104.36.82.39:4738 , piece_id=5A6MDJG5PEHXNAEEDBHP6ZMV45KWTBRAK5OIVRUL2SOE4NEJPI5Q, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854181972 (216h42m21.585449623s) [noise=true , address=77.90.31.19:4844 , piece_id=ZSISRMQJ3URFB6YZWSO23SMU7BI2QLEHCHADY4PZFNXIUOT5N2FA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854317537 (216h42m21.585585197s) [noise=true , address=77.90.31.15:4713 , piece_id=IBPJ2XQI6TD5SIGBFJIEDEMMX6WH37P6ECFFUCD5F3MWPQR6HYHQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854538112 (216h42m21.585805761s) [noise=true , address=104.36.82.60:4363 , piece_id=CIXNGIAGIFAHZUH5V5A6BTRZT4ANYEITZ6XBKJKX4RMZQKURIIMA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854888400 (216h42m21.586156049s) [noise=true , address=104.36.82.18:4368 , piece_id=L5ZIXJFLLUXJLSLTMURQOOFYGRKGW3BD3XNF3MK362FTZYU2ICVQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.855236013 (216h42m21.586503662s) [noise=true , address=104.36.82.34:4566 , piece_id=TKRYBM75X63T6VDRPYN6ZNT5FEKROIVA5NZAELVPRGAQL6XVXU7Q, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.855379192 (216h42m21.586646842s) [noise=true , address=45.91.116.8:4059 , piece_id=DEDZA2DR33EK3URR27H6DKURMDDTWT65SCS3UGECCWM5BKVD4QHQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.855570652 (216h42m21.586838302s) [noise=true , address=77.90.31.10:4529 , piece_id=VZSQBU6PUYIP7XNBN5JQFZ5VI4WXHLSQUCGQNDRRRGU6TETCGQBQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.856194745 (216h42m21.587462415s) [noise=true , address=79.127.201.215:4359 , piece_id=DJVGXMVZA6JI35GVPHBGRMIEDS6OBOOFT74DNVZWUGTUQMKV6WKA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.857030525 (216h42m21.588298175s) [noise=true , address=45.91.116.7:4019 , piece_id=QK25YOV3HUQGIMGM4IGMLDVPLLNUR3KQMHQOIH4GU3PJVFQUPTKQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.857816381 (216h42m21.589084091s) [noise=true , address=104.36.82.58:4276 , piece_id=SMD2BUAUTWDS33QOWM3HQFYHQS5V33BLFRO4RZ2S6TC2GR5YGX3A, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.857978566 (216h42m21.589246216s) [noise=true , address=104.36.82.11:4127 , piece_id=U6JDUSEWROCLEHVG2ZATIVLD2ELN5M6JYUVZREWQWAA7BG3DI6UQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.974500804 (216h42m21.705768454s) [upload=225459]: Next returned nil segment
Aug 17 18:08:40.974518928 (216h42m21.705786568s) [upload=225459]: Waiting for error group managing segments...
Aug 17 18:08:40.987516869 (216h42m21.71878452s) [noise=true , address=104.36.82.11:4127 , piece_id=U6JDUSEWROCLEHVG2ZATIVLD2ELN5M6JYUVZREWQWAA7BG3DI6UQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:40.988549711 (216h42m21.719817331s) [noise=true , address=104.36.82.44:4899 , piece_id=LQQ7J5HK3LTHARNZIULHU3RKYL252NGGHZXIXP3TFVE32KKGXG6A, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.000082720 (216h42m21.73135034s) [noise=true , address=104.36.82.34:4566 , piece_id=TKRYBM75X63T6VDRPYN6ZNT5FEKROIVA5NZAELVPRGAQL6XVXU7Q, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.004638781 (216h42m21.735906401s) [noise=true , address=104.36.82.39:4738 , piece_id=5A6MDJG5PEHXNAEEDBHP6ZMV45KWTBRAK5OIVRUL2SOE4NEJPI5Q, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.004918978 (216h42m21.736186608s) [noise=true , address=104.36.82.58:4276 , piece_id=SMD2BUAUTWDS33QOWM3HQFYHQS5V33BLFRO4RZ2S6TC2GR5YGX3A, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.017616555 (216h42m21.748884185s) [noise=true , address=45.91.116.13:4168 , piece_id=VTT3MS2UIVXODCPZOJXHADVTDHW6S4HUTSEREFN7F6T75GMSRYNA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.026705041 (216h42m21.757972671s) [noise=true , address=104.36.82.60:4363 , piece_id=CIXNGIAGIFAHZUH5V5A6BTRZT4ANYEITZ6XBKJKX4RMZQKURIIMA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.029172177 (216h42m21.760439807s) [noise=true , address=45.91.116.7:4019 , piece_id=QK25YOV3HUQGIMGM4IGMLDVPLLNUR3KQMHQOIH4GU3PJVFQUPTKQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.032674628 (216h42m21.763942248s) [noise=true , address=77.90.31.15:4713 , piece_id=IBPJ2XQI6TD5SIGBFJIEDEMMX6WH37P6ECFFUCD5F3MWPQR6HYHQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.049253778 (216h42m21.780521408s) [noise=true , address=104.36.82.17:4336 , piece_id=A7UARNTYXQNF47MOPK7UNWWRZNCHBCMRMIMZQ6D53GVVPH6XZLHA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.049498879 (216h42m21.780766509s) [noise=true , address=104.36.82.35:4614 , piece_id=45LILLUGTP77755UK2BJS7ZQT2KFGCZ4IM2LXXA4NARZLNZQZK5A, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.068541098 (216h42m21.799808718s) [noise=true , address=77.90.31.11:4567 , piece_id=AOYPMJE7T6RDIS2ZV5UIAXF7BS2PHHIPZNGCTX7J2VEQIA5WOUGQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.070945586 (216h42m21.802213216s) [noise=true , address=77.90.31.19:4844 , piece_id=ZSISRMQJ3URFB6YZWSO23SMU7BI2QLEHCHADY4PZFNXIUOT5N2FA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.090207367 (216h42m21.821474997s) [noise=true , address=79.127.201.215:4359 , piece_id=DJVGXMVZA6JI35GVPHBGRMIEDS6OBOOFT74DNVZWUGTUQMKV6WKA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.090233866 (216h42m21.821501487s) [seg_pos={0 0}, upload=225459]: Segment reached optimal threshold of 14 pieces.
Aug 17 18:08:41.090351558 (216h42m21.821619179s) [noise=true , address=77.90.31.10:4529 , piece_id=VZSQBU6PUYIP7XNBN5JQFZ5VI4WXHLSQUCGQNDRRRGU6TETCGQBQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm): protocol: expected piece hash; context canceled; EOF
Aug 17 18:08:41.090444122 (216h42m21.821711752s) [noise=true , address=104.36.82.51:4077 , piece_id=DHAWXMJWOMEV57K5W4WCMFDRHW4L32OSSRN2VA2O4S4BLB4ULMKQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Njt39WE2REJivSU8fuzUReFN1n6BbRH78kJWaurrMK3Xh6PpS): protocol: expected piece hash; context canceled; EOF
Aug 17 18:08:41.090452788 (216h42m21.821720418s) [noise=true , address=45.91.116.8:4059 , piece_id=DEDZA2DR33EK3URR27H6DKURMDDTWT65SCS3UGECCWM5BKVD4QHQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YzYcwyVJqZywPJt9tYXXHMrjfjeziu6fobhHjt6sRf3utaror): protocol: expected piece hash; context canceled; EOF
Aug 17 18:08:41.090529141 (216h42m21.821796771s) [noise=true , address=104.36.82.18:4368 , piece_id=L5ZIXJFLLUXJLSLTMURQOOFYGRKGW3BD3XNF3MK362FTZYU2ICVQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ByhoW6Effjs8acfsvdF1xzDwBVqggsBK53oRZ8bYhEYYPChKz): protocol: write tcp 5.161.89.252:13580->104.36.82.18:4368: use of closed network connection; write tcp 5.161.89.252:13580->104.36.82.18:4368: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:13580->104.36.82.18:4368: use of closed network connection
Aug 17 18:08:41.090549199 (216h42m21.82181686s) [seg_pos={0 0}, upload=225459]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 18:08:41.090665598 (216h42m21.821933279s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 18:08:41.090672481 (216h42m21.821940102s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 18:08:41.259395157 (216h42m21.990662806s) [upload=225459]: Done uploading segments...
Aug 17 18:08:41.259414002 (216h42m21.990681662s) [upload=225459]: Upload finished. err: <nil>
Duration: 588.316784ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...................X...............................X........] duration:
198.861326ms
FAIL (2025-08-17 18:37:31 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 18:33:16.400923957 (217h6m57.132191577s) [upload=225900]: Starting upload Aug 17 18:33:16.400969883 (217h6m57.132237513s) [upload=225900]: Done starting upload Aug 17 18:33:16.401014718 (217h6m57.132282338s) [upload=225900]: Uploading segments... Aug 17 18:33:16.401046027 (217h6m57.132313647s) [upload=225900]: Got next segment. Inline: true Aug 17 18:33:16.401050014 (217h6m57.132317645s) [upload=225900]: Waiting for error group managing segments... Aug 17 18:33:16.401081874 (217h6m57.132349504s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:33:16.401085992 (217h6m57.132353622s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 18:33:16.401088517 (217h6m57.132356147s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 18:33:16.418323930 (217h6m57.149591591s) [upload=225900]: Done uploading segments... Aug 17 18:33:16.418334601 (217h6m57.149602231s) [upload=225900]: Upload finished. err: metaclient: Too Many Requests
Duration: 198.886273ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
546.097616ms
FAIL (2025-08-17 18:37:11 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 17 18:08:40.777064912 (216h42m21.508332542s) [upload=225459]: Starting upload
Aug 17 18:08:40.777115086 (216h42m21.508382716s) [upload=225459]: Done starting upload
Aug 17 18:08:40.777269627 (216h42m21.508537287s) [upload=225459]: Uploading segments...
Aug 17 18:08:40.777454013 (216h42m21.508721673s) [upload=225459]: Got next segment. Inline: false
Aug 17 18:08:40.777510961 (216h42m21.508778611s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 18:08:40.777517212 (216h42m21.508784863s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 18:08:40.852095643 (216h42m21.583363283s) [seg_pos={0 0}, upload=225459]: Begin upload segment...
Aug 17 18:08:40.852138052 (216h42m21.583405692s) [seg_pos={0 0}, upload=225459]: Done begin upload segment.
Aug 17 18:08:40.852171765 (216h42m21.583439416s) [noise=true , address=104.36.82.35:4614 , piece_id=45LILLUGTP77755UK2BJS7ZQT2KFGCZ4IM2LXXA4NARZLNZQZK5A, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.852266774 (216h42m21.583534444s) [noise=true , address=104.36.82.51:4077 , piece_id=DHAWXMJWOMEV57K5W4WCMFDRHW4L32OSSRN2VA2O4S4BLB4ULMKQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.852610419 (216h42m21.583878059s) [noise=true , address=104.36.82.17:4336 , piece_id=A7UARNTYXQNF47MOPK7UNWWRZNCHBCMRMIMZQ6D53GVVPH6XZLHA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853024428 (216h42m21.584292077s) [noise=true , address=77.90.31.11:4567 , piece_id=AOYPMJE7T6RDIS2ZV5UIAXF7BS2PHHIPZNGCTX7J2VEQIA5WOUGQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853326185 (216h42m21.584593844s) [noise=true , address=45.91.116.13:4168 , piece_id=VTT3MS2UIVXODCPZOJXHADVTDHW6S4HUTSEREFN7F6T75GMSRYNA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853425190 (216h42m21.584692841s) [noise=true , address=104.36.82.44:4899 , piece_id=LQQ7J5HK3LTHARNZIULHU3RKYL252NGGHZXIXP3TFVE32KKGXG6A, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853793371 (216h42m21.585061022s) [noise=true , address=104.36.82.39:4738 , piece_id=5A6MDJG5PEHXNAEEDBHP6ZMV45KWTBRAK5OIVRUL2SOE4NEJPI5Q, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854181972 (216h42m21.585449623s) [noise=true , address=77.90.31.19:4844 , piece_id=ZSISRMQJ3URFB6YZWSO23SMU7BI2QLEHCHADY4PZFNXIUOT5N2FA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854317537 (216h42m21.585585197s) [noise=true , address=77.90.31.15:4713 , piece_id=IBPJ2XQI6TD5SIGBFJIEDEMMX6WH37P6ECFFUCD5F3MWPQR6HYHQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854538112 (216h42m21.585805761s) [noise=true , address=104.36.82.60:4363 , piece_id=CIXNGIAGIFAHZUH5V5A6BTRZT4ANYEITZ6XBKJKX4RMZQKURIIMA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854888400 (216h42m21.586156049s) [noise=true , address=104.36.82.18:4368 , piece_id=L5ZIXJFLLUXJLSLTMURQOOFYGRKGW3BD3XNF3MK362FTZYU2ICVQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.855236013 (216h42m21.586503662s) [noise=true , address=104.36.82.34:4566 , piece_id=TKRYBM75X63T6VDRPYN6ZNT5FEKROIVA5NZAELVPRGAQL6XVXU7Q, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.855379192 (216h42m21.586646842s) [noise=true , address=45.91.116.8:4059 , piece_id=DEDZA2DR33EK3URR27H6DKURMDDTWT65SCS3UGECCWM5BKVD4QHQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.855570652 (216h42m21.586838302s) [noise=true , address=77.90.31.10:4529 , piece_id=VZSQBU6PUYIP7XNBN5JQFZ5VI4WXHLSQUCGQNDRRRGU6TETCGQBQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.856194745 (216h42m21.587462415s) [noise=true , address=79.127.201.215:4359 , piece_id=DJVGXMVZA6JI35GVPHBGRMIEDS6OBOOFT74DNVZWUGTUQMKV6WKA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.857030525 (216h42m21.588298175s) [noise=true , address=45.91.116.7:4019 , piece_id=QK25YOV3HUQGIMGM4IGMLDVPLLNUR3KQMHQOIH4GU3PJVFQUPTKQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.857816381 (216h42m21.589084091s) [noise=true , address=104.36.82.58:4276 , piece_id=SMD2BUAUTWDS33QOWM3HQFYHQS5V33BLFRO4RZ2S6TC2GR5YGX3A, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.857978566 (216h42m21.589246216s) [noise=true , address=104.36.82.11:4127 , piece_id=U6JDUSEWROCLEHVG2ZATIVLD2ELN5M6JYUVZREWQWAA7BG3DI6UQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.974500804 (216h42m21.705768454s) [upload=225459]: Next returned nil segment
Aug 17 18:08:40.974518928 (216h42m21.705786568s) [upload=225459]: Waiting for error group managing segments...
Aug 17 18:08:40.987516869 (216h42m21.71878452s) [noise=true , address=104.36.82.11:4127 , piece_id=U6JDUSEWROCLEHVG2ZATIVLD2ELN5M6JYUVZREWQWAA7BG3DI6UQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:40.988549711 (216h42m21.719817331s) [noise=true , address=104.36.82.44:4899 , piece_id=LQQ7J5HK3LTHARNZIULHU3RKYL252NGGHZXIXP3TFVE32KKGXG6A, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.000082720 (216h42m21.73135034s) [noise=true , address=104.36.82.34:4566 , piece_id=TKRYBM75X63T6VDRPYN6ZNT5FEKROIVA5NZAELVPRGAQL6XVXU7Q, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.004638781 (216h42m21.735906401s) [noise=true , address=104.36.82.39:4738 , piece_id=5A6MDJG5PEHXNAEEDBHP6ZMV45KWTBRAK5OIVRUL2SOE4NEJPI5Q, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.004918978 (216h42m21.736186608s) [noise=true , address=104.36.82.58:4276 , piece_id=SMD2BUAUTWDS33QOWM3HQFYHQS5V33BLFRO4RZ2S6TC2GR5YGX3A, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.017616555 (216h42m21.748884185s) [noise=true , address=45.91.116.13:4168 , piece_id=VTT3MS2UIVXODCPZOJXHADVTDHW6S4HUTSEREFN7F6T75GMSRYNA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.026705041 (216h42m21.757972671s) [noise=true , address=104.36.82.60:4363 , piece_id=CIXNGIAGIFAHZUH5V5A6BTRZT4ANYEITZ6XBKJKX4RMZQKURIIMA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.029172177 (216h42m21.760439807s) [noise=true , address=45.91.116.7:4019 , piece_id=QK25YOV3HUQGIMGM4IGMLDVPLLNUR3KQMHQOIH4GU3PJVFQUPTKQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.032674628 (216h42m21.763942248s) [noise=true , address=77.90.31.15:4713 , piece_id=IBPJ2XQI6TD5SIGBFJIEDEMMX6WH37P6ECFFUCD5F3MWPQR6HYHQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.049253778 (216h42m21.780521408s) [noise=true , address=104.36.82.17:4336 , piece_id=A7UARNTYXQNF47MOPK7UNWWRZNCHBCMRMIMZQ6D53GVVPH6XZLHA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.049498879 (216h42m21.780766509s) [noise=true , address=104.36.82.35:4614 , piece_id=45LILLUGTP77755UK2BJS7ZQT2KFGCZ4IM2LXXA4NARZLNZQZK5A, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.068541098 (216h42m21.799808718s) [noise=true , address=77.90.31.11:4567 , piece_id=AOYPMJE7T6RDIS2ZV5UIAXF7BS2PHHIPZNGCTX7J2VEQIA5WOUGQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.070945586 (216h42m21.802213216s) [noise=true , address=77.90.31.19:4844 , piece_id=ZSISRMQJ3URFB6YZWSO23SMU7BI2QLEHCHADY4PZFNXIUOT5N2FA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.090207367 (216h42m21.821474997s) [noise=true , address=79.127.201.215:4359 , piece_id=DJVGXMVZA6JI35GVPHBGRMIEDS6OBOOFT74DNVZWUGTUQMKV6WKA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.090233866 (216h42m21.821501487s) [seg_pos={0 0}, upload=225459]: Segment reached optimal threshold of 14 pieces.
Aug 17 18:08:41.090351558 (216h42m21.821619179s) [noise=true , address=77.90.31.10:4529 , piece_id=VZSQBU6PUYIP7XNBN5JQFZ5VI4WXHLSQUCGQNDRRRGU6TETCGQBQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm): protocol: expected piece hash; context canceled; EOF
Aug 17 18:08:41.090444122 (216h42m21.821711752s) [noise=true , address=104.36.82.51:4077 , piece_id=DHAWXMJWOMEV57K5W4WCMFDRHW4L32OSSRN2VA2O4S4BLB4ULMKQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Njt39WE2REJivSU8fuzUReFN1n6BbRH78kJWaurrMK3Xh6PpS): protocol: expected piece hash; context canceled; EOF
Aug 17 18:08:41.090452788 (216h42m21.821720418s) [noise=true , address=45.91.116.8:4059 , piece_id=DEDZA2DR33EK3URR27H6DKURMDDTWT65SCS3UGECCWM5BKVD4QHQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YzYcwyVJqZywPJt9tYXXHMrjfjeziu6fobhHjt6sRf3utaror): protocol: expected piece hash; context canceled; EOF
Aug 17 18:08:41.090529141 (216h42m21.821796771s) [noise=true , address=104.36.82.18:4368 , piece_id=L5ZIXJFLLUXJLSLTMURQOOFYGRKGW3BD3XNF3MK362FTZYU2ICVQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ByhoW6Effjs8acfsvdF1xzDwBVqggsBK53oRZ8bYhEYYPChKz): protocol: write tcp 5.161.89.252:13580->104.36.82.18:4368: use of closed network connection; write tcp 5.161.89.252:13580->104.36.82.18:4368: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:13580->104.36.82.18:4368: use of closed network connection
Aug 17 18:08:41.090549199 (216h42m21.82181686s) [seg_pos={0 0}, upload=225459]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 18:08:41.090665598 (216h42m21.821933279s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 18:08:41.090672481 (216h42m21.821940102s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 18:08:41.259395157 (216h42m21.990662806s) [upload=225459]: Done uploading segments...
Aug 17 18:08:41.259414002 (216h42m21.990681662s) [upload=225459]: Upload finished. err: <nil>
Duration: 546.112275ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....................X...............................X.......] duration:
355.773822ms
FAIL (2025-08-17 18:37:10 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 18:33:16.400923957 (217h6m57.132191577s) [upload=225900]: Starting upload Aug 17 18:33:16.400969883 (217h6m57.132237513s) [upload=225900]: Done starting upload Aug 17 18:33:16.401014718 (217h6m57.132282338s) [upload=225900]: Uploading segments... Aug 17 18:33:16.401046027 (217h6m57.132313647s) [upload=225900]: Got next segment. Inline: true Aug 17 18:33:16.401050014 (217h6m57.132317645s) [upload=225900]: Waiting for error group managing segments... Aug 17 18:33:16.401081874 (217h6m57.132349504s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:33:16.401085992 (217h6m57.132353622s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 18:33:16.401088517 (217h6m57.132356147s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 18:33:16.418323930 (217h6m57.149591591s) [upload=225900]: Done uploading segments... Aug 17 18:33:16.418334601 (217h6m57.149602231s) [upload=225900]: Upload finished. err: metaclient: Too Many Requests
Duration: 355.793098ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....................X...............................X......] duration:
385.541408ms
FAIL (2025-08-17 18:36:46 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 18:33:16.400923957 (217h6m57.132191577s) [upload=225900]: Starting upload Aug 17 18:33:16.400969883 (217h6m57.132237513s) [upload=225900]: Done starting upload Aug 17 18:33:16.401014718 (217h6m57.132282338s) [upload=225900]: Uploading segments... Aug 17 18:33:16.401046027 (217h6m57.132313647s) [upload=225900]: Got next segment. Inline: true Aug 17 18:33:16.401050014 (217h6m57.132317645s) [upload=225900]: Waiting for error group managing segments... Aug 17 18:33:16.401081874 (217h6m57.132349504s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:33:16.401085992 (217h6m57.132353622s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 18:33:16.401088517 (217h6m57.132356147s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 18:33:16.418323930 (217h6m57.149591591s) [upload=225900]: Done uploading segments... Aug 17 18:33:16.418334601 (217h6m57.149602231s) [upload=225900]: Upload finished. err: metaclient: Too Many Requests
Duration: 385.566614ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
857.781037ms
FAIL (2025-08-17 18:36:13 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 17 18:08:40.777064912 (216h42m21.508332542s) [upload=225459]: Starting upload
Aug 17 18:08:40.777115086 (216h42m21.508382716s) [upload=225459]: Done starting upload
Aug 17 18:08:40.777269627 (216h42m21.508537287s) [upload=225459]: Uploading segments...
Aug 17 18:08:40.777454013 (216h42m21.508721673s) [upload=225459]: Got next segment. Inline: false
Aug 17 18:08:40.777510961 (216h42m21.508778611s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 18:08:40.777517212 (216h42m21.508784863s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 18:08:40.852095643 (216h42m21.583363283s) [seg_pos={0 0}, upload=225459]: Begin upload segment...
Aug 17 18:08:40.852138052 (216h42m21.583405692s) [seg_pos={0 0}, upload=225459]: Done begin upload segment.
Aug 17 18:08:40.852171765 (216h42m21.583439416s) [noise=true , address=104.36.82.35:4614 , piece_id=45LILLUGTP77755UK2BJS7ZQT2KFGCZ4IM2LXXA4NARZLNZQZK5A, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.852266774 (216h42m21.583534444s) [noise=true , address=104.36.82.51:4077 , piece_id=DHAWXMJWOMEV57K5W4WCMFDRHW4L32OSSRN2VA2O4S4BLB4ULMKQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.852610419 (216h42m21.583878059s) [noise=true , address=104.36.82.17:4336 , piece_id=A7UARNTYXQNF47MOPK7UNWWRZNCHBCMRMIMZQ6D53GVVPH6XZLHA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853024428 (216h42m21.584292077s) [noise=true , address=77.90.31.11:4567 , piece_id=AOYPMJE7T6RDIS2ZV5UIAXF7BS2PHHIPZNGCTX7J2VEQIA5WOUGQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853326185 (216h42m21.584593844s) [noise=true , address=45.91.116.13:4168 , piece_id=VTT3MS2UIVXODCPZOJXHADVTDHW6S4HUTSEREFN7F6T75GMSRYNA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853425190 (216h42m21.584692841s) [noise=true , address=104.36.82.44:4899 , piece_id=LQQ7J5HK3LTHARNZIULHU3RKYL252NGGHZXIXP3TFVE32KKGXG6A, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853793371 (216h42m21.585061022s) [noise=true , address=104.36.82.39:4738 , piece_id=5A6MDJG5PEHXNAEEDBHP6ZMV45KWTBRAK5OIVRUL2SOE4NEJPI5Q, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854181972 (216h42m21.585449623s) [noise=true , address=77.90.31.19:4844 , piece_id=ZSISRMQJ3URFB6YZWSO23SMU7BI2QLEHCHADY4PZFNXIUOT5N2FA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854317537 (216h42m21.585585197s) [noise=true , address=77.90.31.15:4713 , piece_id=IBPJ2XQI6TD5SIGBFJIEDEMMX6WH37P6ECFFUCD5F3MWPQR6HYHQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854538112 (216h42m21.585805761s) [noise=true , address=104.36.82.60:4363 , piece_id=CIXNGIAGIFAHZUH5V5A6BTRZT4ANYEITZ6XBKJKX4RMZQKURIIMA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854888400 (216h42m21.586156049s) [noise=true , address=104.36.82.18:4368 , piece_id=L5ZIXJFLLUXJLSLTMURQOOFYGRKGW3BD3XNF3MK362FTZYU2ICVQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.855236013 (216h42m21.586503662s) [noise=true , address=104.36.82.34:4566 , piece_id=TKRYBM75X63T6VDRPYN6ZNT5FEKROIVA5NZAELVPRGAQL6XVXU7Q, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.855379192 (216h42m21.586646842s) [noise=true , address=45.91.116.8:4059 , piece_id=DEDZA2DR33EK3URR27H6DKURMDDTWT65SCS3UGECCWM5BKVD4QHQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.855570652 (216h42m21.586838302s) [noise=true , address=77.90.31.10:4529 , piece_id=VZSQBU6PUYIP7XNBN5JQFZ5VI4WXHLSQUCGQNDRRRGU6TETCGQBQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.856194745 (216h42m21.587462415s) [noise=true , address=79.127.201.215:4359 , piece_id=DJVGXMVZA6JI35GVPHBGRMIEDS6OBOOFT74DNVZWUGTUQMKV6WKA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.857030525 (216h42m21.588298175s) [noise=true , address=45.91.116.7:4019 , piece_id=QK25YOV3HUQGIMGM4IGMLDVPLLNUR3KQMHQOIH4GU3PJVFQUPTKQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.857816381 (216h42m21.589084091s) [noise=true , address=104.36.82.58:4276 , piece_id=SMD2BUAUTWDS33QOWM3HQFYHQS5V33BLFRO4RZ2S6TC2GR5YGX3A, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.857978566 (216h42m21.589246216s) [noise=true , address=104.36.82.11:4127 , piece_id=U6JDUSEWROCLEHVG2ZATIVLD2ELN5M6JYUVZREWQWAA7BG3DI6UQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.974500804 (216h42m21.705768454s) [upload=225459]: Next returned nil segment
Aug 17 18:08:40.974518928 (216h42m21.705786568s) [upload=225459]: Waiting for error group managing segments...
Aug 17 18:08:40.987516869 (216h42m21.71878452s) [noise=true , address=104.36.82.11:4127 , piece_id=U6JDUSEWROCLEHVG2ZATIVLD2ELN5M6JYUVZREWQWAA7BG3DI6UQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:40.988549711 (216h42m21.719817331s) [noise=true , address=104.36.82.44:4899 , piece_id=LQQ7J5HK3LTHARNZIULHU3RKYL252NGGHZXIXP3TFVE32KKGXG6A, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.000082720 (216h42m21.73135034s) [noise=true , address=104.36.82.34:4566 , piece_id=TKRYBM75X63T6VDRPYN6ZNT5FEKROIVA5NZAELVPRGAQL6XVXU7Q, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.004638781 (216h42m21.735906401s) [noise=true , address=104.36.82.39:4738 , piece_id=5A6MDJG5PEHXNAEEDBHP6ZMV45KWTBRAK5OIVRUL2SOE4NEJPI5Q, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.004918978 (216h42m21.736186608s) [noise=true , address=104.36.82.58:4276 , piece_id=SMD2BUAUTWDS33QOWM3HQFYHQS5V33BLFRO4RZ2S6TC2GR5YGX3A, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.017616555 (216h42m21.748884185s) [noise=true , address=45.91.116.13:4168 , piece_id=VTT3MS2UIVXODCPZOJXHADVTDHW6S4HUTSEREFN7F6T75GMSRYNA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.026705041 (216h42m21.757972671s) [noise=true , address=104.36.82.60:4363 , piece_id=CIXNGIAGIFAHZUH5V5A6BTRZT4ANYEITZ6XBKJKX4RMZQKURIIMA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.029172177 (216h42m21.760439807s) [noise=true , address=45.91.116.7:4019 , piece_id=QK25YOV3HUQGIMGM4IGMLDVPLLNUR3KQMHQOIH4GU3PJVFQUPTKQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.032674628 (216h42m21.763942248s) [noise=true , address=77.90.31.15:4713 , piece_id=IBPJ2XQI6TD5SIGBFJIEDEMMX6WH37P6ECFFUCD5F3MWPQR6HYHQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.049253778 (216h42m21.780521408s) [noise=true , address=104.36.82.17:4336 , piece_id=A7UARNTYXQNF47MOPK7UNWWRZNCHBCMRMIMZQ6D53GVVPH6XZLHA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.049498879 (216h42m21.780766509s) [noise=true , address=104.36.82.35:4614 , piece_id=45LILLUGTP77755UK2BJS7ZQT2KFGCZ4IM2LXXA4NARZLNZQZK5A, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.068541098 (216h42m21.799808718s) [noise=true , address=77.90.31.11:4567 , piece_id=AOYPMJE7T6RDIS2ZV5UIAXF7BS2PHHIPZNGCTX7J2VEQIA5WOUGQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.070945586 (216h42m21.802213216s) [noise=true , address=77.90.31.19:4844 , piece_id=ZSISRMQJ3URFB6YZWSO23SMU7BI2QLEHCHADY4PZFNXIUOT5N2FA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.090207367 (216h42m21.821474997s) [noise=true , address=79.127.201.215:4359 , piece_id=DJVGXMVZA6JI35GVPHBGRMIEDS6OBOOFT74DNVZWUGTUQMKV6WKA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.090233866 (216h42m21.821501487s) [seg_pos={0 0}, upload=225459]: Segment reached optimal threshold of 14 pieces.
Aug 17 18:08:41.090351558 (216h42m21.821619179s) [noise=true , address=77.90.31.10:4529 , piece_id=VZSQBU6PUYIP7XNBN5JQFZ5VI4WXHLSQUCGQNDRRRGU6TETCGQBQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm): protocol: expected piece hash; context canceled; EOF
Aug 17 18:08:41.090444122 (216h42m21.821711752s) [noise=true , address=104.36.82.51:4077 , piece_id=DHAWXMJWOMEV57K5W4WCMFDRHW4L32OSSRN2VA2O4S4BLB4ULMKQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Njt39WE2REJivSU8fuzUReFN1n6BbRH78kJWaurrMK3Xh6PpS): protocol: expected piece hash; context canceled; EOF
Aug 17 18:08:41.090452788 (216h42m21.821720418s) [noise=true , address=45.91.116.8:4059 , piece_id=DEDZA2DR33EK3URR27H6DKURMDDTWT65SCS3UGECCWM5BKVD4QHQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YzYcwyVJqZywPJt9tYXXHMrjfjeziu6fobhHjt6sRf3utaror): protocol: expected piece hash; context canceled; EOF
Aug 17 18:08:41.090529141 (216h42m21.821796771s) [noise=true , address=104.36.82.18:4368 , piece_id=L5ZIXJFLLUXJLSLTMURQOOFYGRKGW3BD3XNF3MK362FTZYU2ICVQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ByhoW6Effjs8acfsvdF1xzDwBVqggsBK53oRZ8bYhEYYPChKz): protocol: write tcp 5.161.89.252:13580->104.36.82.18:4368: use of closed network connection; write tcp 5.161.89.252:13580->104.36.82.18:4368: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:13580->104.36.82.18:4368: use of closed network connection
Aug 17 18:08:41.090549199 (216h42m21.82181686s) [seg_pos={0 0}, upload=225459]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 18:08:41.090665598 (216h42m21.821933279s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 18:08:41.090672481 (216h42m21.821940102s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 18:08:41.259395157 (216h42m21.990662806s) [upload=225459]: Done uploading segments...
Aug 17 18:08:41.259414002 (216h42m21.990681662s) [upload=225459]: Upload finished. err: <nil>
Duration: 857.808538ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......................X...............................X.....] duration:
1.696560659s
FAIL (2025-08-17 18:36:10 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 18:33:16.400923957 (217h6m57.132191577s) [upload=225900]: Starting upload Aug 17 18:33:16.400969883 (217h6m57.132237513s) [upload=225900]: Done starting upload Aug 17 18:33:16.401014718 (217h6m57.132282338s) [upload=225900]: Uploading segments... Aug 17 18:33:16.401046027 (217h6m57.132313647s) [upload=225900]: Got next segment. Inline: true Aug 17 18:33:16.401050014 (217h6m57.132317645s) [upload=225900]: Waiting for error group managing segments... Aug 17 18:33:16.401081874 (217h6m57.132349504s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:33:16.401085992 (217h6m57.132353622s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 18:33:16.401088517 (217h6m57.132356147s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 18:33:16.418323930 (217h6m57.149591591s) [upload=225900]: Done uploading segments... Aug 17 18:33:16.418334601 (217h6m57.149602231s) [upload=225900]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.69658799s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......................X...............................X....] duration:
1.071770598s
FAIL (2025-08-17 18:35:42 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 18:33:16.400923957 (217h6m57.132191577s) [upload=225900]: Starting upload Aug 17 18:33:16.400969883 (217h6m57.132237513s) [upload=225900]: Done starting upload Aug 17 18:33:16.401014718 (217h6m57.132282338s) [upload=225900]: Uploading segments... Aug 17 18:33:16.401046027 (217h6m57.132313647s) [upload=225900]: Got next segment. Inline: true Aug 17 18:33:16.401050014 (217h6m57.132317645s) [upload=225900]: Waiting for error group managing segments... Aug 17 18:33:16.401081874 (217h6m57.132349504s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:33:16.401085992 (217h6m57.132353622s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 18:33:16.401088517 (217h6m57.132356147s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 18:33:16.418323930 (217h6m57.149591591s) [upload=225900]: Done uploading segments... Aug 17 18:33:16.418334601 (217h6m57.149602231s) [upload=225900]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.071790205s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
508.703444ms
FAIL (2025-08-17 18:35:29 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 17 18:08:40.777064912 (216h42m21.508332542s) [upload=225459]: Starting upload
Aug 17 18:08:40.777115086 (216h42m21.508382716s) [upload=225459]: Done starting upload
Aug 17 18:08:40.777269627 (216h42m21.508537287s) [upload=225459]: Uploading segments...
Aug 17 18:08:40.777454013 (216h42m21.508721673s) [upload=225459]: Got next segment. Inline: false
Aug 17 18:08:40.777510961 (216h42m21.508778611s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 18:08:40.777517212 (216h42m21.508784863s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 18:08:40.852095643 (216h42m21.583363283s) [seg_pos={0 0}, upload=225459]: Begin upload segment...
Aug 17 18:08:40.852138052 (216h42m21.583405692s) [seg_pos={0 0}, upload=225459]: Done begin upload segment.
Aug 17 18:08:40.852171765 (216h42m21.583439416s) [noise=true , address=104.36.82.35:4614 , piece_id=45LILLUGTP77755UK2BJS7ZQT2KFGCZ4IM2LXXA4NARZLNZQZK5A, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.852266774 (216h42m21.583534444s) [noise=true , address=104.36.82.51:4077 , piece_id=DHAWXMJWOMEV57K5W4WCMFDRHW4L32OSSRN2VA2O4S4BLB4ULMKQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.852610419 (216h42m21.583878059s) [noise=true , address=104.36.82.17:4336 , piece_id=A7UARNTYXQNF47MOPK7UNWWRZNCHBCMRMIMZQ6D53GVVPH6XZLHA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853024428 (216h42m21.584292077s) [noise=true , address=77.90.31.11:4567 , piece_id=AOYPMJE7T6RDIS2ZV5UIAXF7BS2PHHIPZNGCTX7J2VEQIA5WOUGQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853326185 (216h42m21.584593844s) [noise=true , address=45.91.116.13:4168 , piece_id=VTT3MS2UIVXODCPZOJXHADVTDHW6S4HUTSEREFN7F6T75GMSRYNA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853425190 (216h42m21.584692841s) [noise=true , address=104.36.82.44:4899 , piece_id=LQQ7J5HK3LTHARNZIULHU3RKYL252NGGHZXIXP3TFVE32KKGXG6A, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853793371 (216h42m21.585061022s) [noise=true , address=104.36.82.39:4738 , piece_id=5A6MDJG5PEHXNAEEDBHP6ZMV45KWTBRAK5OIVRUL2SOE4NEJPI5Q, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854181972 (216h42m21.585449623s) [noise=true , address=77.90.31.19:4844 , piece_id=ZSISRMQJ3URFB6YZWSO23SMU7BI2QLEHCHADY4PZFNXIUOT5N2FA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854317537 (216h42m21.585585197s) [noise=true , address=77.90.31.15:4713 , piece_id=IBPJ2XQI6TD5SIGBFJIEDEMMX6WH37P6ECFFUCD5F3MWPQR6HYHQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854538112 (216h42m21.585805761s) [noise=true , address=104.36.82.60:4363 , piece_id=CIXNGIAGIFAHZUH5V5A6BTRZT4ANYEITZ6XBKJKX4RMZQKURIIMA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854888400 (216h42m21.586156049s) [noise=true , address=104.36.82.18:4368 , piece_id=L5ZIXJFLLUXJLSLTMURQOOFYGRKGW3BD3XNF3MK362FTZYU2ICVQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.855236013 (216h42m21.586503662s) [noise=true , address=104.36.82.34:4566 , piece_id=TKRYBM75X63T6VDRPYN6ZNT5FEKROIVA5NZAELVPRGAQL6XVXU7Q, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.855379192 (216h42m21.586646842s) [noise=true , address=45.91.116.8:4059 , piece_id=DEDZA2DR33EK3URR27H6DKURMDDTWT65SCS3UGECCWM5BKVD4QHQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.855570652 (216h42m21.586838302s) [noise=true , address=77.90.31.10:4529 , piece_id=VZSQBU6PUYIP7XNBN5JQFZ5VI4WXHLSQUCGQNDRRRGU6TETCGQBQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.856194745 (216h42m21.587462415s) [noise=true , address=79.127.201.215:4359 , piece_id=DJVGXMVZA6JI35GVPHBGRMIEDS6OBOOFT74DNVZWUGTUQMKV6WKA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.857030525 (216h42m21.588298175s) [noise=true , address=45.91.116.7:4019 , piece_id=QK25YOV3HUQGIMGM4IGMLDVPLLNUR3KQMHQOIH4GU3PJVFQUPTKQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.857816381 (216h42m21.589084091s) [noise=true , address=104.36.82.58:4276 , piece_id=SMD2BUAUTWDS33QOWM3HQFYHQS5V33BLFRO4RZ2S6TC2GR5YGX3A, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.857978566 (216h42m21.589246216s) [noise=true , address=104.36.82.11:4127 , piece_id=U6JDUSEWROCLEHVG2ZATIVLD2ELN5M6JYUVZREWQWAA7BG3DI6UQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.974500804 (216h42m21.705768454s) [upload=225459]: Next returned nil segment
Aug 17 18:08:40.974518928 (216h42m21.705786568s) [upload=225459]: Waiting for error group managing segments...
Aug 17 18:08:40.987516869 (216h42m21.71878452s) [noise=true , address=104.36.82.11:4127 , piece_id=U6JDUSEWROCLEHVG2ZATIVLD2ELN5M6JYUVZREWQWAA7BG3DI6UQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:40.988549711 (216h42m21.719817331s) [noise=true , address=104.36.82.44:4899 , piece_id=LQQ7J5HK3LTHARNZIULHU3RKYL252NGGHZXIXP3TFVE32KKGXG6A, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.000082720 (216h42m21.73135034s) [noise=true , address=104.36.82.34:4566 , piece_id=TKRYBM75X63T6VDRPYN6ZNT5FEKROIVA5NZAELVPRGAQL6XVXU7Q, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.004638781 (216h42m21.735906401s) [noise=true , address=104.36.82.39:4738 , piece_id=5A6MDJG5PEHXNAEEDBHP6ZMV45KWTBRAK5OIVRUL2SOE4NEJPI5Q, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.004918978 (216h42m21.736186608s) [noise=true , address=104.36.82.58:4276 , piece_id=SMD2BUAUTWDS33QOWM3HQFYHQS5V33BLFRO4RZ2S6TC2GR5YGX3A, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.017616555 (216h42m21.748884185s) [noise=true , address=45.91.116.13:4168 , piece_id=VTT3MS2UIVXODCPZOJXHADVTDHW6S4HUTSEREFN7F6T75GMSRYNA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.026705041 (216h42m21.757972671s) [noise=true , address=104.36.82.60:4363 , piece_id=CIXNGIAGIFAHZUH5V5A6BTRZT4ANYEITZ6XBKJKX4RMZQKURIIMA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.029172177 (216h42m21.760439807s) [noise=true , address=45.91.116.7:4019 , piece_id=QK25YOV3HUQGIMGM4IGMLDVPLLNUR3KQMHQOIH4GU3PJVFQUPTKQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.032674628 (216h42m21.763942248s) [noise=true , address=77.90.31.15:4713 , piece_id=IBPJ2XQI6TD5SIGBFJIEDEMMX6WH37P6ECFFUCD5F3MWPQR6HYHQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.049253778 (216h42m21.780521408s) [noise=true , address=104.36.82.17:4336 , piece_id=A7UARNTYXQNF47MOPK7UNWWRZNCHBCMRMIMZQ6D53GVVPH6XZLHA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.049498879 (216h42m21.780766509s) [noise=true , address=104.36.82.35:4614 , piece_id=45LILLUGTP77755UK2BJS7ZQT2KFGCZ4IM2LXXA4NARZLNZQZK5A, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.068541098 (216h42m21.799808718s) [noise=true , address=77.90.31.11:4567 , piece_id=AOYPMJE7T6RDIS2ZV5UIAXF7BS2PHHIPZNGCTX7J2VEQIA5WOUGQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.070945586 (216h42m21.802213216s) [noise=true , address=77.90.31.19:4844 , piece_id=ZSISRMQJ3URFB6YZWSO23SMU7BI2QLEHCHADY4PZFNXIUOT5N2FA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.090207367 (216h42m21.821474997s) [noise=true , address=79.127.201.215:4359 , piece_id=DJVGXMVZA6JI35GVPHBGRMIEDS6OBOOFT74DNVZWUGTUQMKV6WKA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.090233866 (216h42m21.821501487s) [seg_pos={0 0}, upload=225459]: Segment reached optimal threshold of 14 pieces.
Aug 17 18:08:41.090351558 (216h42m21.821619179s) [noise=true , address=77.90.31.10:4529 , piece_id=VZSQBU6PUYIP7XNBN5JQFZ5VI4WXHLSQUCGQNDRRRGU6TETCGQBQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm): protocol: expected piece hash; context canceled; EOF
Aug 17 18:08:41.090444122 (216h42m21.821711752s) [noise=true , address=104.36.82.51:4077 , piece_id=DHAWXMJWOMEV57K5W4WCMFDRHW4L32OSSRN2VA2O4S4BLB4ULMKQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Njt39WE2REJivSU8fuzUReFN1n6BbRH78kJWaurrMK3Xh6PpS): protocol: expected piece hash; context canceled; EOF
Aug 17 18:08:41.090452788 (216h42m21.821720418s) [noise=true , address=45.91.116.8:4059 , piece_id=DEDZA2DR33EK3URR27H6DKURMDDTWT65SCS3UGECCWM5BKVD4QHQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YzYcwyVJqZywPJt9tYXXHMrjfjeziu6fobhHjt6sRf3utaror): protocol: expected piece hash; context canceled; EOF
Aug 17 18:08:41.090529141 (216h42m21.821796771s) [noise=true , address=104.36.82.18:4368 , piece_id=L5ZIXJFLLUXJLSLTMURQOOFYGRKGW3BD3XNF3MK362FTZYU2ICVQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ByhoW6Effjs8acfsvdF1xzDwBVqggsBK53oRZ8bYhEYYPChKz): protocol: write tcp 5.161.89.252:13580->104.36.82.18:4368: use of closed network connection; write tcp 5.161.89.252:13580->104.36.82.18:4368: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:13580->104.36.82.18:4368: use of closed network connection
Aug 17 18:08:41.090549199 (216h42m21.82181686s) [seg_pos={0 0}, upload=225459]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 18:08:41.090665598 (216h42m21.821933279s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 18:08:41.090672481 (216h42m21.821940102s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 18:08:41.259395157 (216h42m21.990662806s) [upload=225459]: Done uploading segments...
Aug 17 18:08:41.259414002 (216h42m21.990681662s) [upload=225459]: Upload finished. err: <nil>
Duration: 508.720926ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........................X...............................X...] duration:
186.551266ms
FAIL (2025-08-17 18:35:26 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 18:33:16.400923957 (217h6m57.132191577s) [upload=225900]: Starting upload Aug 17 18:33:16.400969883 (217h6m57.132237513s) [upload=225900]: Done starting upload Aug 17 18:33:16.401014718 (217h6m57.132282338s) [upload=225900]: Uploading segments... Aug 17 18:33:16.401046027 (217h6m57.132313647s) [upload=225900]: Got next segment. Inline: true Aug 17 18:33:16.401050014 (217h6m57.132317645s) [upload=225900]: Waiting for error group managing segments... Aug 17 18:33:16.401081874 (217h6m57.132349504s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:33:16.401085992 (217h6m57.132353622s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 18:33:16.401088517 (217h6m57.132356147s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 18:33:16.418323930 (217h6m57.149591591s) [upload=225900]: Done uploading segments... Aug 17 18:33:16.418334601 (217h6m57.149602231s) [upload=225900]: Upload finished. err: metaclient: Too Many Requests
Duration: 186.576542ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
618.371701ms
FAIL (2025-08-17 18:34:34 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 17 18:08:40.777064912 (216h42m21.508332542s) [upload=225459]: Starting upload
Aug 17 18:08:40.777115086 (216h42m21.508382716s) [upload=225459]: Done starting upload
Aug 17 18:08:40.777269627 (216h42m21.508537287s) [upload=225459]: Uploading segments...
Aug 17 18:08:40.777454013 (216h42m21.508721673s) [upload=225459]: Got next segment. Inline: false
Aug 17 18:08:40.777510961 (216h42m21.508778611s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 18:08:40.777517212 (216h42m21.508784863s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 18:08:40.852095643 (216h42m21.583363283s) [seg_pos={0 0}, upload=225459]: Begin upload segment...
Aug 17 18:08:40.852138052 (216h42m21.583405692s) [seg_pos={0 0}, upload=225459]: Done begin upload segment.
Aug 17 18:08:40.852171765 (216h42m21.583439416s) [noise=true , address=104.36.82.35:4614 , piece_id=45LILLUGTP77755UK2BJS7ZQT2KFGCZ4IM2LXXA4NARZLNZQZK5A, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.852266774 (216h42m21.583534444s) [noise=true , address=104.36.82.51:4077 , piece_id=DHAWXMJWOMEV57K5W4WCMFDRHW4L32OSSRN2VA2O4S4BLB4ULMKQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.852610419 (216h42m21.583878059s) [noise=true , address=104.36.82.17:4336 , piece_id=A7UARNTYXQNF47MOPK7UNWWRZNCHBCMRMIMZQ6D53GVVPH6XZLHA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853024428 (216h42m21.584292077s) [noise=true , address=77.90.31.11:4567 , piece_id=AOYPMJE7T6RDIS2ZV5UIAXF7BS2PHHIPZNGCTX7J2VEQIA5WOUGQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853326185 (216h42m21.584593844s) [noise=true , address=45.91.116.13:4168 , piece_id=VTT3MS2UIVXODCPZOJXHADVTDHW6S4HUTSEREFN7F6T75GMSRYNA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853425190 (216h42m21.584692841s) [noise=true , address=104.36.82.44:4899 , piece_id=LQQ7J5HK3LTHARNZIULHU3RKYL252NGGHZXIXP3TFVE32KKGXG6A, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.853793371 (216h42m21.585061022s) [noise=true , address=104.36.82.39:4738 , piece_id=5A6MDJG5PEHXNAEEDBHP6ZMV45KWTBRAK5OIVRUL2SOE4NEJPI5Q, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854181972 (216h42m21.585449623s) [noise=true , address=77.90.31.19:4844 , piece_id=ZSISRMQJ3URFB6YZWSO23SMU7BI2QLEHCHADY4PZFNXIUOT5N2FA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854317537 (216h42m21.585585197s) [noise=true , address=77.90.31.15:4713 , piece_id=IBPJ2XQI6TD5SIGBFJIEDEMMX6WH37P6ECFFUCD5F3MWPQR6HYHQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854538112 (216h42m21.585805761s) [noise=true , address=104.36.82.60:4363 , piece_id=CIXNGIAGIFAHZUH5V5A6BTRZT4ANYEITZ6XBKJKX4RMZQKURIIMA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.854888400 (216h42m21.586156049s) [noise=true , address=104.36.82.18:4368 , piece_id=L5ZIXJFLLUXJLSLTMURQOOFYGRKGW3BD3XNF3MK362FTZYU2ICVQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.855236013 (216h42m21.586503662s) [noise=true , address=104.36.82.34:4566 , piece_id=TKRYBM75X63T6VDRPYN6ZNT5FEKROIVA5NZAELVPRGAQL6XVXU7Q, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.855379192 (216h42m21.586646842s) [noise=true , address=45.91.116.8:4059 , piece_id=DEDZA2DR33EK3URR27H6DKURMDDTWT65SCS3UGECCWM5BKVD4QHQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.855570652 (216h42m21.586838302s) [noise=true , address=77.90.31.10:4529 , piece_id=VZSQBU6PUYIP7XNBN5JQFZ5VI4WXHLSQUCGQNDRRRGU6TETCGQBQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.856194745 (216h42m21.587462415s) [noise=true , address=79.127.201.215:4359 , piece_id=DJVGXMVZA6JI35GVPHBGRMIEDS6OBOOFT74DNVZWUGTUQMKV6WKA, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.857030525 (216h42m21.588298175s) [noise=true , address=45.91.116.7:4019 , piece_id=QK25YOV3HUQGIMGM4IGMLDVPLLNUR3KQMHQOIH4GU3PJVFQUPTKQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.857816381 (216h42m21.589084091s) [noise=true , address=104.36.82.58:4276 , piece_id=SMD2BUAUTWDS33QOWM3HQFYHQS5V33BLFRO4RZ2S6TC2GR5YGX3A, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.857978566 (216h42m21.589246216s) [noise=true , address=104.36.82.11:4127 , piece_id=U6JDUSEWROCLEHVG2ZATIVLD2ELN5M6JYUVZREWQWAA7BG3DI6UQ, seg_pos={0 0}, upload=225459]: Uploading piece...
Aug 17 18:08:40.974500804 (216h42m21.705768454s) [upload=225459]: Next returned nil segment
Aug 17 18:08:40.974518928 (216h42m21.705786568s) [upload=225459]: Waiting for error group managing segments...
Aug 17 18:08:40.987516869 (216h42m21.71878452s) [noise=true , address=104.36.82.11:4127 , piece_id=U6JDUSEWROCLEHVG2ZATIVLD2ELN5M6JYUVZREWQWAA7BG3DI6UQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:40.988549711 (216h42m21.719817331s) [noise=true , address=104.36.82.44:4899 , piece_id=LQQ7J5HK3LTHARNZIULHU3RKYL252NGGHZXIXP3TFVE32KKGXG6A, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.000082720 (216h42m21.73135034s) [noise=true , address=104.36.82.34:4566 , piece_id=TKRYBM75X63T6VDRPYN6ZNT5FEKROIVA5NZAELVPRGAQL6XVXU7Q, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.004638781 (216h42m21.735906401s) [noise=true , address=104.36.82.39:4738 , piece_id=5A6MDJG5PEHXNAEEDBHP6ZMV45KWTBRAK5OIVRUL2SOE4NEJPI5Q, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.004918978 (216h42m21.736186608s) [noise=true , address=104.36.82.58:4276 , piece_id=SMD2BUAUTWDS33QOWM3HQFYHQS5V33BLFRO4RZ2S6TC2GR5YGX3A, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.017616555 (216h42m21.748884185s) [noise=true , address=45.91.116.13:4168 , piece_id=VTT3MS2UIVXODCPZOJXHADVTDHW6S4HUTSEREFN7F6T75GMSRYNA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.026705041 (216h42m21.757972671s) [noise=true , address=104.36.82.60:4363 , piece_id=CIXNGIAGIFAHZUH5V5A6BTRZT4ANYEITZ6XBKJKX4RMZQKURIIMA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.029172177 (216h42m21.760439807s) [noise=true , address=45.91.116.7:4019 , piece_id=QK25YOV3HUQGIMGM4IGMLDVPLLNUR3KQMHQOIH4GU3PJVFQUPTKQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.032674628 (216h42m21.763942248s) [noise=true , address=77.90.31.15:4713 , piece_id=IBPJ2XQI6TD5SIGBFJIEDEMMX6WH37P6ECFFUCD5F3MWPQR6HYHQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.049253778 (216h42m21.780521408s) [noise=true , address=104.36.82.17:4336 , piece_id=A7UARNTYXQNF47MOPK7UNWWRZNCHBCMRMIMZQ6D53GVVPH6XZLHA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.049498879 (216h42m21.780766509s) [noise=true , address=104.36.82.35:4614 , piece_id=45LILLUGTP77755UK2BJS7ZQT2KFGCZ4IM2LXXA4NARZLNZQZK5A, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.068541098 (216h42m21.799808718s) [noise=true , address=77.90.31.11:4567 , piece_id=AOYPMJE7T6RDIS2ZV5UIAXF7BS2PHHIPZNGCTX7J2VEQIA5WOUGQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.070945586 (216h42m21.802213216s) [noise=true , address=77.90.31.19:4844 , piece_id=ZSISRMQJ3URFB6YZWSO23SMU7BI2QLEHCHADY4PZFNXIUOT5N2FA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.090207367 (216h42m21.821474997s) [noise=true , address=79.127.201.215:4359 , piece_id=DJVGXMVZA6JI35GVPHBGRMIEDS6OBOOFT74DNVZWUGTUQMKV6WKA, seg_pos={0 0}, upload=225459]: Done uploading piece. err: <nil>
Aug 17 18:08:41.090233866 (216h42m21.821501487s) [seg_pos={0 0}, upload=225459]: Segment reached optimal threshold of 14 pieces.
Aug 17 18:08:41.090351558 (216h42m21.821619179s) [noise=true , address=77.90.31.10:4529 , piece_id=VZSQBU6PUYIP7XNBN5JQFZ5VI4WXHLSQUCGQNDRRRGU6TETCGQBQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm): protocol: expected piece hash; context canceled; EOF
Aug 17 18:08:41.090444122 (216h42m21.821711752s) [noise=true , address=104.36.82.51:4077 , piece_id=DHAWXMJWOMEV57K5W4WCMFDRHW4L32OSSRN2VA2O4S4BLB4ULMKQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Njt39WE2REJivSU8fuzUReFN1n6BbRH78kJWaurrMK3Xh6PpS): protocol: expected piece hash; context canceled; EOF
Aug 17 18:08:41.090452788 (216h42m21.821720418s) [noise=true , address=45.91.116.8:4059 , piece_id=DEDZA2DR33EK3URR27H6DKURMDDTWT65SCS3UGECCWM5BKVD4QHQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YzYcwyVJqZywPJt9tYXXHMrjfjeziu6fobhHjt6sRf3utaror): protocol: expected piece hash; context canceled; EOF
Aug 17 18:08:41.090529141 (216h42m21.821796771s) [noise=true , address=104.36.82.18:4368 , piece_id=L5ZIXJFLLUXJLSLTMURQOOFYGRKGW3BD3XNF3MK362FTZYU2ICVQ, seg_pos={0 0}, upload=225459]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ByhoW6Effjs8acfsvdF1xzDwBVqggsBK53oRZ8bYhEYYPChKz): protocol: write tcp 5.161.89.252:13580->104.36.82.18:4368: use of closed network connection; write tcp 5.161.89.252:13580->104.36.82.18:4368: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:13580->104.36.82.18:4368: use of closed network connection
Aug 17 18:08:41.090549199 (216h42m21.82181686s) [seg_pos={0 0}, upload=225459]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 18:08:41.090665598 (216h42m21.821933279s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 18:08:41.090672481 (216h42m21.821940102s) [upload=225459]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 18:08:41.259395157 (216h42m21.990662806s) [upload=225459]: Done uploading segments...
Aug 17 18:08:41.259414002 (216h42m21.990681662s) [upload=225459]: Upload finished. err: <nil>
Duration: 618.395396ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........................X...............................X..] duration:
206.165521ms
FAIL (2025-08-17 18:34:17 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 18:33:16.400923957 (217h6m57.132191577s) [upload=225900]: Starting upload Aug 17 18:33:16.400969883 (217h6m57.132237513s) [upload=225900]: Done starting upload Aug 17 18:33:16.401014718 (217h6m57.132282338s) [upload=225900]: Uploading segments... Aug 17 18:33:16.401046027 (217h6m57.132313647s) [upload=225900]: Got next segment. Inline: true Aug 17 18:33:16.401050014 (217h6m57.132317645s) [upload=225900]: Waiting for error group managing segments... Aug 17 18:33:16.401081874 (217h6m57.132349504s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:33:16.401085992 (217h6m57.132353622s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 18:33:16.401088517 (217h6m57.132356147s) [upload=225900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 18:33:16.418323930 (217h6m57.149591591s) [upload=225900]: Done uploading segments... Aug 17 18:33:16.418334601 (217h6m57.149602231s) [upload=225900]: Upload finished. err: metaclient: Too Many Requests
Duration: 206.189757ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|