Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 165.922847ms FAIL (2025-08-09 01:25:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:52:13.986283699 (7h25m54.71755135s) [upload=7723]: Starting upload Aug 9 00:52:13.986408060 (7h25m54.717675711s) [upload=7723]: Done starting upload Aug 9 00:52:13.986481939 (7h25m54.71774956s) [upload=7723]: Uploading segments... Aug 9 00:52:13.986553753 (7h25m54.717821373s) [upload=7723]: Got next segment. Inline: true Aug 9 00:52:13.986558031 (7h25m54.717825641s) [upload=7723]: Waiting for error group managing segments... Aug 9 00:52:13.986608676 (7h25m54.717876296s) [upload=7723]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 00:52:13.986612834 (7h25m54.717880454s) [upload=7723]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 00:52:13.986615108 (7h25m54.717882728s) [upload=7723]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 00:52:13.989421897 (7h25m54.720689516s) [upload=7723]: Done uploading segments... Aug 9 00:52:13.989431464 (7h25m54.720699084s) [upload=7723]: Upload finished. err: metaclient: Too Many Requests Duration:* 165.947762ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..X.......X..............X......X...........................] duration: 484.182018ms FAIL (2025-08-09 01:25:24 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 9 01:03:50.521251227 (7h37m31.252518857s) [upload=7928]: Starting upload Aug 9 01:03:50.521308083 (7h37m31.252575713s) [upload=7928]: Done starting upload Aug 9 01:03:50.521407979 (7h37m31.252675609s) [upload=7928]: Uploading segments... Aug 9 01:03:50.521679086 (7h37m31.252946716s) [upload=7928]: Got next segment. Inline: false Aug 9 01:03:50.521722226 (7h37m31.252989866s) [upload=7928]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:03:50.521727255 (7h37m31.252994885s) [upload=7928]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 01:03:50.547289380 (7h37m31.278557001s) [seg_pos={0 0}, upload=7928]: Begin upload segment... Aug 9 01:03:50.547314256 (7h37m31.278581886s) [seg_pos={0 0}, upload=7928]: Done begin upload segment. Aug 9 01:03:50.547335476 (7h37m31.278603116s) [noise=true , address=104.36.82.12:4173 , piece_id=VBNMKHSMCJKTABCXB2PAGXH65OEUF6LBQXP7XZFNMYOD3H76IPEQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547382454 (7h37m31.278650084s) [noise=true , address=104.36.82.37:4665 , piece_id=F5RO7SFTH54IDNLT7KF2TNOQRVZEFODCYG65ONZJ6THD4LZKKJJA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547771219 (7h37m31.27903884s) [noise=true , address=104.36.82.59:4314 , piece_id=SCL4G7EHDMHOWB7MZRTOLBT2TUZL45AE7A3UIKOQ2HCGI4AJLQCA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547817245 (7h37m31.279084875s) [noise=true , address=104.36.82.14:4245 , piece_id=4B7WJJILP2ZJ2DIDTPSTI55G67X6IBC24POPB4BCVSJOT4ZFKK3Q, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548158312 (7h37m31.279425942s) [noise=true , address=104.36.82.60:4342 , piece_id=GTKAIDOMRHEEWSS2H64BVSLX245AYHVVIXORCJKFMSIAC7VGOZLQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548182277 (7h37m31.279449907s) [noise=true , address=104.36.82.16:4311 , piece_id=WHQMSXMRLD5QRU6GYEPX2U7YTK7OBEHBKHJXWU2YKBZBA4SQJNEA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548510239 (7h37m31.27977787s) [noise=true , address=104.36.82.21:4479 , piece_id=ZKGGJ6T7MZETBH7P72Y4MHWMTK2CAYR5PYQEGNNN7XOYV63BG2HQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548553630 (7h37m31.27982126s) [noise=true , address=104.36.82.44:4897 , piece_id=YMDI7WR2P3M2HTRDLQNCC24ZU2NRRBH6JDJEHOY6WEBK6KKO5PBQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548917339 (7h37m31.280184959s) [noise=true , address=104.36.82.38:4710 , piece_id=AYQ2JWIS4Y6ECJOPZLL3VO7UEL3LAU72EDKKBZBE77G3XHRUKT3A, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548924042 (7h37m31.280191682s) [noise=true , address=104.36.82.17:4332 , piece_id=NRWIFJYUBAMBJ3FBMRXE3YZTREOENZYWB6J4BJLXIIPQKKXNVRUQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548959829 (7h37m31.280227459s) [noise=true , address=104.36.82.53:4144 , piece_id=AZ4C2TJSHYEVYUUEYI7K7QHHBQVAG6NMP2BJALLEE7IY5YFD6FZA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549302238 (7h37m31.280569868s) [noise=true , address=104.36.82.39:4737 , piece_id=AMV62VOAKHJUZCZWNEYGJKY572LWVJZMANNMQEQIS2HHKR3YVRSQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549314360 (7h37m31.28058199s) [noise=true , address=104.36.82.11:4122 , piece_id=HOAEVCU5N4KLGF7O7ZZJC7YC5OB4VZOZIDKDTQTTOR4TU5T3IZXQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549666998 (7h37m31.280934628s) [noise=true , address=104.36.82.4:4812 , piece_id=VKHFSCHUKZFGXRICZGSICWUTOK2BFMG6LAIC67ORAFN7S44SOPPQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.550026399 (7h37m31.281294019s) [noise=true , address=104.36.82.46:4498 , piece_id=C7HSUOEHMVCU5BX3XGAO4LWIGKXPE2IR6U7EOUBSJDSN3CIVRPPQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.550347188 (7h37m31.281614818s) [noise=true , address=104.36.82.62:4440 , piece_id=45DAJ7PILLSEBZICG7W7KKUR7ENYPF57DM2JA5COJV7IWRFB7KTQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.551515258 (7h37m31.282782888s) [noise=true , address=104.36.82.9:4029 , piece_id=LUA5Q3ZUO3SZI24ZPZGXIRLEMBZX3XQFYJQMCY6E4SXMBQTHSAGA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.553639614 (7h37m31.284907244s) [noise=true , address=104.36.82.34:4578 , piece_id=WROE2XH3WOMRAJ4OJBD5LGCCTUMI7ECXHO6HYYRXYNBNBPN7I5ZQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.654119682 (7h37m31.385387312s) [upload=7928]: Next returned nil segment Aug 9 01:03:50.654133758 (7h37m31.385401378s) [upload=7928]: Waiting for error group managing segments... Aug 9 01:03:50.672101667 (7h37m31.403369288s) [noise=true , address=104.36.82.16:4311 , piece_id=WHQMSXMRLD5QRU6GYEPX2U7YTK7OBEHBKHJXWU2YKBZBA4SQJNEA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.672877525 (7h37m31.404145145s) [noise=true , address=104.36.82.38:4710 , piece_id=AYQ2JWIS4Y6ECJOPZLL3VO7UEL3LAU72EDKKBZBE77G3XHRUKT3A, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.675306269 (7h37m31.406573909s) [noise=true , address=104.36.82.59:4314 , piece_id=SCL4G7EHDMHOWB7MZRTOLBT2TUZL45AE7A3UIKOQ2HCGI4AJLQCA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.675371770 (7h37m31.406639391s) [noise=true , address=104.36.82.37:4665 , piece_id=F5RO7SFTH54IDNLT7KF2TNOQRVZEFODCYG65ONZJ6THD4LZKKJJA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.683603266 (7h37m31.414870896s) [noise=true , address=104.36.82.34:4578 , piece_id=WROE2XH3WOMRAJ4OJBD5LGCCTUMI7ECXHO6HYYRXYNBNBPN7I5ZQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.685155513 (7h37m31.416423133s) [noise=true , address=104.36.82.39:4737 , piece_id=AMV62VOAKHJUZCZWNEYGJKY572LWVJZMANNMQEQIS2HHKR3YVRSQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.685621413 (7h37m31.416889033s) [noise=true , address=104.36.82.53:4144 , piece_id=AZ4C2TJSHYEVYUUEYI7K7QHHBQVAG6NMP2BJALLEE7IY5YFD6FZA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.686461230 (7h37m31.41772886s) [noise=true , address=104.36.82.17:4332 , piece_id=NRWIFJYUBAMBJ3FBMRXE3YZTREOENZYWB6J4BJLXIIPQKKXNVRUQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.686992623 (7h37m31.418260253s) [noise=true , address=104.36.82.12:4173 , piece_id=VBNMKHSMCJKTABCXB2PAGXH65OEUF6LBQXP7XZFNMYOD3H76IPEQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.687219727 (7h37m31.418487347s) [noise=true , address=104.36.82.21:4479 , piece_id=ZKGGJ6T7MZETBH7P72Y4MHWMTK2CAYR5PYQEGNNN7XOYV63BG2HQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.692430363 (7h37m31.423697993s) [noise=true , address=104.36.82.14:4245 , piece_id=4B7WJJILP2ZJ2DIDTPSTI55G67X6IBC24POPB4BCVSJOT4ZFKK3Q, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.707237672 (7h37m31.438505302s) [noise=true , address=104.36.82.9:4029 , piece_id=LUA5Q3ZUO3SZI24ZPZGXIRLEMBZX3XQFYJQMCY6E4SXMBQTHSAGA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.716934623 (7h37m31.448202253s) [noise=true , address=104.36.82.4:4812 , piece_id=VKHFSCHUKZFGXRICZGSICWUTOK2BFMG6LAIC67ORAFN7S44SOPPQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.766972144 (7h37m31.498239774s) [noise=true , address=104.36.82.44:4897 , piece_id=YMDI7WR2P3M2HTRDLQNCC24ZU2NRRBH6JDJEHOY6WEBK6KKO5PBQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.766989206 (7h37m31.498256836s) [seg_pos={0 0}, upload=7928]: Segment reached optimal threshold of 14 pieces. Aug 9 01:03:50.767124678 (7h37m31.498392309s) [noise=true , address=104.36.82.62:4440 , piece_id=45DAJ7PILLSEBZICG7W7KKUR7ENYPF57DM2JA5COJV7IWRFB7KTQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jvc3V5SqNUTwbUea883sp3jsPPu1PAzJaUwcjPjxdjm3JiF2L): protocol: write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection; write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection Aug 9 01:03:50.767270229 (7h37m31.49853786s) [noise=true , address=104.36.82.60:4342 , piece_id=GTKAIDOMRHEEWSS2H64BVSLX245AYHVVIXORCJKFMSIAC7VGOZLQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB): protocol: read tcp 5.161.89.252:54032->104.36.82.60:4342: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 9 01:03:50.767296629 (7h37m31.498564249s) [noise=true , address=104.36.82.46:4498 , piece_id=C7HSUOEHMVCU5BX3XGAO4LWIGKXPE2IR6U7EOUBSJDSN3CIVRPPQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jyjxdWkBRBkDHSKknNmPdcnJ3HRcSCUQNnmpb1CaiEdMPEGk4): protocol: expected piece hash; context canceled; EOF Aug 9 01:03:50.767313812 (7h37m31.498581442s) [noise=true , address=104.36.82.11:4122 , piece_id=HOAEVCU5N4KLGF7O7ZZJC7YC5OB4VZOZIDKDTQTTOR4TU5T3IZXQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1oCu75zR8YccTunHjctcLzTrr9wTQqtAPXHiWrsQs41o8gxgh6): protocol: write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection; write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection Aug 9 01:03:50.767324712 (7h37m31.498592332s) [seg_pos={0 0}, upload=7928]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 01:03:50.767376188 (7h37m31.498643818s) [upload=7928]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 01:03:50.767381278 (7h37m31.498648908s) [upload=7928]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 01:03:50.890154929 (7h37m31.621422559s) [upload=7928]: Done uploading segments... Aug 9 01:03:50.890168986 (7h37m31.621436606s) [upload=7928]: Upload finished. err: <nil> Duration: 484.201814ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 211.520732ms FAIL (2025-08-09 01:25:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:52:13.986283699 (7h25m54.71755135s) [upload=7723]: Starting upload Aug 9 00:52:13.986408060 (7h25m54.717675711s) [upload=7723]: Done starting upload Aug 9 00:52:13.986481939 (7h25m54.71774956s) [upload=7723]: Uploading segments... Aug 9 00:52:13.986553753 (7h25m54.717821373s) [upload=7723]: Got next segment. Inline: true Aug 9 00:52:13.986558031 (7h25m54.717825641s) [upload=7723]: Waiting for error group managing segments... Aug 9 00:52:13.986608676 (7h25m54.717876296s) [upload=7723]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 00:52:13.986612834 (7h25m54.717880454s) [upload=7723]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 00:52:13.986615108 (7h25m54.717882728s) [upload=7723]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 00:52:13.989421897 (7h25m54.720689516s) [upload=7723]: Done uploading segments... Aug 9 00:52:13.989431464 (7h25m54.720699084s) [upload=7723]: Upload finished. err: metaclient: Too Many Requests Duration:* 211.542562ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...X.......X..............X......X..........................] duration: 435.649114ms FAIL (2025-08-09 01:24:54 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 9 01:03:50.521251227 (7h37m31.252518857s) [upload=7928]: Starting upload Aug 9 01:03:50.521308083 (7h37m31.252575713s) [upload=7928]: Done starting upload Aug 9 01:03:50.521407979 (7h37m31.252675609s) [upload=7928]: Uploading segments... Aug 9 01:03:50.521679086 (7h37m31.252946716s) [upload=7928]: Got next segment. Inline: false Aug 9 01:03:50.521722226 (7h37m31.252989866s) [upload=7928]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:03:50.521727255 (7h37m31.252994885s) [upload=7928]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 01:03:50.547289380 (7h37m31.278557001s) [seg_pos={0 0}, upload=7928]: Begin upload segment... Aug 9 01:03:50.547314256 (7h37m31.278581886s) [seg_pos={0 0}, upload=7928]: Done begin upload segment. Aug 9 01:03:50.547335476 (7h37m31.278603116s) [noise=true , address=104.36.82.12:4173 , piece_id=VBNMKHSMCJKTABCXB2PAGXH65OEUF6LBQXP7XZFNMYOD3H76IPEQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547382454 (7h37m31.278650084s) [noise=true , address=104.36.82.37:4665 , piece_id=F5RO7SFTH54IDNLT7KF2TNOQRVZEFODCYG65ONZJ6THD4LZKKJJA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547771219 (7h37m31.27903884s) [noise=true , address=104.36.82.59:4314 , piece_id=SCL4G7EHDMHOWB7MZRTOLBT2TUZL45AE7A3UIKOQ2HCGI4AJLQCA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547817245 (7h37m31.279084875s) [noise=true , address=104.36.82.14:4245 , piece_id=4B7WJJILP2ZJ2DIDTPSTI55G67X6IBC24POPB4BCVSJOT4ZFKK3Q, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548158312 (7h37m31.279425942s) [noise=true , address=104.36.82.60:4342 , piece_id=GTKAIDOMRHEEWSS2H64BVSLX245AYHVVIXORCJKFMSIAC7VGOZLQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548182277 (7h37m31.279449907s) [noise=true , address=104.36.82.16:4311 , piece_id=WHQMSXMRLD5QRU6GYEPX2U7YTK7OBEHBKHJXWU2YKBZBA4SQJNEA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548510239 (7h37m31.27977787s) [noise=true , address=104.36.82.21:4479 , piece_id=ZKGGJ6T7MZETBH7P72Y4MHWMTK2CAYR5PYQEGNNN7XOYV63BG2HQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548553630 (7h37m31.27982126s) [noise=true , address=104.36.82.44:4897 , piece_id=YMDI7WR2P3M2HTRDLQNCC24ZU2NRRBH6JDJEHOY6WEBK6KKO5PBQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548917339 (7h37m31.280184959s) [noise=true , address=104.36.82.38:4710 , piece_id=AYQ2JWIS4Y6ECJOPZLL3VO7UEL3LAU72EDKKBZBE77G3XHRUKT3A, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548924042 (7h37m31.280191682s) [noise=true , address=104.36.82.17:4332 , piece_id=NRWIFJYUBAMBJ3FBMRXE3YZTREOENZYWB6J4BJLXIIPQKKXNVRUQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548959829 (7h37m31.280227459s) [noise=true , address=104.36.82.53:4144 , piece_id=AZ4C2TJSHYEVYUUEYI7K7QHHBQVAG6NMP2BJALLEE7IY5YFD6FZA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549302238 (7h37m31.280569868s) [noise=true , address=104.36.82.39:4737 , piece_id=AMV62VOAKHJUZCZWNEYGJKY572LWVJZMANNMQEQIS2HHKR3YVRSQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549314360 (7h37m31.28058199s) [noise=true , address=104.36.82.11:4122 , piece_id=HOAEVCU5N4KLGF7O7ZZJC7YC5OB4VZOZIDKDTQTTOR4TU5T3IZXQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549666998 (7h37m31.280934628s) [noise=true , address=104.36.82.4:4812 , piece_id=VKHFSCHUKZFGXRICZGSICWUTOK2BFMG6LAIC67ORAFN7S44SOPPQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.550026399 (7h37m31.281294019s) [noise=true , address=104.36.82.46:4498 , piece_id=C7HSUOEHMVCU5BX3XGAO4LWIGKXPE2IR6U7EOUBSJDSN3CIVRPPQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.550347188 (7h37m31.281614818s) [noise=true , address=104.36.82.62:4440 , piece_id=45DAJ7PILLSEBZICG7W7KKUR7ENYPF57DM2JA5COJV7IWRFB7KTQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.551515258 (7h37m31.282782888s) [noise=true , address=104.36.82.9:4029 , piece_id=LUA5Q3ZUO3SZI24ZPZGXIRLEMBZX3XQFYJQMCY6E4SXMBQTHSAGA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.553639614 (7h37m31.284907244s) [noise=true , address=104.36.82.34:4578 , piece_id=WROE2XH3WOMRAJ4OJBD5LGCCTUMI7ECXHO6HYYRXYNBNBPN7I5ZQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.654119682 (7h37m31.385387312s) [upload=7928]: Next returned nil segment Aug 9 01:03:50.654133758 (7h37m31.385401378s) [upload=7928]: Waiting for error group managing segments... Aug 9 01:03:50.672101667 (7h37m31.403369288s) [noise=true , address=104.36.82.16:4311 , piece_id=WHQMSXMRLD5QRU6GYEPX2U7YTK7OBEHBKHJXWU2YKBZBA4SQJNEA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.672877525 (7h37m31.404145145s) [noise=true , address=104.36.82.38:4710 , piece_id=AYQ2JWIS4Y6ECJOPZLL3VO7UEL3LAU72EDKKBZBE77G3XHRUKT3A, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.675306269 (7h37m31.406573909s) [noise=true , address=104.36.82.59:4314 , piece_id=SCL4G7EHDMHOWB7MZRTOLBT2TUZL45AE7A3UIKOQ2HCGI4AJLQCA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.675371770 (7h37m31.406639391s) [noise=true , address=104.36.82.37:4665 , piece_id=F5RO7SFTH54IDNLT7KF2TNOQRVZEFODCYG65ONZJ6THD4LZKKJJA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.683603266 (7h37m31.414870896s) [noise=true , address=104.36.82.34:4578 , piece_id=WROE2XH3WOMRAJ4OJBD5LGCCTUMI7ECXHO6HYYRXYNBNBPN7I5ZQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.685155513 (7h37m31.416423133s) [noise=true , address=104.36.82.39:4737 , piece_id=AMV62VOAKHJUZCZWNEYGJKY572LWVJZMANNMQEQIS2HHKR3YVRSQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.685621413 (7h37m31.416889033s) [noise=true , address=104.36.82.53:4144 , piece_id=AZ4C2TJSHYEVYUUEYI7K7QHHBQVAG6NMP2BJALLEE7IY5YFD6FZA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.686461230 (7h37m31.41772886s) [noise=true , address=104.36.82.17:4332 , piece_id=NRWIFJYUBAMBJ3FBMRXE3YZTREOENZYWB6J4BJLXIIPQKKXNVRUQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.686992623 (7h37m31.418260253s) [noise=true , address=104.36.82.12:4173 , piece_id=VBNMKHSMCJKTABCXB2PAGXH65OEUF6LBQXP7XZFNMYOD3H76IPEQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.687219727 (7h37m31.418487347s) [noise=true , address=104.36.82.21:4479 , piece_id=ZKGGJ6T7MZETBH7P72Y4MHWMTK2CAYR5PYQEGNNN7XOYV63BG2HQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.692430363 (7h37m31.423697993s) [noise=true , address=104.36.82.14:4245 , piece_id=4B7WJJILP2ZJ2DIDTPSTI55G67X6IBC24POPB4BCVSJOT4ZFKK3Q, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.707237672 (7h37m31.438505302s) [noise=true , address=104.36.82.9:4029 , piece_id=LUA5Q3ZUO3SZI24ZPZGXIRLEMBZX3XQFYJQMCY6E4SXMBQTHSAGA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.716934623 (7h37m31.448202253s) [noise=true , address=104.36.82.4:4812 , piece_id=VKHFSCHUKZFGXRICZGSICWUTOK2BFMG6LAIC67ORAFN7S44SOPPQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.766972144 (7h37m31.498239774s) [noise=true , address=104.36.82.44:4897 , piece_id=YMDI7WR2P3M2HTRDLQNCC24ZU2NRRBH6JDJEHOY6WEBK6KKO5PBQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.766989206 (7h37m31.498256836s) [seg_pos={0 0}, upload=7928]: Segment reached optimal threshold of 14 pieces. Aug 9 01:03:50.767124678 (7h37m31.498392309s) [noise=true , address=104.36.82.62:4440 , piece_id=45DAJ7PILLSEBZICG7W7KKUR7ENYPF57DM2JA5COJV7IWRFB7KTQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jvc3V5SqNUTwbUea883sp3jsPPu1PAzJaUwcjPjxdjm3JiF2L): protocol: write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection; write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection Aug 9 01:03:50.767270229 (7h37m31.49853786s) [noise=true , address=104.36.82.60:4342 , piece_id=GTKAIDOMRHEEWSS2H64BVSLX245AYHVVIXORCJKFMSIAC7VGOZLQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB): protocol: read tcp 5.161.89.252:54032->104.36.82.60:4342: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 9 01:03:50.767296629 (7h37m31.498564249s) [noise=true , address=104.36.82.46:4498 , piece_id=C7HSUOEHMVCU5BX3XGAO4LWIGKXPE2IR6U7EOUBSJDSN3CIVRPPQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jyjxdWkBRBkDHSKknNmPdcnJ3HRcSCUQNnmpb1CaiEdMPEGk4): protocol: expected piece hash; context canceled; EOF Aug 9 01:03:50.767313812 (7h37m31.498581442s) [noise=true , address=104.36.82.11:4122 , piece_id=HOAEVCU5N4KLGF7O7ZZJC7YC5OB4VZOZIDKDTQTTOR4TU5T3IZXQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1oCu75zR8YccTunHjctcLzTrr9wTQqtAPXHiWrsQs41o8gxgh6): protocol: write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection; write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection Aug 9 01:03:50.767324712 (7h37m31.498592332s) [seg_pos={0 0}, upload=7928]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 01:03:50.767376188 (7h37m31.498643818s) [upload=7928]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 01:03:50.767381278 (7h37m31.498648908s) [upload=7928]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 01:03:50.890154929 (7h37m31.621422559s) [upload=7928]: Done uploading segments... Aug 9 01:03:50.890168986 (7h37m31.621436606s) [upload=7928]: Upload finished. err: <nil> Duration: 435.675984ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [....X.......X..............X......X.........................] duration: 1.824666656s FAIL (2025-08-09 01:24:23 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 9 01:03:50.521251227 (7h37m31.252518857s) [upload=7928]: Starting upload Aug 9 01:03:50.521308083 (7h37m31.252575713s) [upload=7928]: Done starting upload Aug 9 01:03:50.521407979 (7h37m31.252675609s) [upload=7928]: Uploading segments... Aug 9 01:03:50.521679086 (7h37m31.252946716s) [upload=7928]: Got next segment. Inline: false Aug 9 01:03:50.521722226 (7h37m31.252989866s) [upload=7928]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:03:50.521727255 (7h37m31.252994885s) [upload=7928]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 01:03:50.547289380 (7h37m31.278557001s) [seg_pos={0 0}, upload=7928]: Begin upload segment... Aug 9 01:03:50.547314256 (7h37m31.278581886s) [seg_pos={0 0}, upload=7928]: Done begin upload segment. Aug 9 01:03:50.547335476 (7h37m31.278603116s) [noise=true , address=104.36.82.12:4173 , piece_id=VBNMKHSMCJKTABCXB2PAGXH65OEUF6LBQXP7XZFNMYOD3H76IPEQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547382454 (7h37m31.278650084s) [noise=true , address=104.36.82.37:4665 , piece_id=F5RO7SFTH54IDNLT7KF2TNOQRVZEFODCYG65ONZJ6THD4LZKKJJA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547771219 (7h37m31.27903884s) [noise=true , address=104.36.82.59:4314 , piece_id=SCL4G7EHDMHOWB7MZRTOLBT2TUZL45AE7A3UIKOQ2HCGI4AJLQCA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547817245 (7h37m31.279084875s) [noise=true , address=104.36.82.14:4245 , piece_id=4B7WJJILP2ZJ2DIDTPSTI55G67X6IBC24POPB4BCVSJOT4ZFKK3Q, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548158312 (7h37m31.279425942s) [noise=true , address=104.36.82.60:4342 , piece_id=GTKAIDOMRHEEWSS2H64BVSLX245AYHVVIXORCJKFMSIAC7VGOZLQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548182277 (7h37m31.279449907s) [noise=true , address=104.36.82.16:4311 , piece_id=WHQMSXMRLD5QRU6GYEPX2U7YTK7OBEHBKHJXWU2YKBZBA4SQJNEA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548510239 (7h37m31.27977787s) [noise=true , address=104.36.82.21:4479 , piece_id=ZKGGJ6T7MZETBH7P72Y4MHWMTK2CAYR5PYQEGNNN7XOYV63BG2HQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548553630 (7h37m31.27982126s) [noise=true , address=104.36.82.44:4897 , piece_id=YMDI7WR2P3M2HTRDLQNCC24ZU2NRRBH6JDJEHOY6WEBK6KKO5PBQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548917339 (7h37m31.280184959s) [noise=true , address=104.36.82.38:4710 , piece_id=AYQ2JWIS4Y6ECJOPZLL3VO7UEL3LAU72EDKKBZBE77G3XHRUKT3A, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548924042 (7h37m31.280191682s) [noise=true , address=104.36.82.17:4332 , piece_id=NRWIFJYUBAMBJ3FBMRXE3YZTREOENZYWB6J4BJLXIIPQKKXNVRUQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548959829 (7h37m31.280227459s) [noise=true , address=104.36.82.53:4144 , piece_id=AZ4C2TJSHYEVYUUEYI7K7QHHBQVAG6NMP2BJALLEE7IY5YFD6FZA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549302238 (7h37m31.280569868s) [noise=true , address=104.36.82.39:4737 , piece_id=AMV62VOAKHJUZCZWNEYGJKY572LWVJZMANNMQEQIS2HHKR3YVRSQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549314360 (7h37m31.28058199s) [noise=true , address=104.36.82.11:4122 , piece_id=HOAEVCU5N4KLGF7O7ZZJC7YC5OB4VZOZIDKDTQTTOR4TU5T3IZXQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549666998 (7h37m31.280934628s) [noise=true , address=104.36.82.4:4812 , piece_id=VKHFSCHUKZFGXRICZGSICWUTOK2BFMG6LAIC67ORAFN7S44SOPPQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.550026399 (7h37m31.281294019s) [noise=true , address=104.36.82.46:4498 , piece_id=C7HSUOEHMVCU5BX3XGAO4LWIGKXPE2IR6U7EOUBSJDSN3CIVRPPQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.550347188 (7h37m31.281614818s) [noise=true , address=104.36.82.62:4440 , piece_id=45DAJ7PILLSEBZICG7W7KKUR7ENYPF57DM2JA5COJV7IWRFB7KTQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.551515258 (7h37m31.282782888s) [noise=true , address=104.36.82.9:4029 , piece_id=LUA5Q3ZUO3SZI24ZPZGXIRLEMBZX3XQFYJQMCY6E4SXMBQTHSAGA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.553639614 (7h37m31.284907244s) [noise=true , address=104.36.82.34:4578 , piece_id=WROE2XH3WOMRAJ4OJBD5LGCCTUMI7ECXHO6HYYRXYNBNBPN7I5ZQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.654119682 (7h37m31.385387312s) [upload=7928]: Next returned nil segment Aug 9 01:03:50.654133758 (7h37m31.385401378s) [upload=7928]: Waiting for error group managing segments... Aug 9 01:03:50.672101667 (7h37m31.403369288s) [noise=true , address=104.36.82.16:4311 , piece_id=WHQMSXMRLD5QRU6GYEPX2U7YTK7OBEHBKHJXWU2YKBZBA4SQJNEA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.672877525 (7h37m31.404145145s) [noise=true , address=104.36.82.38:4710 , piece_id=AYQ2JWIS4Y6ECJOPZLL3VO7UEL3LAU72EDKKBZBE77G3XHRUKT3A, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.675306269 (7h37m31.406573909s) [noise=true , address=104.36.82.59:4314 , piece_id=SCL4G7EHDMHOWB7MZRTOLBT2TUZL45AE7A3UIKOQ2HCGI4AJLQCA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.675371770 (7h37m31.406639391s) [noise=true , address=104.36.82.37:4665 , piece_id=F5RO7SFTH54IDNLT7KF2TNOQRVZEFODCYG65ONZJ6THD4LZKKJJA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.683603266 (7h37m31.414870896s) [noise=true , address=104.36.82.34:4578 , piece_id=WROE2XH3WOMRAJ4OJBD5LGCCTUMI7ECXHO6HYYRXYNBNBPN7I5ZQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.685155513 (7h37m31.416423133s) [noise=true , address=104.36.82.39:4737 , piece_id=AMV62VOAKHJUZCZWNEYGJKY572LWVJZMANNMQEQIS2HHKR3YVRSQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.685621413 (7h37m31.416889033s) [noise=true , address=104.36.82.53:4144 , piece_id=AZ4C2TJSHYEVYUUEYI7K7QHHBQVAG6NMP2BJALLEE7IY5YFD6FZA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.686461230 (7h37m31.41772886s) [noise=true , address=104.36.82.17:4332 , piece_id=NRWIFJYUBAMBJ3FBMRXE3YZTREOENZYWB6J4BJLXIIPQKKXNVRUQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.686992623 (7h37m31.418260253s) [noise=true , address=104.36.82.12:4173 , piece_id=VBNMKHSMCJKTABCXB2PAGXH65OEUF6LBQXP7XZFNMYOD3H76IPEQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.687219727 (7h37m31.418487347s) [noise=true , address=104.36.82.21:4479 , piece_id=ZKGGJ6T7MZETBH7P72Y4MHWMTK2CAYR5PYQEGNNN7XOYV63BG2HQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.692430363 (7h37m31.423697993s) [noise=true , address=104.36.82.14:4245 , piece_id=4B7WJJILP2ZJ2DIDTPSTI55G67X6IBC24POPB4BCVSJOT4ZFKK3Q, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.707237672 (7h37m31.438505302s) [noise=true , address=104.36.82.9:4029 , piece_id=LUA5Q3ZUO3SZI24ZPZGXIRLEMBZX3XQFYJQMCY6E4SXMBQTHSAGA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.716934623 (7h37m31.448202253s) [noise=true , address=104.36.82.4:4812 , piece_id=VKHFSCHUKZFGXRICZGSICWUTOK2BFMG6LAIC67ORAFN7S44SOPPQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.766972144 (7h37m31.498239774s) [noise=true , address=104.36.82.44:4897 , piece_id=YMDI7WR2P3M2HTRDLQNCC24ZU2NRRBH6JDJEHOY6WEBK6KKO5PBQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.766989206 (7h37m31.498256836s) [seg_pos={0 0}, upload=7928]: Segment reached optimal threshold of 14 pieces. Aug 9 01:03:50.767124678 (7h37m31.498392309s) [noise=true , address=104.36.82.62:4440 , piece_id=45DAJ7PILLSEBZICG7W7KKUR7ENYPF57DM2JA5COJV7IWRFB7KTQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jvc3V5SqNUTwbUea883sp3jsPPu1PAzJaUwcjPjxdjm3JiF2L): protocol: write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection; write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection Aug 9 01:03:50.767270229 (7h37m31.49853786s) [noise=true , address=104.36.82.60:4342 , piece_id=GTKAIDOMRHEEWSS2H64BVSLX245AYHVVIXORCJKFMSIAC7VGOZLQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB): protocol: read tcp 5.161.89.252:54032->104.36.82.60:4342: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 9 01:03:50.767296629 (7h37m31.498564249s) [noise=true , address=104.36.82.46:4498 , piece_id=C7HSUOEHMVCU5BX3XGAO4LWIGKXPE2IR6U7EOUBSJDSN3CIVRPPQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jyjxdWkBRBkDHSKknNmPdcnJ3HRcSCUQNnmpb1CaiEdMPEGk4): protocol: expected piece hash; context canceled; EOF Aug 9 01:03:50.767313812 (7h37m31.498581442s) [noise=true , address=104.36.82.11:4122 , piece_id=HOAEVCU5N4KLGF7O7ZZJC7YC5OB4VZOZIDKDTQTTOR4TU5T3IZXQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1oCu75zR8YccTunHjctcLzTrr9wTQqtAPXHiWrsQs41o8gxgh6): protocol: write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection; write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection Aug 9 01:03:50.767324712 (7h37m31.498592332s) [seg_pos={0 0}, upload=7928]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 01:03:50.767376188 (7h37m31.498643818s) [upload=7928]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 01:03:50.767381278 (7h37m31.498648908s) [upload=7928]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 01:03:50.890154929 (7h37m31.621422559s) [upload=7928]: Done uploading segments... Aug 9 01:03:50.890168986 (7h37m31.621436606s) [upload=7928]: Upload finished. err: <nil> Duration: 1.824687846s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 153.541716ms FAIL (2025-08-09 01:24:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:52:13.986283699 (7h25m54.71755135s) [upload=7723]: Starting upload Aug 9 00:52:13.986408060 (7h25m54.717675711s) [upload=7723]: Done starting upload Aug 9 00:52:13.986481939 (7h25m54.71774956s) [upload=7723]: Uploading segments... Aug 9 00:52:13.986553753 (7h25m54.717821373s) [upload=7723]: Got next segment. Inline: true Aug 9 00:52:13.986558031 (7h25m54.717825641s) [upload=7723]: Waiting for error group managing segments... Aug 9 00:52:13.986608676 (7h25m54.717876296s) [upload=7723]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 00:52:13.986612834 (7h25m54.717880454s) [upload=7723]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 00:52:13.986615108 (7h25m54.717882728s) [upload=7723]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 00:52:13.989421897 (7h25m54.720689516s) [upload=7723]: Done uploading segments... Aug 9 00:52:13.989431464 (7h25m54.720699084s) [upload=7723]: Upload finished. err: metaclient: Too Many Requests Duration:* 153.564548ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 176.114911ms FAIL (2025-08-09 01:23:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:52:13.986283699 (7h25m54.71755135s) [upload=7723]: Starting upload Aug 9 00:52:13.986408060 (7h25m54.717675711s) [upload=7723]: Done starting upload Aug 9 00:52:13.986481939 (7h25m54.71774956s) [upload=7723]: Uploading segments... Aug 9 00:52:13.986553753 (7h25m54.717821373s) [upload=7723]: Got next segment. Inline: true Aug 9 00:52:13.986558031 (7h25m54.717825641s) [upload=7723]: Waiting for error group managing segments... Aug 9 00:52:13.986608676 (7h25m54.717876296s) [upload=7723]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 00:52:13.986612834 (7h25m54.717880454s) [upload=7723]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 00:52:13.986615108 (7h25m54.717882728s) [upload=7723]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 00:52:13.989421897 (7h25m54.720689516s) [upload=7723]: Done uploading segments... Aug 9 00:52:13.989431464 (7h25m54.720699084s) [upload=7723]: Upload finished. err: metaclient: Too Many Requests Duration:* 176.140408ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.....X.......X..............X......X........................] duration: 688.515713ms FAIL (2025-08-09 01:23:31 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 9 01:03:50.521251227 (7h37m31.252518857s) [upload=7928]: Starting upload Aug 9 01:03:50.521308083 (7h37m31.252575713s) [upload=7928]: Done starting upload Aug 9 01:03:50.521407979 (7h37m31.252675609s) [upload=7928]: Uploading segments... Aug 9 01:03:50.521679086 (7h37m31.252946716s) [upload=7928]: Got next segment. Inline: false Aug 9 01:03:50.521722226 (7h37m31.252989866s) [upload=7928]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:03:50.521727255 (7h37m31.252994885s) [upload=7928]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 01:03:50.547289380 (7h37m31.278557001s) [seg_pos={0 0}, upload=7928]: Begin upload segment... Aug 9 01:03:50.547314256 (7h37m31.278581886s) [seg_pos={0 0}, upload=7928]: Done begin upload segment. Aug 9 01:03:50.547335476 (7h37m31.278603116s) [noise=true , address=104.36.82.12:4173 , piece_id=VBNMKHSMCJKTABCXB2PAGXH65OEUF6LBQXP7XZFNMYOD3H76IPEQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547382454 (7h37m31.278650084s) [noise=true , address=104.36.82.37:4665 , piece_id=F5RO7SFTH54IDNLT7KF2TNOQRVZEFODCYG65ONZJ6THD4LZKKJJA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547771219 (7h37m31.27903884s) [noise=true , address=104.36.82.59:4314 , piece_id=SCL4G7EHDMHOWB7MZRTOLBT2TUZL45AE7A3UIKOQ2HCGI4AJLQCA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547817245 (7h37m31.279084875s) [noise=true , address=104.36.82.14:4245 , piece_id=4B7WJJILP2ZJ2DIDTPSTI55G67X6IBC24POPB4BCVSJOT4ZFKK3Q, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548158312 (7h37m31.279425942s) [noise=true , address=104.36.82.60:4342 , piece_id=GTKAIDOMRHEEWSS2H64BVSLX245AYHVVIXORCJKFMSIAC7VGOZLQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548182277 (7h37m31.279449907s) [noise=true , address=104.36.82.16:4311 , piece_id=WHQMSXMRLD5QRU6GYEPX2U7YTK7OBEHBKHJXWU2YKBZBA4SQJNEA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548510239 (7h37m31.27977787s) [noise=true , address=104.36.82.21:4479 , piece_id=ZKGGJ6T7MZETBH7P72Y4MHWMTK2CAYR5PYQEGNNN7XOYV63BG2HQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548553630 (7h37m31.27982126s) [noise=true , address=104.36.82.44:4897 , piece_id=YMDI7WR2P3M2HTRDLQNCC24ZU2NRRBH6JDJEHOY6WEBK6KKO5PBQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548917339 (7h37m31.280184959s) [noise=true , address=104.36.82.38:4710 , piece_id=AYQ2JWIS4Y6ECJOPZLL3VO7UEL3LAU72EDKKBZBE77G3XHRUKT3A, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548924042 (7h37m31.280191682s) [noise=true , address=104.36.82.17:4332 , piece_id=NRWIFJYUBAMBJ3FBMRXE3YZTREOENZYWB6J4BJLXIIPQKKXNVRUQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548959829 (7h37m31.280227459s) [noise=true , address=104.36.82.53:4144 , piece_id=AZ4C2TJSHYEVYUUEYI7K7QHHBQVAG6NMP2BJALLEE7IY5YFD6FZA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549302238 (7h37m31.280569868s) [noise=true , address=104.36.82.39:4737 , piece_id=AMV62VOAKHJUZCZWNEYGJKY572LWVJZMANNMQEQIS2HHKR3YVRSQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549314360 (7h37m31.28058199s) [noise=true , address=104.36.82.11:4122 , piece_id=HOAEVCU5N4KLGF7O7ZZJC7YC5OB4VZOZIDKDTQTTOR4TU5T3IZXQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549666998 (7h37m31.280934628s) [noise=true , address=104.36.82.4:4812 , piece_id=VKHFSCHUKZFGXRICZGSICWUTOK2BFMG6LAIC67ORAFN7S44SOPPQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.550026399 (7h37m31.281294019s) [noise=true , address=104.36.82.46:4498 , piece_id=C7HSUOEHMVCU5BX3XGAO4LWIGKXPE2IR6U7EOUBSJDSN3CIVRPPQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.550347188 (7h37m31.281614818s) [noise=true , address=104.36.82.62:4440 , piece_id=45DAJ7PILLSEBZICG7W7KKUR7ENYPF57DM2JA5COJV7IWRFB7KTQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.551515258 (7h37m31.282782888s) [noise=true , address=104.36.82.9:4029 , piece_id=LUA5Q3ZUO3SZI24ZPZGXIRLEMBZX3XQFYJQMCY6E4SXMBQTHSAGA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.553639614 (7h37m31.284907244s) [noise=true , address=104.36.82.34:4578 , piece_id=WROE2XH3WOMRAJ4OJBD5LGCCTUMI7ECXHO6HYYRXYNBNBPN7I5ZQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.654119682 (7h37m31.385387312s) [upload=7928]: Next returned nil segment Aug 9 01:03:50.654133758 (7h37m31.385401378s) [upload=7928]: Waiting for error group managing segments... Aug 9 01:03:50.672101667 (7h37m31.403369288s) [noise=true , address=104.36.82.16:4311 , piece_id=WHQMSXMRLD5QRU6GYEPX2U7YTK7OBEHBKHJXWU2YKBZBA4SQJNEA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.672877525 (7h37m31.404145145s) [noise=true , address=104.36.82.38:4710 , piece_id=AYQ2JWIS4Y6ECJOPZLL3VO7UEL3LAU72EDKKBZBE77G3XHRUKT3A, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.675306269 (7h37m31.406573909s) [noise=true , address=104.36.82.59:4314 , piece_id=SCL4G7EHDMHOWB7MZRTOLBT2TUZL45AE7A3UIKOQ2HCGI4AJLQCA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.675371770 (7h37m31.406639391s) [noise=true , address=104.36.82.37:4665 , piece_id=F5RO7SFTH54IDNLT7KF2TNOQRVZEFODCYG65ONZJ6THD4LZKKJJA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.683603266 (7h37m31.414870896s) [noise=true , address=104.36.82.34:4578 , piece_id=WROE2XH3WOMRAJ4OJBD5LGCCTUMI7ECXHO6HYYRXYNBNBPN7I5ZQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.685155513 (7h37m31.416423133s) [noise=true , address=104.36.82.39:4737 , piece_id=AMV62VOAKHJUZCZWNEYGJKY572LWVJZMANNMQEQIS2HHKR3YVRSQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.685621413 (7h37m31.416889033s) [noise=true , address=104.36.82.53:4144 , piece_id=AZ4C2TJSHYEVYUUEYI7K7QHHBQVAG6NMP2BJALLEE7IY5YFD6FZA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.686461230 (7h37m31.41772886s) [noise=true , address=104.36.82.17:4332 , piece_id=NRWIFJYUBAMBJ3FBMRXE3YZTREOENZYWB6J4BJLXIIPQKKXNVRUQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.686992623 (7h37m31.418260253s) [noise=true , address=104.36.82.12:4173 , piece_id=VBNMKHSMCJKTABCXB2PAGXH65OEUF6LBQXP7XZFNMYOD3H76IPEQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.687219727 (7h37m31.418487347s) [noise=true , address=104.36.82.21:4479 , piece_id=ZKGGJ6T7MZETBH7P72Y4MHWMTK2CAYR5PYQEGNNN7XOYV63BG2HQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.692430363 (7h37m31.423697993s) [noise=true , address=104.36.82.14:4245 , piece_id=4B7WJJILP2ZJ2DIDTPSTI55G67X6IBC24POPB4BCVSJOT4ZFKK3Q, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.707237672 (7h37m31.438505302s) [noise=true , address=104.36.82.9:4029 , piece_id=LUA5Q3ZUO3SZI24ZPZGXIRLEMBZX3XQFYJQMCY6E4SXMBQTHSAGA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.716934623 (7h37m31.448202253s) [noise=true , address=104.36.82.4:4812 , piece_id=VKHFSCHUKZFGXRICZGSICWUTOK2BFMG6LAIC67ORAFN7S44SOPPQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.766972144 (7h37m31.498239774s) [noise=true , address=104.36.82.44:4897 , piece_id=YMDI7WR2P3M2HTRDLQNCC24ZU2NRRBH6JDJEHOY6WEBK6KKO5PBQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.766989206 (7h37m31.498256836s) [seg_pos={0 0}, upload=7928]: Segment reached optimal threshold of 14 pieces. Aug 9 01:03:50.767124678 (7h37m31.498392309s) [noise=true , address=104.36.82.62:4440 , piece_id=45DAJ7PILLSEBZICG7W7KKUR7ENYPF57DM2JA5COJV7IWRFB7KTQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jvc3V5SqNUTwbUea883sp3jsPPu1PAzJaUwcjPjxdjm3JiF2L): protocol: write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection; write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection Aug 9 01:03:50.767270229 (7h37m31.49853786s) [noise=true , address=104.36.82.60:4342 , piece_id=GTKAIDOMRHEEWSS2H64BVSLX245AYHVVIXORCJKFMSIAC7VGOZLQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB): protocol: read tcp 5.161.89.252:54032->104.36.82.60:4342: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 9 01:03:50.767296629 (7h37m31.498564249s) [noise=true , address=104.36.82.46:4498 , piece_id=C7HSUOEHMVCU5BX3XGAO4LWIGKXPE2IR6U7EOUBSJDSN3CIVRPPQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jyjxdWkBRBkDHSKknNmPdcnJ3HRcSCUQNnmpb1CaiEdMPEGk4): protocol: expected piece hash; context canceled; EOF Aug 9 01:03:50.767313812 (7h37m31.498581442s) [noise=true , address=104.36.82.11:4122 , piece_id=HOAEVCU5N4KLGF7O7ZZJC7YC5OB4VZOZIDKDTQTTOR4TU5T3IZXQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1oCu75zR8YccTunHjctcLzTrr9wTQqtAPXHiWrsQs41o8gxgh6): protocol: write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection; write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection Aug 9 01:03:50.767324712 (7h37m31.498592332s) [seg_pos={0 0}, upload=7928]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 01:03:50.767376188 (7h37m31.498643818s) [upload=7928]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 01:03:50.767381278 (7h37m31.498648908s) [upload=7928]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 01:03:50.890154929 (7h37m31.621422559s) [upload=7928]: Done uploading segments... Aug 9 01:03:50.890168986 (7h37m31.621436606s) [upload=7928]: Upload finished. err: <nil> Duration: 688.54104ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 316.743783ms FAIL (2025-08-09 01:22:41 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:52:13.986283699 (7h25m54.71755135s) [upload=7723]: Starting upload Aug 9 00:52:13.986408060 (7h25m54.717675711s) [upload=7723]: Done starting upload Aug 9 00:52:13.986481939 (7h25m54.71774956s) [upload=7723]: Uploading segments... Aug 9 00:52:13.986553753 (7h25m54.717821373s) [upload=7723]: Got next segment. Inline: true Aug 9 00:52:13.986558031 (7h25m54.717825641s) [upload=7723]: Waiting for error group managing segments... Aug 9 00:52:13.986608676 (7h25m54.717876296s) [upload=7723]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 00:52:13.986612834 (7h25m54.717880454s) [upload=7723]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 00:52:13.986615108 (7h25m54.717882728s) [upload=7723]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 00:52:13.989421897 (7h25m54.720689516s) [upload=7723]: Done uploading segments... Aug 9 00:52:13.989431464 (7h25m54.720699084s) [upload=7723]: Upload finished. err: metaclient: Too Many Requests Duration:* 316.810517ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [......X.......X..............X......X.......................] duration: 542.112362ms FAIL (2025-08-09 01:22:29 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 9 01:03:50.521251227 (7h37m31.252518857s) [upload=7928]: Starting upload Aug 9 01:03:50.521308083 (7h37m31.252575713s) [upload=7928]: Done starting upload Aug 9 01:03:50.521407979 (7h37m31.252675609s) [upload=7928]: Uploading segments... Aug 9 01:03:50.521679086 (7h37m31.252946716s) [upload=7928]: Got next segment. Inline: false Aug 9 01:03:50.521722226 (7h37m31.252989866s) [upload=7928]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:03:50.521727255 (7h37m31.252994885s) [upload=7928]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 01:03:50.547289380 (7h37m31.278557001s) [seg_pos={0 0}, upload=7928]: Begin upload segment... Aug 9 01:03:50.547314256 (7h37m31.278581886s) [seg_pos={0 0}, upload=7928]: Done begin upload segment. Aug 9 01:03:50.547335476 (7h37m31.278603116s) [noise=true , address=104.36.82.12:4173 , piece_id=VBNMKHSMCJKTABCXB2PAGXH65OEUF6LBQXP7XZFNMYOD3H76IPEQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547382454 (7h37m31.278650084s) [noise=true , address=104.36.82.37:4665 , piece_id=F5RO7SFTH54IDNLT7KF2TNOQRVZEFODCYG65ONZJ6THD4LZKKJJA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547771219 (7h37m31.27903884s) [noise=true , address=104.36.82.59:4314 , piece_id=SCL4G7EHDMHOWB7MZRTOLBT2TUZL45AE7A3UIKOQ2HCGI4AJLQCA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547817245 (7h37m31.279084875s) [noise=true , address=104.36.82.14:4245 , piece_id=4B7WJJILP2ZJ2DIDTPSTI55G67X6IBC24POPB4BCVSJOT4ZFKK3Q, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548158312 (7h37m31.279425942s) [noise=true , address=104.36.82.60:4342 , piece_id=GTKAIDOMRHEEWSS2H64BVSLX245AYHVVIXORCJKFMSIAC7VGOZLQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548182277 (7h37m31.279449907s) [noise=true , address=104.36.82.16:4311 , piece_id=WHQMSXMRLD5QRU6GYEPX2U7YTK7OBEHBKHJXWU2YKBZBA4SQJNEA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548510239 (7h37m31.27977787s) [noise=true , address=104.36.82.21:4479 , piece_id=ZKGGJ6T7MZETBH7P72Y4MHWMTK2CAYR5PYQEGNNN7XOYV63BG2HQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548553630 (7h37m31.27982126s) [noise=true , address=104.36.82.44:4897 , piece_id=YMDI7WR2P3M2HTRDLQNCC24ZU2NRRBH6JDJEHOY6WEBK6KKO5PBQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548917339 (7h37m31.280184959s) [noise=true , address=104.36.82.38:4710 , piece_id=AYQ2JWIS4Y6ECJOPZLL3VO7UEL3LAU72EDKKBZBE77G3XHRUKT3A, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548924042 (7h37m31.280191682s) [noise=true , address=104.36.82.17:4332 , piece_id=NRWIFJYUBAMBJ3FBMRXE3YZTREOENZYWB6J4BJLXIIPQKKXNVRUQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548959829 (7h37m31.280227459s) [noise=true , address=104.36.82.53:4144 , piece_id=AZ4C2TJSHYEVYUUEYI7K7QHHBQVAG6NMP2BJALLEE7IY5YFD6FZA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549302238 (7h37m31.280569868s) [noise=true , address=104.36.82.39:4737 , piece_id=AMV62VOAKHJUZCZWNEYGJKY572LWVJZMANNMQEQIS2HHKR3YVRSQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549314360 (7h37m31.28058199s) [noise=true , address=104.36.82.11:4122 , piece_id=HOAEVCU5N4KLGF7O7ZZJC7YC5OB4VZOZIDKDTQTTOR4TU5T3IZXQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549666998 (7h37m31.280934628s) [noise=true , address=104.36.82.4:4812 , piece_id=VKHFSCHUKZFGXRICZGSICWUTOK2BFMG6LAIC67ORAFN7S44SOPPQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.550026399 (7h37m31.281294019s) [noise=true , address=104.36.82.46:4498 , piece_id=C7HSUOEHMVCU5BX3XGAO4LWIGKXPE2IR6U7EOUBSJDSN3CIVRPPQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.550347188 (7h37m31.281614818s) [noise=true , address=104.36.82.62:4440 , piece_id=45DAJ7PILLSEBZICG7W7KKUR7ENYPF57DM2JA5COJV7IWRFB7KTQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.551515258 (7h37m31.282782888s) [noise=true , address=104.36.82.9:4029 , piece_id=LUA5Q3ZUO3SZI24ZPZGXIRLEMBZX3XQFYJQMCY6E4SXMBQTHSAGA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.553639614 (7h37m31.284907244s) [noise=true , address=104.36.82.34:4578 , piece_id=WROE2XH3WOMRAJ4OJBD5LGCCTUMI7ECXHO6HYYRXYNBNBPN7I5ZQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.654119682 (7h37m31.385387312s) [upload=7928]: Next returned nil segment Aug 9 01:03:50.654133758 (7h37m31.385401378s) [upload=7928]: Waiting for error group managing segments... Aug 9 01:03:50.672101667 (7h37m31.403369288s) [noise=true , address=104.36.82.16:4311 , piece_id=WHQMSXMRLD5QRU6GYEPX2U7YTK7OBEHBKHJXWU2YKBZBA4SQJNEA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.672877525 (7h37m31.404145145s) [noise=true , address=104.36.82.38:4710 , piece_id=AYQ2JWIS4Y6ECJOPZLL3VO7UEL3LAU72EDKKBZBE77G3XHRUKT3A, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.675306269 (7h37m31.406573909s) [noise=true , address=104.36.82.59:4314 , piece_id=SCL4G7EHDMHOWB7MZRTOLBT2TUZL45AE7A3UIKOQ2HCGI4AJLQCA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.675371770 (7h37m31.406639391s) [noise=true , address=104.36.82.37:4665 , piece_id=F5RO7SFTH54IDNLT7KF2TNOQRVZEFODCYG65ONZJ6THD4LZKKJJA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.683603266 (7h37m31.414870896s) [noise=true , address=104.36.82.34:4578 , piece_id=WROE2XH3WOMRAJ4OJBD5LGCCTUMI7ECXHO6HYYRXYNBNBPN7I5ZQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.685155513 (7h37m31.416423133s) [noise=true , address=104.36.82.39:4737 , piece_id=AMV62VOAKHJUZCZWNEYGJKY572LWVJZMANNMQEQIS2HHKR3YVRSQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.685621413 (7h37m31.416889033s) [noise=true , address=104.36.82.53:4144 , piece_id=AZ4C2TJSHYEVYUUEYI7K7QHHBQVAG6NMP2BJALLEE7IY5YFD6FZA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.686461230 (7h37m31.41772886s) [noise=true , address=104.36.82.17:4332 , piece_id=NRWIFJYUBAMBJ3FBMRXE3YZTREOENZYWB6J4BJLXIIPQKKXNVRUQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.686992623 (7h37m31.418260253s) [noise=true , address=104.36.82.12:4173 , piece_id=VBNMKHSMCJKTABCXB2PAGXH65OEUF6LBQXP7XZFNMYOD3H76IPEQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.687219727 (7h37m31.418487347s) [noise=true , address=104.36.82.21:4479 , piece_id=ZKGGJ6T7MZETBH7P72Y4MHWMTK2CAYR5PYQEGNNN7XOYV63BG2HQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.692430363 (7h37m31.423697993s) [noise=true , address=104.36.82.14:4245 , piece_id=4B7WJJILP2ZJ2DIDTPSTI55G67X6IBC24POPB4BCVSJOT4ZFKK3Q, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.707237672 (7h37m31.438505302s) [noise=true , address=104.36.82.9:4029 , piece_id=LUA5Q3ZUO3SZI24ZPZGXIRLEMBZX3XQFYJQMCY6E4SXMBQTHSAGA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.716934623 (7h37m31.448202253s) [noise=true , address=104.36.82.4:4812 , piece_id=VKHFSCHUKZFGXRICZGSICWUTOK2BFMG6LAIC67ORAFN7S44SOPPQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.766972144 (7h37m31.498239774s) [noise=true , address=104.36.82.44:4897 , piece_id=YMDI7WR2P3M2HTRDLQNCC24ZU2NRRBH6JDJEHOY6WEBK6KKO5PBQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.766989206 (7h37m31.498256836s) [seg_pos={0 0}, upload=7928]: Segment reached optimal threshold of 14 pieces. Aug 9 01:03:50.767124678 (7h37m31.498392309s) [noise=true , address=104.36.82.62:4440 , piece_id=45DAJ7PILLSEBZICG7W7KKUR7ENYPF57DM2JA5COJV7IWRFB7KTQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jvc3V5SqNUTwbUea883sp3jsPPu1PAzJaUwcjPjxdjm3JiF2L): protocol: write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection; write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection Aug 9 01:03:50.767270229 (7h37m31.49853786s) [noise=true , address=104.36.82.60:4342 , piece_id=GTKAIDOMRHEEWSS2H64BVSLX245AYHVVIXORCJKFMSIAC7VGOZLQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB): protocol: read tcp 5.161.89.252:54032->104.36.82.60:4342: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 9 01:03:50.767296629 (7h37m31.498564249s) [noise=true , address=104.36.82.46:4498 , piece_id=C7HSUOEHMVCU5BX3XGAO4LWIGKXPE2IR6U7EOUBSJDSN3CIVRPPQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jyjxdWkBRBkDHSKknNmPdcnJ3HRcSCUQNnmpb1CaiEdMPEGk4): protocol: expected piece hash; context canceled; EOF Aug 9 01:03:50.767313812 (7h37m31.498581442s) [noise=true , address=104.36.82.11:4122 , piece_id=HOAEVCU5N4KLGF7O7ZZJC7YC5OB4VZOZIDKDTQTTOR4TU5T3IZXQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1oCu75zR8YccTunHjctcLzTrr9wTQqtAPXHiWrsQs41o8gxgh6): protocol: write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection; write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection Aug 9 01:03:50.767324712 (7h37m31.498592332s) [seg_pos={0 0}, upload=7928]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 01:03:50.767376188 (7h37m31.498643818s) [upload=7928]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 01:03:50.767381278 (7h37m31.498648908s) [upload=7928]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 01:03:50.890154929 (7h37m31.621422559s) [upload=7928]: Done uploading segments... Aug 9 01:03:50.890168986 (7h37m31.621436606s) [upload=7928]: Upload finished. err: <nil> Duration: 542.13785ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 151.75529ms FAIL (2025-08-09 01:22:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:52:13.986283699 (7h25m54.71755135s) [upload=7723]: Starting upload Aug 9 00:52:13.986408060 (7h25m54.717675711s) [upload=7723]: Done starting upload Aug 9 00:52:13.986481939 (7h25m54.71774956s) [upload=7723]: Uploading segments... Aug 9 00:52:13.986553753 (7h25m54.717821373s) [upload=7723]: Got next segment. Inline: true Aug 9 00:52:13.986558031 (7h25m54.717825641s) [upload=7723]: Waiting for error group managing segments... Aug 9 00:52:13.986608676 (7h25m54.717876296s) [upload=7723]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 00:52:13.986612834 (7h25m54.717880454s) [upload=7723]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 00:52:13.986615108 (7h25m54.717882728s) [upload=7723]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 00:52:13.989421897 (7h25m54.720689516s) [upload=7723]: Done uploading segments... Aug 9 00:52:13.989431464 (7h25m54.720699084s) [upload=7723]: Upload finished. err: metaclient: Too Many Requests Duration:* 151.774396ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 191.540695ms FAIL (2025-08-09 01:22:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:52:13.986283699 (7h25m54.71755135s) [upload=7723]: Starting upload Aug 9 00:52:13.986408060 (7h25m54.717675711s) [upload=7723]: Done starting upload Aug 9 00:52:13.986481939 (7h25m54.71774956s) [upload=7723]: Uploading segments... Aug 9 00:52:13.986553753 (7h25m54.717821373s) [upload=7723]: Got next segment. Inline: true Aug 9 00:52:13.986558031 (7h25m54.717825641s) [upload=7723]: Waiting for error group managing segments... Aug 9 00:52:13.986608676 (7h25m54.717876296s) [upload=7723]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 00:52:13.986612834 (7h25m54.717880454s) [upload=7723]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 00:52:13.986615108 (7h25m54.717882728s) [upload=7723]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 00:52:13.989421897 (7h25m54.720689516s) [upload=7723]: Done uploading segments... Aug 9 00:52:13.989431464 (7h25m54.720699084s) [upload=7723]: Upload finished. err: metaclient: Too Many Requests Duration:* 191.572474ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.......X.......X..............X......X......................] duration: 675.020769ms FAIL (2025-08-09 01:21:38 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 9 01:03:50.521251227 (7h37m31.252518857s) [upload=7928]: Starting upload Aug 9 01:03:50.521308083 (7h37m31.252575713s) [upload=7928]: Done starting upload Aug 9 01:03:50.521407979 (7h37m31.252675609s) [upload=7928]: Uploading segments... Aug 9 01:03:50.521679086 (7h37m31.252946716s) [upload=7928]: Got next segment. Inline: false Aug 9 01:03:50.521722226 (7h37m31.252989866s) [upload=7928]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:03:50.521727255 (7h37m31.252994885s) [upload=7928]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 01:03:50.547289380 (7h37m31.278557001s) [seg_pos={0 0}, upload=7928]: Begin upload segment... Aug 9 01:03:50.547314256 (7h37m31.278581886s) [seg_pos={0 0}, upload=7928]: Done begin upload segment. Aug 9 01:03:50.547335476 (7h37m31.278603116s) [noise=true , address=104.36.82.12:4173 , piece_id=VBNMKHSMCJKTABCXB2PAGXH65OEUF6LBQXP7XZFNMYOD3H76IPEQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547382454 (7h37m31.278650084s) [noise=true , address=104.36.82.37:4665 , piece_id=F5RO7SFTH54IDNLT7KF2TNOQRVZEFODCYG65ONZJ6THD4LZKKJJA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547771219 (7h37m31.27903884s) [noise=true , address=104.36.82.59:4314 , piece_id=SCL4G7EHDMHOWB7MZRTOLBT2TUZL45AE7A3UIKOQ2HCGI4AJLQCA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547817245 (7h37m31.279084875s) [noise=true , address=104.36.82.14:4245 , piece_id=4B7WJJILP2ZJ2DIDTPSTI55G67X6IBC24POPB4BCVSJOT4ZFKK3Q, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548158312 (7h37m31.279425942s) [noise=true , address=104.36.82.60:4342 , piece_id=GTKAIDOMRHEEWSS2H64BVSLX245AYHVVIXORCJKFMSIAC7VGOZLQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548182277 (7h37m31.279449907s) [noise=true , address=104.36.82.16:4311 , piece_id=WHQMSXMRLD5QRU6GYEPX2U7YTK7OBEHBKHJXWU2YKBZBA4SQJNEA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548510239 (7h37m31.27977787s) [noise=true , address=104.36.82.21:4479 , piece_id=ZKGGJ6T7MZETBH7P72Y4MHWMTK2CAYR5PYQEGNNN7XOYV63BG2HQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548553630 (7h37m31.27982126s) [noise=true , address=104.36.82.44:4897 , piece_id=YMDI7WR2P3M2HTRDLQNCC24ZU2NRRBH6JDJEHOY6WEBK6KKO5PBQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548917339 (7h37m31.280184959s) [noise=true , address=104.36.82.38:4710 , piece_id=AYQ2JWIS4Y6ECJOPZLL3VO7UEL3LAU72EDKKBZBE77G3XHRUKT3A, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548924042 (7h37m31.280191682s) [noise=true , address=104.36.82.17:4332 , piece_id=NRWIFJYUBAMBJ3FBMRXE3YZTREOENZYWB6J4BJLXIIPQKKXNVRUQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548959829 (7h37m31.280227459s) [noise=true , address=104.36.82.53:4144 , piece_id=AZ4C2TJSHYEVYUUEYI7K7QHHBQVAG6NMP2BJALLEE7IY5YFD6FZA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549302238 (7h37m31.280569868s) [noise=true , address=104.36.82.39:4737 , piece_id=AMV62VOAKHJUZCZWNEYGJKY572LWVJZMANNMQEQIS2HHKR3YVRSQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549314360 (7h37m31.28058199s) [noise=true , address=104.36.82.11:4122 , piece_id=HOAEVCU5N4KLGF7O7ZZJC7YC5OB4VZOZIDKDTQTTOR4TU5T3IZXQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549666998 (7h37m31.280934628s) [noise=true , address=104.36.82.4:4812 , piece_id=VKHFSCHUKZFGXRICZGSICWUTOK2BFMG6LAIC67ORAFN7S44SOPPQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.550026399 (7h37m31.281294019s) [noise=true , address=104.36.82.46:4498 , piece_id=C7HSUOEHMVCU5BX3XGAO4LWIGKXPE2IR6U7EOUBSJDSN3CIVRPPQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.550347188 (7h37m31.281614818s) [noise=true , address=104.36.82.62:4440 , piece_id=45DAJ7PILLSEBZICG7W7KKUR7ENYPF57DM2JA5COJV7IWRFB7KTQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.551515258 (7h37m31.282782888s) [noise=true , address=104.36.82.9:4029 , piece_id=LUA5Q3ZUO3SZI24ZPZGXIRLEMBZX3XQFYJQMCY6E4SXMBQTHSAGA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.553639614 (7h37m31.284907244s) [noise=true , address=104.36.82.34:4578 , piece_id=WROE2XH3WOMRAJ4OJBD5LGCCTUMI7ECXHO6HYYRXYNBNBPN7I5ZQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.654119682 (7h37m31.385387312s) [upload=7928]: Next returned nil segment Aug 9 01:03:50.654133758 (7h37m31.385401378s) [upload=7928]: Waiting for error group managing segments... Aug 9 01:03:50.672101667 (7h37m31.403369288s) [noise=true , address=104.36.82.16:4311 , piece_id=WHQMSXMRLD5QRU6GYEPX2U7YTK7OBEHBKHJXWU2YKBZBA4SQJNEA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.672877525 (7h37m31.404145145s) [noise=true , address=104.36.82.38:4710 , piece_id=AYQ2JWIS4Y6ECJOPZLL3VO7UEL3LAU72EDKKBZBE77G3XHRUKT3A, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.675306269 (7h37m31.406573909s) [noise=true , address=104.36.82.59:4314 , piece_id=SCL4G7EHDMHOWB7MZRTOLBT2TUZL45AE7A3UIKOQ2HCGI4AJLQCA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.675371770 (7h37m31.406639391s) [noise=true , address=104.36.82.37:4665 , piece_id=F5RO7SFTH54IDNLT7KF2TNOQRVZEFODCYG65ONZJ6THD4LZKKJJA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.683603266 (7h37m31.414870896s) [noise=true , address=104.36.82.34:4578 , piece_id=WROE2XH3WOMRAJ4OJBD5LGCCTUMI7ECXHO6HYYRXYNBNBPN7I5ZQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.685155513 (7h37m31.416423133s) [noise=true , address=104.36.82.39:4737 , piece_id=AMV62VOAKHJUZCZWNEYGJKY572LWVJZMANNMQEQIS2HHKR3YVRSQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.685621413 (7h37m31.416889033s) [noise=true , address=104.36.82.53:4144 , piece_id=AZ4C2TJSHYEVYUUEYI7K7QHHBQVAG6NMP2BJALLEE7IY5YFD6FZA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.686461230 (7h37m31.41772886s) [noise=true , address=104.36.82.17:4332 , piece_id=NRWIFJYUBAMBJ3FBMRXE3YZTREOENZYWB6J4BJLXIIPQKKXNVRUQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.686992623 (7h37m31.418260253s) [noise=true , address=104.36.82.12:4173 , piece_id=VBNMKHSMCJKTABCXB2PAGXH65OEUF6LBQXP7XZFNMYOD3H76IPEQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.687219727 (7h37m31.418487347s) [noise=true , address=104.36.82.21:4479 , piece_id=ZKGGJ6T7MZETBH7P72Y4MHWMTK2CAYR5PYQEGNNN7XOYV63BG2HQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.692430363 (7h37m31.423697993s) [noise=true , address=104.36.82.14:4245 , piece_id=4B7WJJILP2ZJ2DIDTPSTI55G67X6IBC24POPB4BCVSJOT4ZFKK3Q, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.707237672 (7h37m31.438505302s) [noise=true , address=104.36.82.9:4029 , piece_id=LUA5Q3ZUO3SZI24ZPZGXIRLEMBZX3XQFYJQMCY6E4SXMBQTHSAGA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.716934623 (7h37m31.448202253s) [noise=true , address=104.36.82.4:4812 , piece_id=VKHFSCHUKZFGXRICZGSICWUTOK2BFMG6LAIC67ORAFN7S44SOPPQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.766972144 (7h37m31.498239774s) [noise=true , address=104.36.82.44:4897 , piece_id=YMDI7WR2P3M2HTRDLQNCC24ZU2NRRBH6JDJEHOY6WEBK6KKO5PBQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.766989206 (7h37m31.498256836s) [seg_pos={0 0}, upload=7928]: Segment reached optimal threshold of 14 pieces. Aug 9 01:03:50.767124678 (7h37m31.498392309s) [noise=true , address=104.36.82.62:4440 , piece_id=45DAJ7PILLSEBZICG7W7KKUR7ENYPF57DM2JA5COJV7IWRFB7KTQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jvc3V5SqNUTwbUea883sp3jsPPu1PAzJaUwcjPjxdjm3JiF2L): protocol: write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection; write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection Aug 9 01:03:50.767270229 (7h37m31.49853786s) [noise=true , address=104.36.82.60:4342 , piece_id=GTKAIDOMRHEEWSS2H64BVSLX245AYHVVIXORCJKFMSIAC7VGOZLQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB): protocol: read tcp 5.161.89.252:54032->104.36.82.60:4342: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 9 01:03:50.767296629 (7h37m31.498564249s) [noise=true , address=104.36.82.46:4498 , piece_id=C7HSUOEHMVCU5BX3XGAO4LWIGKXPE2IR6U7EOUBSJDSN3CIVRPPQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jyjxdWkBRBkDHSKknNmPdcnJ3HRcSCUQNnmpb1CaiEdMPEGk4): protocol: expected piece hash; context canceled; EOF Aug 9 01:03:50.767313812 (7h37m31.498581442s) [noise=true , address=104.36.82.11:4122 , piece_id=HOAEVCU5N4KLGF7O7ZZJC7YC5OB4VZOZIDKDTQTTOR4TU5T3IZXQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1oCu75zR8YccTunHjctcLzTrr9wTQqtAPXHiWrsQs41o8gxgh6): protocol: write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection; write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection Aug 9 01:03:50.767324712 (7h37m31.498592332s) [seg_pos={0 0}, upload=7928]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 01:03:50.767376188 (7h37m31.498643818s) [upload=7928]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 01:03:50.767381278 (7h37m31.498648908s) [upload=7928]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 01:03:50.890154929 (7h37m31.621422559s) [upload=7928]: Done uploading segments... Aug 9 01:03:50.890168986 (7h37m31.621436606s) [upload=7928]: Upload finished. err: <nil> Duration: 675.045306ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [........X.......X..............X......X.....................] duration: 1.141981025s FAIL (2025-08-09 01:21:10 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 9 01:03:50.521251227 (7h37m31.252518857s) [upload=7928]: Starting upload Aug 9 01:03:50.521308083 (7h37m31.252575713s) [upload=7928]: Done starting upload Aug 9 01:03:50.521407979 (7h37m31.252675609s) [upload=7928]: Uploading segments... Aug 9 01:03:50.521679086 (7h37m31.252946716s) [upload=7928]: Got next segment. Inline: false Aug 9 01:03:50.521722226 (7h37m31.252989866s) [upload=7928]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:03:50.521727255 (7h37m31.252994885s) [upload=7928]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 01:03:50.547289380 (7h37m31.278557001s) [seg_pos={0 0}, upload=7928]: Begin upload segment... Aug 9 01:03:50.547314256 (7h37m31.278581886s) [seg_pos={0 0}, upload=7928]: Done begin upload segment. Aug 9 01:03:50.547335476 (7h37m31.278603116s) [noise=true , address=104.36.82.12:4173 , piece_id=VBNMKHSMCJKTABCXB2PAGXH65OEUF6LBQXP7XZFNMYOD3H76IPEQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547382454 (7h37m31.278650084s) [noise=true , address=104.36.82.37:4665 , piece_id=F5RO7SFTH54IDNLT7KF2TNOQRVZEFODCYG65ONZJ6THD4LZKKJJA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547771219 (7h37m31.27903884s) [noise=true , address=104.36.82.59:4314 , piece_id=SCL4G7EHDMHOWB7MZRTOLBT2TUZL45AE7A3UIKOQ2HCGI4AJLQCA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547817245 (7h37m31.279084875s) [noise=true , address=104.36.82.14:4245 , piece_id=4B7WJJILP2ZJ2DIDTPSTI55G67X6IBC24POPB4BCVSJOT4ZFKK3Q, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548158312 (7h37m31.279425942s) [noise=true , address=104.36.82.60:4342 , piece_id=GTKAIDOMRHEEWSS2H64BVSLX245AYHVVIXORCJKFMSIAC7VGOZLQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548182277 (7h37m31.279449907s) [noise=true , address=104.36.82.16:4311 , piece_id=WHQMSXMRLD5QRU6GYEPX2U7YTK7OBEHBKHJXWU2YKBZBA4SQJNEA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548510239 (7h37m31.27977787s) [noise=true , address=104.36.82.21:4479 , piece_id=ZKGGJ6T7MZETBH7P72Y4MHWMTK2CAYR5PYQEGNNN7XOYV63BG2HQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548553630 (7h37m31.27982126s) [noise=true , address=104.36.82.44:4897 , piece_id=YMDI7WR2P3M2HTRDLQNCC24ZU2NRRBH6JDJEHOY6WEBK6KKO5PBQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548917339 (7h37m31.280184959s) [noise=true , address=104.36.82.38:4710 , piece_id=AYQ2JWIS4Y6ECJOPZLL3VO7UEL3LAU72EDKKBZBE77G3XHRUKT3A, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548924042 (7h37m31.280191682s) [noise=true , address=104.36.82.17:4332 , piece_id=NRWIFJYUBAMBJ3FBMRXE3YZTREOENZYWB6J4BJLXIIPQKKXNVRUQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548959829 (7h37m31.280227459s) [noise=true , address=104.36.82.53:4144 , piece_id=AZ4C2TJSHYEVYUUEYI7K7QHHBQVAG6NMP2BJALLEE7IY5YFD6FZA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549302238 (7h37m31.280569868s) [noise=true , address=104.36.82.39:4737 , piece_id=AMV62VOAKHJUZCZWNEYGJKY572LWVJZMANNMQEQIS2HHKR3YVRSQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549314360 (7h37m31.28058199s) [noise=true , address=104.36.82.11:4122 , piece_id=HOAEVCU5N4KLGF7O7ZZJC7YC5OB4VZOZIDKDTQTTOR4TU5T3IZXQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549666998 (7h37m31.280934628s) [noise=true , address=104.36.82.4:4812 , piece_id=VKHFSCHUKZFGXRICZGSICWUTOK2BFMG6LAIC67ORAFN7S44SOPPQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.550026399 (7h37m31.281294019s) [noise=true , address=104.36.82.46:4498 , piece_id=C7HSUOEHMVCU5BX3XGAO4LWIGKXPE2IR6U7EOUBSJDSN3CIVRPPQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.550347188 (7h37m31.281614818s) [noise=true , address=104.36.82.62:4440 , piece_id=45DAJ7PILLSEBZICG7W7KKUR7ENYPF57DM2JA5COJV7IWRFB7KTQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.551515258 (7h37m31.282782888s) [noise=true , address=104.36.82.9:4029 , piece_id=LUA5Q3ZUO3SZI24ZPZGXIRLEMBZX3XQFYJQMCY6E4SXMBQTHSAGA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.553639614 (7h37m31.284907244s) [noise=true , address=104.36.82.34:4578 , piece_id=WROE2XH3WOMRAJ4OJBD5LGCCTUMI7ECXHO6HYYRXYNBNBPN7I5ZQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.654119682 (7h37m31.385387312s) [upload=7928]: Next returned nil segment Aug 9 01:03:50.654133758 (7h37m31.385401378s) [upload=7928]: Waiting for error group managing segments... Aug 9 01:03:50.672101667 (7h37m31.403369288s) [noise=true , address=104.36.82.16:4311 , piece_id=WHQMSXMRLD5QRU6GYEPX2U7YTK7OBEHBKHJXWU2YKBZBA4SQJNEA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.672877525 (7h37m31.404145145s) [noise=true , address=104.36.82.38:4710 , piece_id=AYQ2JWIS4Y6ECJOPZLL3VO7UEL3LAU72EDKKBZBE77G3XHRUKT3A, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.675306269 (7h37m31.406573909s) [noise=true , address=104.36.82.59:4314 , piece_id=SCL4G7EHDMHOWB7MZRTOLBT2TUZL45AE7A3UIKOQ2HCGI4AJLQCA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.675371770 (7h37m31.406639391s) [noise=true , address=104.36.82.37:4665 , piece_id=F5RO7SFTH54IDNLT7KF2TNOQRVZEFODCYG65ONZJ6THD4LZKKJJA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.683603266 (7h37m31.414870896s) [noise=true , address=104.36.82.34:4578 , piece_id=WROE2XH3WOMRAJ4OJBD5LGCCTUMI7ECXHO6HYYRXYNBNBPN7I5ZQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.685155513 (7h37m31.416423133s) [noise=true , address=104.36.82.39:4737 , piece_id=AMV62VOAKHJUZCZWNEYGJKY572LWVJZMANNMQEQIS2HHKR3YVRSQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.685621413 (7h37m31.416889033s) [noise=true , address=104.36.82.53:4144 , piece_id=AZ4C2TJSHYEVYUUEYI7K7QHHBQVAG6NMP2BJALLEE7IY5YFD6FZA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.686461230 (7h37m31.41772886s) [noise=true , address=104.36.82.17:4332 , piece_id=NRWIFJYUBAMBJ3FBMRXE3YZTREOENZYWB6J4BJLXIIPQKKXNVRUQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.686992623 (7h37m31.418260253s) [noise=true , address=104.36.82.12:4173 , piece_id=VBNMKHSMCJKTABCXB2PAGXH65OEUF6LBQXP7XZFNMYOD3H76IPEQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.687219727 (7h37m31.418487347s) [noise=true , address=104.36.82.21:4479 , piece_id=ZKGGJ6T7MZETBH7P72Y4MHWMTK2CAYR5PYQEGNNN7XOYV63BG2HQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.692430363 (7h37m31.423697993s) [noise=true , address=104.36.82.14:4245 , piece_id=4B7WJJILP2ZJ2DIDTPSTI55G67X6IBC24POPB4BCVSJOT4ZFKK3Q, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.707237672 (7h37m31.438505302s) [noise=true , address=104.36.82.9:4029 , piece_id=LUA5Q3ZUO3SZI24ZPZGXIRLEMBZX3XQFYJQMCY6E4SXMBQTHSAGA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.716934623 (7h37m31.448202253s) [noise=true , address=104.36.82.4:4812 , piece_id=VKHFSCHUKZFGXRICZGSICWUTOK2BFMG6LAIC67ORAFN7S44SOPPQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.766972144 (7h37m31.498239774s) [noise=true , address=104.36.82.44:4897 , piece_id=YMDI7WR2P3M2HTRDLQNCC24ZU2NRRBH6JDJEHOY6WEBK6KKO5PBQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.766989206 (7h37m31.498256836s) [seg_pos={0 0}, upload=7928]: Segment reached optimal threshold of 14 pieces. Aug 9 01:03:50.767124678 (7h37m31.498392309s) [noise=true , address=104.36.82.62:4440 , piece_id=45DAJ7PILLSEBZICG7W7KKUR7ENYPF57DM2JA5COJV7IWRFB7KTQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jvc3V5SqNUTwbUea883sp3jsPPu1PAzJaUwcjPjxdjm3JiF2L): protocol: write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection; write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection Aug 9 01:03:50.767270229 (7h37m31.49853786s) [noise=true , address=104.36.82.60:4342 , piece_id=GTKAIDOMRHEEWSS2H64BVSLX245AYHVVIXORCJKFMSIAC7VGOZLQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB): protocol: read tcp 5.161.89.252:54032->104.36.82.60:4342: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 9 01:03:50.767296629 (7h37m31.498564249s) [noise=true , address=104.36.82.46:4498 , piece_id=C7HSUOEHMVCU5BX3XGAO4LWIGKXPE2IR6U7EOUBSJDSN3CIVRPPQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jyjxdWkBRBkDHSKknNmPdcnJ3HRcSCUQNnmpb1CaiEdMPEGk4): protocol: expected piece hash; context canceled; EOF Aug 9 01:03:50.767313812 (7h37m31.498581442s) [noise=true , address=104.36.82.11:4122 , piece_id=HOAEVCU5N4KLGF7O7ZZJC7YC5OB4VZOZIDKDTQTTOR4TU5T3IZXQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1oCu75zR8YccTunHjctcLzTrr9wTQqtAPXHiWrsQs41o8gxgh6): protocol: write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection; write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection Aug 9 01:03:50.767324712 (7h37m31.498592332s) [seg_pos={0 0}, upload=7928]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 01:03:50.767376188 (7h37m31.498643818s) [upload=7928]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 01:03:50.767381278 (7h37m31.498648908s) [upload=7928]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 01:03:50.890154929 (7h37m31.621422559s) [upload=7928]: Done uploading segments... Aug 9 01:03:50.890168986 (7h37m31.621436606s) [upload=7928]: Upload finished. err: <nil> Duration: 1.141998858s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 316.829955ms FAIL (2025-08-09 01:21:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:52:13.986283699 (7h25m54.71755135s) [upload=7723]: Starting upload Aug 9 00:52:13.986408060 (7h25m54.717675711s) [upload=7723]: Done starting upload Aug 9 00:52:13.986481939 (7h25m54.71774956s) [upload=7723]: Uploading segments... Aug 9 00:52:13.986553753 (7h25m54.717821373s) [upload=7723]: Got next segment. Inline: true Aug 9 00:52:13.986558031 (7h25m54.717825641s) [upload=7723]: Waiting for error group managing segments... Aug 9 00:52:13.986608676 (7h25m54.717876296s) [upload=7723]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 00:52:13.986612834 (7h25m54.717880454s) [upload=7723]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 00:52:13.986615108 (7h25m54.717882728s) [upload=7723]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 00:52:13.989421897 (7h25m54.720689516s) [upload=7723]: Done uploading segments... Aug 9 00:52:13.989431464 (7h25m54.720699084s) [upload=7723]: Upload finished. err: metaclient: Too Many Requests Duration:* 316.846275ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.........X.......X..............X......X....................] duration: 721.637008ms FAIL (2025-08-09 01:20:23 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 9 01:03:50.521251227 (7h37m31.252518857s) [upload=7928]: Starting upload Aug 9 01:03:50.521308083 (7h37m31.252575713s) [upload=7928]: Done starting upload Aug 9 01:03:50.521407979 (7h37m31.252675609s) [upload=7928]: Uploading segments... Aug 9 01:03:50.521679086 (7h37m31.252946716s) [upload=7928]: Got next segment. Inline: false Aug 9 01:03:50.521722226 (7h37m31.252989866s) [upload=7928]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:03:50.521727255 (7h37m31.252994885s) [upload=7928]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 01:03:50.547289380 (7h37m31.278557001s) [seg_pos={0 0}, upload=7928]: Begin upload segment... Aug 9 01:03:50.547314256 (7h37m31.278581886s) [seg_pos={0 0}, upload=7928]: Done begin upload segment. Aug 9 01:03:50.547335476 (7h37m31.278603116s) [noise=true , address=104.36.82.12:4173 , piece_id=VBNMKHSMCJKTABCXB2PAGXH65OEUF6LBQXP7XZFNMYOD3H76IPEQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547382454 (7h37m31.278650084s) [noise=true , address=104.36.82.37:4665 , piece_id=F5RO7SFTH54IDNLT7KF2TNOQRVZEFODCYG65ONZJ6THD4LZKKJJA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547771219 (7h37m31.27903884s) [noise=true , address=104.36.82.59:4314 , piece_id=SCL4G7EHDMHOWB7MZRTOLBT2TUZL45AE7A3UIKOQ2HCGI4AJLQCA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547817245 (7h37m31.279084875s) [noise=true , address=104.36.82.14:4245 , piece_id=4B7WJJILP2ZJ2DIDTPSTI55G67X6IBC24POPB4BCVSJOT4ZFKK3Q, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548158312 (7h37m31.279425942s) [noise=true , address=104.36.82.60:4342 , piece_id=GTKAIDOMRHEEWSS2H64BVSLX245AYHVVIXORCJKFMSIAC7VGOZLQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548182277 (7h37m31.279449907s) [noise=true , address=104.36.82.16:4311 , piece_id=WHQMSXMRLD5QRU6GYEPX2U7YTK7OBEHBKHJXWU2YKBZBA4SQJNEA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548510239 (7h37m31.27977787s) [noise=true , address=104.36.82.21:4479 , piece_id=ZKGGJ6T7MZETBH7P72Y4MHWMTK2CAYR5PYQEGNNN7XOYV63BG2HQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548553630 (7h37m31.27982126s) [noise=true , address=104.36.82.44:4897 , piece_id=YMDI7WR2P3M2HTRDLQNCC24ZU2NRRBH6JDJEHOY6WEBK6KKO5PBQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548917339 (7h37m31.280184959s) [noise=true , address=104.36.82.38:4710 , piece_id=AYQ2JWIS4Y6ECJOPZLL3VO7UEL3LAU72EDKKBZBE77G3XHRUKT3A, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548924042 (7h37m31.280191682s) [noise=true , address=104.36.82.17:4332 , piece_id=NRWIFJYUBAMBJ3FBMRXE3YZTREOENZYWB6J4BJLXIIPQKKXNVRUQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548959829 (7h37m31.280227459s) [noise=true , address=104.36.82.53:4144 , piece_id=AZ4C2TJSHYEVYUUEYI7K7QHHBQVAG6NMP2BJALLEE7IY5YFD6FZA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549302238 (7h37m31.280569868s) [noise=true , address=104.36.82.39:4737 , piece_id=AMV62VOAKHJUZCZWNEYGJKY572LWVJZMANNMQEQIS2HHKR3YVRSQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549314360 (7h37m31.28058199s) [noise=true , address=104.36.82.11:4122 , piece_id=HOAEVCU5N4KLGF7O7ZZJC7YC5OB4VZOZIDKDTQTTOR4TU5T3IZXQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549666998 (7h37m31.280934628s) [noise=true , address=104.36.82.4:4812 , piece_id=VKHFSCHUKZFGXRICZGSICWUTOK2BFMG6LAIC67ORAFN7S44SOPPQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.550026399 (7h37m31.281294019s) [noise=true , address=104.36.82.46:4498 , piece_id=C7HSUOEHMVCU5BX3XGAO4LWIGKXPE2IR6U7EOUBSJDSN3CIVRPPQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.550347188 (7h37m31.281614818s) [noise=true , address=104.36.82.62:4440 , piece_id=45DAJ7PILLSEBZICG7W7KKUR7ENYPF57DM2JA5COJV7IWRFB7KTQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.551515258 (7h37m31.282782888s) [noise=true , address=104.36.82.9:4029 , piece_id=LUA5Q3ZUO3SZI24ZPZGXIRLEMBZX3XQFYJQMCY6E4SXMBQTHSAGA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.553639614 (7h37m31.284907244s) [noise=true , address=104.36.82.34:4578 , piece_id=WROE2XH3WOMRAJ4OJBD5LGCCTUMI7ECXHO6HYYRXYNBNBPN7I5ZQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.654119682 (7h37m31.385387312s) [upload=7928]: Next returned nil segment Aug 9 01:03:50.654133758 (7h37m31.385401378s) [upload=7928]: Waiting for error group managing segments... Aug 9 01:03:50.672101667 (7h37m31.403369288s) [noise=true , address=104.36.82.16:4311 , piece_id=WHQMSXMRLD5QRU6GYEPX2U7YTK7OBEHBKHJXWU2YKBZBA4SQJNEA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.672877525 (7h37m31.404145145s) [noise=true , address=104.36.82.38:4710 , piece_id=AYQ2JWIS4Y6ECJOPZLL3VO7UEL3LAU72EDKKBZBE77G3XHRUKT3A, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.675306269 (7h37m31.406573909s) [noise=true , address=104.36.82.59:4314 , piece_id=SCL4G7EHDMHOWB7MZRTOLBT2TUZL45AE7A3UIKOQ2HCGI4AJLQCA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.675371770 (7h37m31.406639391s) [noise=true , address=104.36.82.37:4665 , piece_id=F5RO7SFTH54IDNLT7KF2TNOQRVZEFODCYG65ONZJ6THD4LZKKJJA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.683603266 (7h37m31.414870896s) [noise=true , address=104.36.82.34:4578 , piece_id=WROE2XH3WOMRAJ4OJBD5LGCCTUMI7ECXHO6HYYRXYNBNBPN7I5ZQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.685155513 (7h37m31.416423133s) [noise=true , address=104.36.82.39:4737 , piece_id=AMV62VOAKHJUZCZWNEYGJKY572LWVJZMANNMQEQIS2HHKR3YVRSQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.685621413 (7h37m31.416889033s) [noise=true , address=104.36.82.53:4144 , piece_id=AZ4C2TJSHYEVYUUEYI7K7QHHBQVAG6NMP2BJALLEE7IY5YFD6FZA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.686461230 (7h37m31.41772886s) [noise=true , address=104.36.82.17:4332 , piece_id=NRWIFJYUBAMBJ3FBMRXE3YZTREOENZYWB6J4BJLXIIPQKKXNVRUQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.686992623 (7h37m31.418260253s) [noise=true , address=104.36.82.12:4173 , piece_id=VBNMKHSMCJKTABCXB2PAGXH65OEUF6LBQXP7XZFNMYOD3H76IPEQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.687219727 (7h37m31.418487347s) [noise=true , address=104.36.82.21:4479 , piece_id=ZKGGJ6T7MZETBH7P72Y4MHWMTK2CAYR5PYQEGNNN7XOYV63BG2HQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.692430363 (7h37m31.423697993s) [noise=true , address=104.36.82.14:4245 , piece_id=4B7WJJILP2ZJ2DIDTPSTI55G67X6IBC24POPB4BCVSJOT4ZFKK3Q, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.707237672 (7h37m31.438505302s) [noise=true , address=104.36.82.9:4029 , piece_id=LUA5Q3ZUO3SZI24ZPZGXIRLEMBZX3XQFYJQMCY6E4SXMBQTHSAGA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.716934623 (7h37m31.448202253s) [noise=true , address=104.36.82.4:4812 , piece_id=VKHFSCHUKZFGXRICZGSICWUTOK2BFMG6LAIC67ORAFN7S44SOPPQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.766972144 (7h37m31.498239774s) [noise=true , address=104.36.82.44:4897 , piece_id=YMDI7WR2P3M2HTRDLQNCC24ZU2NRRBH6JDJEHOY6WEBK6KKO5PBQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.766989206 (7h37m31.498256836s) [seg_pos={0 0}, upload=7928]: Segment reached optimal threshold of 14 pieces. Aug 9 01:03:50.767124678 (7h37m31.498392309s) [noise=true , address=104.36.82.62:4440 , piece_id=45DAJ7PILLSEBZICG7W7KKUR7ENYPF57DM2JA5COJV7IWRFB7KTQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jvc3V5SqNUTwbUea883sp3jsPPu1PAzJaUwcjPjxdjm3JiF2L): protocol: write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection; write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection Aug 9 01:03:50.767270229 (7h37m31.49853786s) [noise=true , address=104.36.82.60:4342 , piece_id=GTKAIDOMRHEEWSS2H64BVSLX245AYHVVIXORCJKFMSIAC7VGOZLQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB): protocol: read tcp 5.161.89.252:54032->104.36.82.60:4342: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 9 01:03:50.767296629 (7h37m31.498564249s) [noise=true , address=104.36.82.46:4498 , piece_id=C7HSUOEHMVCU5BX3XGAO4LWIGKXPE2IR6U7EOUBSJDSN3CIVRPPQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jyjxdWkBRBkDHSKknNmPdcnJ3HRcSCUQNnmpb1CaiEdMPEGk4): protocol: expected piece hash; context canceled; EOF Aug 9 01:03:50.767313812 (7h37m31.498581442s) [noise=true , address=104.36.82.11:4122 , piece_id=HOAEVCU5N4KLGF7O7ZZJC7YC5OB4VZOZIDKDTQTTOR4TU5T3IZXQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1oCu75zR8YccTunHjctcLzTrr9wTQqtAPXHiWrsQs41o8gxgh6): protocol: write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection; write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection Aug 9 01:03:50.767324712 (7h37m31.498592332s) [seg_pos={0 0}, upload=7928]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 01:03:50.767376188 (7h37m31.498643818s) [upload=7928]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 01:03:50.767381278 (7h37m31.498648908s) [upload=7928]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 01:03:50.890154929 (7h37m31.621422559s) [upload=7928]: Done uploading segments... Aug 9 01:03:50.890168986 (7h37m31.621436606s) [upload=7928]: Upload finished. err: <nil> Duration: 721.676332ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 152.149958ms FAIL (2025-08-09 01:20:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:52:13.986283699 (7h25m54.71755135s) [upload=7723]: Starting upload Aug 9 00:52:13.986408060 (7h25m54.717675711s) [upload=7723]: Done starting upload Aug 9 00:52:13.986481939 (7h25m54.71774956s) [upload=7723]: Uploading segments... Aug 9 00:52:13.986553753 (7h25m54.717821373s) [upload=7723]: Got next segment. Inline: true Aug 9 00:52:13.986558031 (7h25m54.717825641s) [upload=7723]: Waiting for error group managing segments... Aug 9 00:52:13.986608676 (7h25m54.717876296s) [upload=7723]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 00:52:13.986612834 (7h25m54.717880454s) [upload=7723]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 00:52:13.986615108 (7h25m54.717882728s) [upload=7723]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 00:52:13.989421897 (7h25m54.720689516s) [upload=7723]: Done uploading segments... Aug 9 00:52:13.989431464 (7h25m54.720699084s) [upload=7723]: Upload finished. err: metaclient: Too Many Requests Duration:* 152.175706ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..........X.......X..............X......X...................] duration: 441.600615ms FAIL (2025-08-09 01:19:50 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 9 01:03:50.521251227 (7h37m31.252518857s) [upload=7928]: Starting upload Aug 9 01:03:50.521308083 (7h37m31.252575713s) [upload=7928]: Done starting upload Aug 9 01:03:50.521407979 (7h37m31.252675609s) [upload=7928]: Uploading segments... Aug 9 01:03:50.521679086 (7h37m31.252946716s) [upload=7928]: Got next segment. Inline: false Aug 9 01:03:50.521722226 (7h37m31.252989866s) [upload=7928]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:03:50.521727255 (7h37m31.252994885s) [upload=7928]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 01:03:50.547289380 (7h37m31.278557001s) [seg_pos={0 0}, upload=7928]: Begin upload segment... Aug 9 01:03:50.547314256 (7h37m31.278581886s) [seg_pos={0 0}, upload=7928]: Done begin upload segment. Aug 9 01:03:50.547335476 (7h37m31.278603116s) [noise=true , address=104.36.82.12:4173 , piece_id=VBNMKHSMCJKTABCXB2PAGXH65OEUF6LBQXP7XZFNMYOD3H76IPEQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547382454 (7h37m31.278650084s) [noise=true , address=104.36.82.37:4665 , piece_id=F5RO7SFTH54IDNLT7KF2TNOQRVZEFODCYG65ONZJ6THD4LZKKJJA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547771219 (7h37m31.27903884s) [noise=true , address=104.36.82.59:4314 , piece_id=SCL4G7EHDMHOWB7MZRTOLBT2TUZL45AE7A3UIKOQ2HCGI4AJLQCA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547817245 (7h37m31.279084875s) [noise=true , address=104.36.82.14:4245 , piece_id=4B7WJJILP2ZJ2DIDTPSTI55G67X6IBC24POPB4BCVSJOT4ZFKK3Q, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548158312 (7h37m31.279425942s) [noise=true , address=104.36.82.60:4342 , piece_id=GTKAIDOMRHEEWSS2H64BVSLX245AYHVVIXORCJKFMSIAC7VGOZLQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548182277 (7h37m31.279449907s) [noise=true , address=104.36.82.16:4311 , piece_id=WHQMSXMRLD5QRU6GYEPX2U7YTK7OBEHBKHJXWU2YKBZBA4SQJNEA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548510239 (7h37m31.27977787s) [noise=true , address=104.36.82.21:4479 , piece_id=ZKGGJ6T7MZETBH7P72Y4MHWMTK2CAYR5PYQEGNNN7XOYV63BG2HQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548553630 (7h37m31.27982126s) [noise=true , address=104.36.82.44:4897 , piece_id=YMDI7WR2P3M2HTRDLQNCC24ZU2NRRBH6JDJEHOY6WEBK6KKO5PBQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548917339 (7h37m31.280184959s) [noise=true , address=104.36.82.38:4710 , piece_id=AYQ2JWIS4Y6ECJOPZLL3VO7UEL3LAU72EDKKBZBE77G3XHRUKT3A, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548924042 (7h37m31.280191682s) [noise=true , address=104.36.82.17:4332 , piece_id=NRWIFJYUBAMBJ3FBMRXE3YZTREOENZYWB6J4BJLXIIPQKKXNVRUQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548959829 (7h37m31.280227459s) [noise=true , address=104.36.82.53:4144 , piece_id=AZ4C2TJSHYEVYUUEYI7K7QHHBQVAG6NMP2BJALLEE7IY5YFD6FZA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549302238 (7h37m31.280569868s) [noise=true , address=104.36.82.39:4737 , piece_id=AMV62VOAKHJUZCZWNEYGJKY572LWVJZMANNMQEQIS2HHKR3YVRSQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549314360 (7h37m31.28058199s) [noise=true , address=104.36.82.11:4122 , piece_id=HOAEVCU5N4KLGF7O7ZZJC7YC5OB4VZOZIDKDTQTTOR4TU5T3IZXQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549666998 (7h37m31.280934628s) [noise=true , address=104.36.82.4:4812 , piece_id=VKHFSCHUKZFGXRICZGSICWUTOK2BFMG6LAIC67ORAFN7S44SOPPQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.550026399 (7h37m31.281294019s) [noise=true , address=104.36.82.46:4498 , piece_id=C7HSUOEHMVCU5BX3XGAO4LWIGKXPE2IR6U7EOUBSJDSN3CIVRPPQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.550347188 (7h37m31.281614818s) [noise=true , address=104.36.82.62:4440 , piece_id=45DAJ7PILLSEBZICG7W7KKUR7ENYPF57DM2JA5COJV7IWRFB7KTQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.551515258 (7h37m31.282782888s) [noise=true , address=104.36.82.9:4029 , piece_id=LUA5Q3ZUO3SZI24ZPZGXIRLEMBZX3XQFYJQMCY6E4SXMBQTHSAGA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.553639614 (7h37m31.284907244s) [noise=true , address=104.36.82.34:4578 , piece_id=WROE2XH3WOMRAJ4OJBD5LGCCTUMI7ECXHO6HYYRXYNBNBPN7I5ZQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.654119682 (7h37m31.385387312s) [upload=7928]: Next returned nil segment Aug 9 01:03:50.654133758 (7h37m31.385401378s) [upload=7928]: Waiting for error group managing segments... Aug 9 01:03:50.672101667 (7h37m31.403369288s) [noise=true , address=104.36.82.16:4311 , piece_id=WHQMSXMRLD5QRU6GYEPX2U7YTK7OBEHBKHJXWU2YKBZBA4SQJNEA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.672877525 (7h37m31.404145145s) [noise=true , address=104.36.82.38:4710 , piece_id=AYQ2JWIS4Y6ECJOPZLL3VO7UEL3LAU72EDKKBZBE77G3XHRUKT3A, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.675306269 (7h37m31.406573909s) [noise=true , address=104.36.82.59:4314 , piece_id=SCL4G7EHDMHOWB7MZRTOLBT2TUZL45AE7A3UIKOQ2HCGI4AJLQCA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.675371770 (7h37m31.406639391s) [noise=true , address=104.36.82.37:4665 , piece_id=F5RO7SFTH54IDNLT7KF2TNOQRVZEFODCYG65ONZJ6THD4LZKKJJA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.683603266 (7h37m31.414870896s) [noise=true , address=104.36.82.34:4578 , piece_id=WROE2XH3WOMRAJ4OJBD5LGCCTUMI7ECXHO6HYYRXYNBNBPN7I5ZQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.685155513 (7h37m31.416423133s) [noise=true , address=104.36.82.39:4737 , piece_id=AMV62VOAKHJUZCZWNEYGJKY572LWVJZMANNMQEQIS2HHKR3YVRSQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.685621413 (7h37m31.416889033s) [noise=true , address=104.36.82.53:4144 , piece_id=AZ4C2TJSHYEVYUUEYI7K7QHHBQVAG6NMP2BJALLEE7IY5YFD6FZA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.686461230 (7h37m31.41772886s) [noise=true , address=104.36.82.17:4332 , piece_id=NRWIFJYUBAMBJ3FBMRXE3YZTREOENZYWB6J4BJLXIIPQKKXNVRUQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.686992623 (7h37m31.418260253s) [noise=true , address=104.36.82.12:4173 , piece_id=VBNMKHSMCJKTABCXB2PAGXH65OEUF6LBQXP7XZFNMYOD3H76IPEQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.687219727 (7h37m31.418487347s) [noise=true , address=104.36.82.21:4479 , piece_id=ZKGGJ6T7MZETBH7P72Y4MHWMTK2CAYR5PYQEGNNN7XOYV63BG2HQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.692430363 (7h37m31.423697993s) [noise=true , address=104.36.82.14:4245 , piece_id=4B7WJJILP2ZJ2DIDTPSTI55G67X6IBC24POPB4BCVSJOT4ZFKK3Q, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.707237672 (7h37m31.438505302s) [noise=true , address=104.36.82.9:4029 , piece_id=LUA5Q3ZUO3SZI24ZPZGXIRLEMBZX3XQFYJQMCY6E4SXMBQTHSAGA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.716934623 (7h37m31.448202253s) [noise=true , address=104.36.82.4:4812 , piece_id=VKHFSCHUKZFGXRICZGSICWUTOK2BFMG6LAIC67ORAFN7S44SOPPQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.766972144 (7h37m31.498239774s) [noise=true , address=104.36.82.44:4897 , piece_id=YMDI7WR2P3M2HTRDLQNCC24ZU2NRRBH6JDJEHOY6WEBK6KKO5PBQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.766989206 (7h37m31.498256836s) [seg_pos={0 0}, upload=7928]: Segment reached optimal threshold of 14 pieces. Aug 9 01:03:50.767124678 (7h37m31.498392309s) [noise=true , address=104.36.82.62:4440 , piece_id=45DAJ7PILLSEBZICG7W7KKUR7ENYPF57DM2JA5COJV7IWRFB7KTQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jvc3V5SqNUTwbUea883sp3jsPPu1PAzJaUwcjPjxdjm3JiF2L): protocol: write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection; write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection Aug 9 01:03:50.767270229 (7h37m31.49853786s) [noise=true , address=104.36.82.60:4342 , piece_id=GTKAIDOMRHEEWSS2H64BVSLX245AYHVVIXORCJKFMSIAC7VGOZLQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB): protocol: read tcp 5.161.89.252:54032->104.36.82.60:4342: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 9 01:03:50.767296629 (7h37m31.498564249s) [noise=true , address=104.36.82.46:4498 , piece_id=C7HSUOEHMVCU5BX3XGAO4LWIGKXPE2IR6U7EOUBSJDSN3CIVRPPQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jyjxdWkBRBkDHSKknNmPdcnJ3HRcSCUQNnmpb1CaiEdMPEGk4): protocol: expected piece hash; context canceled; EOF Aug 9 01:03:50.767313812 (7h37m31.498581442s) [noise=true , address=104.36.82.11:4122 , piece_id=HOAEVCU5N4KLGF7O7ZZJC7YC5OB4VZOZIDKDTQTTOR4TU5T3IZXQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1oCu75zR8YccTunHjctcLzTrr9wTQqtAPXHiWrsQs41o8gxgh6): protocol: write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection; write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection Aug 9 01:03:50.767324712 (7h37m31.498592332s) [seg_pos={0 0}, upload=7928]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 01:03:50.767376188 (7h37m31.498643818s) [upload=7928]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 01:03:50.767381278 (7h37m31.498648908s) [upload=7928]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 01:03:50.890154929 (7h37m31.621422559s) [upload=7928]: Done uploading segments... Aug 9 01:03:50.890168986 (7h37m31.621436606s) [upload=7928]: Upload finished. err: <nil> Duration: 441.625772ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 196.406799ms FAIL (2025-08-09 01:19:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:52:13.986283699 (7h25m54.71755135s) [upload=7723]: Starting upload Aug 9 00:52:13.986408060 (7h25m54.717675711s) [upload=7723]: Done starting upload Aug 9 00:52:13.986481939 (7h25m54.71774956s) [upload=7723]: Uploading segments... Aug 9 00:52:13.986553753 (7h25m54.717821373s) [upload=7723]: Got next segment. Inline: true Aug 9 00:52:13.986558031 (7h25m54.717825641s) [upload=7723]: Waiting for error group managing segments... Aug 9 00:52:13.986608676 (7h25m54.717876296s) [upload=7723]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 00:52:13.986612834 (7h25m54.717880454s) [upload=7723]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 00:52:13.986615108 (7h25m54.717882728s) [upload=7723]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 00:52:13.989421897 (7h25m54.720689516s) [upload=7723]: Done uploading segments... Aug 9 00:52:13.989431464 (7h25m54.720699084s) [upload=7723]: Upload finished. err: metaclient: Too Many Requests Duration:* 196.431485ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 153.43699ms FAIL (2025-08-09 01:19:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:52:13.986283699 (7h25m54.71755135s) [upload=7723]: Starting upload Aug 9 00:52:13.986408060 (7h25m54.717675711s) [upload=7723]: Done starting upload Aug 9 00:52:13.986481939 (7h25m54.71774956s) [upload=7723]: Uploading segments... Aug 9 00:52:13.986553753 (7h25m54.717821373s) [upload=7723]: Got next segment. Inline: true Aug 9 00:52:13.986558031 (7h25m54.717825641s) [upload=7723]: Waiting for error group managing segments... Aug 9 00:52:13.986608676 (7h25m54.717876296s) [upload=7723]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 00:52:13.986612834 (7h25m54.717880454s) [upload=7723]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 00:52:13.986615108 (7h25m54.717882728s) [upload=7723]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 00:52:13.989421897 (7h25m54.720689516s) [upload=7723]: Done uploading segments... Aug 9 00:52:13.989431464 (7h25m54.720699084s) [upload=7723]: Upload finished. err: metaclient: Too Many Requests Duration:* 153.457678ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...........X.......X..............X......X..................] duration: 664.272339ms FAIL (2025-08-09 01:18:49 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 9 01:03:50.521251227 (7h37m31.252518857s) [upload=7928]: Starting upload Aug 9 01:03:50.521308083 (7h37m31.252575713s) [upload=7928]: Done starting upload Aug 9 01:03:50.521407979 (7h37m31.252675609s) [upload=7928]: Uploading segments... Aug 9 01:03:50.521679086 (7h37m31.252946716s) [upload=7928]: Got next segment. Inline: false Aug 9 01:03:50.521722226 (7h37m31.252989866s) [upload=7928]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:03:50.521727255 (7h37m31.252994885s) [upload=7928]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 01:03:50.547289380 (7h37m31.278557001s) [seg_pos={0 0}, upload=7928]: Begin upload segment... Aug 9 01:03:50.547314256 (7h37m31.278581886s) [seg_pos={0 0}, upload=7928]: Done begin upload segment. Aug 9 01:03:50.547335476 (7h37m31.278603116s) [noise=true , address=104.36.82.12:4173 , piece_id=VBNMKHSMCJKTABCXB2PAGXH65OEUF6LBQXP7XZFNMYOD3H76IPEQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547382454 (7h37m31.278650084s) [noise=true , address=104.36.82.37:4665 , piece_id=F5RO7SFTH54IDNLT7KF2TNOQRVZEFODCYG65ONZJ6THD4LZKKJJA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547771219 (7h37m31.27903884s) [noise=true , address=104.36.82.59:4314 , piece_id=SCL4G7EHDMHOWB7MZRTOLBT2TUZL45AE7A3UIKOQ2HCGI4AJLQCA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547817245 (7h37m31.279084875s) [noise=true , address=104.36.82.14:4245 , piece_id=4B7WJJILP2ZJ2DIDTPSTI55G67X6IBC24POPB4BCVSJOT4ZFKK3Q, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548158312 (7h37m31.279425942s) [noise=true , address=104.36.82.60:4342 , piece_id=GTKAIDOMRHEEWSS2H64BVSLX245AYHVVIXORCJKFMSIAC7VGOZLQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548182277 (7h37m31.279449907s) [noise=true , address=104.36.82.16:4311 , piece_id=WHQMSXMRLD5QRU6GYEPX2U7YTK7OBEHBKHJXWU2YKBZBA4SQJNEA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548510239 (7h37m31.27977787s) [noise=true , address=104.36.82.21:4479 , piece_id=ZKGGJ6T7MZETBH7P72Y4MHWMTK2CAYR5PYQEGNNN7XOYV63BG2HQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548553630 (7h37m31.27982126s) [noise=true , address=104.36.82.44:4897 , piece_id=YMDI7WR2P3M2HTRDLQNCC24ZU2NRRBH6JDJEHOY6WEBK6KKO5PBQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548917339 (7h37m31.280184959s) [noise=true , address=104.36.82.38:4710 , piece_id=AYQ2JWIS4Y6ECJOPZLL3VO7UEL3LAU72EDKKBZBE77G3XHRUKT3A, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548924042 (7h37m31.280191682s) [noise=true , address=104.36.82.17:4332 , piece_id=NRWIFJYUBAMBJ3FBMRXE3YZTREOENZYWB6J4BJLXIIPQKKXNVRUQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548959829 (7h37m31.280227459s) [noise=true , address=104.36.82.53:4144 , piece_id=AZ4C2TJSHYEVYUUEYI7K7QHHBQVAG6NMP2BJALLEE7IY5YFD6FZA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549302238 (7h37m31.280569868s) [noise=true , address=104.36.82.39:4737 , piece_id=AMV62VOAKHJUZCZWNEYGJKY572LWVJZMANNMQEQIS2HHKR3YVRSQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549314360 (7h37m31.28058199s) [noise=true , address=104.36.82.11:4122 , piece_id=HOAEVCU5N4KLGF7O7ZZJC7YC5OB4VZOZIDKDTQTTOR4TU5T3IZXQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549666998 (7h37m31.280934628s) [noise=true , address=104.36.82.4:4812 , piece_id=VKHFSCHUKZFGXRICZGSICWUTOK2BFMG6LAIC67ORAFN7S44SOPPQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.550026399 (7h37m31.281294019s) [noise=true , address=104.36.82.46:4498 , piece_id=C7HSUOEHMVCU5BX3XGAO4LWIGKXPE2IR6U7EOUBSJDSN3CIVRPPQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.550347188 (7h37m31.281614818s) [noise=true , address=104.36.82.62:4440 , piece_id=45DAJ7PILLSEBZICG7W7KKUR7ENYPF57DM2JA5COJV7IWRFB7KTQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.551515258 (7h37m31.282782888s) [noise=true , address=104.36.82.9:4029 , piece_id=LUA5Q3ZUO3SZI24ZPZGXIRLEMBZX3XQFYJQMCY6E4SXMBQTHSAGA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.553639614 (7h37m31.284907244s) [noise=true , address=104.36.82.34:4578 , piece_id=WROE2XH3WOMRAJ4OJBD5LGCCTUMI7ECXHO6HYYRXYNBNBPN7I5ZQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.654119682 (7h37m31.385387312s) [upload=7928]: Next returned nil segment Aug 9 01:03:50.654133758 (7h37m31.385401378s) [upload=7928]: Waiting for error group managing segments... Aug 9 01:03:50.672101667 (7h37m31.403369288s) [noise=true , address=104.36.82.16:4311 , piece_id=WHQMSXMRLD5QRU6GYEPX2U7YTK7OBEHBKHJXWU2YKBZBA4SQJNEA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.672877525 (7h37m31.404145145s) [noise=true , address=104.36.82.38:4710 , piece_id=AYQ2JWIS4Y6ECJOPZLL3VO7UEL3LAU72EDKKBZBE77G3XHRUKT3A, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.675306269 (7h37m31.406573909s) [noise=true , address=104.36.82.59:4314 , piece_id=SCL4G7EHDMHOWB7MZRTOLBT2TUZL45AE7A3UIKOQ2HCGI4AJLQCA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.675371770 (7h37m31.406639391s) [noise=true , address=104.36.82.37:4665 , piece_id=F5RO7SFTH54IDNLT7KF2TNOQRVZEFODCYG65ONZJ6THD4LZKKJJA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.683603266 (7h37m31.414870896s) [noise=true , address=104.36.82.34:4578 , piece_id=WROE2XH3WOMRAJ4OJBD5LGCCTUMI7ECXHO6HYYRXYNBNBPN7I5ZQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.685155513 (7h37m31.416423133s) [noise=true , address=104.36.82.39:4737 , piece_id=AMV62VOAKHJUZCZWNEYGJKY572LWVJZMANNMQEQIS2HHKR3YVRSQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.685621413 (7h37m31.416889033s) [noise=true , address=104.36.82.53:4144 , piece_id=AZ4C2TJSHYEVYUUEYI7K7QHHBQVAG6NMP2BJALLEE7IY5YFD6FZA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.686461230 (7h37m31.41772886s) [noise=true , address=104.36.82.17:4332 , piece_id=NRWIFJYUBAMBJ3FBMRXE3YZTREOENZYWB6J4BJLXIIPQKKXNVRUQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.686992623 (7h37m31.418260253s) [noise=true , address=104.36.82.12:4173 , piece_id=VBNMKHSMCJKTABCXB2PAGXH65OEUF6LBQXP7XZFNMYOD3H76IPEQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.687219727 (7h37m31.418487347s) [noise=true , address=104.36.82.21:4479 , piece_id=ZKGGJ6T7MZETBH7P72Y4MHWMTK2CAYR5PYQEGNNN7XOYV63BG2HQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.692430363 (7h37m31.423697993s) [noise=true , address=104.36.82.14:4245 , piece_id=4B7WJJILP2ZJ2DIDTPSTI55G67X6IBC24POPB4BCVSJOT4ZFKK3Q, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.707237672 (7h37m31.438505302s) [noise=true , address=104.36.82.9:4029 , piece_id=LUA5Q3ZUO3SZI24ZPZGXIRLEMBZX3XQFYJQMCY6E4SXMBQTHSAGA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.716934623 (7h37m31.448202253s) [noise=true , address=104.36.82.4:4812 , piece_id=VKHFSCHUKZFGXRICZGSICWUTOK2BFMG6LAIC67ORAFN7S44SOPPQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.766972144 (7h37m31.498239774s) [noise=true , address=104.36.82.44:4897 , piece_id=YMDI7WR2P3M2HTRDLQNCC24ZU2NRRBH6JDJEHOY6WEBK6KKO5PBQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.766989206 (7h37m31.498256836s) [seg_pos={0 0}, upload=7928]: Segment reached optimal threshold of 14 pieces. Aug 9 01:03:50.767124678 (7h37m31.498392309s) [noise=true , address=104.36.82.62:4440 , piece_id=45DAJ7PILLSEBZICG7W7KKUR7ENYPF57DM2JA5COJV7IWRFB7KTQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jvc3V5SqNUTwbUea883sp3jsPPu1PAzJaUwcjPjxdjm3JiF2L): protocol: write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection; write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection Aug 9 01:03:50.767270229 (7h37m31.49853786s) [noise=true , address=104.36.82.60:4342 , piece_id=GTKAIDOMRHEEWSS2H64BVSLX245AYHVVIXORCJKFMSIAC7VGOZLQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB): protocol: read tcp 5.161.89.252:54032->104.36.82.60:4342: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 9 01:03:50.767296629 (7h37m31.498564249s) [noise=true , address=104.36.82.46:4498 , piece_id=C7HSUOEHMVCU5BX3XGAO4LWIGKXPE2IR6U7EOUBSJDSN3CIVRPPQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jyjxdWkBRBkDHSKknNmPdcnJ3HRcSCUQNnmpb1CaiEdMPEGk4): protocol: expected piece hash; context canceled; EOF Aug 9 01:03:50.767313812 (7h37m31.498581442s) [noise=true , address=104.36.82.11:4122 , piece_id=HOAEVCU5N4KLGF7O7ZZJC7YC5OB4VZOZIDKDTQTTOR4TU5T3IZXQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1oCu75zR8YccTunHjctcLzTrr9wTQqtAPXHiWrsQs41o8gxgh6): protocol: write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection; write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection Aug 9 01:03:50.767324712 (7h37m31.498592332s) [seg_pos={0 0}, upload=7928]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 01:03:50.767376188 (7h37m31.498643818s) [upload=7928]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 01:03:50.767381278 (7h37m31.498648908s) [upload=7928]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 01:03:50.890154929 (7h37m31.621422559s) [upload=7928]: Done uploading segments... Aug 9 01:03:50.890168986 (7h37m31.621436606s) [upload=7928]: Upload finished. err: <nil> Duration: 664.302494ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 166.004547ms FAIL (2025-08-09 01:18:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:52:13.986283699 (7h25m54.71755135s) [upload=7723]: Starting upload Aug 9 00:52:13.986408060 (7h25m54.717675711s) [upload=7723]: Done starting upload Aug 9 00:52:13.986481939 (7h25m54.71774956s) [upload=7723]: Uploading segments... Aug 9 00:52:13.986553753 (7h25m54.717821373s) [upload=7723]: Got next segment. Inline: true Aug 9 00:52:13.986558031 (7h25m54.717825641s) [upload=7723]: Waiting for error group managing segments... Aug 9 00:52:13.986608676 (7h25m54.717876296s) [upload=7723]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 00:52:13.986612834 (7h25m54.717880454s) [upload=7723]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 00:52:13.986615108 (7h25m54.717882728s) [upload=7723]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 00:52:13.989421897 (7h25m54.720689516s) [upload=7723]: Done uploading segments... Aug 9 00:52:13.989431464 (7h25m54.720699084s) [upload=7723]: Upload finished. err: metaclient: Too Many Requests Duration:* 166.029483ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [............X.......X..............X......X.................] duration: 735.932955ms FAIL (2025-08-09 01:18:13 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 9 01:03:50.521251227 (7h37m31.252518857s) [upload=7928]: Starting upload Aug 9 01:03:50.521308083 (7h37m31.252575713s) [upload=7928]: Done starting upload Aug 9 01:03:50.521407979 (7h37m31.252675609s) [upload=7928]: Uploading segments... Aug 9 01:03:50.521679086 (7h37m31.252946716s) [upload=7928]: Got next segment. Inline: false Aug 9 01:03:50.521722226 (7h37m31.252989866s) [upload=7928]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:03:50.521727255 (7h37m31.252994885s) [upload=7928]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 01:03:50.547289380 (7h37m31.278557001s) [seg_pos={0 0}, upload=7928]: Begin upload segment... Aug 9 01:03:50.547314256 (7h37m31.278581886s) [seg_pos={0 0}, upload=7928]: Done begin upload segment. Aug 9 01:03:50.547335476 (7h37m31.278603116s) [noise=true , address=104.36.82.12:4173 , piece_id=VBNMKHSMCJKTABCXB2PAGXH65OEUF6LBQXP7XZFNMYOD3H76IPEQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547382454 (7h37m31.278650084s) [noise=true , address=104.36.82.37:4665 , piece_id=F5RO7SFTH54IDNLT7KF2TNOQRVZEFODCYG65ONZJ6THD4LZKKJJA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547771219 (7h37m31.27903884s) [noise=true , address=104.36.82.59:4314 , piece_id=SCL4G7EHDMHOWB7MZRTOLBT2TUZL45AE7A3UIKOQ2HCGI4AJLQCA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547817245 (7h37m31.279084875s) [noise=true , address=104.36.82.14:4245 , piece_id=4B7WJJILP2ZJ2DIDTPSTI55G67X6IBC24POPB4BCVSJOT4ZFKK3Q, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548158312 (7h37m31.279425942s) [noise=true , address=104.36.82.60:4342 , piece_id=GTKAIDOMRHEEWSS2H64BVSLX245AYHVVIXORCJKFMSIAC7VGOZLQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548182277 (7h37m31.279449907s) [noise=true , address=104.36.82.16:4311 , piece_id=WHQMSXMRLD5QRU6GYEPX2U7YTK7OBEHBKHJXWU2YKBZBA4SQJNEA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548510239 (7h37m31.27977787s) [noise=true , address=104.36.82.21:4479 , piece_id=ZKGGJ6T7MZETBH7P72Y4MHWMTK2CAYR5PYQEGNNN7XOYV63BG2HQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548553630 (7h37m31.27982126s) [noise=true , address=104.36.82.44:4897 , piece_id=YMDI7WR2P3M2HTRDLQNCC24ZU2NRRBH6JDJEHOY6WEBK6KKO5PBQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548917339 (7h37m31.280184959s) [noise=true , address=104.36.82.38:4710 , piece_id=AYQ2JWIS4Y6ECJOPZLL3VO7UEL3LAU72EDKKBZBE77G3XHRUKT3A, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548924042 (7h37m31.280191682s) [noise=true , address=104.36.82.17:4332 , piece_id=NRWIFJYUBAMBJ3FBMRXE3YZTREOENZYWB6J4BJLXIIPQKKXNVRUQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548959829 (7h37m31.280227459s) [noise=true , address=104.36.82.53:4144 , piece_id=AZ4C2TJSHYEVYUUEYI7K7QHHBQVAG6NMP2BJALLEE7IY5YFD6FZA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549302238 (7h37m31.280569868s) [noise=true , address=104.36.82.39:4737 , piece_id=AMV62VOAKHJUZCZWNEYGJKY572LWVJZMANNMQEQIS2HHKR3YVRSQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549314360 (7h37m31.28058199s) [noise=true , address=104.36.82.11:4122 , piece_id=HOAEVCU5N4KLGF7O7ZZJC7YC5OB4VZOZIDKDTQTTOR4TU5T3IZXQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549666998 (7h37m31.280934628s) [noise=true , address=104.36.82.4:4812 , piece_id=VKHFSCHUKZFGXRICZGSICWUTOK2BFMG6LAIC67ORAFN7S44SOPPQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.550026399 (7h37m31.281294019s) [noise=true , address=104.36.82.46:4498 , piece_id=C7HSUOEHMVCU5BX3XGAO4LWIGKXPE2IR6U7EOUBSJDSN3CIVRPPQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.550347188 (7h37m31.281614818s) [noise=true , address=104.36.82.62:4440 , piece_id=45DAJ7PILLSEBZICG7W7KKUR7ENYPF57DM2JA5COJV7IWRFB7KTQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.551515258 (7h37m31.282782888s) [noise=true , address=104.36.82.9:4029 , piece_id=LUA5Q3ZUO3SZI24ZPZGXIRLEMBZX3XQFYJQMCY6E4SXMBQTHSAGA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.553639614 (7h37m31.284907244s) [noise=true , address=104.36.82.34:4578 , piece_id=WROE2XH3WOMRAJ4OJBD5LGCCTUMI7ECXHO6HYYRXYNBNBPN7I5ZQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.654119682 (7h37m31.385387312s) [upload=7928]: Next returned nil segment Aug 9 01:03:50.654133758 (7h37m31.385401378s) [upload=7928]: Waiting for error group managing segments... Aug 9 01:03:50.672101667 (7h37m31.403369288s) [noise=true , address=104.36.82.16:4311 , piece_id=WHQMSXMRLD5QRU6GYEPX2U7YTK7OBEHBKHJXWU2YKBZBA4SQJNEA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.672877525 (7h37m31.404145145s) [noise=true , address=104.36.82.38:4710 , piece_id=AYQ2JWIS4Y6ECJOPZLL3VO7UEL3LAU72EDKKBZBE77G3XHRUKT3A, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.675306269 (7h37m31.406573909s) [noise=true , address=104.36.82.59:4314 , piece_id=SCL4G7EHDMHOWB7MZRTOLBT2TUZL45AE7A3UIKOQ2HCGI4AJLQCA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.675371770 (7h37m31.406639391s) [noise=true , address=104.36.82.37:4665 , piece_id=F5RO7SFTH54IDNLT7KF2TNOQRVZEFODCYG65ONZJ6THD4LZKKJJA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.683603266 (7h37m31.414870896s) [noise=true , address=104.36.82.34:4578 , piece_id=WROE2XH3WOMRAJ4OJBD5LGCCTUMI7ECXHO6HYYRXYNBNBPN7I5ZQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.685155513 (7h37m31.416423133s) [noise=true , address=104.36.82.39:4737 , piece_id=AMV62VOAKHJUZCZWNEYGJKY572LWVJZMANNMQEQIS2HHKR3YVRSQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.685621413 (7h37m31.416889033s) [noise=true , address=104.36.82.53:4144 , piece_id=AZ4C2TJSHYEVYUUEYI7K7QHHBQVAG6NMP2BJALLEE7IY5YFD6FZA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.686461230 (7h37m31.41772886s) [noise=true , address=104.36.82.17:4332 , piece_id=NRWIFJYUBAMBJ3FBMRXE3YZTREOENZYWB6J4BJLXIIPQKKXNVRUQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.686992623 (7h37m31.418260253s) [noise=true , address=104.36.82.12:4173 , piece_id=VBNMKHSMCJKTABCXB2PAGXH65OEUF6LBQXP7XZFNMYOD3H76IPEQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.687219727 (7h37m31.418487347s) [noise=true , address=104.36.82.21:4479 , piece_id=ZKGGJ6T7MZETBH7P72Y4MHWMTK2CAYR5PYQEGNNN7XOYV63BG2HQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.692430363 (7h37m31.423697993s) [noise=true , address=104.36.82.14:4245 , piece_id=4B7WJJILP2ZJ2DIDTPSTI55G67X6IBC24POPB4BCVSJOT4ZFKK3Q, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.707237672 (7h37m31.438505302s) [noise=true , address=104.36.82.9:4029 , piece_id=LUA5Q3ZUO3SZI24ZPZGXIRLEMBZX3XQFYJQMCY6E4SXMBQTHSAGA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.716934623 (7h37m31.448202253s) [noise=true , address=104.36.82.4:4812 , piece_id=VKHFSCHUKZFGXRICZGSICWUTOK2BFMG6LAIC67ORAFN7S44SOPPQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.766972144 (7h37m31.498239774s) [noise=true , address=104.36.82.44:4897 , piece_id=YMDI7WR2P3M2HTRDLQNCC24ZU2NRRBH6JDJEHOY6WEBK6KKO5PBQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.766989206 (7h37m31.498256836s) [seg_pos={0 0}, upload=7928]: Segment reached optimal threshold of 14 pieces. Aug 9 01:03:50.767124678 (7h37m31.498392309s) [noise=true , address=104.36.82.62:4440 , piece_id=45DAJ7PILLSEBZICG7W7KKUR7ENYPF57DM2JA5COJV7IWRFB7KTQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jvc3V5SqNUTwbUea883sp3jsPPu1PAzJaUwcjPjxdjm3JiF2L): protocol: write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection; write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection Aug 9 01:03:50.767270229 (7h37m31.49853786s) [noise=true , address=104.36.82.60:4342 , piece_id=GTKAIDOMRHEEWSS2H64BVSLX245AYHVVIXORCJKFMSIAC7VGOZLQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB): protocol: read tcp 5.161.89.252:54032->104.36.82.60:4342: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 9 01:03:50.767296629 (7h37m31.498564249s) [noise=true , address=104.36.82.46:4498 , piece_id=C7HSUOEHMVCU5BX3XGAO4LWIGKXPE2IR6U7EOUBSJDSN3CIVRPPQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jyjxdWkBRBkDHSKknNmPdcnJ3HRcSCUQNnmpb1CaiEdMPEGk4): protocol: expected piece hash; context canceled; EOF Aug 9 01:03:50.767313812 (7h37m31.498581442s) [noise=true , address=104.36.82.11:4122 , piece_id=HOAEVCU5N4KLGF7O7ZZJC7YC5OB4VZOZIDKDTQTTOR4TU5T3IZXQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1oCu75zR8YccTunHjctcLzTrr9wTQqtAPXHiWrsQs41o8gxgh6): protocol: write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection; write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection Aug 9 01:03:50.767324712 (7h37m31.498592332s) [seg_pos={0 0}, upload=7928]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 01:03:50.767376188 (7h37m31.498643818s) [upload=7928]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 01:03:50.767381278 (7h37m31.498648908s) [upload=7928]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 01:03:50.890154929 (7h37m31.621422559s) [upload=7928]: Done uploading segments... Aug 9 01:03:50.890168986 (7h37m31.621436606s) [upload=7928]: Upload finished. err: <nil> Duration: 735.954535ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 217.89497ms FAIL (2025-08-09 01:17:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:52:13.986283699 (7h25m54.71755135s) [upload=7723]: Starting upload Aug 9 00:52:13.986408060 (7h25m54.717675711s) [upload=7723]: Done starting upload Aug 9 00:52:13.986481939 (7h25m54.71774956s) [upload=7723]: Uploading segments... Aug 9 00:52:13.986553753 (7h25m54.717821373s) [upload=7723]: Got next segment. Inline: true Aug 9 00:52:13.986558031 (7h25m54.717825641s) [upload=7723]: Waiting for error group managing segments... Aug 9 00:52:13.986608676 (7h25m54.717876296s) [upload=7723]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 00:52:13.986612834 (7h25m54.717880454s) [upload=7723]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 00:52:13.986615108 (7h25m54.717882728s) [upload=7723]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 00:52:13.989421897 (7h25m54.720689516s) [upload=7723]: Done uploading segments... Aug 9 00:52:13.989431464 (7h25m54.720699084s) [upload=7723]: Upload finished. err: metaclient: Too Many Requests Duration:* 217.918313ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.............X.......X..............X......X................] duration: 508.881623ms FAIL (2025-08-09 01:16:59 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 9 01:03:50.521251227 (7h37m31.252518857s) [upload=7928]: Starting upload Aug 9 01:03:50.521308083 (7h37m31.252575713s) [upload=7928]: Done starting upload Aug 9 01:03:50.521407979 (7h37m31.252675609s) [upload=7928]: Uploading segments... Aug 9 01:03:50.521679086 (7h37m31.252946716s) [upload=7928]: Got next segment. Inline: false Aug 9 01:03:50.521722226 (7h37m31.252989866s) [upload=7928]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:03:50.521727255 (7h37m31.252994885s) [upload=7928]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 01:03:50.547289380 (7h37m31.278557001s) [seg_pos={0 0}, upload=7928]: Begin upload segment... Aug 9 01:03:50.547314256 (7h37m31.278581886s) [seg_pos={0 0}, upload=7928]: Done begin upload segment. Aug 9 01:03:50.547335476 (7h37m31.278603116s) [noise=true , address=104.36.82.12:4173 , piece_id=VBNMKHSMCJKTABCXB2PAGXH65OEUF6LBQXP7XZFNMYOD3H76IPEQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547382454 (7h37m31.278650084s) [noise=true , address=104.36.82.37:4665 , piece_id=F5RO7SFTH54IDNLT7KF2TNOQRVZEFODCYG65ONZJ6THD4LZKKJJA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547771219 (7h37m31.27903884s) [noise=true , address=104.36.82.59:4314 , piece_id=SCL4G7EHDMHOWB7MZRTOLBT2TUZL45AE7A3UIKOQ2HCGI4AJLQCA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547817245 (7h37m31.279084875s) [noise=true , address=104.36.82.14:4245 , piece_id=4B7WJJILP2ZJ2DIDTPSTI55G67X6IBC24POPB4BCVSJOT4ZFKK3Q, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548158312 (7h37m31.279425942s) [noise=true , address=104.36.82.60:4342 , piece_id=GTKAIDOMRHEEWSS2H64BVSLX245AYHVVIXORCJKFMSIAC7VGOZLQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548182277 (7h37m31.279449907s) [noise=true , address=104.36.82.16:4311 , piece_id=WHQMSXMRLD5QRU6GYEPX2U7YTK7OBEHBKHJXWU2YKBZBA4SQJNEA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548510239 (7h37m31.27977787s) [noise=true , address=104.36.82.21:4479 , piece_id=ZKGGJ6T7MZETBH7P72Y4MHWMTK2CAYR5PYQEGNNN7XOYV63BG2HQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548553630 (7h37m31.27982126s) [noise=true , address=104.36.82.44:4897 , piece_id=YMDI7WR2P3M2HTRDLQNCC24ZU2NRRBH6JDJEHOY6WEBK6KKO5PBQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548917339 (7h37m31.280184959s) [noise=true , address=104.36.82.38:4710 , piece_id=AYQ2JWIS4Y6ECJOPZLL3VO7UEL3LAU72EDKKBZBE77G3XHRUKT3A, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548924042 (7h37m31.280191682s) [noise=true , address=104.36.82.17:4332 , piece_id=NRWIFJYUBAMBJ3FBMRXE3YZTREOENZYWB6J4BJLXIIPQKKXNVRUQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548959829 (7h37m31.280227459s) [noise=true , address=104.36.82.53:4144 , piece_id=AZ4C2TJSHYEVYUUEYI7K7QHHBQVAG6NMP2BJALLEE7IY5YFD6FZA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549302238 (7h37m31.280569868s) [noise=true , address=104.36.82.39:4737 , piece_id=AMV62VOAKHJUZCZWNEYGJKY572LWVJZMANNMQEQIS2HHKR3YVRSQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549314360 (7h37m31.28058199s) [noise=true , address=104.36.82.11:4122 , piece_id=HOAEVCU5N4KLGF7O7ZZJC7YC5OB4VZOZIDKDTQTTOR4TU5T3IZXQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549666998 (7h37m31.280934628s) [noise=true , address=104.36.82.4:4812 , piece_id=VKHFSCHUKZFGXRICZGSICWUTOK2BFMG6LAIC67ORAFN7S44SOPPQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.550026399 (7h37m31.281294019s) [noise=true , address=104.36.82.46:4498 , piece_id=C7HSUOEHMVCU5BX3XGAO4LWIGKXPE2IR6U7EOUBSJDSN3CIVRPPQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.550347188 (7h37m31.281614818s) [noise=true , address=104.36.82.62:4440 , piece_id=45DAJ7PILLSEBZICG7W7KKUR7ENYPF57DM2JA5COJV7IWRFB7KTQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.551515258 (7h37m31.282782888s) [noise=true , address=104.36.82.9:4029 , piece_id=LUA5Q3ZUO3SZI24ZPZGXIRLEMBZX3XQFYJQMCY6E4SXMBQTHSAGA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.553639614 (7h37m31.284907244s) [noise=true , address=104.36.82.34:4578 , piece_id=WROE2XH3WOMRAJ4OJBD5LGCCTUMI7ECXHO6HYYRXYNBNBPN7I5ZQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.654119682 (7h37m31.385387312s) [upload=7928]: Next returned nil segment Aug 9 01:03:50.654133758 (7h37m31.385401378s) [upload=7928]: Waiting for error group managing segments... Aug 9 01:03:50.672101667 (7h37m31.403369288s) [noise=true , address=104.36.82.16:4311 , piece_id=WHQMSXMRLD5QRU6GYEPX2U7YTK7OBEHBKHJXWU2YKBZBA4SQJNEA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.672877525 (7h37m31.404145145s) [noise=true , address=104.36.82.38:4710 , piece_id=AYQ2JWIS4Y6ECJOPZLL3VO7UEL3LAU72EDKKBZBE77G3XHRUKT3A, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.675306269 (7h37m31.406573909s) [noise=true , address=104.36.82.59:4314 , piece_id=SCL4G7EHDMHOWB7MZRTOLBT2TUZL45AE7A3UIKOQ2HCGI4AJLQCA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.675371770 (7h37m31.406639391s) [noise=true , address=104.36.82.37:4665 , piece_id=F5RO7SFTH54IDNLT7KF2TNOQRVZEFODCYG65ONZJ6THD4LZKKJJA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.683603266 (7h37m31.414870896s) [noise=true , address=104.36.82.34:4578 , piece_id=WROE2XH3WOMRAJ4OJBD5LGCCTUMI7ECXHO6HYYRXYNBNBPN7I5ZQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.685155513 (7h37m31.416423133s) [noise=true , address=104.36.82.39:4737 , piece_id=AMV62VOAKHJUZCZWNEYGJKY572LWVJZMANNMQEQIS2HHKR3YVRSQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.685621413 (7h37m31.416889033s) [noise=true , address=104.36.82.53:4144 , piece_id=AZ4C2TJSHYEVYUUEYI7K7QHHBQVAG6NMP2BJALLEE7IY5YFD6FZA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.686461230 (7h37m31.41772886s) [noise=true , address=104.36.82.17:4332 , piece_id=NRWIFJYUBAMBJ3FBMRXE3YZTREOENZYWB6J4BJLXIIPQKKXNVRUQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.686992623 (7h37m31.418260253s) [noise=true , address=104.36.82.12:4173 , piece_id=VBNMKHSMCJKTABCXB2PAGXH65OEUF6LBQXP7XZFNMYOD3H76IPEQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.687219727 (7h37m31.418487347s) [noise=true , address=104.36.82.21:4479 , piece_id=ZKGGJ6T7MZETBH7P72Y4MHWMTK2CAYR5PYQEGNNN7XOYV63BG2HQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.692430363 (7h37m31.423697993s) [noise=true , address=104.36.82.14:4245 , piece_id=4B7WJJILP2ZJ2DIDTPSTI55G67X6IBC24POPB4BCVSJOT4ZFKK3Q, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.707237672 (7h37m31.438505302s) [noise=true , address=104.36.82.9:4029 , piece_id=LUA5Q3ZUO3SZI24ZPZGXIRLEMBZX3XQFYJQMCY6E4SXMBQTHSAGA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.716934623 (7h37m31.448202253s) [noise=true , address=104.36.82.4:4812 , piece_id=VKHFSCHUKZFGXRICZGSICWUTOK2BFMG6LAIC67ORAFN7S44SOPPQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.766972144 (7h37m31.498239774s) [noise=true , address=104.36.82.44:4897 , piece_id=YMDI7WR2P3M2HTRDLQNCC24ZU2NRRBH6JDJEHOY6WEBK6KKO5PBQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.766989206 (7h37m31.498256836s) [seg_pos={0 0}, upload=7928]: Segment reached optimal threshold of 14 pieces. Aug 9 01:03:50.767124678 (7h37m31.498392309s) [noise=true , address=104.36.82.62:4440 , piece_id=45DAJ7PILLSEBZICG7W7KKUR7ENYPF57DM2JA5COJV7IWRFB7KTQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jvc3V5SqNUTwbUea883sp3jsPPu1PAzJaUwcjPjxdjm3JiF2L): protocol: write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection; write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection Aug 9 01:03:50.767270229 (7h37m31.49853786s) [noise=true , address=104.36.82.60:4342 , piece_id=GTKAIDOMRHEEWSS2H64BVSLX245AYHVVIXORCJKFMSIAC7VGOZLQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB): protocol: read tcp 5.161.89.252:54032->104.36.82.60:4342: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 9 01:03:50.767296629 (7h37m31.498564249s) [noise=true , address=104.36.82.46:4498 , piece_id=C7HSUOEHMVCU5BX3XGAO4LWIGKXPE2IR6U7EOUBSJDSN3CIVRPPQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jyjxdWkBRBkDHSKknNmPdcnJ3HRcSCUQNnmpb1CaiEdMPEGk4): protocol: expected piece hash; context canceled; EOF Aug 9 01:03:50.767313812 (7h37m31.498581442s) [noise=true , address=104.36.82.11:4122 , piece_id=HOAEVCU5N4KLGF7O7ZZJC7YC5OB4VZOZIDKDTQTTOR4TU5T3IZXQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1oCu75zR8YccTunHjctcLzTrr9wTQqtAPXHiWrsQs41o8gxgh6): protocol: write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection; write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection Aug 9 01:03:50.767324712 (7h37m31.498592332s) [seg_pos={0 0}, upload=7928]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 01:03:50.767376188 (7h37m31.498643818s) [upload=7928]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 01:03:50.767381278 (7h37m31.498648908s) [upload=7928]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 01:03:50.890154929 (7h37m31.621422559s) [upload=7928]: Done uploading segments... Aug 9 01:03:50.890168986 (7h37m31.621436606s) [upload=7928]: Upload finished. err: <nil> Duration: 508.906199ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 169.476329ms FAIL (2025-08-09 01:16:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:52:13.986283699 (7h25m54.71755135s) [upload=7723]: Starting upload Aug 9 00:52:13.986408060 (7h25m54.717675711s) [upload=7723]: Done starting upload Aug 9 00:52:13.986481939 (7h25m54.71774956s) [upload=7723]: Uploading segments... Aug 9 00:52:13.986553753 (7h25m54.717821373s) [upload=7723]: Got next segment. Inline: true Aug 9 00:52:13.986558031 (7h25m54.717825641s) [upload=7723]: Waiting for error group managing segments... Aug 9 00:52:13.986608676 (7h25m54.717876296s) [upload=7723]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 00:52:13.986612834 (7h25m54.717880454s) [upload=7723]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 00:52:13.986615108 (7h25m54.717882728s) [upload=7723]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 00:52:13.989421897 (7h25m54.720689516s) [upload=7723]: Done uploading segments... Aug 9 00:52:13.989431464 (7h25m54.720699084s) [upload=7723]: Upload finished. err: metaclient: Too Many Requests Duration:* 169.49793ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..............X.......X..............X......X...............] duration: 706.961834ms FAIL (2025-08-09 01:16:04 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 9 01:03:50.521251227 (7h37m31.252518857s) [upload=7928]: Starting upload Aug 9 01:03:50.521308083 (7h37m31.252575713s) [upload=7928]: Done starting upload Aug 9 01:03:50.521407979 (7h37m31.252675609s) [upload=7928]: Uploading segments... Aug 9 01:03:50.521679086 (7h37m31.252946716s) [upload=7928]: Got next segment. Inline: false Aug 9 01:03:50.521722226 (7h37m31.252989866s) [upload=7928]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:03:50.521727255 (7h37m31.252994885s) [upload=7928]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 01:03:50.547289380 (7h37m31.278557001s) [seg_pos={0 0}, upload=7928]: Begin upload segment... Aug 9 01:03:50.547314256 (7h37m31.278581886s) [seg_pos={0 0}, upload=7928]: Done begin upload segment. Aug 9 01:03:50.547335476 (7h37m31.278603116s) [noise=true , address=104.36.82.12:4173 , piece_id=VBNMKHSMCJKTABCXB2PAGXH65OEUF6LBQXP7XZFNMYOD3H76IPEQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547382454 (7h37m31.278650084s) [noise=true , address=104.36.82.37:4665 , piece_id=F5RO7SFTH54IDNLT7KF2TNOQRVZEFODCYG65ONZJ6THD4LZKKJJA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547771219 (7h37m31.27903884s) [noise=true , address=104.36.82.59:4314 , piece_id=SCL4G7EHDMHOWB7MZRTOLBT2TUZL45AE7A3UIKOQ2HCGI4AJLQCA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547817245 (7h37m31.279084875s) [noise=true , address=104.36.82.14:4245 , piece_id=4B7WJJILP2ZJ2DIDTPSTI55G67X6IBC24POPB4BCVSJOT4ZFKK3Q, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548158312 (7h37m31.279425942s) [noise=true , address=104.36.82.60:4342 , piece_id=GTKAIDOMRHEEWSS2H64BVSLX245AYHVVIXORCJKFMSIAC7VGOZLQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548182277 (7h37m31.279449907s) [noise=true , address=104.36.82.16:4311 , piece_id=WHQMSXMRLD5QRU6GYEPX2U7YTK7OBEHBKHJXWU2YKBZBA4SQJNEA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548510239 (7h37m31.27977787s) [noise=true , address=104.36.82.21:4479 , piece_id=ZKGGJ6T7MZETBH7P72Y4MHWMTK2CAYR5PYQEGNNN7XOYV63BG2HQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548553630 (7h37m31.27982126s) [noise=true , address=104.36.82.44:4897 , piece_id=YMDI7WR2P3M2HTRDLQNCC24ZU2NRRBH6JDJEHOY6WEBK6KKO5PBQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548917339 (7h37m31.280184959s) [noise=true , address=104.36.82.38:4710 , piece_id=AYQ2JWIS4Y6ECJOPZLL3VO7UEL3LAU72EDKKBZBE77G3XHRUKT3A, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548924042 (7h37m31.280191682s) [noise=true , address=104.36.82.17:4332 , piece_id=NRWIFJYUBAMBJ3FBMRXE3YZTREOENZYWB6J4BJLXIIPQKKXNVRUQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548959829 (7h37m31.280227459s) [noise=true , address=104.36.82.53:4144 , piece_id=AZ4C2TJSHYEVYUUEYI7K7QHHBQVAG6NMP2BJALLEE7IY5YFD6FZA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549302238 (7h37m31.280569868s) [noise=true , address=104.36.82.39:4737 , piece_id=AMV62VOAKHJUZCZWNEYGJKY572LWVJZMANNMQEQIS2HHKR3YVRSQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549314360 (7h37m31.28058199s) [noise=true , address=104.36.82.11:4122 , piece_id=HOAEVCU5N4KLGF7O7ZZJC7YC5OB4VZOZIDKDTQTTOR4TU5T3IZXQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549666998 (7h37m31.280934628s) [noise=true , address=104.36.82.4:4812 , piece_id=VKHFSCHUKZFGXRICZGSICWUTOK2BFMG6LAIC67ORAFN7S44SOPPQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.550026399 (7h37m31.281294019s) [noise=true , address=104.36.82.46:4498 , piece_id=C7HSUOEHMVCU5BX3XGAO4LWIGKXPE2IR6U7EOUBSJDSN3CIVRPPQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.550347188 (7h37m31.281614818s) [noise=true , address=104.36.82.62:4440 , piece_id=45DAJ7PILLSEBZICG7W7KKUR7ENYPF57DM2JA5COJV7IWRFB7KTQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.551515258 (7h37m31.282782888s) [noise=true , address=104.36.82.9:4029 , piece_id=LUA5Q3ZUO3SZI24ZPZGXIRLEMBZX3XQFYJQMCY6E4SXMBQTHSAGA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.553639614 (7h37m31.284907244s) [noise=true , address=104.36.82.34:4578 , piece_id=WROE2XH3WOMRAJ4OJBD5LGCCTUMI7ECXHO6HYYRXYNBNBPN7I5ZQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.654119682 (7h37m31.385387312s) [upload=7928]: Next returned nil segment Aug 9 01:03:50.654133758 (7h37m31.385401378s) [upload=7928]: Waiting for error group managing segments... Aug 9 01:03:50.672101667 (7h37m31.403369288s) [noise=true , address=104.36.82.16:4311 , piece_id=WHQMSXMRLD5QRU6GYEPX2U7YTK7OBEHBKHJXWU2YKBZBA4SQJNEA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.672877525 (7h37m31.404145145s) [noise=true , address=104.36.82.38:4710 , piece_id=AYQ2JWIS4Y6ECJOPZLL3VO7UEL3LAU72EDKKBZBE77G3XHRUKT3A, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.675306269 (7h37m31.406573909s) [noise=true , address=104.36.82.59:4314 , piece_id=SCL4G7EHDMHOWB7MZRTOLBT2TUZL45AE7A3UIKOQ2HCGI4AJLQCA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.675371770 (7h37m31.406639391s) [noise=true , address=104.36.82.37:4665 , piece_id=F5RO7SFTH54IDNLT7KF2TNOQRVZEFODCYG65ONZJ6THD4LZKKJJA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.683603266 (7h37m31.414870896s) [noise=true , address=104.36.82.34:4578 , piece_id=WROE2XH3WOMRAJ4OJBD5LGCCTUMI7ECXHO6HYYRXYNBNBPN7I5ZQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.685155513 (7h37m31.416423133s) [noise=true , address=104.36.82.39:4737 , piece_id=AMV62VOAKHJUZCZWNEYGJKY572LWVJZMANNMQEQIS2HHKR3YVRSQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.685621413 (7h37m31.416889033s) [noise=true , address=104.36.82.53:4144 , piece_id=AZ4C2TJSHYEVYUUEYI7K7QHHBQVAG6NMP2BJALLEE7IY5YFD6FZA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.686461230 (7h37m31.41772886s) [noise=true , address=104.36.82.17:4332 , piece_id=NRWIFJYUBAMBJ3FBMRXE3YZTREOENZYWB6J4BJLXIIPQKKXNVRUQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.686992623 (7h37m31.418260253s) [noise=true , address=104.36.82.12:4173 , piece_id=VBNMKHSMCJKTABCXB2PAGXH65OEUF6LBQXP7XZFNMYOD3H76IPEQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.687219727 (7h37m31.418487347s) [noise=true , address=104.36.82.21:4479 , piece_id=ZKGGJ6T7MZETBH7P72Y4MHWMTK2CAYR5PYQEGNNN7XOYV63BG2HQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.692430363 (7h37m31.423697993s) [noise=true , address=104.36.82.14:4245 , piece_id=4B7WJJILP2ZJ2DIDTPSTI55G67X6IBC24POPB4BCVSJOT4ZFKK3Q, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.707237672 (7h37m31.438505302s) [noise=true , address=104.36.82.9:4029 , piece_id=LUA5Q3ZUO3SZI24ZPZGXIRLEMBZX3XQFYJQMCY6E4SXMBQTHSAGA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.716934623 (7h37m31.448202253s) [noise=true , address=104.36.82.4:4812 , piece_id=VKHFSCHUKZFGXRICZGSICWUTOK2BFMG6LAIC67ORAFN7S44SOPPQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.766972144 (7h37m31.498239774s) [noise=true , address=104.36.82.44:4897 , piece_id=YMDI7WR2P3M2HTRDLQNCC24ZU2NRRBH6JDJEHOY6WEBK6KKO5PBQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.766989206 (7h37m31.498256836s) [seg_pos={0 0}, upload=7928]: Segment reached optimal threshold of 14 pieces. Aug 9 01:03:50.767124678 (7h37m31.498392309s) [noise=true , address=104.36.82.62:4440 , piece_id=45DAJ7PILLSEBZICG7W7KKUR7ENYPF57DM2JA5COJV7IWRFB7KTQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jvc3V5SqNUTwbUea883sp3jsPPu1PAzJaUwcjPjxdjm3JiF2L): protocol: write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection; write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection Aug 9 01:03:50.767270229 (7h37m31.49853786s) [noise=true , address=104.36.82.60:4342 , piece_id=GTKAIDOMRHEEWSS2H64BVSLX245AYHVVIXORCJKFMSIAC7VGOZLQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB): protocol: read tcp 5.161.89.252:54032->104.36.82.60:4342: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 9 01:03:50.767296629 (7h37m31.498564249s) [noise=true , address=104.36.82.46:4498 , piece_id=C7HSUOEHMVCU5BX3XGAO4LWIGKXPE2IR6U7EOUBSJDSN3CIVRPPQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jyjxdWkBRBkDHSKknNmPdcnJ3HRcSCUQNnmpb1CaiEdMPEGk4): protocol: expected piece hash; context canceled; EOF Aug 9 01:03:50.767313812 (7h37m31.498581442s) [noise=true , address=104.36.82.11:4122 , piece_id=HOAEVCU5N4KLGF7O7ZZJC7YC5OB4VZOZIDKDTQTTOR4TU5T3IZXQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1oCu75zR8YccTunHjctcLzTrr9wTQqtAPXHiWrsQs41o8gxgh6): protocol: write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection; write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection Aug 9 01:03:50.767324712 (7h37m31.498592332s) [seg_pos={0 0}, upload=7928]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 01:03:50.767376188 (7h37m31.498643818s) [upload=7928]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 01:03:50.767381278 (7h37m31.498648908s) [upload=7928]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 01:03:50.890154929 (7h37m31.621422559s) [upload=7928]: Done uploading segments... Aug 9 01:03:50.890168986 (7h37m31.621436606s) [upload=7928]: Upload finished. err: <nil> Duration: 706.979518ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 141.7102ms FAIL (2025-08-09 01:15:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:52:13.986283699 (7h25m54.71755135s) [upload=7723]: Starting upload Aug 9 00:52:13.986408060 (7h25m54.717675711s) [upload=7723]: Done starting upload Aug 9 00:52:13.986481939 (7h25m54.71774956s) [upload=7723]: Uploading segments... Aug 9 00:52:13.986553753 (7h25m54.717821373s) [upload=7723]: Got next segment. Inline: true Aug 9 00:52:13.986558031 (7h25m54.717825641s) [upload=7723]: Waiting for error group managing segments... Aug 9 00:52:13.986608676 (7h25m54.717876296s) [upload=7723]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 00:52:13.986612834 (7h25m54.717880454s) [upload=7723]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 00:52:13.986615108 (7h25m54.717882728s) [upload=7723]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 00:52:13.989421897 (7h25m54.720689516s) [upload=7723]: Done uploading segments... Aug 9 00:52:13.989431464 (7h25m54.720699084s) [upload=7723]: Upload finished. err: metaclient: Too Many Requests Duration:* 141.741249ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...............X.......X..............X......X..............] duration: 452.0182ms FAIL (2025-08-09 01:15:04 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 9 01:03:50.521251227 (7h37m31.252518857s) [upload=7928]: Starting upload Aug 9 01:03:50.521308083 (7h37m31.252575713s) [upload=7928]: Done starting upload Aug 9 01:03:50.521407979 (7h37m31.252675609s) [upload=7928]: Uploading segments... Aug 9 01:03:50.521679086 (7h37m31.252946716s) [upload=7928]: Got next segment. Inline: false Aug 9 01:03:50.521722226 (7h37m31.252989866s) [upload=7928]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:03:50.521727255 (7h37m31.252994885s) [upload=7928]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 01:03:50.547289380 (7h37m31.278557001s) [seg_pos={0 0}, upload=7928]: Begin upload segment... Aug 9 01:03:50.547314256 (7h37m31.278581886s) [seg_pos={0 0}, upload=7928]: Done begin upload segment. Aug 9 01:03:50.547335476 (7h37m31.278603116s) [noise=true , address=104.36.82.12:4173 , piece_id=VBNMKHSMCJKTABCXB2PAGXH65OEUF6LBQXP7XZFNMYOD3H76IPEQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547382454 (7h37m31.278650084s) [noise=true , address=104.36.82.37:4665 , piece_id=F5RO7SFTH54IDNLT7KF2TNOQRVZEFODCYG65ONZJ6THD4LZKKJJA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547771219 (7h37m31.27903884s) [noise=true , address=104.36.82.59:4314 , piece_id=SCL4G7EHDMHOWB7MZRTOLBT2TUZL45AE7A3UIKOQ2HCGI4AJLQCA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547817245 (7h37m31.279084875s) [noise=true , address=104.36.82.14:4245 , piece_id=4B7WJJILP2ZJ2DIDTPSTI55G67X6IBC24POPB4BCVSJOT4ZFKK3Q, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548158312 (7h37m31.279425942s) [noise=true , address=104.36.82.60:4342 , piece_id=GTKAIDOMRHEEWSS2H64BVSLX245AYHVVIXORCJKFMSIAC7VGOZLQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548182277 (7h37m31.279449907s) [noise=true , address=104.36.82.16:4311 , piece_id=WHQMSXMRLD5QRU6GYEPX2U7YTK7OBEHBKHJXWU2YKBZBA4SQJNEA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548510239 (7h37m31.27977787s) [noise=true , address=104.36.82.21:4479 , piece_id=ZKGGJ6T7MZETBH7P72Y4MHWMTK2CAYR5PYQEGNNN7XOYV63BG2HQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548553630 (7h37m31.27982126s) [noise=true , address=104.36.82.44:4897 , piece_id=YMDI7WR2P3M2HTRDLQNCC24ZU2NRRBH6JDJEHOY6WEBK6KKO5PBQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548917339 (7h37m31.280184959s) [noise=true , address=104.36.82.38:4710 , piece_id=AYQ2JWIS4Y6ECJOPZLL3VO7UEL3LAU72EDKKBZBE77G3XHRUKT3A, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548924042 (7h37m31.280191682s) [noise=true , address=104.36.82.17:4332 , piece_id=NRWIFJYUBAMBJ3FBMRXE3YZTREOENZYWB6J4BJLXIIPQKKXNVRUQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548959829 (7h37m31.280227459s) [noise=true , address=104.36.82.53:4144 , piece_id=AZ4C2TJSHYEVYUUEYI7K7QHHBQVAG6NMP2BJALLEE7IY5YFD6FZA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549302238 (7h37m31.280569868s) [noise=true , address=104.36.82.39:4737 , piece_id=AMV62VOAKHJUZCZWNEYGJKY572LWVJZMANNMQEQIS2HHKR3YVRSQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549314360 (7h37m31.28058199s) [noise=true , address=104.36.82.11:4122 , piece_id=HOAEVCU5N4KLGF7O7ZZJC7YC5OB4VZOZIDKDTQTTOR4TU5T3IZXQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549666998 (7h37m31.280934628s) [noise=true , address=104.36.82.4:4812 , piece_id=VKHFSCHUKZFGXRICZGSICWUTOK2BFMG6LAIC67ORAFN7S44SOPPQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.550026399 (7h37m31.281294019s) [noise=true , address=104.36.82.46:4498 , piece_id=C7HSUOEHMVCU5BX3XGAO4LWIGKXPE2IR6U7EOUBSJDSN3CIVRPPQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.550347188 (7h37m31.281614818s) [noise=true , address=104.36.82.62:4440 , piece_id=45DAJ7PILLSEBZICG7W7KKUR7ENYPF57DM2JA5COJV7IWRFB7KTQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.551515258 (7h37m31.282782888s) [noise=true , address=104.36.82.9:4029 , piece_id=LUA5Q3ZUO3SZI24ZPZGXIRLEMBZX3XQFYJQMCY6E4SXMBQTHSAGA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.553639614 (7h37m31.284907244s) [noise=true , address=104.36.82.34:4578 , piece_id=WROE2XH3WOMRAJ4OJBD5LGCCTUMI7ECXHO6HYYRXYNBNBPN7I5ZQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.654119682 (7h37m31.385387312s) [upload=7928]: Next returned nil segment Aug 9 01:03:50.654133758 (7h37m31.385401378s) [upload=7928]: Waiting for error group managing segments... Aug 9 01:03:50.672101667 (7h37m31.403369288s) [noise=true , address=104.36.82.16:4311 , piece_id=WHQMSXMRLD5QRU6GYEPX2U7YTK7OBEHBKHJXWU2YKBZBA4SQJNEA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.672877525 (7h37m31.404145145s) [noise=true , address=104.36.82.38:4710 , piece_id=AYQ2JWIS4Y6ECJOPZLL3VO7UEL3LAU72EDKKBZBE77G3XHRUKT3A, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.675306269 (7h37m31.406573909s) [noise=true , address=104.36.82.59:4314 , piece_id=SCL4G7EHDMHOWB7MZRTOLBT2TUZL45AE7A3UIKOQ2HCGI4AJLQCA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.675371770 (7h37m31.406639391s) [noise=true , address=104.36.82.37:4665 , piece_id=F5RO7SFTH54IDNLT7KF2TNOQRVZEFODCYG65ONZJ6THD4LZKKJJA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.683603266 (7h37m31.414870896s) [noise=true , address=104.36.82.34:4578 , piece_id=WROE2XH3WOMRAJ4OJBD5LGCCTUMI7ECXHO6HYYRXYNBNBPN7I5ZQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.685155513 (7h37m31.416423133s) [noise=true , address=104.36.82.39:4737 , piece_id=AMV62VOAKHJUZCZWNEYGJKY572LWVJZMANNMQEQIS2HHKR3YVRSQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.685621413 (7h37m31.416889033s) [noise=true , address=104.36.82.53:4144 , piece_id=AZ4C2TJSHYEVYUUEYI7K7QHHBQVAG6NMP2BJALLEE7IY5YFD6FZA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.686461230 (7h37m31.41772886s) [noise=true , address=104.36.82.17:4332 , piece_id=NRWIFJYUBAMBJ3FBMRXE3YZTREOENZYWB6J4BJLXIIPQKKXNVRUQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.686992623 (7h37m31.418260253s) [noise=true , address=104.36.82.12:4173 , piece_id=VBNMKHSMCJKTABCXB2PAGXH65OEUF6LBQXP7XZFNMYOD3H76IPEQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.687219727 (7h37m31.418487347s) [noise=true , address=104.36.82.21:4479 , piece_id=ZKGGJ6T7MZETBH7P72Y4MHWMTK2CAYR5PYQEGNNN7XOYV63BG2HQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.692430363 (7h37m31.423697993s) [noise=true , address=104.36.82.14:4245 , piece_id=4B7WJJILP2ZJ2DIDTPSTI55G67X6IBC24POPB4BCVSJOT4ZFKK3Q, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.707237672 (7h37m31.438505302s) [noise=true , address=104.36.82.9:4029 , piece_id=LUA5Q3ZUO3SZI24ZPZGXIRLEMBZX3XQFYJQMCY6E4SXMBQTHSAGA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.716934623 (7h37m31.448202253s) [noise=true , address=104.36.82.4:4812 , piece_id=VKHFSCHUKZFGXRICZGSICWUTOK2BFMG6LAIC67ORAFN7S44SOPPQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.766972144 (7h37m31.498239774s) [noise=true , address=104.36.82.44:4897 , piece_id=YMDI7WR2P3M2HTRDLQNCC24ZU2NRRBH6JDJEHOY6WEBK6KKO5PBQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.766989206 (7h37m31.498256836s) [seg_pos={0 0}, upload=7928]: Segment reached optimal threshold of 14 pieces. Aug 9 01:03:50.767124678 (7h37m31.498392309s) [noise=true , address=104.36.82.62:4440 , piece_id=45DAJ7PILLSEBZICG7W7KKUR7ENYPF57DM2JA5COJV7IWRFB7KTQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jvc3V5SqNUTwbUea883sp3jsPPu1PAzJaUwcjPjxdjm3JiF2L): protocol: write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection; write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection Aug 9 01:03:50.767270229 (7h37m31.49853786s) [noise=true , address=104.36.82.60:4342 , piece_id=GTKAIDOMRHEEWSS2H64BVSLX245AYHVVIXORCJKFMSIAC7VGOZLQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB): protocol: read tcp 5.161.89.252:54032->104.36.82.60:4342: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 9 01:03:50.767296629 (7h37m31.498564249s) [noise=true , address=104.36.82.46:4498 , piece_id=C7HSUOEHMVCU5BX3XGAO4LWIGKXPE2IR6U7EOUBSJDSN3CIVRPPQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jyjxdWkBRBkDHSKknNmPdcnJ3HRcSCUQNnmpb1CaiEdMPEGk4): protocol: expected piece hash; context canceled; EOF Aug 9 01:03:50.767313812 (7h37m31.498581442s) [noise=true , address=104.36.82.11:4122 , piece_id=HOAEVCU5N4KLGF7O7ZZJC7YC5OB4VZOZIDKDTQTTOR4TU5T3IZXQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1oCu75zR8YccTunHjctcLzTrr9wTQqtAPXHiWrsQs41o8gxgh6): protocol: write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection; write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection Aug 9 01:03:50.767324712 (7h37m31.498592332s) [seg_pos={0 0}, upload=7928]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 01:03:50.767376188 (7h37m31.498643818s) [upload=7928]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 01:03:50.767381278 (7h37m31.498648908s) [upload=7928]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 01:03:50.890154929 (7h37m31.621422559s) [upload=7928]: Done uploading segments... Aug 9 01:03:50.890168986 (7h37m31.621436606s) [upload=7928]: Upload finished. err: <nil> Duration: 452.037217ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 254.848718ms FAIL (2025-08-09 01:14:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:52:13.986283699 (7h25m54.71755135s) [upload=7723]: Starting upload Aug 9 00:52:13.986408060 (7h25m54.717675711s) [upload=7723]: Done starting upload Aug 9 00:52:13.986481939 (7h25m54.71774956s) [upload=7723]: Uploading segments... Aug 9 00:52:13.986553753 (7h25m54.717821373s) [upload=7723]: Got next segment. Inline: true Aug 9 00:52:13.986558031 (7h25m54.717825641s) [upload=7723]: Waiting for error group managing segments... Aug 9 00:52:13.986608676 (7h25m54.717876296s) [upload=7723]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 00:52:13.986612834 (7h25m54.717880454s) [upload=7723]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 00:52:13.986615108 (7h25m54.717882728s) [upload=7723]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 00:52:13.989421897 (7h25m54.720689516s) [upload=7723]: Done uploading segments... Aug 9 00:52:13.989431464 (7h25m54.720699084s) [upload=7723]: Upload finished. err: metaclient: Too Many Requests Duration:* 254.873603ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 141.667681ms FAIL (2025-08-09 01:14:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:52:13.986283699 (7h25m54.71755135s) [upload=7723]: Starting upload Aug 9 00:52:13.986408060 (7h25m54.717675711s) [upload=7723]: Done starting upload Aug 9 00:52:13.986481939 (7h25m54.71774956s) [upload=7723]: Uploading segments... Aug 9 00:52:13.986553753 (7h25m54.717821373s) [upload=7723]: Got next segment. Inline: true Aug 9 00:52:13.986558031 (7h25m54.717825641s) [upload=7723]: Waiting for error group managing segments... Aug 9 00:52:13.986608676 (7h25m54.717876296s) [upload=7723]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 00:52:13.986612834 (7h25m54.717880454s) [upload=7723]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 00:52:13.986615108 (7h25m54.717882728s) [upload=7723]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 00:52:13.989421897 (7h25m54.720689516s) [upload=7723]: Done uploading segments... Aug 9 00:52:13.989431464 (7h25m54.720699084s) [upload=7723]: Upload finished. err: metaclient: Too Many Requests Duration:* 141.689062ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [................X.......X..............X......X.............] duration: 423.016766ms FAIL (2025-08-09 01:14:03 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 9 01:03:50.521251227 (7h37m31.252518857s) [upload=7928]: Starting upload Aug 9 01:03:50.521308083 (7h37m31.252575713s) [upload=7928]: Done starting upload Aug 9 01:03:50.521407979 (7h37m31.252675609s) [upload=7928]: Uploading segments... Aug 9 01:03:50.521679086 (7h37m31.252946716s) [upload=7928]: Got next segment. Inline: false Aug 9 01:03:50.521722226 (7h37m31.252989866s) [upload=7928]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:03:50.521727255 (7h37m31.252994885s) [upload=7928]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 01:03:50.547289380 (7h37m31.278557001s) [seg_pos={0 0}, upload=7928]: Begin upload segment... Aug 9 01:03:50.547314256 (7h37m31.278581886s) [seg_pos={0 0}, upload=7928]: Done begin upload segment. Aug 9 01:03:50.547335476 (7h37m31.278603116s) [noise=true , address=104.36.82.12:4173 , piece_id=VBNMKHSMCJKTABCXB2PAGXH65OEUF6LBQXP7XZFNMYOD3H76IPEQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547382454 (7h37m31.278650084s) [noise=true , address=104.36.82.37:4665 , piece_id=F5RO7SFTH54IDNLT7KF2TNOQRVZEFODCYG65ONZJ6THD4LZKKJJA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547771219 (7h37m31.27903884s) [noise=true , address=104.36.82.59:4314 , piece_id=SCL4G7EHDMHOWB7MZRTOLBT2TUZL45AE7A3UIKOQ2HCGI4AJLQCA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547817245 (7h37m31.279084875s) [noise=true , address=104.36.82.14:4245 , piece_id=4B7WJJILP2ZJ2DIDTPSTI55G67X6IBC24POPB4BCVSJOT4ZFKK3Q, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548158312 (7h37m31.279425942s) [noise=true , address=104.36.82.60:4342 , piece_id=GTKAIDOMRHEEWSS2H64BVSLX245AYHVVIXORCJKFMSIAC7VGOZLQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548182277 (7h37m31.279449907s) [noise=true , address=104.36.82.16:4311 , piece_id=WHQMSXMRLD5QRU6GYEPX2U7YTK7OBEHBKHJXWU2YKBZBA4SQJNEA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548510239 (7h37m31.27977787s) [noise=true , address=104.36.82.21:4479 , piece_id=ZKGGJ6T7MZETBH7P72Y4MHWMTK2CAYR5PYQEGNNN7XOYV63BG2HQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548553630 (7h37m31.27982126s) [noise=true , address=104.36.82.44:4897 , piece_id=YMDI7WR2P3M2HTRDLQNCC24ZU2NRRBH6JDJEHOY6WEBK6KKO5PBQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548917339 (7h37m31.280184959s) [noise=true , address=104.36.82.38:4710 , piece_id=AYQ2JWIS4Y6ECJOPZLL3VO7UEL3LAU72EDKKBZBE77G3XHRUKT3A, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548924042 (7h37m31.280191682s) [noise=true , address=104.36.82.17:4332 , piece_id=NRWIFJYUBAMBJ3FBMRXE3YZTREOENZYWB6J4BJLXIIPQKKXNVRUQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548959829 (7h37m31.280227459s) [noise=true , address=104.36.82.53:4144 , piece_id=AZ4C2TJSHYEVYUUEYI7K7QHHBQVAG6NMP2BJALLEE7IY5YFD6FZA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549302238 (7h37m31.280569868s) [noise=true , address=104.36.82.39:4737 , piece_id=AMV62VOAKHJUZCZWNEYGJKY572LWVJZMANNMQEQIS2HHKR3YVRSQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549314360 (7h37m31.28058199s) [noise=true , address=104.36.82.11:4122 , piece_id=HOAEVCU5N4KLGF7O7ZZJC7YC5OB4VZOZIDKDTQTTOR4TU5T3IZXQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549666998 (7h37m31.280934628s) [noise=true , address=104.36.82.4:4812 , piece_id=VKHFSCHUKZFGXRICZGSICWUTOK2BFMG6LAIC67ORAFN7S44SOPPQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.550026399 (7h37m31.281294019s) [noise=true , address=104.36.82.46:4498 , piece_id=C7HSUOEHMVCU5BX3XGAO4LWIGKXPE2IR6U7EOUBSJDSN3CIVRPPQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.550347188 (7h37m31.281614818s) [noise=true , address=104.36.82.62:4440 , piece_id=45DAJ7PILLSEBZICG7W7KKUR7ENYPF57DM2JA5COJV7IWRFB7KTQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.551515258 (7h37m31.282782888s) [noise=true , address=104.36.82.9:4029 , piece_id=LUA5Q3ZUO3SZI24ZPZGXIRLEMBZX3XQFYJQMCY6E4SXMBQTHSAGA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.553639614 (7h37m31.284907244s) [noise=true , address=104.36.82.34:4578 , piece_id=WROE2XH3WOMRAJ4OJBD5LGCCTUMI7ECXHO6HYYRXYNBNBPN7I5ZQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.654119682 (7h37m31.385387312s) [upload=7928]: Next returned nil segment Aug 9 01:03:50.654133758 (7h37m31.385401378s) [upload=7928]: Waiting for error group managing segments... Aug 9 01:03:50.672101667 (7h37m31.403369288s) [noise=true , address=104.36.82.16:4311 , piece_id=WHQMSXMRLD5QRU6GYEPX2U7YTK7OBEHBKHJXWU2YKBZBA4SQJNEA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.672877525 (7h37m31.404145145s) [noise=true , address=104.36.82.38:4710 , piece_id=AYQ2JWIS4Y6ECJOPZLL3VO7UEL3LAU72EDKKBZBE77G3XHRUKT3A, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.675306269 (7h37m31.406573909s) [noise=true , address=104.36.82.59:4314 , piece_id=SCL4G7EHDMHOWB7MZRTOLBT2TUZL45AE7A3UIKOQ2HCGI4AJLQCA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.675371770 (7h37m31.406639391s) [noise=true , address=104.36.82.37:4665 , piece_id=F5RO7SFTH54IDNLT7KF2TNOQRVZEFODCYG65ONZJ6THD4LZKKJJA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.683603266 (7h37m31.414870896s) [noise=true , address=104.36.82.34:4578 , piece_id=WROE2XH3WOMRAJ4OJBD5LGCCTUMI7ECXHO6HYYRXYNBNBPN7I5ZQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.685155513 (7h37m31.416423133s) [noise=true , address=104.36.82.39:4737 , piece_id=AMV62VOAKHJUZCZWNEYGJKY572LWVJZMANNMQEQIS2HHKR3YVRSQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.685621413 (7h37m31.416889033s) [noise=true , address=104.36.82.53:4144 , piece_id=AZ4C2TJSHYEVYUUEYI7K7QHHBQVAG6NMP2BJALLEE7IY5YFD6FZA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.686461230 (7h37m31.41772886s) [noise=true , address=104.36.82.17:4332 , piece_id=NRWIFJYUBAMBJ3FBMRXE3YZTREOENZYWB6J4BJLXIIPQKKXNVRUQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.686992623 (7h37m31.418260253s) [noise=true , address=104.36.82.12:4173 , piece_id=VBNMKHSMCJKTABCXB2PAGXH65OEUF6LBQXP7XZFNMYOD3H76IPEQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.687219727 (7h37m31.418487347s) [noise=true , address=104.36.82.21:4479 , piece_id=ZKGGJ6T7MZETBH7P72Y4MHWMTK2CAYR5PYQEGNNN7XOYV63BG2HQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.692430363 (7h37m31.423697993s) [noise=true , address=104.36.82.14:4245 , piece_id=4B7WJJILP2ZJ2DIDTPSTI55G67X6IBC24POPB4BCVSJOT4ZFKK3Q, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.707237672 (7h37m31.438505302s) [noise=true , address=104.36.82.9:4029 , piece_id=LUA5Q3ZUO3SZI24ZPZGXIRLEMBZX3XQFYJQMCY6E4SXMBQTHSAGA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.716934623 (7h37m31.448202253s) [noise=true , address=104.36.82.4:4812 , piece_id=VKHFSCHUKZFGXRICZGSICWUTOK2BFMG6LAIC67ORAFN7S44SOPPQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.766972144 (7h37m31.498239774s) [noise=true , address=104.36.82.44:4897 , piece_id=YMDI7WR2P3M2HTRDLQNCC24ZU2NRRBH6JDJEHOY6WEBK6KKO5PBQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.766989206 (7h37m31.498256836s) [seg_pos={0 0}, upload=7928]: Segment reached optimal threshold of 14 pieces. Aug 9 01:03:50.767124678 (7h37m31.498392309s) [noise=true , address=104.36.82.62:4440 , piece_id=45DAJ7PILLSEBZICG7W7KKUR7ENYPF57DM2JA5COJV7IWRFB7KTQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jvc3V5SqNUTwbUea883sp3jsPPu1PAzJaUwcjPjxdjm3JiF2L): protocol: write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection; write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection Aug 9 01:03:50.767270229 (7h37m31.49853786s) [noise=true , address=104.36.82.60:4342 , piece_id=GTKAIDOMRHEEWSS2H64BVSLX245AYHVVIXORCJKFMSIAC7VGOZLQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB): protocol: read tcp 5.161.89.252:54032->104.36.82.60:4342: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 9 01:03:50.767296629 (7h37m31.498564249s) [noise=true , address=104.36.82.46:4498 , piece_id=C7HSUOEHMVCU5BX3XGAO4LWIGKXPE2IR6U7EOUBSJDSN3CIVRPPQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jyjxdWkBRBkDHSKknNmPdcnJ3HRcSCUQNnmpb1CaiEdMPEGk4): protocol: expected piece hash; context canceled; EOF Aug 9 01:03:50.767313812 (7h37m31.498581442s) [noise=true , address=104.36.82.11:4122 , piece_id=HOAEVCU5N4KLGF7O7ZZJC7YC5OB4VZOZIDKDTQTTOR4TU5T3IZXQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1oCu75zR8YccTunHjctcLzTrr9wTQqtAPXHiWrsQs41o8gxgh6): protocol: write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection; write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection Aug 9 01:03:50.767324712 (7h37m31.498592332s) [seg_pos={0 0}, upload=7928]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 01:03:50.767376188 (7h37m31.498643818s) [upload=7928]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 01:03:50.767381278 (7h37m31.498648908s) [upload=7928]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 01:03:50.890154929 (7h37m31.621422559s) [upload=7928]: Done uploading segments... Aug 9 01:03:50.890168986 (7h37m31.621436606s) [upload=7928]: Upload finished. err: <nil> Duration: 423.040992ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 181.098702ms FAIL (2025-08-09 01:13:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:52:13.986283699 (7h25m54.71755135s) [upload=7723]: Starting upload Aug 9 00:52:13.986408060 (7h25m54.717675711s) [upload=7723]: Done starting upload Aug 9 00:52:13.986481939 (7h25m54.71774956s) [upload=7723]: Uploading segments... Aug 9 00:52:13.986553753 (7h25m54.717821373s) [upload=7723]: Got next segment. Inline: true Aug 9 00:52:13.986558031 (7h25m54.717825641s) [upload=7723]: Waiting for error group managing segments... Aug 9 00:52:13.986608676 (7h25m54.717876296s) [upload=7723]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 00:52:13.986612834 (7h25m54.717880454s) [upload=7723]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 00:52:13.986615108 (7h25m54.717882728s) [upload=7723]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 00:52:13.989421897 (7h25m54.720689516s) [upload=7723]: Done uploading segments... Aug 9 00:52:13.989431464 (7h25m54.720699084s) [upload=7723]: Upload finished. err: metaclient: Too Many Requests Duration:* 181.116697ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.................X.......X..............X......X............] duration: 491.560285ms FAIL (2025-08-09 01:13:01 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 9 01:03:50.521251227 (7h37m31.252518857s) [upload=7928]: Starting upload Aug 9 01:03:50.521308083 (7h37m31.252575713s) [upload=7928]: Done starting upload Aug 9 01:03:50.521407979 (7h37m31.252675609s) [upload=7928]: Uploading segments... Aug 9 01:03:50.521679086 (7h37m31.252946716s) [upload=7928]: Got next segment. Inline: false Aug 9 01:03:50.521722226 (7h37m31.252989866s) [upload=7928]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:03:50.521727255 (7h37m31.252994885s) [upload=7928]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 01:03:50.547289380 (7h37m31.278557001s) [seg_pos={0 0}, upload=7928]: Begin upload segment... Aug 9 01:03:50.547314256 (7h37m31.278581886s) [seg_pos={0 0}, upload=7928]: Done begin upload segment. Aug 9 01:03:50.547335476 (7h37m31.278603116s) [noise=true , address=104.36.82.12:4173 , piece_id=VBNMKHSMCJKTABCXB2PAGXH65OEUF6LBQXP7XZFNMYOD3H76IPEQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547382454 (7h37m31.278650084s) [noise=true , address=104.36.82.37:4665 , piece_id=F5RO7SFTH54IDNLT7KF2TNOQRVZEFODCYG65ONZJ6THD4LZKKJJA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547771219 (7h37m31.27903884s) [noise=true , address=104.36.82.59:4314 , piece_id=SCL4G7EHDMHOWB7MZRTOLBT2TUZL45AE7A3UIKOQ2HCGI4AJLQCA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547817245 (7h37m31.279084875s) [noise=true , address=104.36.82.14:4245 , piece_id=4B7WJJILP2ZJ2DIDTPSTI55G67X6IBC24POPB4BCVSJOT4ZFKK3Q, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548158312 (7h37m31.279425942s) [noise=true , address=104.36.82.60:4342 , piece_id=GTKAIDOMRHEEWSS2H64BVSLX245AYHVVIXORCJKFMSIAC7VGOZLQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548182277 (7h37m31.279449907s) [noise=true , address=104.36.82.16:4311 , piece_id=WHQMSXMRLD5QRU6GYEPX2U7YTK7OBEHBKHJXWU2YKBZBA4SQJNEA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548510239 (7h37m31.27977787s) [noise=true , address=104.36.82.21:4479 , piece_id=ZKGGJ6T7MZETBH7P72Y4MHWMTK2CAYR5PYQEGNNN7XOYV63BG2HQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548553630 (7h37m31.27982126s) [noise=true , address=104.36.82.44:4897 , piece_id=YMDI7WR2P3M2HTRDLQNCC24ZU2NRRBH6JDJEHOY6WEBK6KKO5PBQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548917339 (7h37m31.280184959s) [noise=true , address=104.36.82.38:4710 , piece_id=AYQ2JWIS4Y6ECJOPZLL3VO7UEL3LAU72EDKKBZBE77G3XHRUKT3A, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548924042 (7h37m31.280191682s) [noise=true , address=104.36.82.17:4332 , piece_id=NRWIFJYUBAMBJ3FBMRXE3YZTREOENZYWB6J4BJLXIIPQKKXNVRUQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548959829 (7h37m31.280227459s) [noise=true , address=104.36.82.53:4144 , piece_id=AZ4C2TJSHYEVYUUEYI7K7QHHBQVAG6NMP2BJALLEE7IY5YFD6FZA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549302238 (7h37m31.280569868s) [noise=true , address=104.36.82.39:4737 , piece_id=AMV62VOAKHJUZCZWNEYGJKY572LWVJZMANNMQEQIS2HHKR3YVRSQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549314360 (7h37m31.28058199s) [noise=true , address=104.36.82.11:4122 , piece_id=HOAEVCU5N4KLGF7O7ZZJC7YC5OB4VZOZIDKDTQTTOR4TU5T3IZXQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549666998 (7h37m31.280934628s) [noise=true , address=104.36.82.4:4812 , piece_id=VKHFSCHUKZFGXRICZGSICWUTOK2BFMG6LAIC67ORAFN7S44SOPPQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.550026399 (7h37m31.281294019s) [noise=true , address=104.36.82.46:4498 , piece_id=C7HSUOEHMVCU5BX3XGAO4LWIGKXPE2IR6U7EOUBSJDSN3CIVRPPQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.550347188 (7h37m31.281614818s) [noise=true , address=104.36.82.62:4440 , piece_id=45DAJ7PILLSEBZICG7W7KKUR7ENYPF57DM2JA5COJV7IWRFB7KTQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.551515258 (7h37m31.282782888s) [noise=true , address=104.36.82.9:4029 , piece_id=LUA5Q3ZUO3SZI24ZPZGXIRLEMBZX3XQFYJQMCY6E4SXMBQTHSAGA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.553639614 (7h37m31.284907244s) [noise=true , address=104.36.82.34:4578 , piece_id=WROE2XH3WOMRAJ4OJBD5LGCCTUMI7ECXHO6HYYRXYNBNBPN7I5ZQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.654119682 (7h37m31.385387312s) [upload=7928]: Next returned nil segment Aug 9 01:03:50.654133758 (7h37m31.385401378s) [upload=7928]: Waiting for error group managing segments... Aug 9 01:03:50.672101667 (7h37m31.403369288s) [noise=true , address=104.36.82.16:4311 , piece_id=WHQMSXMRLD5QRU6GYEPX2U7YTK7OBEHBKHJXWU2YKBZBA4SQJNEA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.672877525 (7h37m31.404145145s) [noise=true , address=104.36.82.38:4710 , piece_id=AYQ2JWIS4Y6ECJOPZLL3VO7UEL3LAU72EDKKBZBE77G3XHRUKT3A, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.675306269 (7h37m31.406573909s) [noise=true , address=104.36.82.59:4314 , piece_id=SCL4G7EHDMHOWB7MZRTOLBT2TUZL45AE7A3UIKOQ2HCGI4AJLQCA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.675371770 (7h37m31.406639391s) [noise=true , address=104.36.82.37:4665 , piece_id=F5RO7SFTH54IDNLT7KF2TNOQRVZEFODCYG65ONZJ6THD4LZKKJJA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.683603266 (7h37m31.414870896s) [noise=true , address=104.36.82.34:4578 , piece_id=WROE2XH3WOMRAJ4OJBD5LGCCTUMI7ECXHO6HYYRXYNBNBPN7I5ZQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.685155513 (7h37m31.416423133s) [noise=true , address=104.36.82.39:4737 , piece_id=AMV62VOAKHJUZCZWNEYGJKY572LWVJZMANNMQEQIS2HHKR3YVRSQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.685621413 (7h37m31.416889033s) [noise=true , address=104.36.82.53:4144 , piece_id=AZ4C2TJSHYEVYUUEYI7K7QHHBQVAG6NMP2BJALLEE7IY5YFD6FZA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.686461230 (7h37m31.41772886s) [noise=true , address=104.36.82.17:4332 , piece_id=NRWIFJYUBAMBJ3FBMRXE3YZTREOENZYWB6J4BJLXIIPQKKXNVRUQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.686992623 (7h37m31.418260253s) [noise=true , address=104.36.82.12:4173 , piece_id=VBNMKHSMCJKTABCXB2PAGXH65OEUF6LBQXP7XZFNMYOD3H76IPEQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.687219727 (7h37m31.418487347s) [noise=true , address=104.36.82.21:4479 , piece_id=ZKGGJ6T7MZETBH7P72Y4MHWMTK2CAYR5PYQEGNNN7XOYV63BG2HQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.692430363 (7h37m31.423697993s) [noise=true , address=104.36.82.14:4245 , piece_id=4B7WJJILP2ZJ2DIDTPSTI55G67X6IBC24POPB4BCVSJOT4ZFKK3Q, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.707237672 (7h37m31.438505302s) [noise=true , address=104.36.82.9:4029 , piece_id=LUA5Q3ZUO3SZI24ZPZGXIRLEMBZX3XQFYJQMCY6E4SXMBQTHSAGA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.716934623 (7h37m31.448202253s) [noise=true , address=104.36.82.4:4812 , piece_id=VKHFSCHUKZFGXRICZGSICWUTOK2BFMG6LAIC67ORAFN7S44SOPPQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.766972144 (7h37m31.498239774s) [noise=true , address=104.36.82.44:4897 , piece_id=YMDI7WR2P3M2HTRDLQNCC24ZU2NRRBH6JDJEHOY6WEBK6KKO5PBQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.766989206 (7h37m31.498256836s) [seg_pos={0 0}, upload=7928]: Segment reached optimal threshold of 14 pieces. Aug 9 01:03:50.767124678 (7h37m31.498392309s) [noise=true , address=104.36.82.62:4440 , piece_id=45DAJ7PILLSEBZICG7W7KKUR7ENYPF57DM2JA5COJV7IWRFB7KTQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jvc3V5SqNUTwbUea883sp3jsPPu1PAzJaUwcjPjxdjm3JiF2L): protocol: write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection; write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection Aug 9 01:03:50.767270229 (7h37m31.49853786s) [noise=true , address=104.36.82.60:4342 , piece_id=GTKAIDOMRHEEWSS2H64BVSLX245AYHVVIXORCJKFMSIAC7VGOZLQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB): protocol: read tcp 5.161.89.252:54032->104.36.82.60:4342: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 9 01:03:50.767296629 (7h37m31.498564249s) [noise=true , address=104.36.82.46:4498 , piece_id=C7HSUOEHMVCU5BX3XGAO4LWIGKXPE2IR6U7EOUBSJDSN3CIVRPPQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jyjxdWkBRBkDHSKknNmPdcnJ3HRcSCUQNnmpb1CaiEdMPEGk4): protocol: expected piece hash; context canceled; EOF Aug 9 01:03:50.767313812 (7h37m31.498581442s) [noise=true , address=104.36.82.11:4122 , piece_id=HOAEVCU5N4KLGF7O7ZZJC7YC5OB4VZOZIDKDTQTTOR4TU5T3IZXQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1oCu75zR8YccTunHjctcLzTrr9wTQqtAPXHiWrsQs41o8gxgh6): protocol: write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection; write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection Aug 9 01:03:50.767324712 (7h37m31.498592332s) [seg_pos={0 0}, upload=7928]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 01:03:50.767376188 (7h37m31.498643818s) [upload=7928]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 01:03:50.767381278 (7h37m31.498648908s) [upload=7928]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 01:03:50.890154929 (7h37m31.621422559s) [upload=7928]: Done uploading segments... Aug 9 01:03:50.890168986 (7h37m31.621436606s) [upload=7928]: Upload finished. err: <nil> Duration: 491.581616ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..................X.......X..............X......X...........] duration: 562.35947ms FAIL (2025-08-09 01:12:04 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 9 01:03:50.521251227 (7h37m31.252518857s) [upload=7928]: Starting upload Aug 9 01:03:50.521308083 (7h37m31.252575713s) [upload=7928]: Done starting upload Aug 9 01:03:50.521407979 (7h37m31.252675609s) [upload=7928]: Uploading segments... Aug 9 01:03:50.521679086 (7h37m31.252946716s) [upload=7928]: Got next segment. Inline: false Aug 9 01:03:50.521722226 (7h37m31.252989866s) [upload=7928]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:03:50.521727255 (7h37m31.252994885s) [upload=7928]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 01:03:50.547289380 (7h37m31.278557001s) [seg_pos={0 0}, upload=7928]: Begin upload segment... Aug 9 01:03:50.547314256 (7h37m31.278581886s) [seg_pos={0 0}, upload=7928]: Done begin upload segment. Aug 9 01:03:50.547335476 (7h37m31.278603116s) [noise=true , address=104.36.82.12:4173 , piece_id=VBNMKHSMCJKTABCXB2PAGXH65OEUF6LBQXP7XZFNMYOD3H76IPEQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547382454 (7h37m31.278650084s) [noise=true , address=104.36.82.37:4665 , piece_id=F5RO7SFTH54IDNLT7KF2TNOQRVZEFODCYG65ONZJ6THD4LZKKJJA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547771219 (7h37m31.27903884s) [noise=true , address=104.36.82.59:4314 , piece_id=SCL4G7EHDMHOWB7MZRTOLBT2TUZL45AE7A3UIKOQ2HCGI4AJLQCA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547817245 (7h37m31.279084875s) [noise=true , address=104.36.82.14:4245 , piece_id=4B7WJJILP2ZJ2DIDTPSTI55G67X6IBC24POPB4BCVSJOT4ZFKK3Q, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548158312 (7h37m31.279425942s) [noise=true , address=104.36.82.60:4342 , piece_id=GTKAIDOMRHEEWSS2H64BVSLX245AYHVVIXORCJKFMSIAC7VGOZLQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548182277 (7h37m31.279449907s) [noise=true , address=104.36.82.16:4311 , piece_id=WHQMSXMRLD5QRU6GYEPX2U7YTK7OBEHBKHJXWU2YKBZBA4SQJNEA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548510239 (7h37m31.27977787s) [noise=true , address=104.36.82.21:4479 , piece_id=ZKGGJ6T7MZETBH7P72Y4MHWMTK2CAYR5PYQEGNNN7XOYV63BG2HQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548553630 (7h37m31.27982126s) [noise=true , address=104.36.82.44:4897 , piece_id=YMDI7WR2P3M2HTRDLQNCC24ZU2NRRBH6JDJEHOY6WEBK6KKO5PBQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548917339 (7h37m31.280184959s) [noise=true , address=104.36.82.38:4710 , piece_id=AYQ2JWIS4Y6ECJOPZLL3VO7UEL3LAU72EDKKBZBE77G3XHRUKT3A, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548924042 (7h37m31.280191682s) [noise=true , address=104.36.82.17:4332 , piece_id=NRWIFJYUBAMBJ3FBMRXE3YZTREOENZYWB6J4BJLXIIPQKKXNVRUQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548959829 (7h37m31.280227459s) [noise=true , address=104.36.82.53:4144 , piece_id=AZ4C2TJSHYEVYUUEYI7K7QHHBQVAG6NMP2BJALLEE7IY5YFD6FZA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549302238 (7h37m31.280569868s) [noise=true , address=104.36.82.39:4737 , piece_id=AMV62VOAKHJUZCZWNEYGJKY572LWVJZMANNMQEQIS2HHKR3YVRSQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549314360 (7h37m31.28058199s) [noise=true , address=104.36.82.11:4122 , piece_id=HOAEVCU5N4KLGF7O7ZZJC7YC5OB4VZOZIDKDTQTTOR4TU5T3IZXQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549666998 (7h37m31.280934628s) [noise=true , address=104.36.82.4:4812 , piece_id=VKHFSCHUKZFGXRICZGSICWUTOK2BFMG6LAIC67ORAFN7S44SOPPQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.550026399 (7h37m31.281294019s) [noise=true , address=104.36.82.46:4498 , piece_id=C7HSUOEHMVCU5BX3XGAO4LWIGKXPE2IR6U7EOUBSJDSN3CIVRPPQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.550347188 (7h37m31.281614818s) [noise=true , address=104.36.82.62:4440 , piece_id=45DAJ7PILLSEBZICG7W7KKUR7ENYPF57DM2JA5COJV7IWRFB7KTQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.551515258 (7h37m31.282782888s) [noise=true , address=104.36.82.9:4029 , piece_id=LUA5Q3ZUO3SZI24ZPZGXIRLEMBZX3XQFYJQMCY6E4SXMBQTHSAGA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.553639614 (7h37m31.284907244s) [noise=true , address=104.36.82.34:4578 , piece_id=WROE2XH3WOMRAJ4OJBD5LGCCTUMI7ECXHO6HYYRXYNBNBPN7I5ZQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.654119682 (7h37m31.385387312s) [upload=7928]: Next returned nil segment Aug 9 01:03:50.654133758 (7h37m31.385401378s) [upload=7928]: Waiting for error group managing segments... Aug 9 01:03:50.672101667 (7h37m31.403369288s) [noise=true , address=104.36.82.16:4311 , piece_id=WHQMSXMRLD5QRU6GYEPX2U7YTK7OBEHBKHJXWU2YKBZBA4SQJNEA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.672877525 (7h37m31.404145145s) [noise=true , address=104.36.82.38:4710 , piece_id=AYQ2JWIS4Y6ECJOPZLL3VO7UEL3LAU72EDKKBZBE77G3XHRUKT3A, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.675306269 (7h37m31.406573909s) [noise=true , address=104.36.82.59:4314 , piece_id=SCL4G7EHDMHOWB7MZRTOLBT2TUZL45AE7A3UIKOQ2HCGI4AJLQCA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.675371770 (7h37m31.406639391s) [noise=true , address=104.36.82.37:4665 , piece_id=F5RO7SFTH54IDNLT7KF2TNOQRVZEFODCYG65ONZJ6THD4LZKKJJA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.683603266 (7h37m31.414870896s) [noise=true , address=104.36.82.34:4578 , piece_id=WROE2XH3WOMRAJ4OJBD5LGCCTUMI7ECXHO6HYYRXYNBNBPN7I5ZQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.685155513 (7h37m31.416423133s) [noise=true , address=104.36.82.39:4737 , piece_id=AMV62VOAKHJUZCZWNEYGJKY572LWVJZMANNMQEQIS2HHKR3YVRSQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.685621413 (7h37m31.416889033s) [noise=true , address=104.36.82.53:4144 , piece_id=AZ4C2TJSHYEVYUUEYI7K7QHHBQVAG6NMP2BJALLEE7IY5YFD6FZA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.686461230 (7h37m31.41772886s) [noise=true , address=104.36.82.17:4332 , piece_id=NRWIFJYUBAMBJ3FBMRXE3YZTREOENZYWB6J4BJLXIIPQKKXNVRUQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.686992623 (7h37m31.418260253s) [noise=true , address=104.36.82.12:4173 , piece_id=VBNMKHSMCJKTABCXB2PAGXH65OEUF6LBQXP7XZFNMYOD3H76IPEQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.687219727 (7h37m31.418487347s) [noise=true , address=104.36.82.21:4479 , piece_id=ZKGGJ6T7MZETBH7P72Y4MHWMTK2CAYR5PYQEGNNN7XOYV63BG2HQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.692430363 (7h37m31.423697993s) [noise=true , address=104.36.82.14:4245 , piece_id=4B7WJJILP2ZJ2DIDTPSTI55G67X6IBC24POPB4BCVSJOT4ZFKK3Q, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.707237672 (7h37m31.438505302s) [noise=true , address=104.36.82.9:4029 , piece_id=LUA5Q3ZUO3SZI24ZPZGXIRLEMBZX3XQFYJQMCY6E4SXMBQTHSAGA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.716934623 (7h37m31.448202253s) [noise=true , address=104.36.82.4:4812 , piece_id=VKHFSCHUKZFGXRICZGSICWUTOK2BFMG6LAIC67ORAFN7S44SOPPQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.766972144 (7h37m31.498239774s) [noise=true , address=104.36.82.44:4897 , piece_id=YMDI7WR2P3M2HTRDLQNCC24ZU2NRRBH6JDJEHOY6WEBK6KKO5PBQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.766989206 (7h37m31.498256836s) [seg_pos={0 0}, upload=7928]: Segment reached optimal threshold of 14 pieces. Aug 9 01:03:50.767124678 (7h37m31.498392309s) [noise=true , address=104.36.82.62:4440 , piece_id=45DAJ7PILLSEBZICG7W7KKUR7ENYPF57DM2JA5COJV7IWRFB7KTQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jvc3V5SqNUTwbUea883sp3jsPPu1PAzJaUwcjPjxdjm3JiF2L): protocol: write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection; write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection Aug 9 01:03:50.767270229 (7h37m31.49853786s) [noise=true , address=104.36.82.60:4342 , piece_id=GTKAIDOMRHEEWSS2H64BVSLX245AYHVVIXORCJKFMSIAC7VGOZLQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB): protocol: read tcp 5.161.89.252:54032->104.36.82.60:4342: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 9 01:03:50.767296629 (7h37m31.498564249s) [noise=true , address=104.36.82.46:4498 , piece_id=C7HSUOEHMVCU5BX3XGAO4LWIGKXPE2IR6U7EOUBSJDSN3CIVRPPQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jyjxdWkBRBkDHSKknNmPdcnJ3HRcSCUQNnmpb1CaiEdMPEGk4): protocol: expected piece hash; context canceled; EOF Aug 9 01:03:50.767313812 (7h37m31.498581442s) [noise=true , address=104.36.82.11:4122 , piece_id=HOAEVCU5N4KLGF7O7ZZJC7YC5OB4VZOZIDKDTQTTOR4TU5T3IZXQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1oCu75zR8YccTunHjctcLzTrr9wTQqtAPXHiWrsQs41o8gxgh6): protocol: write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection; write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection Aug 9 01:03:50.767324712 (7h37m31.498592332s) [seg_pos={0 0}, upload=7928]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 01:03:50.767376188 (7h37m31.498643818s) [upload=7928]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 01:03:50.767381278 (7h37m31.498648908s) [upload=7928]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 01:03:50.890154929 (7h37m31.621422559s) [upload=7928]: Done uploading segments... Aug 9 01:03:50.890168986 (7h37m31.621436606s) [upload=7928]: Upload finished. err: <nil> Duration: 562.38591ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 163.54245ms FAIL (2025-08-09 01:11:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:52:13.986283699 (7h25m54.71755135s) [upload=7723]: Starting upload Aug 9 00:52:13.986408060 (7h25m54.717675711s) [upload=7723]: Done starting upload Aug 9 00:52:13.986481939 (7h25m54.71774956s) [upload=7723]: Uploading segments... Aug 9 00:52:13.986553753 (7h25m54.717821373s) [upload=7723]: Got next segment. Inline: true Aug 9 00:52:13.986558031 (7h25m54.717825641s) [upload=7723]: Waiting for error group managing segments... Aug 9 00:52:13.986608676 (7h25m54.717876296s) [upload=7723]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 00:52:13.986612834 (7h25m54.717880454s) [upload=7723]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 00:52:13.986615108 (7h25m54.717882728s) [upload=7723]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 00:52:13.989421897 (7h25m54.720689516s) [upload=7723]: Done uploading segments... Aug 9 00:52:13.989431464 (7h25m54.720699084s) [upload=7723]: Upload finished. err: metaclient: Too Many Requests Duration:* 163.560714ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...................X.......X..............X......X..........] duration: 474.594415ms FAIL (2025-08-09 01:11:09 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 9 01:03:50.521251227 (7h37m31.252518857s) [upload=7928]: Starting upload Aug 9 01:03:50.521308083 (7h37m31.252575713s) [upload=7928]: Done starting upload Aug 9 01:03:50.521407979 (7h37m31.252675609s) [upload=7928]: Uploading segments... Aug 9 01:03:50.521679086 (7h37m31.252946716s) [upload=7928]: Got next segment. Inline: false Aug 9 01:03:50.521722226 (7h37m31.252989866s) [upload=7928]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:03:50.521727255 (7h37m31.252994885s) [upload=7928]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 01:03:50.547289380 (7h37m31.278557001s) [seg_pos={0 0}, upload=7928]: Begin upload segment... Aug 9 01:03:50.547314256 (7h37m31.278581886s) [seg_pos={0 0}, upload=7928]: Done begin upload segment. Aug 9 01:03:50.547335476 (7h37m31.278603116s) [noise=true , address=104.36.82.12:4173 , piece_id=VBNMKHSMCJKTABCXB2PAGXH65OEUF6LBQXP7XZFNMYOD3H76IPEQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547382454 (7h37m31.278650084s) [noise=true , address=104.36.82.37:4665 , piece_id=F5RO7SFTH54IDNLT7KF2TNOQRVZEFODCYG65ONZJ6THD4LZKKJJA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547771219 (7h37m31.27903884s) [noise=true , address=104.36.82.59:4314 , piece_id=SCL4G7EHDMHOWB7MZRTOLBT2TUZL45AE7A3UIKOQ2HCGI4AJLQCA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547817245 (7h37m31.279084875s) [noise=true , address=104.36.82.14:4245 , piece_id=4B7WJJILP2ZJ2DIDTPSTI55G67X6IBC24POPB4BCVSJOT4ZFKK3Q, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548158312 (7h37m31.279425942s) [noise=true , address=104.36.82.60:4342 , piece_id=GTKAIDOMRHEEWSS2H64BVSLX245AYHVVIXORCJKFMSIAC7VGOZLQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548182277 (7h37m31.279449907s) [noise=true , address=104.36.82.16:4311 , piece_id=WHQMSXMRLD5QRU6GYEPX2U7YTK7OBEHBKHJXWU2YKBZBA4SQJNEA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548510239 (7h37m31.27977787s) [noise=true , address=104.36.82.21:4479 , piece_id=ZKGGJ6T7MZETBH7P72Y4MHWMTK2CAYR5PYQEGNNN7XOYV63BG2HQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548553630 (7h37m31.27982126s) [noise=true , address=104.36.82.44:4897 , piece_id=YMDI7WR2P3M2HTRDLQNCC24ZU2NRRBH6JDJEHOY6WEBK6KKO5PBQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548917339 (7h37m31.280184959s) [noise=true , address=104.36.82.38:4710 , piece_id=AYQ2JWIS4Y6ECJOPZLL3VO7UEL3LAU72EDKKBZBE77G3XHRUKT3A, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548924042 (7h37m31.280191682s) [noise=true , address=104.36.82.17:4332 , piece_id=NRWIFJYUBAMBJ3FBMRXE3YZTREOENZYWB6J4BJLXIIPQKKXNVRUQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548959829 (7h37m31.280227459s) [noise=true , address=104.36.82.53:4144 , piece_id=AZ4C2TJSHYEVYUUEYI7K7QHHBQVAG6NMP2BJALLEE7IY5YFD6FZA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549302238 (7h37m31.280569868s) [noise=true , address=104.36.82.39:4737 , piece_id=AMV62VOAKHJUZCZWNEYGJKY572LWVJZMANNMQEQIS2HHKR3YVRSQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549314360 (7h37m31.28058199s) [noise=true , address=104.36.82.11:4122 , piece_id=HOAEVCU5N4KLGF7O7ZZJC7YC5OB4VZOZIDKDTQTTOR4TU5T3IZXQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549666998 (7h37m31.280934628s) [noise=true , address=104.36.82.4:4812 , piece_id=VKHFSCHUKZFGXRICZGSICWUTOK2BFMG6LAIC67ORAFN7S44SOPPQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.550026399 (7h37m31.281294019s) [noise=true , address=104.36.82.46:4498 , piece_id=C7HSUOEHMVCU5BX3XGAO4LWIGKXPE2IR6U7EOUBSJDSN3CIVRPPQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.550347188 (7h37m31.281614818s) [noise=true , address=104.36.82.62:4440 , piece_id=45DAJ7PILLSEBZICG7W7KKUR7ENYPF57DM2JA5COJV7IWRFB7KTQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.551515258 (7h37m31.282782888s) [noise=true , address=104.36.82.9:4029 , piece_id=LUA5Q3ZUO3SZI24ZPZGXIRLEMBZX3XQFYJQMCY6E4SXMBQTHSAGA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.553639614 (7h37m31.284907244s) [noise=true , address=104.36.82.34:4578 , piece_id=WROE2XH3WOMRAJ4OJBD5LGCCTUMI7ECXHO6HYYRXYNBNBPN7I5ZQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.654119682 (7h37m31.385387312s) [upload=7928]: Next returned nil segment Aug 9 01:03:50.654133758 (7h37m31.385401378s) [upload=7928]: Waiting for error group managing segments... Aug 9 01:03:50.672101667 (7h37m31.403369288s) [noise=true , address=104.36.82.16:4311 , piece_id=WHQMSXMRLD5QRU6GYEPX2U7YTK7OBEHBKHJXWU2YKBZBA4SQJNEA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.672877525 (7h37m31.404145145s) [noise=true , address=104.36.82.38:4710 , piece_id=AYQ2JWIS4Y6ECJOPZLL3VO7UEL3LAU72EDKKBZBE77G3XHRUKT3A, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.675306269 (7h37m31.406573909s) [noise=true , address=104.36.82.59:4314 , piece_id=SCL4G7EHDMHOWB7MZRTOLBT2TUZL45AE7A3UIKOQ2HCGI4AJLQCA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.675371770 (7h37m31.406639391s) [noise=true , address=104.36.82.37:4665 , piece_id=F5RO7SFTH54IDNLT7KF2TNOQRVZEFODCYG65ONZJ6THD4LZKKJJA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.683603266 (7h37m31.414870896s) [noise=true , address=104.36.82.34:4578 , piece_id=WROE2XH3WOMRAJ4OJBD5LGCCTUMI7ECXHO6HYYRXYNBNBPN7I5ZQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.685155513 (7h37m31.416423133s) [noise=true , address=104.36.82.39:4737 , piece_id=AMV62VOAKHJUZCZWNEYGJKY572LWVJZMANNMQEQIS2HHKR3YVRSQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.685621413 (7h37m31.416889033s) [noise=true , address=104.36.82.53:4144 , piece_id=AZ4C2TJSHYEVYUUEYI7K7QHHBQVAG6NMP2BJALLEE7IY5YFD6FZA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.686461230 (7h37m31.41772886s) [noise=true , address=104.36.82.17:4332 , piece_id=NRWIFJYUBAMBJ3FBMRXE3YZTREOENZYWB6J4BJLXIIPQKKXNVRUQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.686992623 (7h37m31.418260253s) [noise=true , address=104.36.82.12:4173 , piece_id=VBNMKHSMCJKTABCXB2PAGXH65OEUF6LBQXP7XZFNMYOD3H76IPEQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.687219727 (7h37m31.418487347s) [noise=true , address=104.36.82.21:4479 , piece_id=ZKGGJ6T7MZETBH7P72Y4MHWMTK2CAYR5PYQEGNNN7XOYV63BG2HQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.692430363 (7h37m31.423697993s) [noise=true , address=104.36.82.14:4245 , piece_id=4B7WJJILP2ZJ2DIDTPSTI55G67X6IBC24POPB4BCVSJOT4ZFKK3Q, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.707237672 (7h37m31.438505302s) [noise=true , address=104.36.82.9:4029 , piece_id=LUA5Q3ZUO3SZI24ZPZGXIRLEMBZX3XQFYJQMCY6E4SXMBQTHSAGA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.716934623 (7h37m31.448202253s) [noise=true , address=104.36.82.4:4812 , piece_id=VKHFSCHUKZFGXRICZGSICWUTOK2BFMG6LAIC67ORAFN7S44SOPPQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.766972144 (7h37m31.498239774s) [noise=true , address=104.36.82.44:4897 , piece_id=YMDI7WR2P3M2HTRDLQNCC24ZU2NRRBH6JDJEHOY6WEBK6KKO5PBQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.766989206 (7h37m31.498256836s) [seg_pos={0 0}, upload=7928]: Segment reached optimal threshold of 14 pieces. Aug 9 01:03:50.767124678 (7h37m31.498392309s) [noise=true , address=104.36.82.62:4440 , piece_id=45DAJ7PILLSEBZICG7W7KKUR7ENYPF57DM2JA5COJV7IWRFB7KTQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jvc3V5SqNUTwbUea883sp3jsPPu1PAzJaUwcjPjxdjm3JiF2L): protocol: write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection; write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection Aug 9 01:03:50.767270229 (7h37m31.49853786s) [noise=true , address=104.36.82.60:4342 , piece_id=GTKAIDOMRHEEWSS2H64BVSLX245AYHVVIXORCJKFMSIAC7VGOZLQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB): protocol: read tcp 5.161.89.252:54032->104.36.82.60:4342: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 9 01:03:50.767296629 (7h37m31.498564249s) [noise=true , address=104.36.82.46:4498 , piece_id=C7HSUOEHMVCU5BX3XGAO4LWIGKXPE2IR6U7EOUBSJDSN3CIVRPPQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jyjxdWkBRBkDHSKknNmPdcnJ3HRcSCUQNnmpb1CaiEdMPEGk4): protocol: expected piece hash; context canceled; EOF Aug 9 01:03:50.767313812 (7h37m31.498581442s) [noise=true , address=104.36.82.11:4122 , piece_id=HOAEVCU5N4KLGF7O7ZZJC7YC5OB4VZOZIDKDTQTTOR4TU5T3IZXQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1oCu75zR8YccTunHjctcLzTrr9wTQqtAPXHiWrsQs41o8gxgh6): protocol: write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection; write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection Aug 9 01:03:50.767324712 (7h37m31.498592332s) [seg_pos={0 0}, upload=7928]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 01:03:50.767376188 (7h37m31.498643818s) [upload=7928]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 01:03:50.767381278 (7h37m31.498648908s) [upload=7928]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 01:03:50.890154929 (7h37m31.621422559s) [upload=7928]: Done uploading segments... Aug 9 01:03:50.890168986 (7h37m31.621436606s) [upload=7928]: Upload finished. err: <nil> Duration: 474.664957ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 187.888535ms FAIL (2025-08-09 01:11:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:52:13.986283699 (7h25m54.71755135s) [upload=7723]: Starting upload Aug 9 00:52:13.986408060 (7h25m54.717675711s) [upload=7723]: Done starting upload Aug 9 00:52:13.986481939 (7h25m54.71774956s) [upload=7723]: Uploading segments... Aug 9 00:52:13.986553753 (7h25m54.717821373s) [upload=7723]: Got next segment. Inline: true Aug 9 00:52:13.986558031 (7h25m54.717825641s) [upload=7723]: Waiting for error group managing segments... Aug 9 00:52:13.986608676 (7h25m54.717876296s) [upload=7723]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 00:52:13.986612834 (7h25m54.717880454s) [upload=7723]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 00:52:13.986615108 (7h25m54.717882728s) [upload=7723]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 00:52:13.989421897 (7h25m54.720689516s) [upload=7723]: Done uploading segments... Aug 9 00:52:13.989431464 (7h25m54.720699084s) [upload=7723]: Upload finished. err: metaclient: Too Many Requests Duration:* 187.908543ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [....................X.......X..............X......X.........] duration: 564.667518ms FAIL (2025-08-09 01:10:32 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 9 01:03:50.521251227 (7h37m31.252518857s) [upload=7928]: Starting upload Aug 9 01:03:50.521308083 (7h37m31.252575713s) [upload=7928]: Done starting upload Aug 9 01:03:50.521407979 (7h37m31.252675609s) [upload=7928]: Uploading segments... Aug 9 01:03:50.521679086 (7h37m31.252946716s) [upload=7928]: Got next segment. Inline: false Aug 9 01:03:50.521722226 (7h37m31.252989866s) [upload=7928]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:03:50.521727255 (7h37m31.252994885s) [upload=7928]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 01:03:50.547289380 (7h37m31.278557001s) [seg_pos={0 0}, upload=7928]: Begin upload segment... Aug 9 01:03:50.547314256 (7h37m31.278581886s) [seg_pos={0 0}, upload=7928]: Done begin upload segment. Aug 9 01:03:50.547335476 (7h37m31.278603116s) [noise=true , address=104.36.82.12:4173 , piece_id=VBNMKHSMCJKTABCXB2PAGXH65OEUF6LBQXP7XZFNMYOD3H76IPEQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547382454 (7h37m31.278650084s) [noise=true , address=104.36.82.37:4665 , piece_id=F5RO7SFTH54IDNLT7KF2TNOQRVZEFODCYG65ONZJ6THD4LZKKJJA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547771219 (7h37m31.27903884s) [noise=true , address=104.36.82.59:4314 , piece_id=SCL4G7EHDMHOWB7MZRTOLBT2TUZL45AE7A3UIKOQ2HCGI4AJLQCA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547817245 (7h37m31.279084875s) [noise=true , address=104.36.82.14:4245 , piece_id=4B7WJJILP2ZJ2DIDTPSTI55G67X6IBC24POPB4BCVSJOT4ZFKK3Q, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548158312 (7h37m31.279425942s) [noise=true , address=104.36.82.60:4342 , piece_id=GTKAIDOMRHEEWSS2H64BVSLX245AYHVVIXORCJKFMSIAC7VGOZLQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548182277 (7h37m31.279449907s) [noise=true , address=104.36.82.16:4311 , piece_id=WHQMSXMRLD5QRU6GYEPX2U7YTK7OBEHBKHJXWU2YKBZBA4SQJNEA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548510239 (7h37m31.27977787s) [noise=true , address=104.36.82.21:4479 , piece_id=ZKGGJ6T7MZETBH7P72Y4MHWMTK2CAYR5PYQEGNNN7XOYV63BG2HQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548553630 (7h37m31.27982126s) [noise=true , address=104.36.82.44:4897 , piece_id=YMDI7WR2P3M2HTRDLQNCC24ZU2NRRBH6JDJEHOY6WEBK6KKO5PBQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548917339 (7h37m31.280184959s) [noise=true , address=104.36.82.38:4710 , piece_id=AYQ2JWIS4Y6ECJOPZLL3VO7UEL3LAU72EDKKBZBE77G3XHRUKT3A, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548924042 (7h37m31.280191682s) [noise=true , address=104.36.82.17:4332 , piece_id=NRWIFJYUBAMBJ3FBMRXE3YZTREOENZYWB6J4BJLXIIPQKKXNVRUQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548959829 (7h37m31.280227459s) [noise=true , address=104.36.82.53:4144 , piece_id=AZ4C2TJSHYEVYUUEYI7K7QHHBQVAG6NMP2BJALLEE7IY5YFD6FZA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549302238 (7h37m31.280569868s) [noise=true , address=104.36.82.39:4737 , piece_id=AMV62VOAKHJUZCZWNEYGJKY572LWVJZMANNMQEQIS2HHKR3YVRSQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549314360 (7h37m31.28058199s) [noise=true , address=104.36.82.11:4122 , piece_id=HOAEVCU5N4KLGF7O7ZZJC7YC5OB4VZOZIDKDTQTTOR4TU5T3IZXQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549666998 (7h37m31.280934628s) [noise=true , address=104.36.82.4:4812 , piece_id=VKHFSCHUKZFGXRICZGSICWUTOK2BFMG6LAIC67ORAFN7S44SOPPQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.550026399 (7h37m31.281294019s) [noise=true , address=104.36.82.46:4498 , piece_id=C7HSUOEHMVCU5BX3XGAO4LWIGKXPE2IR6U7EOUBSJDSN3CIVRPPQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.550347188 (7h37m31.281614818s) [noise=true , address=104.36.82.62:4440 , piece_id=45DAJ7PILLSEBZICG7W7KKUR7ENYPF57DM2JA5COJV7IWRFB7KTQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.551515258 (7h37m31.282782888s) [noise=true , address=104.36.82.9:4029 , piece_id=LUA5Q3ZUO3SZI24ZPZGXIRLEMBZX3XQFYJQMCY6E4SXMBQTHSAGA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.553639614 (7h37m31.284907244s) [noise=true , address=104.36.82.34:4578 , piece_id=WROE2XH3WOMRAJ4OJBD5LGCCTUMI7ECXHO6HYYRXYNBNBPN7I5ZQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.654119682 (7h37m31.385387312s) [upload=7928]: Next returned nil segment Aug 9 01:03:50.654133758 (7h37m31.385401378s) [upload=7928]: Waiting for error group managing segments... Aug 9 01:03:50.672101667 (7h37m31.403369288s) [noise=true , address=104.36.82.16:4311 , piece_id=WHQMSXMRLD5QRU6GYEPX2U7YTK7OBEHBKHJXWU2YKBZBA4SQJNEA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.672877525 (7h37m31.404145145s) [noise=true , address=104.36.82.38:4710 , piece_id=AYQ2JWIS4Y6ECJOPZLL3VO7UEL3LAU72EDKKBZBE77G3XHRUKT3A, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.675306269 (7h37m31.406573909s) [noise=true , address=104.36.82.59:4314 , piece_id=SCL4G7EHDMHOWB7MZRTOLBT2TUZL45AE7A3UIKOQ2HCGI4AJLQCA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.675371770 (7h37m31.406639391s) [noise=true , address=104.36.82.37:4665 , piece_id=F5RO7SFTH54IDNLT7KF2TNOQRVZEFODCYG65ONZJ6THD4LZKKJJA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.683603266 (7h37m31.414870896s) [noise=true , address=104.36.82.34:4578 , piece_id=WROE2XH3WOMRAJ4OJBD5LGCCTUMI7ECXHO6HYYRXYNBNBPN7I5ZQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.685155513 (7h37m31.416423133s) [noise=true , address=104.36.82.39:4737 , piece_id=AMV62VOAKHJUZCZWNEYGJKY572LWVJZMANNMQEQIS2HHKR3YVRSQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.685621413 (7h37m31.416889033s) [noise=true , address=104.36.82.53:4144 , piece_id=AZ4C2TJSHYEVYUUEYI7K7QHHBQVAG6NMP2BJALLEE7IY5YFD6FZA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.686461230 (7h37m31.41772886s) [noise=true , address=104.36.82.17:4332 , piece_id=NRWIFJYUBAMBJ3FBMRXE3YZTREOENZYWB6J4BJLXIIPQKKXNVRUQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.686992623 (7h37m31.418260253s) [noise=true , address=104.36.82.12:4173 , piece_id=VBNMKHSMCJKTABCXB2PAGXH65OEUF6LBQXP7XZFNMYOD3H76IPEQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.687219727 (7h37m31.418487347s) [noise=true , address=104.36.82.21:4479 , piece_id=ZKGGJ6T7MZETBH7P72Y4MHWMTK2CAYR5PYQEGNNN7XOYV63BG2HQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.692430363 (7h37m31.423697993s) [noise=true , address=104.36.82.14:4245 , piece_id=4B7WJJILP2ZJ2DIDTPSTI55G67X6IBC24POPB4BCVSJOT4ZFKK3Q, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.707237672 (7h37m31.438505302s) [noise=true , address=104.36.82.9:4029 , piece_id=LUA5Q3ZUO3SZI24ZPZGXIRLEMBZX3XQFYJQMCY6E4SXMBQTHSAGA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.716934623 (7h37m31.448202253s) [noise=true , address=104.36.82.4:4812 , piece_id=VKHFSCHUKZFGXRICZGSICWUTOK2BFMG6LAIC67ORAFN7S44SOPPQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.766972144 (7h37m31.498239774s) [noise=true , address=104.36.82.44:4897 , piece_id=YMDI7WR2P3M2HTRDLQNCC24ZU2NRRBH6JDJEHOY6WEBK6KKO5PBQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.766989206 (7h37m31.498256836s) [seg_pos={0 0}, upload=7928]: Segment reached optimal threshold of 14 pieces. Aug 9 01:03:50.767124678 (7h37m31.498392309s) [noise=true , address=104.36.82.62:4440 , piece_id=45DAJ7PILLSEBZICG7W7KKUR7ENYPF57DM2JA5COJV7IWRFB7KTQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jvc3V5SqNUTwbUea883sp3jsPPu1PAzJaUwcjPjxdjm3JiF2L): protocol: write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection; write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection Aug 9 01:03:50.767270229 (7h37m31.49853786s) [noise=true , address=104.36.82.60:4342 , piece_id=GTKAIDOMRHEEWSS2H64BVSLX245AYHVVIXORCJKFMSIAC7VGOZLQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB): protocol: read tcp 5.161.89.252:54032->104.36.82.60:4342: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 9 01:03:50.767296629 (7h37m31.498564249s) [noise=true , address=104.36.82.46:4498 , piece_id=C7HSUOEHMVCU5BX3XGAO4LWIGKXPE2IR6U7EOUBSJDSN3CIVRPPQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jyjxdWkBRBkDHSKknNmPdcnJ3HRcSCUQNnmpb1CaiEdMPEGk4): protocol: expected piece hash; context canceled; EOF Aug 9 01:03:50.767313812 (7h37m31.498581442s) [noise=true , address=104.36.82.11:4122 , piece_id=HOAEVCU5N4KLGF7O7ZZJC7YC5OB4VZOZIDKDTQTTOR4TU5T3IZXQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1oCu75zR8YccTunHjctcLzTrr9wTQqtAPXHiWrsQs41o8gxgh6): protocol: write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection; write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection Aug 9 01:03:50.767324712 (7h37m31.498592332s) [seg_pos={0 0}, upload=7928]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 01:03:50.767376188 (7h37m31.498643818s) [upload=7928]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 01:03:50.767381278 (7h37m31.498648908s) [upload=7928]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 01:03:50.890154929 (7h37m31.621422559s) [upload=7928]: Done uploading segments... Aug 9 01:03:50.890168986 (7h37m31.621436606s) [upload=7928]: Upload finished. err: <nil> Duration: 564.692625ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 196.950501ms FAIL (2025-08-09 01:09:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:52:13.986283699 (7h25m54.71755135s) [upload=7723]: Starting upload Aug 9 00:52:13.986408060 (7h25m54.717675711s) [upload=7723]: Done starting upload Aug 9 00:52:13.986481939 (7h25m54.71774956s) [upload=7723]: Uploading segments... Aug 9 00:52:13.986553753 (7h25m54.717821373s) [upload=7723]: Got next segment. Inline: true Aug 9 00:52:13.986558031 (7h25m54.717825641s) [upload=7723]: Waiting for error group managing segments... Aug 9 00:52:13.986608676 (7h25m54.717876296s) [upload=7723]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 00:52:13.986612834 (7h25m54.717880454s) [upload=7723]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 00:52:13.986615108 (7h25m54.717882728s) [upload=7723]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 00:52:13.989421897 (7h25m54.720689516s) [upload=7723]: Done uploading segments... Aug 9 00:52:13.989431464 (7h25m54.720699084s) [upload=7723]: Upload finished. err: metaclient: Too Many Requests Duration:* 196.968415ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.....................X.......X..............X......X........] duration: 722.854683ms FAIL (2025-08-09 01:09:27 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 9 01:03:50.521251227 (7h37m31.252518857s) [upload=7928]: Starting upload Aug 9 01:03:50.521308083 (7h37m31.252575713s) [upload=7928]: Done starting upload Aug 9 01:03:50.521407979 (7h37m31.252675609s) [upload=7928]: Uploading segments... Aug 9 01:03:50.521679086 (7h37m31.252946716s) [upload=7928]: Got next segment. Inline: false Aug 9 01:03:50.521722226 (7h37m31.252989866s) [upload=7928]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:03:50.521727255 (7h37m31.252994885s) [upload=7928]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 01:03:50.547289380 (7h37m31.278557001s) [seg_pos={0 0}, upload=7928]: Begin upload segment... Aug 9 01:03:50.547314256 (7h37m31.278581886s) [seg_pos={0 0}, upload=7928]: Done begin upload segment. Aug 9 01:03:50.547335476 (7h37m31.278603116s) [noise=true , address=104.36.82.12:4173 , piece_id=VBNMKHSMCJKTABCXB2PAGXH65OEUF6LBQXP7XZFNMYOD3H76IPEQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547382454 (7h37m31.278650084s) [noise=true , address=104.36.82.37:4665 , piece_id=F5RO7SFTH54IDNLT7KF2TNOQRVZEFODCYG65ONZJ6THD4LZKKJJA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547771219 (7h37m31.27903884s) [noise=true , address=104.36.82.59:4314 , piece_id=SCL4G7EHDMHOWB7MZRTOLBT2TUZL45AE7A3UIKOQ2HCGI4AJLQCA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547817245 (7h37m31.279084875s) [noise=true , address=104.36.82.14:4245 , piece_id=4B7WJJILP2ZJ2DIDTPSTI55G67X6IBC24POPB4BCVSJOT4ZFKK3Q, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548158312 (7h37m31.279425942s) [noise=true , address=104.36.82.60:4342 , piece_id=GTKAIDOMRHEEWSS2H64BVSLX245AYHVVIXORCJKFMSIAC7VGOZLQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548182277 (7h37m31.279449907s) [noise=true , address=104.36.82.16:4311 , piece_id=WHQMSXMRLD5QRU6GYEPX2U7YTK7OBEHBKHJXWU2YKBZBA4SQJNEA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548510239 (7h37m31.27977787s) [noise=true , address=104.36.82.21:4479 , piece_id=ZKGGJ6T7MZETBH7P72Y4MHWMTK2CAYR5PYQEGNNN7XOYV63BG2HQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548553630 (7h37m31.27982126s) [noise=true , address=104.36.82.44:4897 , piece_id=YMDI7WR2P3M2HTRDLQNCC24ZU2NRRBH6JDJEHOY6WEBK6KKO5PBQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548917339 (7h37m31.280184959s) [noise=true , address=104.36.82.38:4710 , piece_id=AYQ2JWIS4Y6ECJOPZLL3VO7UEL3LAU72EDKKBZBE77G3XHRUKT3A, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548924042 (7h37m31.280191682s) [noise=true , address=104.36.82.17:4332 , piece_id=NRWIFJYUBAMBJ3FBMRXE3YZTREOENZYWB6J4BJLXIIPQKKXNVRUQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548959829 (7h37m31.280227459s) [noise=true , address=104.36.82.53:4144 , piece_id=AZ4C2TJSHYEVYUUEYI7K7QHHBQVAG6NMP2BJALLEE7IY5YFD6FZA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549302238 (7h37m31.280569868s) [noise=true , address=104.36.82.39:4737 , piece_id=AMV62VOAKHJUZCZWNEYGJKY572LWVJZMANNMQEQIS2HHKR3YVRSQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549314360 (7h37m31.28058199s) [noise=true , address=104.36.82.11:4122 , piece_id=HOAEVCU5N4KLGF7O7ZZJC7YC5OB4VZOZIDKDTQTTOR4TU5T3IZXQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549666998 (7h37m31.280934628s) [noise=true , address=104.36.82.4:4812 , piece_id=VKHFSCHUKZFGXRICZGSICWUTOK2BFMG6LAIC67ORAFN7S44SOPPQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.550026399 (7h37m31.281294019s) [noise=true , address=104.36.82.46:4498 , piece_id=C7HSUOEHMVCU5BX3XGAO4LWIGKXPE2IR6U7EOUBSJDSN3CIVRPPQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.550347188 (7h37m31.281614818s) [noise=true , address=104.36.82.62:4440 , piece_id=45DAJ7PILLSEBZICG7W7KKUR7ENYPF57DM2JA5COJV7IWRFB7KTQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.551515258 (7h37m31.282782888s) [noise=true , address=104.36.82.9:4029 , piece_id=LUA5Q3ZUO3SZI24ZPZGXIRLEMBZX3XQFYJQMCY6E4SXMBQTHSAGA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.553639614 (7h37m31.284907244s) [noise=true , address=104.36.82.34:4578 , piece_id=WROE2XH3WOMRAJ4OJBD5LGCCTUMI7ECXHO6HYYRXYNBNBPN7I5ZQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.654119682 (7h37m31.385387312s) [upload=7928]: Next returned nil segment Aug 9 01:03:50.654133758 (7h37m31.385401378s) [upload=7928]: Waiting for error group managing segments... Aug 9 01:03:50.672101667 (7h37m31.403369288s) [noise=true , address=104.36.82.16:4311 , piece_id=WHQMSXMRLD5QRU6GYEPX2U7YTK7OBEHBKHJXWU2YKBZBA4SQJNEA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.672877525 (7h37m31.404145145s) [noise=true , address=104.36.82.38:4710 , piece_id=AYQ2JWIS4Y6ECJOPZLL3VO7UEL3LAU72EDKKBZBE77G3XHRUKT3A, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.675306269 (7h37m31.406573909s) [noise=true , address=104.36.82.59:4314 , piece_id=SCL4G7EHDMHOWB7MZRTOLBT2TUZL45AE7A3UIKOQ2HCGI4AJLQCA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.675371770 (7h37m31.406639391s) [noise=true , address=104.36.82.37:4665 , piece_id=F5RO7SFTH54IDNLT7KF2TNOQRVZEFODCYG65ONZJ6THD4LZKKJJA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.683603266 (7h37m31.414870896s) [noise=true , address=104.36.82.34:4578 , piece_id=WROE2XH3WOMRAJ4OJBD5LGCCTUMI7ECXHO6HYYRXYNBNBPN7I5ZQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.685155513 (7h37m31.416423133s) [noise=true , address=104.36.82.39:4737 , piece_id=AMV62VOAKHJUZCZWNEYGJKY572LWVJZMANNMQEQIS2HHKR3YVRSQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.685621413 (7h37m31.416889033s) [noise=true , address=104.36.82.53:4144 , piece_id=AZ4C2TJSHYEVYUUEYI7K7QHHBQVAG6NMP2BJALLEE7IY5YFD6FZA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.686461230 (7h37m31.41772886s) [noise=true , address=104.36.82.17:4332 , piece_id=NRWIFJYUBAMBJ3FBMRXE3YZTREOENZYWB6J4BJLXIIPQKKXNVRUQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.686992623 (7h37m31.418260253s) [noise=true , address=104.36.82.12:4173 , piece_id=VBNMKHSMCJKTABCXB2PAGXH65OEUF6LBQXP7XZFNMYOD3H76IPEQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.687219727 (7h37m31.418487347s) [noise=true , address=104.36.82.21:4479 , piece_id=ZKGGJ6T7MZETBH7P72Y4MHWMTK2CAYR5PYQEGNNN7XOYV63BG2HQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.692430363 (7h37m31.423697993s) [noise=true , address=104.36.82.14:4245 , piece_id=4B7WJJILP2ZJ2DIDTPSTI55G67X6IBC24POPB4BCVSJOT4ZFKK3Q, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.707237672 (7h37m31.438505302s) [noise=true , address=104.36.82.9:4029 , piece_id=LUA5Q3ZUO3SZI24ZPZGXIRLEMBZX3XQFYJQMCY6E4SXMBQTHSAGA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.716934623 (7h37m31.448202253s) [noise=true , address=104.36.82.4:4812 , piece_id=VKHFSCHUKZFGXRICZGSICWUTOK2BFMG6LAIC67ORAFN7S44SOPPQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.766972144 (7h37m31.498239774s) [noise=true , address=104.36.82.44:4897 , piece_id=YMDI7WR2P3M2HTRDLQNCC24ZU2NRRBH6JDJEHOY6WEBK6KKO5PBQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.766989206 (7h37m31.498256836s) [seg_pos={0 0}, upload=7928]: Segment reached optimal threshold of 14 pieces. Aug 9 01:03:50.767124678 (7h37m31.498392309s) [noise=true , address=104.36.82.62:4440 , piece_id=45DAJ7PILLSEBZICG7W7KKUR7ENYPF57DM2JA5COJV7IWRFB7KTQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jvc3V5SqNUTwbUea883sp3jsPPu1PAzJaUwcjPjxdjm3JiF2L): protocol: write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection; write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection Aug 9 01:03:50.767270229 (7h37m31.49853786s) [noise=true , address=104.36.82.60:4342 , piece_id=GTKAIDOMRHEEWSS2H64BVSLX245AYHVVIXORCJKFMSIAC7VGOZLQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB): protocol: read tcp 5.161.89.252:54032->104.36.82.60:4342: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 9 01:03:50.767296629 (7h37m31.498564249s) [noise=true , address=104.36.82.46:4498 , piece_id=C7HSUOEHMVCU5BX3XGAO4LWIGKXPE2IR6U7EOUBSJDSN3CIVRPPQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jyjxdWkBRBkDHSKknNmPdcnJ3HRcSCUQNnmpb1CaiEdMPEGk4): protocol: expected piece hash; context canceled; EOF Aug 9 01:03:50.767313812 (7h37m31.498581442s) [noise=true , address=104.36.82.11:4122 , piece_id=HOAEVCU5N4KLGF7O7ZZJC7YC5OB4VZOZIDKDTQTTOR4TU5T3IZXQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1oCu75zR8YccTunHjctcLzTrr9wTQqtAPXHiWrsQs41o8gxgh6): protocol: write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection; write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection Aug 9 01:03:50.767324712 (7h37m31.498592332s) [seg_pos={0 0}, upload=7928]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 01:03:50.767376188 (7h37m31.498643818s) [upload=7928]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 01:03:50.767381278 (7h37m31.498648908s) [upload=7928]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 01:03:50.890154929 (7h37m31.621422559s) [upload=7928]: Done uploading segments... Aug 9 01:03:50.890168986 (7h37m31.621436606s) [upload=7928]: Upload finished. err: <nil> Duration: 722.881903ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [......................X.......X..............X......X.......] duration: 629.200678ms FAIL (2025-08-09 01:08:58 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 9 01:03:50.521251227 (7h37m31.252518857s) [upload=7928]: Starting upload Aug 9 01:03:50.521308083 (7h37m31.252575713s) [upload=7928]: Done starting upload Aug 9 01:03:50.521407979 (7h37m31.252675609s) [upload=7928]: Uploading segments... Aug 9 01:03:50.521679086 (7h37m31.252946716s) [upload=7928]: Got next segment. Inline: false Aug 9 01:03:50.521722226 (7h37m31.252989866s) [upload=7928]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:03:50.521727255 (7h37m31.252994885s) [upload=7928]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 01:03:50.547289380 (7h37m31.278557001s) [seg_pos={0 0}, upload=7928]: Begin upload segment... Aug 9 01:03:50.547314256 (7h37m31.278581886s) [seg_pos={0 0}, upload=7928]: Done begin upload segment. Aug 9 01:03:50.547335476 (7h37m31.278603116s) [noise=true , address=104.36.82.12:4173 , piece_id=VBNMKHSMCJKTABCXB2PAGXH65OEUF6LBQXP7XZFNMYOD3H76IPEQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547382454 (7h37m31.278650084s) [noise=true , address=104.36.82.37:4665 , piece_id=F5RO7SFTH54IDNLT7KF2TNOQRVZEFODCYG65ONZJ6THD4LZKKJJA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547771219 (7h37m31.27903884s) [noise=true , address=104.36.82.59:4314 , piece_id=SCL4G7EHDMHOWB7MZRTOLBT2TUZL45AE7A3UIKOQ2HCGI4AJLQCA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547817245 (7h37m31.279084875s) [noise=true , address=104.36.82.14:4245 , piece_id=4B7WJJILP2ZJ2DIDTPSTI55G67X6IBC24POPB4BCVSJOT4ZFKK3Q, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548158312 (7h37m31.279425942s) [noise=true , address=104.36.82.60:4342 , piece_id=GTKAIDOMRHEEWSS2H64BVSLX245AYHVVIXORCJKFMSIAC7VGOZLQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548182277 (7h37m31.279449907s) [noise=true , address=104.36.82.16:4311 , piece_id=WHQMSXMRLD5QRU6GYEPX2U7YTK7OBEHBKHJXWU2YKBZBA4SQJNEA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548510239 (7h37m31.27977787s) [noise=true , address=104.36.82.21:4479 , piece_id=ZKGGJ6T7MZETBH7P72Y4MHWMTK2CAYR5PYQEGNNN7XOYV63BG2HQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548553630 (7h37m31.27982126s) [noise=true , address=104.36.82.44:4897 , piece_id=YMDI7WR2P3M2HTRDLQNCC24ZU2NRRBH6JDJEHOY6WEBK6KKO5PBQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548917339 (7h37m31.280184959s) [noise=true , address=104.36.82.38:4710 , piece_id=AYQ2JWIS4Y6ECJOPZLL3VO7UEL3LAU72EDKKBZBE77G3XHRUKT3A, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548924042 (7h37m31.280191682s) [noise=true , address=104.36.82.17:4332 , piece_id=NRWIFJYUBAMBJ3FBMRXE3YZTREOENZYWB6J4BJLXIIPQKKXNVRUQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548959829 (7h37m31.280227459s) [noise=true , address=104.36.82.53:4144 , piece_id=AZ4C2TJSHYEVYUUEYI7K7QHHBQVAG6NMP2BJALLEE7IY5YFD6FZA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549302238 (7h37m31.280569868s) [noise=true , address=104.36.82.39:4737 , piece_id=AMV62VOAKHJUZCZWNEYGJKY572LWVJZMANNMQEQIS2HHKR3YVRSQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549314360 (7h37m31.28058199s) [noise=true , address=104.36.82.11:4122 , piece_id=HOAEVCU5N4KLGF7O7ZZJC7YC5OB4VZOZIDKDTQTTOR4TU5T3IZXQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549666998 (7h37m31.280934628s) [noise=true , address=104.36.82.4:4812 , piece_id=VKHFSCHUKZFGXRICZGSICWUTOK2BFMG6LAIC67ORAFN7S44SOPPQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.550026399 (7h37m31.281294019s) [noise=true , address=104.36.82.46:4498 , piece_id=C7HSUOEHMVCU5BX3XGAO4LWIGKXPE2IR6U7EOUBSJDSN3CIVRPPQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.550347188 (7h37m31.281614818s) [noise=true , address=104.36.82.62:4440 , piece_id=45DAJ7PILLSEBZICG7W7KKUR7ENYPF57DM2JA5COJV7IWRFB7KTQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.551515258 (7h37m31.282782888s) [noise=true , address=104.36.82.9:4029 , piece_id=LUA5Q3ZUO3SZI24ZPZGXIRLEMBZX3XQFYJQMCY6E4SXMBQTHSAGA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.553639614 (7h37m31.284907244s) [noise=true , address=104.36.82.34:4578 , piece_id=WROE2XH3WOMRAJ4OJBD5LGCCTUMI7ECXHO6HYYRXYNBNBPN7I5ZQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.654119682 (7h37m31.385387312s) [upload=7928]: Next returned nil segment Aug 9 01:03:50.654133758 (7h37m31.385401378s) [upload=7928]: Waiting for error group managing segments... Aug 9 01:03:50.672101667 (7h37m31.403369288s) [noise=true , address=104.36.82.16:4311 , piece_id=WHQMSXMRLD5QRU6GYEPX2U7YTK7OBEHBKHJXWU2YKBZBA4SQJNEA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.672877525 (7h37m31.404145145s) [noise=true , address=104.36.82.38:4710 , piece_id=AYQ2JWIS4Y6ECJOPZLL3VO7UEL3LAU72EDKKBZBE77G3XHRUKT3A, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.675306269 (7h37m31.406573909s) [noise=true , address=104.36.82.59:4314 , piece_id=SCL4G7EHDMHOWB7MZRTOLBT2TUZL45AE7A3UIKOQ2HCGI4AJLQCA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.675371770 (7h37m31.406639391s) [noise=true , address=104.36.82.37:4665 , piece_id=F5RO7SFTH54IDNLT7KF2TNOQRVZEFODCYG65ONZJ6THD4LZKKJJA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.683603266 (7h37m31.414870896s) [noise=true , address=104.36.82.34:4578 , piece_id=WROE2XH3WOMRAJ4OJBD5LGCCTUMI7ECXHO6HYYRXYNBNBPN7I5ZQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.685155513 (7h37m31.416423133s) [noise=true , address=104.36.82.39:4737 , piece_id=AMV62VOAKHJUZCZWNEYGJKY572LWVJZMANNMQEQIS2HHKR3YVRSQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.685621413 (7h37m31.416889033s) [noise=true , address=104.36.82.53:4144 , piece_id=AZ4C2TJSHYEVYUUEYI7K7QHHBQVAG6NMP2BJALLEE7IY5YFD6FZA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.686461230 (7h37m31.41772886s) [noise=true , address=104.36.82.17:4332 , piece_id=NRWIFJYUBAMBJ3FBMRXE3YZTREOENZYWB6J4BJLXIIPQKKXNVRUQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.686992623 (7h37m31.418260253s) [noise=true , address=104.36.82.12:4173 , piece_id=VBNMKHSMCJKTABCXB2PAGXH65OEUF6LBQXP7XZFNMYOD3H76IPEQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.687219727 (7h37m31.418487347s) [noise=true , address=104.36.82.21:4479 , piece_id=ZKGGJ6T7MZETBH7P72Y4MHWMTK2CAYR5PYQEGNNN7XOYV63BG2HQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.692430363 (7h37m31.423697993s) [noise=true , address=104.36.82.14:4245 , piece_id=4B7WJJILP2ZJ2DIDTPSTI55G67X6IBC24POPB4BCVSJOT4ZFKK3Q, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.707237672 (7h37m31.438505302s) [noise=true , address=104.36.82.9:4029 , piece_id=LUA5Q3ZUO3SZI24ZPZGXIRLEMBZX3XQFYJQMCY6E4SXMBQTHSAGA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.716934623 (7h37m31.448202253s) [noise=true , address=104.36.82.4:4812 , piece_id=VKHFSCHUKZFGXRICZGSICWUTOK2BFMG6LAIC67ORAFN7S44SOPPQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.766972144 (7h37m31.498239774s) [noise=true , address=104.36.82.44:4897 , piece_id=YMDI7WR2P3M2HTRDLQNCC24ZU2NRRBH6JDJEHOY6WEBK6KKO5PBQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.766989206 (7h37m31.498256836s) [seg_pos={0 0}, upload=7928]: Segment reached optimal threshold of 14 pieces. Aug 9 01:03:50.767124678 (7h37m31.498392309s) [noise=true , address=104.36.82.62:4440 , piece_id=45DAJ7PILLSEBZICG7W7KKUR7ENYPF57DM2JA5COJV7IWRFB7KTQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jvc3V5SqNUTwbUea883sp3jsPPu1PAzJaUwcjPjxdjm3JiF2L): protocol: write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection; write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection Aug 9 01:03:50.767270229 (7h37m31.49853786s) [noise=true , address=104.36.82.60:4342 , piece_id=GTKAIDOMRHEEWSS2H64BVSLX245AYHVVIXORCJKFMSIAC7VGOZLQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB): protocol: read tcp 5.161.89.252:54032->104.36.82.60:4342: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 9 01:03:50.767296629 (7h37m31.498564249s) [noise=true , address=104.36.82.46:4498 , piece_id=C7HSUOEHMVCU5BX3XGAO4LWIGKXPE2IR6U7EOUBSJDSN3CIVRPPQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jyjxdWkBRBkDHSKknNmPdcnJ3HRcSCUQNnmpb1CaiEdMPEGk4): protocol: expected piece hash; context canceled; EOF Aug 9 01:03:50.767313812 (7h37m31.498581442s) [noise=true , address=104.36.82.11:4122 , piece_id=HOAEVCU5N4KLGF7O7ZZJC7YC5OB4VZOZIDKDTQTTOR4TU5T3IZXQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1oCu75zR8YccTunHjctcLzTrr9wTQqtAPXHiWrsQs41o8gxgh6): protocol: write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection; write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection Aug 9 01:03:50.767324712 (7h37m31.498592332s) [seg_pos={0 0}, upload=7928]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 01:03:50.767376188 (7h37m31.498643818s) [upload=7928]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 01:03:50.767381278 (7h37m31.498648908s) [upload=7928]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 01:03:50.890154929 (7h37m31.621422559s) [upload=7928]: Done uploading segments... Aug 9 01:03:50.890168986 (7h37m31.621436606s) [upload=7928]: Upload finished. err: <nil> Duration: 629.222809ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 152.014452ms FAIL (2025-08-09 01:08:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:52:13.986283699 (7h25m54.71755135s) [upload=7723]: Starting upload Aug 9 00:52:13.986408060 (7h25m54.717675711s) [upload=7723]: Done starting upload Aug 9 00:52:13.986481939 (7h25m54.71774956s) [upload=7723]: Uploading segments... Aug 9 00:52:13.986553753 (7h25m54.717821373s) [upload=7723]: Got next segment. Inline: true Aug 9 00:52:13.986558031 (7h25m54.717825641s) [upload=7723]: Waiting for error group managing segments... Aug 9 00:52:13.986608676 (7h25m54.717876296s) [upload=7723]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 00:52:13.986612834 (7h25m54.717880454s) [upload=7723]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 00:52:13.986615108 (7h25m54.717882728s) [upload=7723]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 00:52:13.989421897 (7h25m54.720689516s) [upload=7723]: Done uploading segments... Aug 9 00:52:13.989431464 (7h25m54.720699084s) [upload=7723]: Upload finished. err: metaclient: Too Many Requests Duration:* 152.033187ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.......................X.......X..............X......X......] duration: 1.001015735s FAIL (2025-08-09 01:08:24 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 9 01:03:50.521251227 (7h37m31.252518857s) [upload=7928]: Starting upload Aug 9 01:03:50.521308083 (7h37m31.252575713s) [upload=7928]: Done starting upload Aug 9 01:03:50.521407979 (7h37m31.252675609s) [upload=7928]: Uploading segments... Aug 9 01:03:50.521679086 (7h37m31.252946716s) [upload=7928]: Got next segment. Inline: false Aug 9 01:03:50.521722226 (7h37m31.252989866s) [upload=7928]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:03:50.521727255 (7h37m31.252994885s) [upload=7928]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 01:03:50.547289380 (7h37m31.278557001s) [seg_pos={0 0}, upload=7928]: Begin upload segment... Aug 9 01:03:50.547314256 (7h37m31.278581886s) [seg_pos={0 0}, upload=7928]: Done begin upload segment. Aug 9 01:03:50.547335476 (7h37m31.278603116s) [noise=true , address=104.36.82.12:4173 , piece_id=VBNMKHSMCJKTABCXB2PAGXH65OEUF6LBQXP7XZFNMYOD3H76IPEQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547382454 (7h37m31.278650084s) [noise=true , address=104.36.82.37:4665 , piece_id=F5RO7SFTH54IDNLT7KF2TNOQRVZEFODCYG65ONZJ6THD4LZKKJJA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547771219 (7h37m31.27903884s) [noise=true , address=104.36.82.59:4314 , piece_id=SCL4G7EHDMHOWB7MZRTOLBT2TUZL45AE7A3UIKOQ2HCGI4AJLQCA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547817245 (7h37m31.279084875s) [noise=true , address=104.36.82.14:4245 , piece_id=4B7WJJILP2ZJ2DIDTPSTI55G67X6IBC24POPB4BCVSJOT4ZFKK3Q, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548158312 (7h37m31.279425942s) [noise=true , address=104.36.82.60:4342 , piece_id=GTKAIDOMRHEEWSS2H64BVSLX245AYHVVIXORCJKFMSIAC7VGOZLQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548182277 (7h37m31.279449907s) [noise=true , address=104.36.82.16:4311 , piece_id=WHQMSXMRLD5QRU6GYEPX2U7YTK7OBEHBKHJXWU2YKBZBA4SQJNEA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548510239 (7h37m31.27977787s) [noise=true , address=104.36.82.21:4479 , piece_id=ZKGGJ6T7MZETBH7P72Y4MHWMTK2CAYR5PYQEGNNN7XOYV63BG2HQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548553630 (7h37m31.27982126s) [noise=true , address=104.36.82.44:4897 , piece_id=YMDI7WR2P3M2HTRDLQNCC24ZU2NRRBH6JDJEHOY6WEBK6KKO5PBQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548917339 (7h37m31.280184959s) [noise=true , address=104.36.82.38:4710 , piece_id=AYQ2JWIS4Y6ECJOPZLL3VO7UEL3LAU72EDKKBZBE77G3XHRUKT3A, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548924042 (7h37m31.280191682s) [noise=true , address=104.36.82.17:4332 , piece_id=NRWIFJYUBAMBJ3FBMRXE3YZTREOENZYWB6J4BJLXIIPQKKXNVRUQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548959829 (7h37m31.280227459s) [noise=true , address=104.36.82.53:4144 , piece_id=AZ4C2TJSHYEVYUUEYI7K7QHHBQVAG6NMP2BJALLEE7IY5YFD6FZA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549302238 (7h37m31.280569868s) [noise=true , address=104.36.82.39:4737 , piece_id=AMV62VOAKHJUZCZWNEYGJKY572LWVJZMANNMQEQIS2HHKR3YVRSQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549314360 (7h37m31.28058199s) [noise=true , address=104.36.82.11:4122 , piece_id=HOAEVCU5N4KLGF7O7ZZJC7YC5OB4VZOZIDKDTQTTOR4TU5T3IZXQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549666998 (7h37m31.280934628s) [noise=true , address=104.36.82.4:4812 , piece_id=VKHFSCHUKZFGXRICZGSICWUTOK2BFMG6LAIC67ORAFN7S44SOPPQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.550026399 (7h37m31.281294019s) [noise=true , address=104.36.82.46:4498 , piece_id=C7HSUOEHMVCU5BX3XGAO4LWIGKXPE2IR6U7EOUBSJDSN3CIVRPPQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.550347188 (7h37m31.281614818s) [noise=true , address=104.36.82.62:4440 , piece_id=45DAJ7PILLSEBZICG7W7KKUR7ENYPF57DM2JA5COJV7IWRFB7KTQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.551515258 (7h37m31.282782888s) [noise=true , address=104.36.82.9:4029 , piece_id=LUA5Q3ZUO3SZI24ZPZGXIRLEMBZX3XQFYJQMCY6E4SXMBQTHSAGA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.553639614 (7h37m31.284907244s) [noise=true , address=104.36.82.34:4578 , piece_id=WROE2XH3WOMRAJ4OJBD5LGCCTUMI7ECXHO6HYYRXYNBNBPN7I5ZQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.654119682 (7h37m31.385387312s) [upload=7928]: Next returned nil segment Aug 9 01:03:50.654133758 (7h37m31.385401378s) [upload=7928]: Waiting for error group managing segments... Aug 9 01:03:50.672101667 (7h37m31.403369288s) [noise=true , address=104.36.82.16:4311 , piece_id=WHQMSXMRLD5QRU6GYEPX2U7YTK7OBEHBKHJXWU2YKBZBA4SQJNEA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.672877525 (7h37m31.404145145s) [noise=true , address=104.36.82.38:4710 , piece_id=AYQ2JWIS4Y6ECJOPZLL3VO7UEL3LAU72EDKKBZBE77G3XHRUKT3A, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.675306269 (7h37m31.406573909s) [noise=true , address=104.36.82.59:4314 , piece_id=SCL4G7EHDMHOWB7MZRTOLBT2TUZL45AE7A3UIKOQ2HCGI4AJLQCA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.675371770 (7h37m31.406639391s) [noise=true , address=104.36.82.37:4665 , piece_id=F5RO7SFTH54IDNLT7KF2TNOQRVZEFODCYG65ONZJ6THD4LZKKJJA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.683603266 (7h37m31.414870896s) [noise=true , address=104.36.82.34:4578 , piece_id=WROE2XH3WOMRAJ4OJBD5LGCCTUMI7ECXHO6HYYRXYNBNBPN7I5ZQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.685155513 (7h37m31.416423133s) [noise=true , address=104.36.82.39:4737 , piece_id=AMV62VOAKHJUZCZWNEYGJKY572LWVJZMANNMQEQIS2HHKR3YVRSQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.685621413 (7h37m31.416889033s) [noise=true , address=104.36.82.53:4144 , piece_id=AZ4C2TJSHYEVYUUEYI7K7QHHBQVAG6NMP2BJALLEE7IY5YFD6FZA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.686461230 (7h37m31.41772886s) [noise=true , address=104.36.82.17:4332 , piece_id=NRWIFJYUBAMBJ3FBMRXE3YZTREOENZYWB6J4BJLXIIPQKKXNVRUQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.686992623 (7h37m31.418260253s) [noise=true , address=104.36.82.12:4173 , piece_id=VBNMKHSMCJKTABCXB2PAGXH65OEUF6LBQXP7XZFNMYOD3H76IPEQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.687219727 (7h37m31.418487347s) [noise=true , address=104.36.82.21:4479 , piece_id=ZKGGJ6T7MZETBH7P72Y4MHWMTK2CAYR5PYQEGNNN7XOYV63BG2HQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.692430363 (7h37m31.423697993s) [noise=true , address=104.36.82.14:4245 , piece_id=4B7WJJILP2ZJ2DIDTPSTI55G67X6IBC24POPB4BCVSJOT4ZFKK3Q, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.707237672 (7h37m31.438505302s) [noise=true , address=104.36.82.9:4029 , piece_id=LUA5Q3ZUO3SZI24ZPZGXIRLEMBZX3XQFYJQMCY6E4SXMBQTHSAGA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.716934623 (7h37m31.448202253s) [noise=true , address=104.36.82.4:4812 , piece_id=VKHFSCHUKZFGXRICZGSICWUTOK2BFMG6LAIC67ORAFN7S44SOPPQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.766972144 (7h37m31.498239774s) [noise=true , address=104.36.82.44:4897 , piece_id=YMDI7WR2P3M2HTRDLQNCC24ZU2NRRBH6JDJEHOY6WEBK6KKO5PBQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.766989206 (7h37m31.498256836s) [seg_pos={0 0}, upload=7928]: Segment reached optimal threshold of 14 pieces. Aug 9 01:03:50.767124678 (7h37m31.498392309s) [noise=true , address=104.36.82.62:4440 , piece_id=45DAJ7PILLSEBZICG7W7KKUR7ENYPF57DM2JA5COJV7IWRFB7KTQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jvc3V5SqNUTwbUea883sp3jsPPu1PAzJaUwcjPjxdjm3JiF2L): protocol: write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection; write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection Aug 9 01:03:50.767270229 (7h37m31.49853786s) [noise=true , address=104.36.82.60:4342 , piece_id=GTKAIDOMRHEEWSS2H64BVSLX245AYHVVIXORCJKFMSIAC7VGOZLQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB): protocol: read tcp 5.161.89.252:54032->104.36.82.60:4342: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 9 01:03:50.767296629 (7h37m31.498564249s) [noise=true , address=104.36.82.46:4498 , piece_id=C7HSUOEHMVCU5BX3XGAO4LWIGKXPE2IR6U7EOUBSJDSN3CIVRPPQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jyjxdWkBRBkDHSKknNmPdcnJ3HRcSCUQNnmpb1CaiEdMPEGk4): protocol: expected piece hash; context canceled; EOF Aug 9 01:03:50.767313812 (7h37m31.498581442s) [noise=true , address=104.36.82.11:4122 , piece_id=HOAEVCU5N4KLGF7O7ZZJC7YC5OB4VZOZIDKDTQTTOR4TU5T3IZXQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1oCu75zR8YccTunHjctcLzTrr9wTQqtAPXHiWrsQs41o8gxgh6): protocol: write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection; write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection Aug 9 01:03:50.767324712 (7h37m31.498592332s) [seg_pos={0 0}, upload=7928]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 01:03:50.767376188 (7h37m31.498643818s) [upload=7928]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 01:03:50.767381278 (7h37m31.498648908s) [upload=7928]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 01:03:50.890154929 (7h37m31.621422559s) [upload=7928]: Done uploading segments... Aug 9 01:03:50.890168986 (7h37m31.621436606s) [upload=7928]: Upload finished. err: <nil> Duration: 1.001028348s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 157.11327ms FAIL (2025-08-09 01:07:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:52:13.986283699 (7h25m54.71755135s) [upload=7723]: Starting upload Aug 9 00:52:13.986408060 (7h25m54.717675711s) [upload=7723]: Done starting upload Aug 9 00:52:13.986481939 (7h25m54.71774956s) [upload=7723]: Uploading segments... Aug 9 00:52:13.986553753 (7h25m54.717821373s) [upload=7723]: Got next segment. Inline: true Aug 9 00:52:13.986558031 (7h25m54.717825641s) [upload=7723]: Waiting for error group managing segments... Aug 9 00:52:13.986608676 (7h25m54.717876296s) [upload=7723]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 00:52:13.986612834 (7h25m54.717880454s) [upload=7723]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 00:52:13.986615108 (7h25m54.717882728s) [upload=7723]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 00:52:13.989421897 (7h25m54.720689516s) [upload=7723]: Done uploading segments... Aug 9 00:52:13.989431464 (7h25m54.720699084s) [upload=7723]: Upload finished. err: metaclient: Too Many Requests Duration:* 157.12938ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [........................X.......X..............X......X.....] duration: 685.558703ms FAIL (2025-08-09 01:07:41 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 9 01:03:50.521251227 (7h37m31.252518857s) [upload=7928]: Starting upload Aug 9 01:03:50.521308083 (7h37m31.252575713s) [upload=7928]: Done starting upload Aug 9 01:03:50.521407979 (7h37m31.252675609s) [upload=7928]: Uploading segments... Aug 9 01:03:50.521679086 (7h37m31.252946716s) [upload=7928]: Got next segment. Inline: false Aug 9 01:03:50.521722226 (7h37m31.252989866s) [upload=7928]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:03:50.521727255 (7h37m31.252994885s) [upload=7928]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 01:03:50.547289380 (7h37m31.278557001s) [seg_pos={0 0}, upload=7928]: Begin upload segment... Aug 9 01:03:50.547314256 (7h37m31.278581886s) [seg_pos={0 0}, upload=7928]: Done begin upload segment. Aug 9 01:03:50.547335476 (7h37m31.278603116s) [noise=true , address=104.36.82.12:4173 , piece_id=VBNMKHSMCJKTABCXB2PAGXH65OEUF6LBQXP7XZFNMYOD3H76IPEQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547382454 (7h37m31.278650084s) [noise=true , address=104.36.82.37:4665 , piece_id=F5RO7SFTH54IDNLT7KF2TNOQRVZEFODCYG65ONZJ6THD4LZKKJJA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547771219 (7h37m31.27903884s) [noise=true , address=104.36.82.59:4314 , piece_id=SCL4G7EHDMHOWB7MZRTOLBT2TUZL45AE7A3UIKOQ2HCGI4AJLQCA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547817245 (7h37m31.279084875s) [noise=true , address=104.36.82.14:4245 , piece_id=4B7WJJILP2ZJ2DIDTPSTI55G67X6IBC24POPB4BCVSJOT4ZFKK3Q, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548158312 (7h37m31.279425942s) [noise=true , address=104.36.82.60:4342 , piece_id=GTKAIDOMRHEEWSS2H64BVSLX245AYHVVIXORCJKFMSIAC7VGOZLQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548182277 (7h37m31.279449907s) [noise=true , address=104.36.82.16:4311 , piece_id=WHQMSXMRLD5QRU6GYEPX2U7YTK7OBEHBKHJXWU2YKBZBA4SQJNEA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548510239 (7h37m31.27977787s) [noise=true , address=104.36.82.21:4479 , piece_id=ZKGGJ6T7MZETBH7P72Y4MHWMTK2CAYR5PYQEGNNN7XOYV63BG2HQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548553630 (7h37m31.27982126s) [noise=true , address=104.36.82.44:4897 , piece_id=YMDI7WR2P3M2HTRDLQNCC24ZU2NRRBH6JDJEHOY6WEBK6KKO5PBQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548917339 (7h37m31.280184959s) [noise=true , address=104.36.82.38:4710 , piece_id=AYQ2JWIS4Y6ECJOPZLL3VO7UEL3LAU72EDKKBZBE77G3XHRUKT3A, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548924042 (7h37m31.280191682s) [noise=true , address=104.36.82.17:4332 , piece_id=NRWIFJYUBAMBJ3FBMRXE3YZTREOENZYWB6J4BJLXIIPQKKXNVRUQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548959829 (7h37m31.280227459s) [noise=true , address=104.36.82.53:4144 , piece_id=AZ4C2TJSHYEVYUUEYI7K7QHHBQVAG6NMP2BJALLEE7IY5YFD6FZA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549302238 (7h37m31.280569868s) [noise=true , address=104.36.82.39:4737 , piece_id=AMV62VOAKHJUZCZWNEYGJKY572LWVJZMANNMQEQIS2HHKR3YVRSQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549314360 (7h37m31.28058199s) [noise=true , address=104.36.82.11:4122 , piece_id=HOAEVCU5N4KLGF7O7ZZJC7YC5OB4VZOZIDKDTQTTOR4TU5T3IZXQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549666998 (7h37m31.280934628s) [noise=true , address=104.36.82.4:4812 , piece_id=VKHFSCHUKZFGXRICZGSICWUTOK2BFMG6LAIC67ORAFN7S44SOPPQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.550026399 (7h37m31.281294019s) [noise=true , address=104.36.82.46:4498 , piece_id=C7HSUOEHMVCU5BX3XGAO4LWIGKXPE2IR6U7EOUBSJDSN3CIVRPPQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.550347188 (7h37m31.281614818s) [noise=true , address=104.36.82.62:4440 , piece_id=45DAJ7PILLSEBZICG7W7KKUR7ENYPF57DM2JA5COJV7IWRFB7KTQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.551515258 (7h37m31.282782888s) [noise=true , address=104.36.82.9:4029 , piece_id=LUA5Q3ZUO3SZI24ZPZGXIRLEMBZX3XQFYJQMCY6E4SXMBQTHSAGA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.553639614 (7h37m31.284907244s) [noise=true , address=104.36.82.34:4578 , piece_id=WROE2XH3WOMRAJ4OJBD5LGCCTUMI7ECXHO6HYYRXYNBNBPN7I5ZQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.654119682 (7h37m31.385387312s) [upload=7928]: Next returned nil segment Aug 9 01:03:50.654133758 (7h37m31.385401378s) [upload=7928]: Waiting for error group managing segments... Aug 9 01:03:50.672101667 (7h37m31.403369288s) [noise=true , address=104.36.82.16:4311 , piece_id=WHQMSXMRLD5QRU6GYEPX2U7YTK7OBEHBKHJXWU2YKBZBA4SQJNEA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.672877525 (7h37m31.404145145s) [noise=true , address=104.36.82.38:4710 , piece_id=AYQ2JWIS4Y6ECJOPZLL3VO7UEL3LAU72EDKKBZBE77G3XHRUKT3A, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.675306269 (7h37m31.406573909s) [noise=true , address=104.36.82.59:4314 , piece_id=SCL4G7EHDMHOWB7MZRTOLBT2TUZL45AE7A3UIKOQ2HCGI4AJLQCA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.675371770 (7h37m31.406639391s) [noise=true , address=104.36.82.37:4665 , piece_id=F5RO7SFTH54IDNLT7KF2TNOQRVZEFODCYG65ONZJ6THD4LZKKJJA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.683603266 (7h37m31.414870896s) [noise=true , address=104.36.82.34:4578 , piece_id=WROE2XH3WOMRAJ4OJBD5LGCCTUMI7ECXHO6HYYRXYNBNBPN7I5ZQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.685155513 (7h37m31.416423133s) [noise=true , address=104.36.82.39:4737 , piece_id=AMV62VOAKHJUZCZWNEYGJKY572LWVJZMANNMQEQIS2HHKR3YVRSQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.685621413 (7h37m31.416889033s) [noise=true , address=104.36.82.53:4144 , piece_id=AZ4C2TJSHYEVYUUEYI7K7QHHBQVAG6NMP2BJALLEE7IY5YFD6FZA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.686461230 (7h37m31.41772886s) [noise=true , address=104.36.82.17:4332 , piece_id=NRWIFJYUBAMBJ3FBMRXE3YZTREOENZYWB6J4BJLXIIPQKKXNVRUQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.686992623 (7h37m31.418260253s) [noise=true , address=104.36.82.12:4173 , piece_id=VBNMKHSMCJKTABCXB2PAGXH65OEUF6LBQXP7XZFNMYOD3H76IPEQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.687219727 (7h37m31.418487347s) [noise=true , address=104.36.82.21:4479 , piece_id=ZKGGJ6T7MZETBH7P72Y4MHWMTK2CAYR5PYQEGNNN7XOYV63BG2HQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.692430363 (7h37m31.423697993s) [noise=true , address=104.36.82.14:4245 , piece_id=4B7WJJILP2ZJ2DIDTPSTI55G67X6IBC24POPB4BCVSJOT4ZFKK3Q, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.707237672 (7h37m31.438505302s) [noise=true , address=104.36.82.9:4029 , piece_id=LUA5Q3ZUO3SZI24ZPZGXIRLEMBZX3XQFYJQMCY6E4SXMBQTHSAGA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.716934623 (7h37m31.448202253s) [noise=true , address=104.36.82.4:4812 , piece_id=VKHFSCHUKZFGXRICZGSICWUTOK2BFMG6LAIC67ORAFN7S44SOPPQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.766972144 (7h37m31.498239774s) [noise=true , address=104.36.82.44:4897 , piece_id=YMDI7WR2P3M2HTRDLQNCC24ZU2NRRBH6JDJEHOY6WEBK6KKO5PBQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.766989206 (7h37m31.498256836s) [seg_pos={0 0}, upload=7928]: Segment reached optimal threshold of 14 pieces. Aug 9 01:03:50.767124678 (7h37m31.498392309s) [noise=true , address=104.36.82.62:4440 , piece_id=45DAJ7PILLSEBZICG7W7KKUR7ENYPF57DM2JA5COJV7IWRFB7KTQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jvc3V5SqNUTwbUea883sp3jsPPu1PAzJaUwcjPjxdjm3JiF2L): protocol: write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection; write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection Aug 9 01:03:50.767270229 (7h37m31.49853786s) [noise=true , address=104.36.82.60:4342 , piece_id=GTKAIDOMRHEEWSS2H64BVSLX245AYHVVIXORCJKFMSIAC7VGOZLQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB): protocol: read tcp 5.161.89.252:54032->104.36.82.60:4342: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 9 01:03:50.767296629 (7h37m31.498564249s) [noise=true , address=104.36.82.46:4498 , piece_id=C7HSUOEHMVCU5BX3XGAO4LWIGKXPE2IR6U7EOUBSJDSN3CIVRPPQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jyjxdWkBRBkDHSKknNmPdcnJ3HRcSCUQNnmpb1CaiEdMPEGk4): protocol: expected piece hash; context canceled; EOF Aug 9 01:03:50.767313812 (7h37m31.498581442s) [noise=true , address=104.36.82.11:4122 , piece_id=HOAEVCU5N4KLGF7O7ZZJC7YC5OB4VZOZIDKDTQTTOR4TU5T3IZXQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1oCu75zR8YccTunHjctcLzTrr9wTQqtAPXHiWrsQs41o8gxgh6): protocol: write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection; write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection Aug 9 01:03:50.767324712 (7h37m31.498592332s) [seg_pos={0 0}, upload=7928]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 01:03:50.767376188 (7h37m31.498643818s) [upload=7928]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 01:03:50.767381278 (7h37m31.498648908s) [upload=7928]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 01:03:50.890154929 (7h37m31.621422559s) [upload=7928]: Done uploading segments... Aug 9 01:03:50.890168986 (7h37m31.621436606s) [upload=7928]: Upload finished. err: <nil> Duration: 685.581797ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 148.183392ms FAIL (2025-08-09 01:07:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:52:13.986283699 (7h25m54.71755135s) [upload=7723]: Starting upload Aug 9 00:52:13.986408060 (7h25m54.717675711s) [upload=7723]: Done starting upload Aug 9 00:52:13.986481939 (7h25m54.71774956s) [upload=7723]: Uploading segments... Aug 9 00:52:13.986553753 (7h25m54.717821373s) [upload=7723]: Got next segment. Inline: true Aug 9 00:52:13.986558031 (7h25m54.717825641s) [upload=7723]: Waiting for error group managing segments... Aug 9 00:52:13.986608676 (7h25m54.717876296s) [upload=7723]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 00:52:13.986612834 (7h25m54.717880454s) [upload=7723]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 00:52:13.986615108 (7h25m54.717882728s) [upload=7723]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 00:52:13.989421897 (7h25m54.720689516s) [upload=7723]: Done uploading segments... Aug 9 00:52:13.989431464 (7h25m54.720699084s) [upload=7723]: Upload finished. err: metaclient: Too Many Requests Duration:* 148.203349ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.........................X.......X..............X......X....] duration: 713.043799ms FAIL (2025-08-09 01:06:41 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 9 01:03:50.521251227 (7h37m31.252518857s) [upload=7928]: Starting upload Aug 9 01:03:50.521308083 (7h37m31.252575713s) [upload=7928]: Done starting upload Aug 9 01:03:50.521407979 (7h37m31.252675609s) [upload=7928]: Uploading segments... Aug 9 01:03:50.521679086 (7h37m31.252946716s) [upload=7928]: Got next segment. Inline: false Aug 9 01:03:50.521722226 (7h37m31.252989866s) [upload=7928]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:03:50.521727255 (7h37m31.252994885s) [upload=7928]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 01:03:50.547289380 (7h37m31.278557001s) [seg_pos={0 0}, upload=7928]: Begin upload segment... Aug 9 01:03:50.547314256 (7h37m31.278581886s) [seg_pos={0 0}, upload=7928]: Done begin upload segment. Aug 9 01:03:50.547335476 (7h37m31.278603116s) [noise=true , address=104.36.82.12:4173 , piece_id=VBNMKHSMCJKTABCXB2PAGXH65OEUF6LBQXP7XZFNMYOD3H76IPEQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547382454 (7h37m31.278650084s) [noise=true , address=104.36.82.37:4665 , piece_id=F5RO7SFTH54IDNLT7KF2TNOQRVZEFODCYG65ONZJ6THD4LZKKJJA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547771219 (7h37m31.27903884s) [noise=true , address=104.36.82.59:4314 , piece_id=SCL4G7EHDMHOWB7MZRTOLBT2TUZL45AE7A3UIKOQ2HCGI4AJLQCA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547817245 (7h37m31.279084875s) [noise=true , address=104.36.82.14:4245 , piece_id=4B7WJJILP2ZJ2DIDTPSTI55G67X6IBC24POPB4BCVSJOT4ZFKK3Q, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548158312 (7h37m31.279425942s) [noise=true , address=104.36.82.60:4342 , piece_id=GTKAIDOMRHEEWSS2H64BVSLX245AYHVVIXORCJKFMSIAC7VGOZLQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548182277 (7h37m31.279449907s) [noise=true , address=104.36.82.16:4311 , piece_id=WHQMSXMRLD5QRU6GYEPX2U7YTK7OBEHBKHJXWU2YKBZBA4SQJNEA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548510239 (7h37m31.27977787s) [noise=true , address=104.36.82.21:4479 , piece_id=ZKGGJ6T7MZETBH7P72Y4MHWMTK2CAYR5PYQEGNNN7XOYV63BG2HQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548553630 (7h37m31.27982126s) [noise=true , address=104.36.82.44:4897 , piece_id=YMDI7WR2P3M2HTRDLQNCC24ZU2NRRBH6JDJEHOY6WEBK6KKO5PBQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548917339 (7h37m31.280184959s) [noise=true , address=104.36.82.38:4710 , piece_id=AYQ2JWIS4Y6ECJOPZLL3VO7UEL3LAU72EDKKBZBE77G3XHRUKT3A, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548924042 (7h37m31.280191682s) [noise=true , address=104.36.82.17:4332 , piece_id=NRWIFJYUBAMBJ3FBMRXE3YZTREOENZYWB6J4BJLXIIPQKKXNVRUQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548959829 (7h37m31.280227459s) [noise=true , address=104.36.82.53:4144 , piece_id=AZ4C2TJSHYEVYUUEYI7K7QHHBQVAG6NMP2BJALLEE7IY5YFD6FZA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549302238 (7h37m31.280569868s) [noise=true , address=104.36.82.39:4737 , piece_id=AMV62VOAKHJUZCZWNEYGJKY572LWVJZMANNMQEQIS2HHKR3YVRSQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549314360 (7h37m31.28058199s) [noise=true , address=104.36.82.11:4122 , piece_id=HOAEVCU5N4KLGF7O7ZZJC7YC5OB4VZOZIDKDTQTTOR4TU5T3IZXQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549666998 (7h37m31.280934628s) [noise=true , address=104.36.82.4:4812 , piece_id=VKHFSCHUKZFGXRICZGSICWUTOK2BFMG6LAIC67ORAFN7S44SOPPQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.550026399 (7h37m31.281294019s) [noise=true , address=104.36.82.46:4498 , piece_id=C7HSUOEHMVCU5BX3XGAO4LWIGKXPE2IR6U7EOUBSJDSN3CIVRPPQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.550347188 (7h37m31.281614818s) [noise=true , address=104.36.82.62:4440 , piece_id=45DAJ7PILLSEBZICG7W7KKUR7ENYPF57DM2JA5COJV7IWRFB7KTQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.551515258 (7h37m31.282782888s) [noise=true , address=104.36.82.9:4029 , piece_id=LUA5Q3ZUO3SZI24ZPZGXIRLEMBZX3XQFYJQMCY6E4SXMBQTHSAGA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.553639614 (7h37m31.284907244s) [noise=true , address=104.36.82.34:4578 , piece_id=WROE2XH3WOMRAJ4OJBD5LGCCTUMI7ECXHO6HYYRXYNBNBPN7I5ZQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.654119682 (7h37m31.385387312s) [upload=7928]: Next returned nil segment Aug 9 01:03:50.654133758 (7h37m31.385401378s) [upload=7928]: Waiting for error group managing segments... Aug 9 01:03:50.672101667 (7h37m31.403369288s) [noise=true , address=104.36.82.16:4311 , piece_id=WHQMSXMRLD5QRU6GYEPX2U7YTK7OBEHBKHJXWU2YKBZBA4SQJNEA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.672877525 (7h37m31.404145145s) [noise=true , address=104.36.82.38:4710 , piece_id=AYQ2JWIS4Y6ECJOPZLL3VO7UEL3LAU72EDKKBZBE77G3XHRUKT3A, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.675306269 (7h37m31.406573909s) [noise=true , address=104.36.82.59:4314 , piece_id=SCL4G7EHDMHOWB7MZRTOLBT2TUZL45AE7A3UIKOQ2HCGI4AJLQCA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.675371770 (7h37m31.406639391s) [noise=true , address=104.36.82.37:4665 , piece_id=F5RO7SFTH54IDNLT7KF2TNOQRVZEFODCYG65ONZJ6THD4LZKKJJA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.683603266 (7h37m31.414870896s) [noise=true , address=104.36.82.34:4578 , piece_id=WROE2XH3WOMRAJ4OJBD5LGCCTUMI7ECXHO6HYYRXYNBNBPN7I5ZQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.685155513 (7h37m31.416423133s) [noise=true , address=104.36.82.39:4737 , piece_id=AMV62VOAKHJUZCZWNEYGJKY572LWVJZMANNMQEQIS2HHKR3YVRSQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.685621413 (7h37m31.416889033s) [noise=true , address=104.36.82.53:4144 , piece_id=AZ4C2TJSHYEVYUUEYI7K7QHHBQVAG6NMP2BJALLEE7IY5YFD6FZA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.686461230 (7h37m31.41772886s) [noise=true , address=104.36.82.17:4332 , piece_id=NRWIFJYUBAMBJ3FBMRXE3YZTREOENZYWB6J4BJLXIIPQKKXNVRUQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.686992623 (7h37m31.418260253s) [noise=true , address=104.36.82.12:4173 , piece_id=VBNMKHSMCJKTABCXB2PAGXH65OEUF6LBQXP7XZFNMYOD3H76IPEQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.687219727 (7h37m31.418487347s) [noise=true , address=104.36.82.21:4479 , piece_id=ZKGGJ6T7MZETBH7P72Y4MHWMTK2CAYR5PYQEGNNN7XOYV63BG2HQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.692430363 (7h37m31.423697993s) [noise=true , address=104.36.82.14:4245 , piece_id=4B7WJJILP2ZJ2DIDTPSTI55G67X6IBC24POPB4BCVSJOT4ZFKK3Q, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.707237672 (7h37m31.438505302s) [noise=true , address=104.36.82.9:4029 , piece_id=LUA5Q3ZUO3SZI24ZPZGXIRLEMBZX3XQFYJQMCY6E4SXMBQTHSAGA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.716934623 (7h37m31.448202253s) [noise=true , address=104.36.82.4:4812 , piece_id=VKHFSCHUKZFGXRICZGSICWUTOK2BFMG6LAIC67ORAFN7S44SOPPQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.766972144 (7h37m31.498239774s) [noise=true , address=104.36.82.44:4897 , piece_id=YMDI7WR2P3M2HTRDLQNCC24ZU2NRRBH6JDJEHOY6WEBK6KKO5PBQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.766989206 (7h37m31.498256836s) [seg_pos={0 0}, upload=7928]: Segment reached optimal threshold of 14 pieces. Aug 9 01:03:50.767124678 (7h37m31.498392309s) [noise=true , address=104.36.82.62:4440 , piece_id=45DAJ7PILLSEBZICG7W7KKUR7ENYPF57DM2JA5COJV7IWRFB7KTQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jvc3V5SqNUTwbUea883sp3jsPPu1PAzJaUwcjPjxdjm3JiF2L): protocol: write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection; write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection Aug 9 01:03:50.767270229 (7h37m31.49853786s) [noise=true , address=104.36.82.60:4342 , piece_id=GTKAIDOMRHEEWSS2H64BVSLX245AYHVVIXORCJKFMSIAC7VGOZLQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB): protocol: read tcp 5.161.89.252:54032->104.36.82.60:4342: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 9 01:03:50.767296629 (7h37m31.498564249s) [noise=true , address=104.36.82.46:4498 , piece_id=C7HSUOEHMVCU5BX3XGAO4LWIGKXPE2IR6U7EOUBSJDSN3CIVRPPQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jyjxdWkBRBkDHSKknNmPdcnJ3HRcSCUQNnmpb1CaiEdMPEGk4): protocol: expected piece hash; context canceled; EOF Aug 9 01:03:50.767313812 (7h37m31.498581442s) [noise=true , address=104.36.82.11:4122 , piece_id=HOAEVCU5N4KLGF7O7ZZJC7YC5OB4VZOZIDKDTQTTOR4TU5T3IZXQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1oCu75zR8YccTunHjctcLzTrr9wTQqtAPXHiWrsQs41o8gxgh6): protocol: write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection; write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection Aug 9 01:03:50.767324712 (7h37m31.498592332s) [seg_pos={0 0}, upload=7928]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 01:03:50.767376188 (7h37m31.498643818s) [upload=7928]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 01:03:50.767381278 (7h37m31.498648908s) [upload=7928]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 01:03:50.890154929 (7h37m31.621422559s) [upload=7928]: Done uploading segments... Aug 9 01:03:50.890168986 (7h37m31.621436606s) [upload=7928]: Upload finished. err: <nil> Duration: 713.063314ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 172.288617ms FAIL (2025-08-09 01:06:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:52:13.986283699 (7h25m54.71755135s) [upload=7723]: Starting upload Aug 9 00:52:13.986408060 (7h25m54.717675711s) [upload=7723]: Done starting upload Aug 9 00:52:13.986481939 (7h25m54.71774956s) [upload=7723]: Uploading segments... Aug 9 00:52:13.986553753 (7h25m54.717821373s) [upload=7723]: Got next segment. Inline: true Aug 9 00:52:13.986558031 (7h25m54.717825641s) [upload=7723]: Waiting for error group managing segments... Aug 9 00:52:13.986608676 (7h25m54.717876296s) [upload=7723]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 00:52:13.986612834 (7h25m54.717880454s) [upload=7723]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 00:52:13.986615108 (7h25m54.717882728s) [upload=7723]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 00:52:13.989421897 (7h25m54.720689516s) [upload=7723]: Done uploading segments... Aug 9 00:52:13.989431464 (7h25m54.720699084s) [upload=7723]: Upload finished. err: metaclient: Too Many Requests Duration:* 172.307242ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..........................X.......X..............X......X...] duration: 629.049525ms FAIL (2025-08-09 01:05:42 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 9 01:03:50.521251227 (7h37m31.252518857s) [upload=7928]: Starting upload Aug 9 01:03:50.521308083 (7h37m31.252575713s) [upload=7928]: Done starting upload Aug 9 01:03:50.521407979 (7h37m31.252675609s) [upload=7928]: Uploading segments... Aug 9 01:03:50.521679086 (7h37m31.252946716s) [upload=7928]: Got next segment. Inline: false Aug 9 01:03:50.521722226 (7h37m31.252989866s) [upload=7928]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:03:50.521727255 (7h37m31.252994885s) [upload=7928]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 01:03:50.547289380 (7h37m31.278557001s) [seg_pos={0 0}, upload=7928]: Begin upload segment... Aug 9 01:03:50.547314256 (7h37m31.278581886s) [seg_pos={0 0}, upload=7928]: Done begin upload segment. Aug 9 01:03:50.547335476 (7h37m31.278603116s) [noise=true , address=104.36.82.12:4173 , piece_id=VBNMKHSMCJKTABCXB2PAGXH65OEUF6LBQXP7XZFNMYOD3H76IPEQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547382454 (7h37m31.278650084s) [noise=true , address=104.36.82.37:4665 , piece_id=F5RO7SFTH54IDNLT7KF2TNOQRVZEFODCYG65ONZJ6THD4LZKKJJA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547771219 (7h37m31.27903884s) [noise=true , address=104.36.82.59:4314 , piece_id=SCL4G7EHDMHOWB7MZRTOLBT2TUZL45AE7A3UIKOQ2HCGI4AJLQCA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.547817245 (7h37m31.279084875s) [noise=true , address=104.36.82.14:4245 , piece_id=4B7WJJILP2ZJ2DIDTPSTI55G67X6IBC24POPB4BCVSJOT4ZFKK3Q, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548158312 (7h37m31.279425942s) [noise=true , address=104.36.82.60:4342 , piece_id=GTKAIDOMRHEEWSS2H64BVSLX245AYHVVIXORCJKFMSIAC7VGOZLQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548182277 (7h37m31.279449907s) [noise=true , address=104.36.82.16:4311 , piece_id=WHQMSXMRLD5QRU6GYEPX2U7YTK7OBEHBKHJXWU2YKBZBA4SQJNEA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548510239 (7h37m31.27977787s) [noise=true , address=104.36.82.21:4479 , piece_id=ZKGGJ6T7MZETBH7P72Y4MHWMTK2CAYR5PYQEGNNN7XOYV63BG2HQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548553630 (7h37m31.27982126s) [noise=true , address=104.36.82.44:4897 , piece_id=YMDI7WR2P3M2HTRDLQNCC24ZU2NRRBH6JDJEHOY6WEBK6KKO5PBQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548917339 (7h37m31.280184959s) [noise=true , address=104.36.82.38:4710 , piece_id=AYQ2JWIS4Y6ECJOPZLL3VO7UEL3LAU72EDKKBZBE77G3XHRUKT3A, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548924042 (7h37m31.280191682s) [noise=true , address=104.36.82.17:4332 , piece_id=NRWIFJYUBAMBJ3FBMRXE3YZTREOENZYWB6J4BJLXIIPQKKXNVRUQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.548959829 (7h37m31.280227459s) [noise=true , address=104.36.82.53:4144 , piece_id=AZ4C2TJSHYEVYUUEYI7K7QHHBQVAG6NMP2BJALLEE7IY5YFD6FZA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549302238 (7h37m31.280569868s) [noise=true , address=104.36.82.39:4737 , piece_id=AMV62VOAKHJUZCZWNEYGJKY572LWVJZMANNMQEQIS2HHKR3YVRSQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549314360 (7h37m31.28058199s) [noise=true , address=104.36.82.11:4122 , piece_id=HOAEVCU5N4KLGF7O7ZZJC7YC5OB4VZOZIDKDTQTTOR4TU5T3IZXQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.549666998 (7h37m31.280934628s) [noise=true , address=104.36.82.4:4812 , piece_id=VKHFSCHUKZFGXRICZGSICWUTOK2BFMG6LAIC67ORAFN7S44SOPPQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.550026399 (7h37m31.281294019s) [noise=true , address=104.36.82.46:4498 , piece_id=C7HSUOEHMVCU5BX3XGAO4LWIGKXPE2IR6U7EOUBSJDSN3CIVRPPQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.550347188 (7h37m31.281614818s) [noise=true , address=104.36.82.62:4440 , piece_id=45DAJ7PILLSEBZICG7W7KKUR7ENYPF57DM2JA5COJV7IWRFB7KTQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.551515258 (7h37m31.282782888s) [noise=true , address=104.36.82.9:4029 , piece_id=LUA5Q3ZUO3SZI24ZPZGXIRLEMBZX3XQFYJQMCY6E4SXMBQTHSAGA, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.553639614 (7h37m31.284907244s) [noise=true , address=104.36.82.34:4578 , piece_id=WROE2XH3WOMRAJ4OJBD5LGCCTUMI7ECXHO6HYYRXYNBNBPN7I5ZQ, seg_pos={0 0}, upload=7928]: Uploading piece... Aug 9 01:03:50.654119682 (7h37m31.385387312s) [upload=7928]: Next returned nil segment Aug 9 01:03:50.654133758 (7h37m31.385401378s) [upload=7928]: Waiting for error group managing segments... Aug 9 01:03:50.672101667 (7h37m31.403369288s) [noise=true , address=104.36.82.16:4311 , piece_id=WHQMSXMRLD5QRU6GYEPX2U7YTK7OBEHBKHJXWU2YKBZBA4SQJNEA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.672877525 (7h37m31.404145145s) [noise=true , address=104.36.82.38:4710 , piece_id=AYQ2JWIS4Y6ECJOPZLL3VO7UEL3LAU72EDKKBZBE77G3XHRUKT3A, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.675306269 (7h37m31.406573909s) [noise=true , address=104.36.82.59:4314 , piece_id=SCL4G7EHDMHOWB7MZRTOLBT2TUZL45AE7A3UIKOQ2HCGI4AJLQCA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.675371770 (7h37m31.406639391s) [noise=true , address=104.36.82.37:4665 , piece_id=F5RO7SFTH54IDNLT7KF2TNOQRVZEFODCYG65ONZJ6THD4LZKKJJA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.683603266 (7h37m31.414870896s) [noise=true , address=104.36.82.34:4578 , piece_id=WROE2XH3WOMRAJ4OJBD5LGCCTUMI7ECXHO6HYYRXYNBNBPN7I5ZQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.685155513 (7h37m31.416423133s) [noise=true , address=104.36.82.39:4737 , piece_id=AMV62VOAKHJUZCZWNEYGJKY572LWVJZMANNMQEQIS2HHKR3YVRSQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.685621413 (7h37m31.416889033s) [noise=true , address=104.36.82.53:4144 , piece_id=AZ4C2TJSHYEVYUUEYI7K7QHHBQVAG6NMP2BJALLEE7IY5YFD6FZA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.686461230 (7h37m31.41772886s) [noise=true , address=104.36.82.17:4332 , piece_id=NRWIFJYUBAMBJ3FBMRXE3YZTREOENZYWB6J4BJLXIIPQKKXNVRUQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.686992623 (7h37m31.418260253s) [noise=true , address=104.36.82.12:4173 , piece_id=VBNMKHSMCJKTABCXB2PAGXH65OEUF6LBQXP7XZFNMYOD3H76IPEQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.687219727 (7h37m31.418487347s) [noise=true , address=104.36.82.21:4479 , piece_id=ZKGGJ6T7MZETBH7P72Y4MHWMTK2CAYR5PYQEGNNN7XOYV63BG2HQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.692430363 (7h37m31.423697993s) [noise=true , address=104.36.82.14:4245 , piece_id=4B7WJJILP2ZJ2DIDTPSTI55G67X6IBC24POPB4BCVSJOT4ZFKK3Q, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.707237672 (7h37m31.438505302s) [noise=true , address=104.36.82.9:4029 , piece_id=LUA5Q3ZUO3SZI24ZPZGXIRLEMBZX3XQFYJQMCY6E4SXMBQTHSAGA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.716934623 (7h37m31.448202253s) [noise=true , address=104.36.82.4:4812 , piece_id=VKHFSCHUKZFGXRICZGSICWUTOK2BFMG6LAIC67ORAFN7S44SOPPQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.766972144 (7h37m31.498239774s) [noise=true , address=104.36.82.44:4897 , piece_id=YMDI7WR2P3M2HTRDLQNCC24ZU2NRRBH6JDJEHOY6WEBK6KKO5PBQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil> Aug 9 01:03:50.766989206 (7h37m31.498256836s) [seg_pos={0 0}, upload=7928]: Segment reached optimal threshold of 14 pieces. Aug 9 01:03:50.767124678 (7h37m31.498392309s) [noise=true , address=104.36.82.62:4440 , piece_id=45DAJ7PILLSEBZICG7W7KKUR7ENYPF57DM2JA5COJV7IWRFB7KTQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jvc3V5SqNUTwbUea883sp3jsPPu1PAzJaUwcjPjxdjm3JiF2L): protocol: write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection; write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection Aug 9 01:03:50.767270229 (7h37m31.49853786s) [noise=true , address=104.36.82.60:4342 , piece_id=GTKAIDOMRHEEWSS2H64BVSLX245AYHVVIXORCJKFMSIAC7VGOZLQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB): protocol: read tcp 5.161.89.252:54032->104.36.82.60:4342: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 9 01:03:50.767296629 (7h37m31.498564249s) [noise=true , address=104.36.82.46:4498 , piece_id=C7HSUOEHMVCU5BX3XGAO4LWIGKXPE2IR6U7EOUBSJDSN3CIVRPPQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jyjxdWkBRBkDHSKknNmPdcnJ3HRcSCUQNnmpb1CaiEdMPEGk4): protocol: expected piece hash; context canceled; EOF Aug 9 01:03:50.767313812 (7h37m31.498581442s) [noise=true , address=104.36.82.11:4122 , piece_id=HOAEVCU5N4KLGF7O7ZZJC7YC5OB4VZOZIDKDTQTTOR4TU5T3IZXQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1oCu75zR8YccTunHjctcLzTrr9wTQqtAPXHiWrsQs41o8gxgh6): protocol: write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection; write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection Aug 9 01:03:50.767324712 (7h37m31.498592332s) [seg_pos={0 0}, upload=7928]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 01:03:50.767376188 (7h37m31.498643818s) [upload=7928]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 01:03:50.767381278 (7h37m31.498648908s) [upload=7928]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 01:03:50.890154929 (7h37m31.621422559s) [upload=7928]: Done uploading segments... Aug 9 01:03:50.890168986 (7h37m31.621436606s) [upload=7928]: Upload finished. err: <nil> Duration: 629.075122ms core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)