Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
191.759841ms
FAIL (2025-08-09 01:05:34 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:52:13.986283699 (7h25m54.71755135s) [upload=7723]: Starting upload Aug 9 00:52:13.986408060 (7h25m54.717675711s) [upload=7723]: Done starting upload Aug 9 00:52:13.986481939 (7h25m54.71774956s) [upload=7723]: Uploading segments... Aug 9 00:52:13.986553753 (7h25m54.717821373s) [upload=7723]: Got next segment. Inline: true Aug 9 00:52:13.986558031 (7h25m54.717825641s) [upload=7723]: Waiting for error group managing segments... Aug 9 00:52:13.986608676 (7h25m54.717876296s) [upload=7723]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 00:52:13.986612834 (7h25m54.717880454s) [upload=7723]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 00:52:13.986615108 (7h25m54.717882728s) [upload=7723]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 00:52:13.989421897 (7h25m54.720689516s) [upload=7723]: Done uploading segments... Aug 9 00:52:13.989431464 (7h25m54.720699084s) [upload=7723]: Upload finished. err: metaclient: Too Many Requests
Duration: 191.79208ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...........................X.......X..............X......X..] duration:
665.667247ms
FAIL (2025-08-09 01:04:44 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 9 01:03:50.521251227 (7h37m31.252518857s) [upload=7928]: Starting upload
Aug 9 01:03:50.521308083 (7h37m31.252575713s) [upload=7928]: Done starting upload
Aug 9 01:03:50.521407979 (7h37m31.252675609s) [upload=7928]: Uploading segments...
Aug 9 01:03:50.521679086 (7h37m31.252946716s) [upload=7928]: Got next segment. Inline: false
Aug 9 01:03:50.521722226 (7h37m31.252989866s) [upload=7928]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 01:03:50.521727255 (7h37m31.252994885s) [upload=7928]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 01:03:50.547289380 (7h37m31.278557001s) [seg_pos={0 0}, upload=7928]: Begin upload segment...
Aug 9 01:03:50.547314256 (7h37m31.278581886s) [seg_pos={0 0}, upload=7928]: Done begin upload segment.
Aug 9 01:03:50.547335476 (7h37m31.278603116s) [noise=true , address=104.36.82.12:4173 , piece_id=VBNMKHSMCJKTABCXB2PAGXH65OEUF6LBQXP7XZFNMYOD3H76IPEQ, seg_pos={0 0}, upload=7928]: Uploading piece...
Aug 9 01:03:50.547382454 (7h37m31.278650084s) [noise=true , address=104.36.82.37:4665 , piece_id=F5RO7SFTH54IDNLT7KF2TNOQRVZEFODCYG65ONZJ6THD4LZKKJJA, seg_pos={0 0}, upload=7928]: Uploading piece...
Aug 9 01:03:50.547771219 (7h37m31.27903884s) [noise=true , address=104.36.82.59:4314 , piece_id=SCL4G7EHDMHOWB7MZRTOLBT2TUZL45AE7A3UIKOQ2HCGI4AJLQCA, seg_pos={0 0}, upload=7928]: Uploading piece...
Aug 9 01:03:50.547817245 (7h37m31.279084875s) [noise=true , address=104.36.82.14:4245 , piece_id=4B7WJJILP2ZJ2DIDTPSTI55G67X6IBC24POPB4BCVSJOT4ZFKK3Q, seg_pos={0 0}, upload=7928]: Uploading piece...
Aug 9 01:03:50.548158312 (7h37m31.279425942s) [noise=true , address=104.36.82.60:4342 , piece_id=GTKAIDOMRHEEWSS2H64BVSLX245AYHVVIXORCJKFMSIAC7VGOZLQ, seg_pos={0 0}, upload=7928]: Uploading piece...
Aug 9 01:03:50.548182277 (7h37m31.279449907s) [noise=true , address=104.36.82.16:4311 , piece_id=WHQMSXMRLD5QRU6GYEPX2U7YTK7OBEHBKHJXWU2YKBZBA4SQJNEA, seg_pos={0 0}, upload=7928]: Uploading piece...
Aug 9 01:03:50.548510239 (7h37m31.27977787s) [noise=true , address=104.36.82.21:4479 , piece_id=ZKGGJ6T7MZETBH7P72Y4MHWMTK2CAYR5PYQEGNNN7XOYV63BG2HQ, seg_pos={0 0}, upload=7928]: Uploading piece...
Aug 9 01:03:50.548553630 (7h37m31.27982126s) [noise=true , address=104.36.82.44:4897 , piece_id=YMDI7WR2P3M2HTRDLQNCC24ZU2NRRBH6JDJEHOY6WEBK6KKO5PBQ, seg_pos={0 0}, upload=7928]: Uploading piece...
Aug 9 01:03:50.548917339 (7h37m31.280184959s) [noise=true , address=104.36.82.38:4710 , piece_id=AYQ2JWIS4Y6ECJOPZLL3VO7UEL3LAU72EDKKBZBE77G3XHRUKT3A, seg_pos={0 0}, upload=7928]: Uploading piece...
Aug 9 01:03:50.548924042 (7h37m31.280191682s) [noise=true , address=104.36.82.17:4332 , piece_id=NRWIFJYUBAMBJ3FBMRXE3YZTREOENZYWB6J4BJLXIIPQKKXNVRUQ, seg_pos={0 0}, upload=7928]: Uploading piece...
Aug 9 01:03:50.548959829 (7h37m31.280227459s) [noise=true , address=104.36.82.53:4144 , piece_id=AZ4C2TJSHYEVYUUEYI7K7QHHBQVAG6NMP2BJALLEE7IY5YFD6FZA, seg_pos={0 0}, upload=7928]: Uploading piece...
Aug 9 01:03:50.549302238 (7h37m31.280569868s) [noise=true , address=104.36.82.39:4737 , piece_id=AMV62VOAKHJUZCZWNEYGJKY572LWVJZMANNMQEQIS2HHKR3YVRSQ, seg_pos={0 0}, upload=7928]: Uploading piece...
Aug 9 01:03:50.549314360 (7h37m31.28058199s) [noise=true , address=104.36.82.11:4122 , piece_id=HOAEVCU5N4KLGF7O7ZZJC7YC5OB4VZOZIDKDTQTTOR4TU5T3IZXQ, seg_pos={0 0}, upload=7928]: Uploading piece...
Aug 9 01:03:50.549666998 (7h37m31.280934628s) [noise=true , address=104.36.82.4:4812 , piece_id=VKHFSCHUKZFGXRICZGSICWUTOK2BFMG6LAIC67ORAFN7S44SOPPQ, seg_pos={0 0}, upload=7928]: Uploading piece...
Aug 9 01:03:50.550026399 (7h37m31.281294019s) [noise=true , address=104.36.82.46:4498 , piece_id=C7HSUOEHMVCU5BX3XGAO4LWIGKXPE2IR6U7EOUBSJDSN3CIVRPPQ, seg_pos={0 0}, upload=7928]: Uploading piece...
Aug 9 01:03:50.550347188 (7h37m31.281614818s) [noise=true , address=104.36.82.62:4440 , piece_id=45DAJ7PILLSEBZICG7W7KKUR7ENYPF57DM2JA5COJV7IWRFB7KTQ, seg_pos={0 0}, upload=7928]: Uploading piece...
Aug 9 01:03:50.551515258 (7h37m31.282782888s) [noise=true , address=104.36.82.9:4029 , piece_id=LUA5Q3ZUO3SZI24ZPZGXIRLEMBZX3XQFYJQMCY6E4SXMBQTHSAGA, seg_pos={0 0}, upload=7928]: Uploading piece...
Aug 9 01:03:50.553639614 (7h37m31.284907244s) [noise=true , address=104.36.82.34:4578 , piece_id=WROE2XH3WOMRAJ4OJBD5LGCCTUMI7ECXHO6HYYRXYNBNBPN7I5ZQ, seg_pos={0 0}, upload=7928]: Uploading piece...
Aug 9 01:03:50.654119682 (7h37m31.385387312s) [upload=7928]: Next returned nil segment
Aug 9 01:03:50.654133758 (7h37m31.385401378s) [upload=7928]: Waiting for error group managing segments...
Aug 9 01:03:50.672101667 (7h37m31.403369288s) [noise=true , address=104.36.82.16:4311 , piece_id=WHQMSXMRLD5QRU6GYEPX2U7YTK7OBEHBKHJXWU2YKBZBA4SQJNEA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil>
Aug 9 01:03:50.672877525 (7h37m31.404145145s) [noise=true , address=104.36.82.38:4710 , piece_id=AYQ2JWIS4Y6ECJOPZLL3VO7UEL3LAU72EDKKBZBE77G3XHRUKT3A, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil>
Aug 9 01:03:50.675306269 (7h37m31.406573909s) [noise=true , address=104.36.82.59:4314 , piece_id=SCL4G7EHDMHOWB7MZRTOLBT2TUZL45AE7A3UIKOQ2HCGI4AJLQCA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil>
Aug 9 01:03:50.675371770 (7h37m31.406639391s) [noise=true , address=104.36.82.37:4665 , piece_id=F5RO7SFTH54IDNLT7KF2TNOQRVZEFODCYG65ONZJ6THD4LZKKJJA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil>
Aug 9 01:03:50.683603266 (7h37m31.414870896s) [noise=true , address=104.36.82.34:4578 , piece_id=WROE2XH3WOMRAJ4OJBD5LGCCTUMI7ECXHO6HYYRXYNBNBPN7I5ZQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil>
Aug 9 01:03:50.685155513 (7h37m31.416423133s) [noise=true , address=104.36.82.39:4737 , piece_id=AMV62VOAKHJUZCZWNEYGJKY572LWVJZMANNMQEQIS2HHKR3YVRSQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil>
Aug 9 01:03:50.685621413 (7h37m31.416889033s) [noise=true , address=104.36.82.53:4144 , piece_id=AZ4C2TJSHYEVYUUEYI7K7QHHBQVAG6NMP2BJALLEE7IY5YFD6FZA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil>
Aug 9 01:03:50.686461230 (7h37m31.41772886s) [noise=true , address=104.36.82.17:4332 , piece_id=NRWIFJYUBAMBJ3FBMRXE3YZTREOENZYWB6J4BJLXIIPQKKXNVRUQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil>
Aug 9 01:03:50.686992623 (7h37m31.418260253s) [noise=true , address=104.36.82.12:4173 , piece_id=VBNMKHSMCJKTABCXB2PAGXH65OEUF6LBQXP7XZFNMYOD3H76IPEQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil>
Aug 9 01:03:50.687219727 (7h37m31.418487347s) [noise=true , address=104.36.82.21:4479 , piece_id=ZKGGJ6T7MZETBH7P72Y4MHWMTK2CAYR5PYQEGNNN7XOYV63BG2HQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil>
Aug 9 01:03:50.692430363 (7h37m31.423697993s) [noise=true , address=104.36.82.14:4245 , piece_id=4B7WJJILP2ZJ2DIDTPSTI55G67X6IBC24POPB4BCVSJOT4ZFKK3Q, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil>
Aug 9 01:03:50.707237672 (7h37m31.438505302s) [noise=true , address=104.36.82.9:4029 , piece_id=LUA5Q3ZUO3SZI24ZPZGXIRLEMBZX3XQFYJQMCY6E4SXMBQTHSAGA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil>
Aug 9 01:03:50.716934623 (7h37m31.448202253s) [noise=true , address=104.36.82.4:4812 , piece_id=VKHFSCHUKZFGXRICZGSICWUTOK2BFMG6LAIC67ORAFN7S44SOPPQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil>
Aug 9 01:03:50.766972144 (7h37m31.498239774s) [noise=true , address=104.36.82.44:4897 , piece_id=YMDI7WR2P3M2HTRDLQNCC24ZU2NRRBH6JDJEHOY6WEBK6KKO5PBQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil>
Aug 9 01:03:50.766989206 (7h37m31.498256836s) [seg_pos={0 0}, upload=7928]: Segment reached optimal threshold of 14 pieces.
Aug 9 01:03:50.767124678 (7h37m31.498392309s) [noise=true , address=104.36.82.62:4440 , piece_id=45DAJ7PILLSEBZICG7W7KKUR7ENYPF57DM2JA5COJV7IWRFB7KTQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jvc3V5SqNUTwbUea883sp3jsPPu1PAzJaUwcjPjxdjm3JiF2L): protocol: write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection; write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection
Aug 9 01:03:50.767270229 (7h37m31.49853786s) [noise=true , address=104.36.82.60:4342 , piece_id=GTKAIDOMRHEEWSS2H64BVSLX245AYHVVIXORCJKFMSIAC7VGOZLQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB): protocol: read tcp 5.161.89.252:54032->104.36.82.60:4342: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 01:03:50.767296629 (7h37m31.498564249s) [noise=true , address=104.36.82.46:4498 , piece_id=C7HSUOEHMVCU5BX3XGAO4LWIGKXPE2IR6U7EOUBSJDSN3CIVRPPQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jyjxdWkBRBkDHSKknNmPdcnJ3HRcSCUQNnmpb1CaiEdMPEGk4): protocol: expected piece hash; context canceled; EOF
Aug 9 01:03:50.767313812 (7h37m31.498581442s) [noise=true , address=104.36.82.11:4122 , piece_id=HOAEVCU5N4KLGF7O7ZZJC7YC5OB4VZOZIDKDTQTTOR4TU5T3IZXQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1oCu75zR8YccTunHjctcLzTrr9wTQqtAPXHiWrsQs41o8gxgh6): protocol: write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection; write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection
Aug 9 01:03:50.767324712 (7h37m31.498592332s) [seg_pos={0 0}, upload=7928]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 01:03:50.767376188 (7h37m31.498643818s) [upload=7928]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 01:03:50.767381278 (7h37m31.498648908s) [upload=7928]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 01:03:50.890154929 (7h37m31.621422559s) [upload=7928]: Done uploading segments...
Aug 9 01:03:50.890168986 (7h37m31.621436606s) [upload=7928]: Upload finished. err: <nil>
Duration: 665.695599ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
515.128687ms
FAIL (2025-08-09 01:04:36 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:52:13.986283699 (7h25m54.71755135s) [upload=7723]: Starting upload Aug 9 00:52:13.986408060 (7h25m54.717675711s) [upload=7723]: Done starting upload Aug 9 00:52:13.986481939 (7h25m54.71774956s) [upload=7723]: Uploading segments... Aug 9 00:52:13.986553753 (7h25m54.717821373s) [upload=7723]: Got next segment. Inline: true Aug 9 00:52:13.986558031 (7h25m54.717825641s) [upload=7723]: Waiting for error group managing segments... Aug 9 00:52:13.986608676 (7h25m54.717876296s) [upload=7723]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 00:52:13.986612834 (7h25m54.717880454s) [upload=7723]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 00:52:13.986615108 (7h25m54.717882728s) [upload=7723]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 00:52:13.989421897 (7h25m54.720689516s) [upload=7723]: Done uploading segments... Aug 9 00:52:13.989431464 (7h25m54.720699084s) [upload=7723]: Upload finished. err: metaclient: Too Many Requests
Duration: 515.152201ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [............................X.......X..............X......X.] duration:
537.511191ms
FAIL (2025-08-09 01:04:12 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 9 01:03:50.521251227 (7h37m31.252518857s) [upload=7928]: Starting upload
Aug 9 01:03:50.521308083 (7h37m31.252575713s) [upload=7928]: Done starting upload
Aug 9 01:03:50.521407979 (7h37m31.252675609s) [upload=7928]: Uploading segments...
Aug 9 01:03:50.521679086 (7h37m31.252946716s) [upload=7928]: Got next segment. Inline: false
Aug 9 01:03:50.521722226 (7h37m31.252989866s) [upload=7928]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 01:03:50.521727255 (7h37m31.252994885s) [upload=7928]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 01:03:50.547289380 (7h37m31.278557001s) [seg_pos={0 0}, upload=7928]: Begin upload segment...
Aug 9 01:03:50.547314256 (7h37m31.278581886s) [seg_pos={0 0}, upload=7928]: Done begin upload segment.
Aug 9 01:03:50.547335476 (7h37m31.278603116s) [noise=true , address=104.36.82.12:4173 , piece_id=VBNMKHSMCJKTABCXB2PAGXH65OEUF6LBQXP7XZFNMYOD3H76IPEQ, seg_pos={0 0}, upload=7928]: Uploading piece...
Aug 9 01:03:50.547382454 (7h37m31.278650084s) [noise=true , address=104.36.82.37:4665 , piece_id=F5RO7SFTH54IDNLT7KF2TNOQRVZEFODCYG65ONZJ6THD4LZKKJJA, seg_pos={0 0}, upload=7928]: Uploading piece...
Aug 9 01:03:50.547771219 (7h37m31.27903884s) [noise=true , address=104.36.82.59:4314 , piece_id=SCL4G7EHDMHOWB7MZRTOLBT2TUZL45AE7A3UIKOQ2HCGI4AJLQCA, seg_pos={0 0}, upload=7928]: Uploading piece...
Aug 9 01:03:50.547817245 (7h37m31.279084875s) [noise=true , address=104.36.82.14:4245 , piece_id=4B7WJJILP2ZJ2DIDTPSTI55G67X6IBC24POPB4BCVSJOT4ZFKK3Q, seg_pos={0 0}, upload=7928]: Uploading piece...
Aug 9 01:03:50.548158312 (7h37m31.279425942s) [noise=true , address=104.36.82.60:4342 , piece_id=GTKAIDOMRHEEWSS2H64BVSLX245AYHVVIXORCJKFMSIAC7VGOZLQ, seg_pos={0 0}, upload=7928]: Uploading piece...
Aug 9 01:03:50.548182277 (7h37m31.279449907s) [noise=true , address=104.36.82.16:4311 , piece_id=WHQMSXMRLD5QRU6GYEPX2U7YTK7OBEHBKHJXWU2YKBZBA4SQJNEA, seg_pos={0 0}, upload=7928]: Uploading piece...
Aug 9 01:03:50.548510239 (7h37m31.27977787s) [noise=true , address=104.36.82.21:4479 , piece_id=ZKGGJ6T7MZETBH7P72Y4MHWMTK2CAYR5PYQEGNNN7XOYV63BG2HQ, seg_pos={0 0}, upload=7928]: Uploading piece...
Aug 9 01:03:50.548553630 (7h37m31.27982126s) [noise=true , address=104.36.82.44:4897 , piece_id=YMDI7WR2P3M2HTRDLQNCC24ZU2NRRBH6JDJEHOY6WEBK6KKO5PBQ, seg_pos={0 0}, upload=7928]: Uploading piece...
Aug 9 01:03:50.548917339 (7h37m31.280184959s) [noise=true , address=104.36.82.38:4710 , piece_id=AYQ2JWIS4Y6ECJOPZLL3VO7UEL3LAU72EDKKBZBE77G3XHRUKT3A, seg_pos={0 0}, upload=7928]: Uploading piece...
Aug 9 01:03:50.548924042 (7h37m31.280191682s) [noise=true , address=104.36.82.17:4332 , piece_id=NRWIFJYUBAMBJ3FBMRXE3YZTREOENZYWB6J4BJLXIIPQKKXNVRUQ, seg_pos={0 0}, upload=7928]: Uploading piece...
Aug 9 01:03:50.548959829 (7h37m31.280227459s) [noise=true , address=104.36.82.53:4144 , piece_id=AZ4C2TJSHYEVYUUEYI7K7QHHBQVAG6NMP2BJALLEE7IY5YFD6FZA, seg_pos={0 0}, upload=7928]: Uploading piece...
Aug 9 01:03:50.549302238 (7h37m31.280569868s) [noise=true , address=104.36.82.39:4737 , piece_id=AMV62VOAKHJUZCZWNEYGJKY572LWVJZMANNMQEQIS2HHKR3YVRSQ, seg_pos={0 0}, upload=7928]: Uploading piece...
Aug 9 01:03:50.549314360 (7h37m31.28058199s) [noise=true , address=104.36.82.11:4122 , piece_id=HOAEVCU5N4KLGF7O7ZZJC7YC5OB4VZOZIDKDTQTTOR4TU5T3IZXQ, seg_pos={0 0}, upload=7928]: Uploading piece...
Aug 9 01:03:50.549666998 (7h37m31.280934628s) [noise=true , address=104.36.82.4:4812 , piece_id=VKHFSCHUKZFGXRICZGSICWUTOK2BFMG6LAIC67ORAFN7S44SOPPQ, seg_pos={0 0}, upload=7928]: Uploading piece...
Aug 9 01:03:50.550026399 (7h37m31.281294019s) [noise=true , address=104.36.82.46:4498 , piece_id=C7HSUOEHMVCU5BX3XGAO4LWIGKXPE2IR6U7EOUBSJDSN3CIVRPPQ, seg_pos={0 0}, upload=7928]: Uploading piece...
Aug 9 01:03:50.550347188 (7h37m31.281614818s) [noise=true , address=104.36.82.62:4440 , piece_id=45DAJ7PILLSEBZICG7W7KKUR7ENYPF57DM2JA5COJV7IWRFB7KTQ, seg_pos={0 0}, upload=7928]: Uploading piece...
Aug 9 01:03:50.551515258 (7h37m31.282782888s) [noise=true , address=104.36.82.9:4029 , piece_id=LUA5Q3ZUO3SZI24ZPZGXIRLEMBZX3XQFYJQMCY6E4SXMBQTHSAGA, seg_pos={0 0}, upload=7928]: Uploading piece...
Aug 9 01:03:50.553639614 (7h37m31.284907244s) [noise=true , address=104.36.82.34:4578 , piece_id=WROE2XH3WOMRAJ4OJBD5LGCCTUMI7ECXHO6HYYRXYNBNBPN7I5ZQ, seg_pos={0 0}, upload=7928]: Uploading piece...
Aug 9 01:03:50.654119682 (7h37m31.385387312s) [upload=7928]: Next returned nil segment
Aug 9 01:03:50.654133758 (7h37m31.385401378s) [upload=7928]: Waiting for error group managing segments...
Aug 9 01:03:50.672101667 (7h37m31.403369288s) [noise=true , address=104.36.82.16:4311 , piece_id=WHQMSXMRLD5QRU6GYEPX2U7YTK7OBEHBKHJXWU2YKBZBA4SQJNEA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil>
Aug 9 01:03:50.672877525 (7h37m31.404145145s) [noise=true , address=104.36.82.38:4710 , piece_id=AYQ2JWIS4Y6ECJOPZLL3VO7UEL3LAU72EDKKBZBE77G3XHRUKT3A, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil>
Aug 9 01:03:50.675306269 (7h37m31.406573909s) [noise=true , address=104.36.82.59:4314 , piece_id=SCL4G7EHDMHOWB7MZRTOLBT2TUZL45AE7A3UIKOQ2HCGI4AJLQCA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil>
Aug 9 01:03:50.675371770 (7h37m31.406639391s) [noise=true , address=104.36.82.37:4665 , piece_id=F5RO7SFTH54IDNLT7KF2TNOQRVZEFODCYG65ONZJ6THD4LZKKJJA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil>
Aug 9 01:03:50.683603266 (7h37m31.414870896s) [noise=true , address=104.36.82.34:4578 , piece_id=WROE2XH3WOMRAJ4OJBD5LGCCTUMI7ECXHO6HYYRXYNBNBPN7I5ZQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil>
Aug 9 01:03:50.685155513 (7h37m31.416423133s) [noise=true , address=104.36.82.39:4737 , piece_id=AMV62VOAKHJUZCZWNEYGJKY572LWVJZMANNMQEQIS2HHKR3YVRSQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil>
Aug 9 01:03:50.685621413 (7h37m31.416889033s) [noise=true , address=104.36.82.53:4144 , piece_id=AZ4C2TJSHYEVYUUEYI7K7QHHBQVAG6NMP2BJALLEE7IY5YFD6FZA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil>
Aug 9 01:03:50.686461230 (7h37m31.41772886s) [noise=true , address=104.36.82.17:4332 , piece_id=NRWIFJYUBAMBJ3FBMRXE3YZTREOENZYWB6J4BJLXIIPQKKXNVRUQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil>
Aug 9 01:03:50.686992623 (7h37m31.418260253s) [noise=true , address=104.36.82.12:4173 , piece_id=VBNMKHSMCJKTABCXB2PAGXH65OEUF6LBQXP7XZFNMYOD3H76IPEQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil>
Aug 9 01:03:50.687219727 (7h37m31.418487347s) [noise=true , address=104.36.82.21:4479 , piece_id=ZKGGJ6T7MZETBH7P72Y4MHWMTK2CAYR5PYQEGNNN7XOYV63BG2HQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil>
Aug 9 01:03:50.692430363 (7h37m31.423697993s) [noise=true , address=104.36.82.14:4245 , piece_id=4B7WJJILP2ZJ2DIDTPSTI55G67X6IBC24POPB4BCVSJOT4ZFKK3Q, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil>
Aug 9 01:03:50.707237672 (7h37m31.438505302s) [noise=true , address=104.36.82.9:4029 , piece_id=LUA5Q3ZUO3SZI24ZPZGXIRLEMBZX3XQFYJQMCY6E4SXMBQTHSAGA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil>
Aug 9 01:03:50.716934623 (7h37m31.448202253s) [noise=true , address=104.36.82.4:4812 , piece_id=VKHFSCHUKZFGXRICZGSICWUTOK2BFMG6LAIC67ORAFN7S44SOPPQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil>
Aug 9 01:03:50.766972144 (7h37m31.498239774s) [noise=true , address=104.36.82.44:4897 , piece_id=YMDI7WR2P3M2HTRDLQNCC24ZU2NRRBH6JDJEHOY6WEBK6KKO5PBQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil>
Aug 9 01:03:50.766989206 (7h37m31.498256836s) [seg_pos={0 0}, upload=7928]: Segment reached optimal threshold of 14 pieces.
Aug 9 01:03:50.767124678 (7h37m31.498392309s) [noise=true , address=104.36.82.62:4440 , piece_id=45DAJ7PILLSEBZICG7W7KKUR7ENYPF57DM2JA5COJV7IWRFB7KTQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jvc3V5SqNUTwbUea883sp3jsPPu1PAzJaUwcjPjxdjm3JiF2L): protocol: write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection; write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection
Aug 9 01:03:50.767270229 (7h37m31.49853786s) [noise=true , address=104.36.82.60:4342 , piece_id=GTKAIDOMRHEEWSS2H64BVSLX245AYHVVIXORCJKFMSIAC7VGOZLQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB): protocol: read tcp 5.161.89.252:54032->104.36.82.60:4342: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 01:03:50.767296629 (7h37m31.498564249s) [noise=true , address=104.36.82.46:4498 , piece_id=C7HSUOEHMVCU5BX3XGAO4LWIGKXPE2IR6U7EOUBSJDSN3CIVRPPQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jyjxdWkBRBkDHSKknNmPdcnJ3HRcSCUQNnmpb1CaiEdMPEGk4): protocol: expected piece hash; context canceled; EOF
Aug 9 01:03:50.767313812 (7h37m31.498581442s) [noise=true , address=104.36.82.11:4122 , piece_id=HOAEVCU5N4KLGF7O7ZZJC7YC5OB4VZOZIDKDTQTTOR4TU5T3IZXQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1oCu75zR8YccTunHjctcLzTrr9wTQqtAPXHiWrsQs41o8gxgh6): protocol: write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection; write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection
Aug 9 01:03:50.767324712 (7h37m31.498592332s) [seg_pos={0 0}, upload=7928]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 01:03:50.767376188 (7h37m31.498643818s) [upload=7928]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 01:03:50.767381278 (7h37m31.498648908s) [upload=7928]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 01:03:50.890154929 (7h37m31.621422559s) [upload=7928]: Done uploading segments...
Aug 9 01:03:50.890168986 (7h37m31.621436606s) [upload=7928]: Upload finished. err: <nil>
Duration: 537.528914ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
178.391896ms
FAIL (2025-08-09 01:03:58 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:52:13.986283699 (7h25m54.71755135s) [upload=7723]: Starting upload Aug 9 00:52:13.986408060 (7h25m54.717675711s) [upload=7723]: Done starting upload Aug 9 00:52:13.986481939 (7h25m54.71774956s) [upload=7723]: Uploading segments... Aug 9 00:52:13.986553753 (7h25m54.717821373s) [upload=7723]: Got next segment. Inline: true Aug 9 00:52:13.986558031 (7h25m54.717825641s) [upload=7723]: Waiting for error group managing segments... Aug 9 00:52:13.986608676 (7h25m54.717876296s) [upload=7723]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 00:52:13.986612834 (7h25m54.717880454s) [upload=7723]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 00:52:13.986615108 (7h25m54.717882728s) [upload=7723]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 00:52:13.989421897 (7h25m54.720689516s) [upload=7723]: Done uploading segments... Aug 9 00:52:13.989431464 (7h25m54.720699084s) [upload=7723]: Upload finished. err: metaclient: Too Many Requests
Duration: 178.41998ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.............................X.......X..............X......X] duration:
480.631676ms
FAIL (2025-08-09 01:03:50 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 9 01:03:50.521251227 (7h37m31.252518857s) [upload=7928]: Starting upload
Aug 9 01:03:50.521308083 (7h37m31.252575713s) [upload=7928]: Done starting upload
Aug 9 01:03:50.521407979 (7h37m31.252675609s) [upload=7928]: Uploading segments...
Aug 9 01:03:50.521679086 (7h37m31.252946716s) [upload=7928]: Got next segment. Inline: false
Aug 9 01:03:50.521722226 (7h37m31.252989866s) [upload=7928]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 01:03:50.521727255 (7h37m31.252994885s) [upload=7928]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 01:03:50.547289380 (7h37m31.278557001s) [seg_pos={0 0}, upload=7928]: Begin upload segment...
Aug 9 01:03:50.547314256 (7h37m31.278581886s) [seg_pos={0 0}, upload=7928]: Done begin upload segment.
Aug 9 01:03:50.547335476 (7h37m31.278603116s) [noise=true , address=104.36.82.12:4173 , piece_id=VBNMKHSMCJKTABCXB2PAGXH65OEUF6LBQXP7XZFNMYOD3H76IPEQ, seg_pos={0 0}, upload=7928]: Uploading piece...
Aug 9 01:03:50.547382454 (7h37m31.278650084s) [noise=true , address=104.36.82.37:4665 , piece_id=F5RO7SFTH54IDNLT7KF2TNOQRVZEFODCYG65ONZJ6THD4LZKKJJA, seg_pos={0 0}, upload=7928]: Uploading piece...
Aug 9 01:03:50.547771219 (7h37m31.27903884s) [noise=true , address=104.36.82.59:4314 , piece_id=SCL4G7EHDMHOWB7MZRTOLBT2TUZL45AE7A3UIKOQ2HCGI4AJLQCA, seg_pos={0 0}, upload=7928]: Uploading piece...
Aug 9 01:03:50.547817245 (7h37m31.279084875s) [noise=true , address=104.36.82.14:4245 , piece_id=4B7WJJILP2ZJ2DIDTPSTI55G67X6IBC24POPB4BCVSJOT4ZFKK3Q, seg_pos={0 0}, upload=7928]: Uploading piece...
Aug 9 01:03:50.548158312 (7h37m31.279425942s) [noise=true , address=104.36.82.60:4342 , piece_id=GTKAIDOMRHEEWSS2H64BVSLX245AYHVVIXORCJKFMSIAC7VGOZLQ, seg_pos={0 0}, upload=7928]: Uploading piece...
Aug 9 01:03:50.548182277 (7h37m31.279449907s) [noise=true , address=104.36.82.16:4311 , piece_id=WHQMSXMRLD5QRU6GYEPX2U7YTK7OBEHBKHJXWU2YKBZBA4SQJNEA, seg_pos={0 0}, upload=7928]: Uploading piece...
Aug 9 01:03:50.548510239 (7h37m31.27977787s) [noise=true , address=104.36.82.21:4479 , piece_id=ZKGGJ6T7MZETBH7P72Y4MHWMTK2CAYR5PYQEGNNN7XOYV63BG2HQ, seg_pos={0 0}, upload=7928]: Uploading piece...
Aug 9 01:03:50.548553630 (7h37m31.27982126s) [noise=true , address=104.36.82.44:4897 , piece_id=YMDI7WR2P3M2HTRDLQNCC24ZU2NRRBH6JDJEHOY6WEBK6KKO5PBQ, seg_pos={0 0}, upload=7928]: Uploading piece...
Aug 9 01:03:50.548917339 (7h37m31.280184959s) [noise=true , address=104.36.82.38:4710 , piece_id=AYQ2JWIS4Y6ECJOPZLL3VO7UEL3LAU72EDKKBZBE77G3XHRUKT3A, seg_pos={0 0}, upload=7928]: Uploading piece...
Aug 9 01:03:50.548924042 (7h37m31.280191682s) [noise=true , address=104.36.82.17:4332 , piece_id=NRWIFJYUBAMBJ3FBMRXE3YZTREOENZYWB6J4BJLXIIPQKKXNVRUQ, seg_pos={0 0}, upload=7928]: Uploading piece...
Aug 9 01:03:50.548959829 (7h37m31.280227459s) [noise=true , address=104.36.82.53:4144 , piece_id=AZ4C2TJSHYEVYUUEYI7K7QHHBQVAG6NMP2BJALLEE7IY5YFD6FZA, seg_pos={0 0}, upload=7928]: Uploading piece...
Aug 9 01:03:50.549302238 (7h37m31.280569868s) [noise=true , address=104.36.82.39:4737 , piece_id=AMV62VOAKHJUZCZWNEYGJKY572LWVJZMANNMQEQIS2HHKR3YVRSQ, seg_pos={0 0}, upload=7928]: Uploading piece...
Aug 9 01:03:50.549314360 (7h37m31.28058199s) [noise=true , address=104.36.82.11:4122 , piece_id=HOAEVCU5N4KLGF7O7ZZJC7YC5OB4VZOZIDKDTQTTOR4TU5T3IZXQ, seg_pos={0 0}, upload=7928]: Uploading piece...
Aug 9 01:03:50.549666998 (7h37m31.280934628s) [noise=true , address=104.36.82.4:4812 , piece_id=VKHFSCHUKZFGXRICZGSICWUTOK2BFMG6LAIC67ORAFN7S44SOPPQ, seg_pos={0 0}, upload=7928]: Uploading piece...
Aug 9 01:03:50.550026399 (7h37m31.281294019s) [noise=true , address=104.36.82.46:4498 , piece_id=C7HSUOEHMVCU5BX3XGAO4LWIGKXPE2IR6U7EOUBSJDSN3CIVRPPQ, seg_pos={0 0}, upload=7928]: Uploading piece...
Aug 9 01:03:50.550347188 (7h37m31.281614818s) [noise=true , address=104.36.82.62:4440 , piece_id=45DAJ7PILLSEBZICG7W7KKUR7ENYPF57DM2JA5COJV7IWRFB7KTQ, seg_pos={0 0}, upload=7928]: Uploading piece...
Aug 9 01:03:50.551515258 (7h37m31.282782888s) [noise=true , address=104.36.82.9:4029 , piece_id=LUA5Q3ZUO3SZI24ZPZGXIRLEMBZX3XQFYJQMCY6E4SXMBQTHSAGA, seg_pos={0 0}, upload=7928]: Uploading piece...
Aug 9 01:03:50.553639614 (7h37m31.284907244s) [noise=true , address=104.36.82.34:4578 , piece_id=WROE2XH3WOMRAJ4OJBD5LGCCTUMI7ECXHO6HYYRXYNBNBPN7I5ZQ, seg_pos={0 0}, upload=7928]: Uploading piece...
Aug 9 01:03:50.654119682 (7h37m31.385387312s) [upload=7928]: Next returned nil segment
Aug 9 01:03:50.654133758 (7h37m31.385401378s) [upload=7928]: Waiting for error group managing segments...
Aug 9 01:03:50.672101667 (7h37m31.403369288s) [noise=true , address=104.36.82.16:4311 , piece_id=WHQMSXMRLD5QRU6GYEPX2U7YTK7OBEHBKHJXWU2YKBZBA4SQJNEA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil>
Aug 9 01:03:50.672877525 (7h37m31.404145145s) [noise=true , address=104.36.82.38:4710 , piece_id=AYQ2JWIS4Y6ECJOPZLL3VO7UEL3LAU72EDKKBZBE77G3XHRUKT3A, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil>
Aug 9 01:03:50.675306269 (7h37m31.406573909s) [noise=true , address=104.36.82.59:4314 , piece_id=SCL4G7EHDMHOWB7MZRTOLBT2TUZL45AE7A3UIKOQ2HCGI4AJLQCA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil>
Aug 9 01:03:50.675371770 (7h37m31.406639391s) [noise=true , address=104.36.82.37:4665 , piece_id=F5RO7SFTH54IDNLT7KF2TNOQRVZEFODCYG65ONZJ6THD4LZKKJJA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil>
Aug 9 01:03:50.683603266 (7h37m31.414870896s) [noise=true , address=104.36.82.34:4578 , piece_id=WROE2XH3WOMRAJ4OJBD5LGCCTUMI7ECXHO6HYYRXYNBNBPN7I5ZQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil>
Aug 9 01:03:50.685155513 (7h37m31.416423133s) [noise=true , address=104.36.82.39:4737 , piece_id=AMV62VOAKHJUZCZWNEYGJKY572LWVJZMANNMQEQIS2HHKR3YVRSQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil>
Aug 9 01:03:50.685621413 (7h37m31.416889033s) [noise=true , address=104.36.82.53:4144 , piece_id=AZ4C2TJSHYEVYUUEYI7K7QHHBQVAG6NMP2BJALLEE7IY5YFD6FZA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil>
Aug 9 01:03:50.686461230 (7h37m31.41772886s) [noise=true , address=104.36.82.17:4332 , piece_id=NRWIFJYUBAMBJ3FBMRXE3YZTREOENZYWB6J4BJLXIIPQKKXNVRUQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil>
Aug 9 01:03:50.686992623 (7h37m31.418260253s) [noise=true , address=104.36.82.12:4173 , piece_id=VBNMKHSMCJKTABCXB2PAGXH65OEUF6LBQXP7XZFNMYOD3H76IPEQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil>
Aug 9 01:03:50.687219727 (7h37m31.418487347s) [noise=true , address=104.36.82.21:4479 , piece_id=ZKGGJ6T7MZETBH7P72Y4MHWMTK2CAYR5PYQEGNNN7XOYV63BG2HQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil>
Aug 9 01:03:50.692430363 (7h37m31.423697993s) [noise=true , address=104.36.82.14:4245 , piece_id=4B7WJJILP2ZJ2DIDTPSTI55G67X6IBC24POPB4BCVSJOT4ZFKK3Q, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil>
Aug 9 01:03:50.707237672 (7h37m31.438505302s) [noise=true , address=104.36.82.9:4029 , piece_id=LUA5Q3ZUO3SZI24ZPZGXIRLEMBZX3XQFYJQMCY6E4SXMBQTHSAGA, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil>
Aug 9 01:03:50.716934623 (7h37m31.448202253s) [noise=true , address=104.36.82.4:4812 , piece_id=VKHFSCHUKZFGXRICZGSICWUTOK2BFMG6LAIC67ORAFN7S44SOPPQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil>
Aug 9 01:03:50.766972144 (7h37m31.498239774s) [noise=true , address=104.36.82.44:4897 , piece_id=YMDI7WR2P3M2HTRDLQNCC24ZU2NRRBH6JDJEHOY6WEBK6KKO5PBQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: <nil>
Aug 9 01:03:50.766989206 (7h37m31.498256836s) [seg_pos={0 0}, upload=7928]: Segment reached optimal threshold of 14 pieces.
Aug 9 01:03:50.767124678 (7h37m31.498392309s) [noise=true , address=104.36.82.62:4440 , piece_id=45DAJ7PILLSEBZICG7W7KKUR7ENYPF57DM2JA5COJV7IWRFB7KTQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jvc3V5SqNUTwbUea883sp3jsPPu1PAzJaUwcjPjxdjm3JiF2L): protocol: write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection; write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:19332->104.36.82.62:4440: use of closed network connection
Aug 9 01:03:50.767270229 (7h37m31.49853786s) [noise=true , address=104.36.82.60:4342 , piece_id=GTKAIDOMRHEEWSS2H64BVSLX245AYHVVIXORCJKFMSIAC7VGOZLQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB): protocol: read tcp 5.161.89.252:54032->104.36.82.60:4342: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 01:03:50.767296629 (7h37m31.498564249s) [noise=true , address=104.36.82.46:4498 , piece_id=C7HSUOEHMVCU5BX3XGAO4LWIGKXPE2IR6U7EOUBSJDSN3CIVRPPQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jyjxdWkBRBkDHSKknNmPdcnJ3HRcSCUQNnmpb1CaiEdMPEGk4): protocol: expected piece hash; context canceled; EOF
Aug 9 01:03:50.767313812 (7h37m31.498581442s) [noise=true , address=104.36.82.11:4122 , piece_id=HOAEVCU5N4KLGF7O7ZZJC7YC5OB4VZOZIDKDTQTTOR4TU5T3IZXQ, seg_pos={0 0}, upload=7928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1oCu75zR8YccTunHjctcLzTrr9wTQqtAPXHiWrsQs41o8gxgh6): protocol: write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection; write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:36002->104.36.82.11:4122: use of closed network connection
Aug 9 01:03:50.767324712 (7h37m31.498592332s) [seg_pos={0 0}, upload=7928]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 01:03:50.767376188 (7h37m31.498643818s) [upload=7928]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 01:03:50.767381278 (7h37m31.498648908s) [upload=7928]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 01:03:50.890154929 (7h37m31.621422559s) [upload=7928]: Done uploading segments...
Aug 9 01:03:50.890168986 (7h37m31.621436606s) [upload=7928]: Upload finished. err: <nil>
Duration: 480.653236ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..............................X.......X..............X......] duration:
1.208861969s
FAIL (2025-08-09 01:03:13 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:58:55.611432878 (7h32m36.342700498s) [upload=7842]: Starting upload Aug 9 00:58:55.611478363 (7h32m36.342745993s) [upload=7842]: Done starting upload Aug 9 00:58:55.611582637 (7h32m36.342850257s) [upload=7842]: Uploading segments... Aug 9 00:58:55.611929314 (7h32m36.343196934s) [upload=7842]: Got next segment. Inline: false Aug 9 00:58:55.611969570 (7h32m36.34323719s) [upload=7842]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 00:58:55.611996149 (7h32m36.3432638s) [upload=7842]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 00:58:55.614881525 (7h32m36.346149145s) [upload=7842]: Next segment err: metaclient: Too Many Requests Aug 9 00:58:55.614894008 (7h32m36.346161628s) [upload=7842]: Done uploading segments... Aug 9 00:58:55.614905530 (7h32m36.34617315s) [upload=7842]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.208889511s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
159.276257ms
FAIL (2025-08-09 01:02:52 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:52:13.986283699 (7h25m54.71755135s) [upload=7723]: Starting upload Aug 9 00:52:13.986408060 (7h25m54.717675711s) [upload=7723]: Done starting upload Aug 9 00:52:13.986481939 (7h25m54.71774956s) [upload=7723]: Uploading segments... Aug 9 00:52:13.986553753 (7h25m54.717821373s) [upload=7723]: Got next segment. Inline: true Aug 9 00:52:13.986558031 (7h25m54.717825641s) [upload=7723]: Waiting for error group managing segments... Aug 9 00:52:13.986608676 (7h25m54.717876296s) [upload=7723]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 00:52:13.986612834 (7h25m54.717880454s) [upload=7723]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 00:52:13.986615108 (7h25m54.717882728s) [upload=7723]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 00:52:13.989421897 (7h25m54.720689516s) [upload=7723]: Done uploading segments... Aug 9 00:52:13.989431464 (7h25m54.720699084s) [upload=7723]: Upload finished. err: metaclient: Too Many Requests
Duration: 159.293991ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...............................X.......X..............X.....] duration:
1.356145053s
FAIL (2025-08-09 01:02:28 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:58:55.611432878 (7h32m36.342700498s) [upload=7842]: Starting upload Aug 9 00:58:55.611478363 (7h32m36.342745993s) [upload=7842]: Done starting upload Aug 9 00:58:55.611582637 (7h32m36.342850257s) [upload=7842]: Uploading segments... Aug 9 00:58:55.611929314 (7h32m36.343196934s) [upload=7842]: Got next segment. Inline: false Aug 9 00:58:55.611969570 (7h32m36.34323719s) [upload=7842]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 00:58:55.611996149 (7h32m36.3432638s) [upload=7842]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 00:58:55.614881525 (7h32m36.346149145s) [upload=7842]: Next segment err: metaclient: Too Many Requests Aug 9 00:58:55.614894008 (7h32m36.346161628s) [upload=7842]: Done uploading segments... Aug 9 00:58:55.614905530 (7h32m36.34617315s) [upload=7842]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.356166543s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
223.313221ms
FAIL (2025-08-09 01:02:15 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:52:13.986283699 (7h25m54.71755135s) [upload=7723]: Starting upload Aug 9 00:52:13.986408060 (7h25m54.717675711s) [upload=7723]: Done starting upload Aug 9 00:52:13.986481939 (7h25m54.71774956s) [upload=7723]: Uploading segments... Aug 9 00:52:13.986553753 (7h25m54.717821373s) [upload=7723]: Got next segment. Inline: true Aug 9 00:52:13.986558031 (7h25m54.717825641s) [upload=7723]: Waiting for error group managing segments... Aug 9 00:52:13.986608676 (7h25m54.717876296s) [upload=7723]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 00:52:13.986612834 (7h25m54.717880454s) [upload=7723]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 00:52:13.986615108 (7h25m54.717882728s) [upload=7723]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 00:52:13.989421897 (7h25m54.720689516s) [upload=7723]: Done uploading segments... Aug 9 00:52:13.989431464 (7h25m54.720699084s) [upload=7723]: Upload finished. err: metaclient: Too Many Requests
Duration: 223.342767ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [................................X.......X..............X....] duration:
602.943985ms
FAIL (2025-08-09 01:02:00 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:58:55.611432878 (7h32m36.342700498s) [upload=7842]: Starting upload Aug 9 00:58:55.611478363 (7h32m36.342745993s) [upload=7842]: Done starting upload Aug 9 00:58:55.611582637 (7h32m36.342850257s) [upload=7842]: Uploading segments... Aug 9 00:58:55.611929314 (7h32m36.343196934s) [upload=7842]: Got next segment. Inline: false Aug 9 00:58:55.611969570 (7h32m36.34323719s) [upload=7842]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 00:58:55.611996149 (7h32m36.3432638s) [upload=7842]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 00:58:55.614881525 (7h32m36.346149145s) [upload=7842]: Next segment err: metaclient: Too Many Requests Aug 9 00:58:55.614894008 (7h32m36.346161628s) [upload=7842]: Done uploading segments... Aug 9 00:58:55.614905530 (7h32m36.34617315s) [upload=7842]: Upload finished. err: metaclient: Too Many Requests
Duration: 602.964174ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.................................X.......X..............X...] duration:
1.190270891s
FAIL (2025-08-09 01:01:20 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:58:55.611432878 (7h32m36.342700498s) [upload=7842]: Starting upload Aug 9 00:58:55.611478363 (7h32m36.342745993s) [upload=7842]: Done starting upload Aug 9 00:58:55.611582637 (7h32m36.342850257s) [upload=7842]: Uploading segments... Aug 9 00:58:55.611929314 (7h32m36.343196934s) [upload=7842]: Got next segment. Inline: false Aug 9 00:58:55.611969570 (7h32m36.34323719s) [upload=7842]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 00:58:55.611996149 (7h32m36.3432638s) [upload=7842]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 00:58:55.614881525 (7h32m36.346149145s) [upload=7842]: Next segment err: metaclient: Too Many Requests Aug 9 00:58:55.614894008 (7h32m36.346161628s) [upload=7842]: Done uploading segments... Aug 9 00:58:55.614905530 (7h32m36.34617315s) [upload=7842]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.190290748s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
146.987118ms
FAIL (2025-08-09 01:01:09 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:52:13.986283699 (7h25m54.71755135s) [upload=7723]: Starting upload Aug 9 00:52:13.986408060 (7h25m54.717675711s) [upload=7723]: Done starting upload Aug 9 00:52:13.986481939 (7h25m54.71774956s) [upload=7723]: Uploading segments... Aug 9 00:52:13.986553753 (7h25m54.717821373s) [upload=7723]: Got next segment. Inline: true Aug 9 00:52:13.986558031 (7h25m54.717825641s) [upload=7723]: Waiting for error group managing segments... Aug 9 00:52:13.986608676 (7h25m54.717876296s) [upload=7723]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 00:52:13.986612834 (7h25m54.717880454s) [upload=7723]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 00:52:13.986615108 (7h25m54.717882728s) [upload=7723]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 00:52:13.989421897 (7h25m54.720689516s) [upload=7723]: Done uploading segments... Aug 9 00:52:13.989431464 (7h25m54.720699084s) [upload=7723]: Upload finished. err: metaclient: Too Many Requests
Duration: 147.005331ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
178.825279ms
FAIL (2025-08-09 01:00:53 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:52:13.986283699 (7h25m54.71755135s) [upload=7723]: Starting upload Aug 9 00:52:13.986408060 (7h25m54.717675711s) [upload=7723]: Done starting upload Aug 9 00:52:13.986481939 (7h25m54.71774956s) [upload=7723]: Uploading segments... Aug 9 00:52:13.986553753 (7h25m54.717821373s) [upload=7723]: Got next segment. Inline: true Aug 9 00:52:13.986558031 (7h25m54.717825641s) [upload=7723]: Waiting for error group managing segments... Aug 9 00:52:13.986608676 (7h25m54.717876296s) [upload=7723]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 00:52:13.986612834 (7h25m54.717880454s) [upload=7723]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 00:52:13.986615108 (7h25m54.717882728s) [upload=7723]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 00:52:13.989421897 (7h25m54.720689516s) [upload=7723]: Done uploading segments... Aug 9 00:52:13.989431464 (7h25m54.720699084s) [upload=7723]: Upload finished. err: metaclient: Too Many Requests
Duration: 178.844705ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..................................X.......X..............X..] duration:
1.309634665s
FAIL (2025-08-09 01:00:24 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:58:55.611432878 (7h32m36.342700498s) [upload=7842]: Starting upload Aug 9 00:58:55.611478363 (7h32m36.342745993s) [upload=7842]: Done starting upload Aug 9 00:58:55.611582637 (7h32m36.342850257s) [upload=7842]: Uploading segments... Aug 9 00:58:55.611929314 (7h32m36.343196934s) [upload=7842]: Got next segment. Inline: false Aug 9 00:58:55.611969570 (7h32m36.34323719s) [upload=7842]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 00:58:55.611996149 (7h32m36.3432638s) [upload=7842]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 00:58:55.614881525 (7h32m36.346149145s) [upload=7842]: Next segment err: metaclient: Too Many Requests Aug 9 00:58:55.614894008 (7h32m36.346161628s) [upload=7842]: Done uploading segments... Aug 9 00:58:55.614905530 (7h32m36.34617315s) [upload=7842]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.309657588s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
195.268948ms
FAIL (2025-08-09 01:00:07 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:52:13.986283699 (7h25m54.71755135s) [upload=7723]: Starting upload Aug 9 00:52:13.986408060 (7h25m54.717675711s) [upload=7723]: Done starting upload Aug 9 00:52:13.986481939 (7h25m54.71774956s) [upload=7723]: Uploading segments... Aug 9 00:52:13.986553753 (7h25m54.717821373s) [upload=7723]: Got next segment. Inline: true Aug 9 00:52:13.986558031 (7h25m54.717825641s) [upload=7723]: Waiting for error group managing segments... Aug 9 00:52:13.986608676 (7h25m54.717876296s) [upload=7723]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 00:52:13.986612834 (7h25m54.717880454s) [upload=7723]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 00:52:13.986615108 (7h25m54.717882728s) [upload=7723]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 00:52:13.989421897 (7h25m54.720689516s) [upload=7723]: Done uploading segments... Aug 9 00:52:13.989431464 (7h25m54.720699084s) [upload=7723]: Upload finished. err: metaclient: Too Many Requests
Duration: 195.295266ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
185.150875ms
FAIL (2025-08-09 00:59:49 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:52:13.986283699 (7h25m54.71755135s) [upload=7723]: Starting upload Aug 9 00:52:13.986408060 (7h25m54.717675711s) [upload=7723]: Done starting upload Aug 9 00:52:13.986481939 (7h25m54.71774956s) [upload=7723]: Uploading segments... Aug 9 00:52:13.986553753 (7h25m54.717821373s) [upload=7723]: Got next segment. Inline: true Aug 9 00:52:13.986558031 (7h25m54.717825641s) [upload=7723]: Waiting for error group managing segments... Aug 9 00:52:13.986608676 (7h25m54.717876296s) [upload=7723]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 00:52:13.986612834 (7h25m54.717880454s) [upload=7723]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 00:52:13.986615108 (7h25m54.717882728s) [upload=7723]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 00:52:13.989421897 (7h25m54.720689516s) [upload=7723]: Done uploading segments... Aug 9 00:52:13.989431464 (7h25m54.720699084s) [upload=7723]: Upload finished. err: metaclient: Too Many Requests
Duration: 185.19063ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...................................X.......X..............X.] duration:
963.515165ms
FAIL (2025-08-09 00:59:38 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:58:55.611432878 (7h32m36.342700498s) [upload=7842]: Starting upload Aug 9 00:58:55.611478363 (7h32m36.342745993s) [upload=7842]: Done starting upload Aug 9 00:58:55.611582637 (7h32m36.342850257s) [upload=7842]: Uploading segments... Aug 9 00:58:55.611929314 (7h32m36.343196934s) [upload=7842]: Got next segment. Inline: false Aug 9 00:58:55.611969570 (7h32m36.34323719s) [upload=7842]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 00:58:55.611996149 (7h32m36.3432638s) [upload=7842]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 00:58:55.614881525 (7h32m36.346149145s) [upload=7842]: Next segment err: metaclient: Too Many Requests Aug 9 00:58:55.614894008 (7h32m36.346161628s) [upload=7842]: Done uploading segments... Aug 9 00:58:55.614905530 (7h32m36.34617315s) [upload=7842]: Upload finished. err: metaclient: Too Many Requests
Duration: 963.551491ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [....................................X.......X..............X] duration:
16.149074ms
FAIL (2025-08-09 00:58:55 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:58:55.611432878 (7h32m36.342700498s) [upload=7842]: Starting upload Aug 9 00:58:55.611478363 (7h32m36.342745993s) [upload=7842]: Done starting upload Aug 9 00:58:55.611582637 (7h32m36.342850257s) [upload=7842]: Uploading segments... Aug 9 00:58:55.611929314 (7h32m36.343196934s) [upload=7842]: Got next segment. Inline: false Aug 9 00:58:55.611969570 (7h32m36.34323719s) [upload=7842]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 00:58:55.611996149 (7h32m36.3432638s) [upload=7842]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 00:58:55.614881525 (7h32m36.346149145s) [upload=7842]: Next segment err: metaclient: Too Many Requests Aug 9 00:58:55.614894008 (7h32m36.346161628s) [upload=7842]: Done uploading segments... Aug 9 00:58:55.614905530 (7h32m36.34617315s) [upload=7842]: Upload finished. err: metaclient: Too Many Requests
Duration: 16.165686ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
182.232528ms
FAIL (2025-08-09 00:58:42 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:52:13.986283699 (7h25m54.71755135s) [upload=7723]: Starting upload Aug 9 00:52:13.986408060 (7h25m54.717675711s) [upload=7723]: Done starting upload Aug 9 00:52:13.986481939 (7h25m54.71774956s) [upload=7723]: Uploading segments... Aug 9 00:52:13.986553753 (7h25m54.717821373s) [upload=7723]: Got next segment. Inline: true Aug 9 00:52:13.986558031 (7h25m54.717825641s) [upload=7723]: Waiting for error group managing segments... Aug 9 00:52:13.986608676 (7h25m54.717876296s) [upload=7723]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 00:52:13.986612834 (7h25m54.717880454s) [upload=7723]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 00:52:13.986615108 (7h25m54.717882728s) [upload=7723]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 00:52:13.989421897 (7h25m54.720689516s) [upload=7723]: Done uploading segments... Aug 9 00:52:13.989431464 (7h25m54.720699084s) [upload=7723]: Upload finished. err: metaclient: Too Many Requests
Duration: 182.254609ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....................................X.......X..............] duration:
987.241913ms
FAIL (2025-08-09 00:58:24 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:49:21.885707185 (7h23m2.616974815s) [upload=7675]: Starting upload Aug 9 00:49:21.885751047 (7h23m2.617018677s) [upload=7675]: Done starting upload Aug 9 00:49:21.885832289 (7h23m2.617099919s) [upload=7675]: Uploading segments... Aug 9 00:49:21.886004210 (7h23m2.617271829s) [upload=7675]: Got next segment. Inline: false Aug 9 00:49:21.886054744 (7h23m2.617322374s) [upload=7675]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 00:49:21.886061847 (7h23m2.617329477s) [upload=7675]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 00:49:21.888190692 (7h23m2.619458322s) [upload=7675]: Next segment err: metaclient: Too Many Requests Aug 9 00:49:21.888204597 (7h23m2.619472256s) [upload=7675]: Done uploading segments... Aug 9 00:49:21.888217872 (7h23m2.619485502s) [upload=7675]: Upload finished. err: metaclient: Too Many Requests
Duration: 987.264216ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
151.692983ms
FAIL (2025-08-09 00:58:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:52:13.986283699 (7h25m54.71755135s) [upload=7723]: Starting upload Aug 9 00:52:13.986408060 (7h25m54.717675711s) [upload=7723]: Done starting upload Aug 9 00:52:13.986481939 (7h25m54.71774956s) [upload=7723]: Uploading segments... Aug 9 00:52:13.986553753 (7h25m54.717821373s) [upload=7723]: Got next segment. Inline: true Aug 9 00:52:13.986558031 (7h25m54.717825641s) [upload=7723]: Waiting for error group managing segments... Aug 9 00:52:13.986608676 (7h25m54.717876296s) [upload=7723]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 00:52:13.986612834 (7h25m54.717880454s) [upload=7723]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 00:52:13.986615108 (7h25m54.717882728s) [upload=7723]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 00:52:13.989421897 (7h25m54.720689516s) [upload=7723]: Done uploading segments... Aug 9 00:52:13.989431464 (7h25m54.720699084s) [upload=7723]: Upload finished. err: metaclient: Too Many Requests
Duration: 151.715675ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
287.540938ms
FAIL (2025-08-09 00:57:54 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:52:13.986283699 (7h25m54.71755135s) [upload=7723]: Starting upload Aug 9 00:52:13.986408060 (7h25m54.717675711s) [upload=7723]: Done starting upload Aug 9 00:52:13.986481939 (7h25m54.71774956s) [upload=7723]: Uploading segments... Aug 9 00:52:13.986553753 (7h25m54.717821373s) [upload=7723]: Got next segment. Inline: true Aug 9 00:52:13.986558031 (7h25m54.717825641s) [upload=7723]: Waiting for error group managing segments... Aug 9 00:52:13.986608676 (7h25m54.717876296s) [upload=7723]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 00:52:13.986612834 (7h25m54.717880454s) [upload=7723]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 00:52:13.986615108 (7h25m54.717882728s) [upload=7723]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 00:52:13.989421897 (7h25m54.720689516s) [upload=7723]: Done uploading segments... Aug 9 00:52:13.989431464 (7h25m54.720699084s) [upload=7723]: Upload finished. err: metaclient: Too Many Requests
Duration: 287.5625ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......................................X.......X.............] duration:
1.018440257s
FAIL (2025-08-09 00:57:34 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:49:21.885707185 (7h23m2.616974815s) [upload=7675]: Starting upload Aug 9 00:49:21.885751047 (7h23m2.617018677s) [upload=7675]: Done starting upload Aug 9 00:49:21.885832289 (7h23m2.617099919s) [upload=7675]: Uploading segments... Aug 9 00:49:21.886004210 (7h23m2.617271829s) [upload=7675]: Got next segment. Inline: false Aug 9 00:49:21.886054744 (7h23m2.617322374s) [upload=7675]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 00:49:21.886061847 (7h23m2.617329477s) [upload=7675]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 00:49:21.888190692 (7h23m2.619458322s) [upload=7675]: Next segment err: metaclient: Too Many Requests Aug 9 00:49:21.888204597 (7h23m2.619472256s) [upload=7675]: Done uploading segments... Aug 9 00:49:21.888217872 (7h23m2.619485502s) [upload=7675]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.018466756s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......................................X.......X............] duration:
3.368935923s
FAIL (2025-08-09 00:57:05 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:49:21.885707185 (7h23m2.616974815s) [upload=7675]: Starting upload Aug 9 00:49:21.885751047 (7h23m2.617018677s) [upload=7675]: Done starting upload Aug 9 00:49:21.885832289 (7h23m2.617099919s) [upload=7675]: Uploading segments... Aug 9 00:49:21.886004210 (7h23m2.617271829s) [upload=7675]: Got next segment. Inline: false Aug 9 00:49:21.886054744 (7h23m2.617322374s) [upload=7675]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 00:49:21.886061847 (7h23m2.617329477s) [upload=7675]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 00:49:21.888190692 (7h23m2.619458322s) [upload=7675]: Next segment err: metaclient: Too Many Requests Aug 9 00:49:21.888204597 (7h23m2.619472256s) [upload=7675]: Done uploading segments... Aug 9 00:49:21.888217872 (7h23m2.619485502s) [upload=7675]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.368979473s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
138.787642ms
FAIL (2025-08-09 00:56:43 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:52:13.986283699 (7h25m54.71755135s) [upload=7723]: Starting upload Aug 9 00:52:13.986408060 (7h25m54.717675711s) [upload=7723]: Done starting upload Aug 9 00:52:13.986481939 (7h25m54.71774956s) [upload=7723]: Uploading segments... Aug 9 00:52:13.986553753 (7h25m54.717821373s) [upload=7723]: Got next segment. Inline: true Aug 9 00:52:13.986558031 (7h25m54.717825641s) [upload=7723]: Waiting for error group managing segments... Aug 9 00:52:13.986608676 (7h25m54.717876296s) [upload=7723]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 00:52:13.986612834 (7h25m54.717880454s) [upload=7723]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 00:52:13.986615108 (7h25m54.717882728s) [upload=7723]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 00:52:13.989421897 (7h25m54.720689516s) [upload=7723]: Done uploading segments... Aug 9 00:52:13.989431464 (7h25m54.720699084s) [upload=7723]: Upload finished. err: metaclient: Too Many Requests
Duration: 138.805865ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........................................X.......X...........] duration:
505.670208ms
FAIL (2025-08-09 00:56:32 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:49:21.885707185 (7h23m2.616974815s) [upload=7675]: Starting upload Aug 9 00:49:21.885751047 (7h23m2.617018677s) [upload=7675]: Done starting upload Aug 9 00:49:21.885832289 (7h23m2.617099919s) [upload=7675]: Uploading segments... Aug 9 00:49:21.886004210 (7h23m2.617271829s) [upload=7675]: Got next segment. Inline: false Aug 9 00:49:21.886054744 (7h23m2.617322374s) [upload=7675]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 00:49:21.886061847 (7h23m2.617329477s) [upload=7675]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 00:49:21.888190692 (7h23m2.619458322s) [upload=7675]: Next segment err: metaclient: Too Many Requests Aug 9 00:49:21.888204597 (7h23m2.619472256s) [upload=7675]: Done uploading segments... Aug 9 00:49:21.888217872 (7h23m2.619485502s) [upload=7675]: Upload finished. err: metaclient: Too Many Requests
Duration: 505.688483ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
159.624937ms
FAIL (2025-08-09 00:55:55 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:52:13.986283699 (7h25m54.71755135s) [upload=7723]: Starting upload Aug 9 00:52:13.986408060 (7h25m54.717675711s) [upload=7723]: Done starting upload Aug 9 00:52:13.986481939 (7h25m54.71774956s) [upload=7723]: Uploading segments... Aug 9 00:52:13.986553753 (7h25m54.717821373s) [upload=7723]: Got next segment. Inline: true Aug 9 00:52:13.986558031 (7h25m54.717825641s) [upload=7723]: Waiting for error group managing segments... Aug 9 00:52:13.986608676 (7h25m54.717876296s) [upload=7723]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 00:52:13.986612834 (7h25m54.717880454s) [upload=7723]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 00:52:13.986615108 (7h25m54.717882728s) [upload=7723]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 00:52:13.989421897 (7h25m54.720689516s) [upload=7723]: Done uploading segments... Aug 9 00:52:13.989431464 (7h25m54.720699084s) [upload=7723]: Upload finished. err: metaclient: Too Many Requests
Duration: 159.644054ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........................................X.......X..........] duration:
823.5394ms
FAIL (2025-08-09 00:55:50 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:49:21.885707185 (7h23m2.616974815s) [upload=7675]: Starting upload Aug 9 00:49:21.885751047 (7h23m2.617018677s) [upload=7675]: Done starting upload Aug 9 00:49:21.885832289 (7h23m2.617099919s) [upload=7675]: Uploading segments... Aug 9 00:49:21.886004210 (7h23m2.617271829s) [upload=7675]: Got next segment. Inline: false Aug 9 00:49:21.886054744 (7h23m2.617322374s) [upload=7675]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 00:49:21.886061847 (7h23m2.617329477s) [upload=7675]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 00:49:21.888190692 (7h23m2.619458322s) [upload=7675]: Next segment err: metaclient: Too Many Requests Aug 9 00:49:21.888204597 (7h23m2.619472256s) [upload=7675]: Done uploading segments... Aug 9 00:49:21.888217872 (7h23m2.619485502s) [upload=7675]: Upload finished. err: metaclient: Too Many Requests
Duration: 823.559256ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........................................X.......X.........] duration:
1.169768039s
FAIL (2025-08-09 00:55:34 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:49:21.885707185 (7h23m2.616974815s) [upload=7675]: Starting upload Aug 9 00:49:21.885751047 (7h23m2.617018677s) [upload=7675]: Done starting upload Aug 9 00:49:21.885832289 (7h23m2.617099919s) [upload=7675]: Uploading segments... Aug 9 00:49:21.886004210 (7h23m2.617271829s) [upload=7675]: Got next segment. Inline: false Aug 9 00:49:21.886054744 (7h23m2.617322374s) [upload=7675]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 00:49:21.886061847 (7h23m2.617329477s) [upload=7675]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 00:49:21.888190692 (7h23m2.619458322s) [upload=7675]: Next segment err: metaclient: Too Many Requests Aug 9 00:49:21.888204597 (7h23m2.619472256s) [upload=7675]: Done uploading segments... Aug 9 00:49:21.888217872 (7h23m2.619485502s) [upload=7675]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.169790562s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........................................X.......X........] duration:
1.060567533s
FAIL (2025-08-09 00:55:13 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:49:21.885707185 (7h23m2.616974815s) [upload=7675]: Starting upload Aug 9 00:49:21.885751047 (7h23m2.617018677s) [upload=7675]: Done starting upload Aug 9 00:49:21.885832289 (7h23m2.617099919s) [upload=7675]: Uploading segments... Aug 9 00:49:21.886004210 (7h23m2.617271829s) [upload=7675]: Got next segment. Inline: false Aug 9 00:49:21.886054744 (7h23m2.617322374s) [upload=7675]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 00:49:21.886061847 (7h23m2.617329477s) [upload=7675]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 00:49:21.888190692 (7h23m2.619458322s) [upload=7675]: Next segment err: metaclient: Too Many Requests Aug 9 00:49:21.888204597 (7h23m2.619472256s) [upload=7675]: Done uploading segments... Aug 9 00:49:21.888217872 (7h23m2.619485502s) [upload=7675]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.060584794s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
183.848715ms
FAIL (2025-08-09 00:54:46 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:52:13.986283699 (7h25m54.71755135s) [upload=7723]: Starting upload Aug 9 00:52:13.986408060 (7h25m54.717675711s) [upload=7723]: Done starting upload Aug 9 00:52:13.986481939 (7h25m54.71774956s) [upload=7723]: Uploading segments... Aug 9 00:52:13.986553753 (7h25m54.717821373s) [upload=7723]: Got next segment. Inline: true Aug 9 00:52:13.986558031 (7h25m54.717825641s) [upload=7723]: Waiting for error group managing segments... Aug 9 00:52:13.986608676 (7h25m54.717876296s) [upload=7723]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 00:52:13.986612834 (7h25m54.717880454s) [upload=7723]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 00:52:13.986615108 (7h25m54.717882728s) [upload=7723]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 00:52:13.989421897 (7h25m54.720689516s) [upload=7723]: Done uploading segments... Aug 9 00:52:13.989431464 (7h25m54.720699084s) [upload=7723]: Upload finished. err: metaclient: Too Many Requests
Duration: 183.871037ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [............................................X.......X.......] duration:
1.381859154s
FAIL (2025-08-09 00:54:37 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:49:21.885707185 (7h23m2.616974815s) [upload=7675]: Starting upload Aug 9 00:49:21.885751047 (7h23m2.617018677s) [upload=7675]: Done starting upload Aug 9 00:49:21.885832289 (7h23m2.617099919s) [upload=7675]: Uploading segments... Aug 9 00:49:21.886004210 (7h23m2.617271829s) [upload=7675]: Got next segment. Inline: false Aug 9 00:49:21.886054744 (7h23m2.617322374s) [upload=7675]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 00:49:21.886061847 (7h23m2.617329477s) [upload=7675]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 00:49:21.888190692 (7h23m2.619458322s) [upload=7675]: Next segment err: metaclient: Too Many Requests Aug 9 00:49:21.888204597 (7h23m2.619472256s) [upload=7675]: Done uploading segments... Aug 9 00:49:21.888217872 (7h23m2.619485502s) [upload=7675]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.381881964s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
202.856928ms
FAIL (2025-08-09 00:54:27 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:52:13.986283699 (7h25m54.71755135s) [upload=7723]: Starting upload Aug 9 00:52:13.986408060 (7h25m54.717675711s) [upload=7723]: Done starting upload Aug 9 00:52:13.986481939 (7h25m54.71774956s) [upload=7723]: Uploading segments... Aug 9 00:52:13.986553753 (7h25m54.717821373s) [upload=7723]: Got next segment. Inline: true Aug 9 00:52:13.986558031 (7h25m54.717825641s) [upload=7723]: Waiting for error group managing segments... Aug 9 00:52:13.986608676 (7h25m54.717876296s) [upload=7723]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 00:52:13.986612834 (7h25m54.717880454s) [upload=7723]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 00:52:13.986615108 (7h25m54.717882728s) [upload=7723]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 00:52:13.989421897 (7h25m54.720689516s) [upload=7723]: Done uploading segments... Aug 9 00:52:13.989431464 (7h25m54.720699084s) [upload=7723]: Upload finished. err: metaclient: Too Many Requests
Duration: 202.875893ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
336.732985ms
FAIL (2025-08-09 00:54:11 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:52:13.986283699 (7h25m54.71755135s) [upload=7723]: Starting upload Aug 9 00:52:13.986408060 (7h25m54.717675711s) [upload=7723]: Done starting upload Aug 9 00:52:13.986481939 (7h25m54.71774956s) [upload=7723]: Uploading segments... Aug 9 00:52:13.986553753 (7h25m54.717821373s) [upload=7723]: Got next segment. Inline: true Aug 9 00:52:13.986558031 (7h25m54.717825641s) [upload=7723]: Waiting for error group managing segments... Aug 9 00:52:13.986608676 (7h25m54.717876296s) [upload=7723]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 00:52:13.986612834 (7h25m54.717880454s) [upload=7723]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 00:52:13.986615108 (7h25m54.717882728s) [upload=7723]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 00:52:13.989421897 (7h25m54.720689516s) [upload=7723]: Done uploading segments... Aug 9 00:52:13.989431464 (7h25m54.720699084s) [upload=7723]: Upload finished. err: metaclient: Too Many Requests
Duration: 336.753363ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............................................X.......X......] duration:
875.868359ms
FAIL (2025-08-09 00:53:33 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:49:21.885707185 (7h23m2.616974815s) [upload=7675]: Starting upload Aug 9 00:49:21.885751047 (7h23m2.617018677s) [upload=7675]: Done starting upload Aug 9 00:49:21.885832289 (7h23m2.617099919s) [upload=7675]: Uploading segments... Aug 9 00:49:21.886004210 (7h23m2.617271829s) [upload=7675]: Got next segment. Inline: false Aug 9 00:49:21.886054744 (7h23m2.617322374s) [upload=7675]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 00:49:21.886061847 (7h23m2.617329477s) [upload=7675]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 00:49:21.888190692 (7h23m2.619458322s) [upload=7675]: Next segment err: metaclient: Too Many Requests Aug 9 00:49:21.888204597 (7h23m2.619472256s) [upload=7675]: Done uploading segments... Aug 9 00:49:21.888217872 (7h23m2.619485502s) [upload=7675]: Upload finished. err: metaclient: Too Many Requests
Duration: 875.891142ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
152.900047ms
FAIL (2025-08-09 00:53:13 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:52:13.986283699 (7h25m54.71755135s) [upload=7723]: Starting upload Aug 9 00:52:13.986408060 (7h25m54.717675711s) [upload=7723]: Done starting upload Aug 9 00:52:13.986481939 (7h25m54.71774956s) [upload=7723]: Uploading segments... Aug 9 00:52:13.986553753 (7h25m54.717821373s) [upload=7723]: Got next segment. Inline: true Aug 9 00:52:13.986558031 (7h25m54.717825641s) [upload=7723]: Waiting for error group managing segments... Aug 9 00:52:13.986608676 (7h25m54.717876296s) [upload=7723]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 00:52:13.986612834 (7h25m54.717880454s) [upload=7723]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 00:52:13.986615108 (7h25m54.717882728s) [upload=7723]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 00:52:13.989421897 (7h25m54.720689516s) [upload=7723]: Done uploading segments... Aug 9 00:52:13.989431464 (7h25m54.720699084s) [upload=7723]: Upload finished. err: metaclient: Too Many Requests
Duration: 152.919323ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............................................X.......X.....] duration:
795.868188ms
FAIL (2025-08-09 00:52:56 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:49:21.885707185 (7h23m2.616974815s) [upload=7675]: Starting upload Aug 9 00:49:21.885751047 (7h23m2.617018677s) [upload=7675]: Done starting upload Aug 9 00:49:21.885832289 (7h23m2.617099919s) [upload=7675]: Uploading segments... Aug 9 00:49:21.886004210 (7h23m2.617271829s) [upload=7675]: Got next segment. Inline: false Aug 9 00:49:21.886054744 (7h23m2.617322374s) [upload=7675]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 00:49:21.886061847 (7h23m2.617329477s) [upload=7675]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 00:49:21.888190692 (7h23m2.619458322s) [upload=7675]: Next segment err: metaclient: Too Many Requests Aug 9 00:49:21.888204597 (7h23m2.619472256s) [upload=7675]: Done uploading segments... Aug 9 00:49:21.888217872 (7h23m2.619485502s) [upload=7675]: Upload finished. err: metaclient: Too Many Requests
Duration: 795.886562ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
20.944746ms
FAIL (2025-08-09 00:52:13 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:52:13.986283699 (7h25m54.71755135s) [upload=7723]: Starting upload Aug 9 00:52:13.986408060 (7h25m54.717675711s) [upload=7723]: Done starting upload Aug 9 00:52:13.986481939 (7h25m54.71774956s) [upload=7723]: Uploading segments... Aug 9 00:52:13.986553753 (7h25m54.717821373s) [upload=7723]: Got next segment. Inline: true Aug 9 00:52:13.986558031 (7h25m54.717825641s) [upload=7723]: Waiting for error group managing segments... Aug 9 00:52:13.986608676 (7h25m54.717876296s) [upload=7723]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 00:52:13.986612834 (7h25m54.717880454s) [upload=7723]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 00:52:13.986615108 (7h25m54.717882728s) [upload=7723]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 00:52:13.989421897 (7h25m54.720689516s) [upload=7723]: Done uploading segments... Aug 9 00:52:13.989431464 (7h25m54.720699084s) [upload=7723]: Upload finished. err: metaclient: Too Many Requests
Duration: 20.964604ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............................................X.......X....] duration:
1.31958995s
FAIL (2025-08-09 00:52:00 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:49:21.885707185 (7h23m2.616974815s) [upload=7675]: Starting upload Aug 9 00:49:21.885751047 (7h23m2.617018677s) [upload=7675]: Done starting upload Aug 9 00:49:21.885832289 (7h23m2.617099919s) [upload=7675]: Uploading segments... Aug 9 00:49:21.886004210 (7h23m2.617271829s) [upload=7675]: Got next segment. Inline: false Aug 9 00:49:21.886054744 (7h23m2.617322374s) [upload=7675]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 00:49:21.886061847 (7h23m2.617329477s) [upload=7675]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 00:49:21.888190692 (7h23m2.619458322s) [upload=7675]: Next segment err: metaclient: Too Many Requests Aug 9 00:49:21.888204597 (7h23m2.619472256s) [upload=7675]: Done uploading segments... Aug 9 00:49:21.888217872 (7h23m2.619485502s) [upload=7675]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.319626769s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [................................................X.......X...] duration:
694.860495ms
FAIL (2025-08-09 00:51:08 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:49:21.885707185 (7h23m2.616974815s) [upload=7675]: Starting upload Aug 9 00:49:21.885751047 (7h23m2.617018677s) [upload=7675]: Done starting upload Aug 9 00:49:21.885832289 (7h23m2.617099919s) [upload=7675]: Uploading segments... Aug 9 00:49:21.886004210 (7h23m2.617271829s) [upload=7675]: Got next segment. Inline: false Aug 9 00:49:21.886054744 (7h23m2.617322374s) [upload=7675]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 00:49:21.886061847 (7h23m2.617329477s) [upload=7675]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 00:49:21.888190692 (7h23m2.619458322s) [upload=7675]: Next segment err: metaclient: Too Many Requests Aug 9 00:49:21.888204597 (7h23m2.619472256s) [upload=7675]: Done uploading segments... Aug 9 00:49:21.888217872 (7h23m2.619485502s) [upload=7675]: Upload finished. err: metaclient: Too Many Requests
Duration: 694.878479ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.................................................X.......X..] duration:
1.010609521s
FAIL (2025-08-09 00:50:38 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:49:21.885707185 (7h23m2.616974815s) [upload=7675]: Starting upload Aug 9 00:49:21.885751047 (7h23m2.617018677s) [upload=7675]: Done starting upload Aug 9 00:49:21.885832289 (7h23m2.617099919s) [upload=7675]: Uploading segments... Aug 9 00:49:21.886004210 (7h23m2.617271829s) [upload=7675]: Got next segment. Inline: false Aug 9 00:49:21.886054744 (7h23m2.617322374s) [upload=7675]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 00:49:21.886061847 (7h23m2.617329477s) [upload=7675]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 00:49:21.888190692 (7h23m2.619458322s) [upload=7675]: Next segment err: metaclient: Too Many Requests Aug 9 00:49:21.888204597 (7h23m2.619472256s) [upload=7675]: Done uploading segments... Aug 9 00:49:21.888217872 (7h23m2.619485502s) [upload=7675]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.010632082s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................................................X.......X.] duration:
1.017751471s
FAIL (2025-08-09 00:50:01 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:49:21.885707185 (7h23m2.616974815s) [upload=7675]: Starting upload Aug 9 00:49:21.885751047 (7h23m2.617018677s) [upload=7675]: Done starting upload Aug 9 00:49:21.885832289 (7h23m2.617099919s) [upload=7675]: Uploading segments... Aug 9 00:49:21.886004210 (7h23m2.617271829s) [upload=7675]: Got next segment. Inline: false Aug 9 00:49:21.886054744 (7h23m2.617322374s) [upload=7675]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 00:49:21.886061847 (7h23m2.617329477s) [upload=7675]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 00:49:21.888190692 (7h23m2.619458322s) [upload=7675]: Next segment err: metaclient: Too Many Requests Aug 9 00:49:21.888204597 (7h23m2.619472256s) [upload=7675]: Done uploading segments... Aug 9 00:49:21.888217872 (7h23m2.619485502s) [upload=7675]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.017768713s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................................................X.......X] duration:
14.958132ms
FAIL (2025-08-09 00:49:21 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:49:21.885707185 (7h23m2.616974815s) [upload=7675]: Starting upload Aug 9 00:49:21.885751047 (7h23m2.617018677s) [upload=7675]: Done starting upload Aug 9 00:49:21.885832289 (7h23m2.617099919s) [upload=7675]: Uploading segments... Aug 9 00:49:21.886004210 (7h23m2.617271829s) [upload=7675]: Got next segment. Inline: false Aug 9 00:49:21.886054744 (7h23m2.617322374s) [upload=7675]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 00:49:21.886061847 (7h23m2.617329477s) [upload=7675]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 00:49:21.888190692 (7h23m2.619458322s) [upload=7675]: Next segment err: metaclient: Too Many Requests Aug 9 00:49:21.888204597 (7h23m2.619472256s) [upload=7675]: Done uploading segments... Aug 9 00:49:21.888217872 (7h23m2.619485502s) [upload=7675]: Upload finished. err: metaclient: Too Many Requests
Duration: 14.97267ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
770.281047ms
FAIL (2025-08-09 00:48:58 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:44:44.688752913 (7h18m25.420020543s) [upload=7592]: Starting upload Aug 9 00:44:44.688816031 (7h18m25.420083651s) [upload=7592]: Done starting upload Aug 9 00:44:44.688869842 (7h18m25.420137461s) [upload=7592]: Uploading segments... Aug 9 00:44:44.689016295 (7h18m25.420283915s) [upload=7592]: Got next segment. Inline: false Aug 9 00:44:44.689045839 (7h18m25.420313459s) [upload=7592]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 00:44:44.689050398 (7h18m25.420318018s) [upload=7592]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 00:44:44.691466188 (7h18m25.422733808s) [upload=7592]: Next segment err: metaclient: Too Many Requests Aug 9 00:44:44.691481707 (7h18m25.422749337s) [upload=7592]: Done uploading segments... Aug 9 00:44:44.691491124 (7h18m25.422758754s) [upload=7592]: Upload finished. err: metaclient: Too Many Requests
Duration: 770.300324ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
908.428466ms
FAIL (2025-08-09 00:48:30 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:44:44.688752913 (7h18m25.420020543s) [upload=7592]: Starting upload Aug 9 00:44:44.688816031 (7h18m25.420083651s) [upload=7592]: Done starting upload Aug 9 00:44:44.688869842 (7h18m25.420137461s) [upload=7592]: Uploading segments... Aug 9 00:44:44.689016295 (7h18m25.420283915s) [upload=7592]: Got next segment. Inline: false Aug 9 00:44:44.689045839 (7h18m25.420313459s) [upload=7592]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 00:44:44.689050398 (7h18m25.420318018s) [upload=7592]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 00:44:44.691466188 (7h18m25.422733808s) [upload=7592]: Next segment err: metaclient: Too Many Requests Aug 9 00:44:44.691481707 (7h18m25.422749337s) [upload=7592]: Done uploading segments... Aug 9 00:44:44.691491124 (7h18m25.422758754s) [upload=7592]: Upload finished. err: metaclient: Too Many Requests
Duration: 908.449835ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
959.149703ms
FAIL (2025-08-09 00:48:06 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:44:44.688752913 (7h18m25.420020543s) [upload=7592]: Starting upload Aug 9 00:44:44.688816031 (7h18m25.420083651s) [upload=7592]: Done starting upload Aug 9 00:44:44.688869842 (7h18m25.420137461s) [upload=7592]: Uploading segments... Aug 9 00:44:44.689016295 (7h18m25.420283915s) [upload=7592]: Got next segment. Inline: false Aug 9 00:44:44.689045839 (7h18m25.420313459s) [upload=7592]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 00:44:44.689050398 (7h18m25.420318018s) [upload=7592]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 00:44:44.691466188 (7h18m25.422733808s) [upload=7592]: Next segment err: metaclient: Too Many Requests Aug 9 00:44:44.691481707 (7h18m25.422749337s) [upload=7592]: Done uploading segments... Aug 9 00:44:44.691491124 (7h18m25.422758754s) [upload=7592]: Upload finished. err: metaclient: Too Many Requests
Duration: 959.229863ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
901.976532ms
FAIL (2025-08-09 00:47:23 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:44:44.688752913 (7h18m25.420020543s) [upload=7592]: Starting upload Aug 9 00:44:44.688816031 (7h18m25.420083651s) [upload=7592]: Done starting upload Aug 9 00:44:44.688869842 (7h18m25.420137461s) [upload=7592]: Uploading segments... Aug 9 00:44:44.689016295 (7h18m25.420283915s) [upload=7592]: Got next segment. Inline: false Aug 9 00:44:44.689045839 (7h18m25.420313459s) [upload=7592]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 00:44:44.689050398 (7h18m25.420318018s) [upload=7592]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 00:44:44.691466188 (7h18m25.422733808s) [upload=7592]: Next segment err: metaclient: Too Many Requests Aug 9 00:44:44.691481707 (7h18m25.422749337s) [upload=7592]: Done uploading segments... Aug 9 00:44:44.691491124 (7h18m25.422758754s) [upload=7592]: Upload finished. err: metaclient: Too Many Requests
Duration: 901.996771ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
1.050514074s
FAIL (2025-08-09 00:46:27 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:44:44.688752913 (7h18m25.420020543s) [upload=7592]: Starting upload Aug 9 00:44:44.688816031 (7h18m25.420083651s) [upload=7592]: Done starting upload Aug 9 00:44:44.688869842 (7h18m25.420137461s) [upload=7592]: Uploading segments... Aug 9 00:44:44.689016295 (7h18m25.420283915s) [upload=7592]: Got next segment. Inline: false Aug 9 00:44:44.689045839 (7h18m25.420313459s) [upload=7592]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 00:44:44.689050398 (7h18m25.420318018s) [upload=7592]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 00:44:44.691466188 (7h18m25.422733808s) [upload=7592]: Next segment err: metaclient: Too Many Requests Aug 9 00:44:44.691481707 (7h18m25.422749337s) [upload=7592]: Done uploading segments... Aug 9 00:44:44.691491124 (7h18m25.422758754s) [upload=7592]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.050537368s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
836.863259ms
FAIL (2025-08-09 00:45:30 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 00:44:44.688752913 (7h18m25.420020543s) [upload=7592]: Starting upload Aug 9 00:44:44.688816031 (7h18m25.420083651s) [upload=7592]: Done starting upload Aug 9 00:44:44.688869842 (7h18m25.420137461s) [upload=7592]: Uploading segments... Aug 9 00:44:44.689016295 (7h18m25.420283915s) [upload=7592]: Got next segment. Inline: false Aug 9 00:44:44.689045839 (7h18m25.420313459s) [upload=7592]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 00:44:44.689050398 (7h18m25.420318018s) [upload=7592]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 00:44:44.691466188 (7h18m25.422733808s) [upload=7592]: Next segment err: metaclient: Too Many Requests Aug 9 00:44:44.691481707 (7h18m25.422749337s) [upload=7592]: Done uploading segments... Aug 9 00:44:44.691491124 (7h18m25.422758754s) [upload=7592]: Upload finished. err: metaclient: Too Many Requests
Duration: 836.882275ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|