Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....................X...........X..........................] duration:
334.996172ms
FAIL (2025-08-16 18:52:07 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 18:30:20.656629884 (193h4m1.387897535s) [upload=200914]: Starting upload Aug 16 18:30:20.656698023 (193h4m1.387965672s) [upload=200914]: Done starting upload Aug 16 18:30:20.656779016 (193h4m1.388046665s) [upload=200914]: Uploading segments... Aug 16 18:30:20.656835431 (193h4m1.388103081s) [upload=200914]: Got next segment. Inline: true Aug 16 18:30:20.656842083 (193h4m1.388109744s) [upload=200914]: Waiting for error group managing segments... Aug 16 18:30:20.656913488 (193h4m1.388181139s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 18:30:20.656919560 (193h4m1.38818721s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 18:30:20.656923327 (193h4m1.388190977s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 18:30:20.659031257 (193h4m1.390298906s) [upload=200914]: Done uploading segments... Aug 16 18:30:20.659043129 (193h4m1.390310778s) [upload=200914]: Upload finished. err: metaclient: Too Many Requests
Duration: 335.013134ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.......X............................X......X.............X..] duration:
980.826692ms
FAIL (2025-08-16 18:51:41 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 18:50:06.795231389 (193h23m47.52649904s) [upload=201259]: Starting upload
Aug 16 18:50:06.795294448 (193h23m47.526562098s) [upload=201259]: Done starting upload
Aug 16 18:50:06.795449339 (193h23m47.526716989s) [upload=201259]: Uploading segments...
Aug 16 18:50:06.795693649 (193h23m47.5269613s) [upload=201259]: Got next segment. Inline: false
Aug 16 18:50:06.795759203 (193h23m47.527026853s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 18:50:06.795765165 (193h23m47.527032824s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 18:50:06.841060252 (193h23m47.572327901s) [seg_pos={0 0}, upload=201259]: Begin upload segment...
Aug 16 18:50:06.841119362 (193h23m47.572387012s) [seg_pos={0 0}, upload=201259]: Done begin upload segment.
Aug 16 18:50:06.841151233 (193h23m47.572418883s) [noise=true , address=104.36.82.35:4587 , piece_id=5JFLAGKDPOYPDZFSKF2DJT6EHCPJHQBHGMV3T4RAPKFOXP5YDVYQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841184625 (193h23m47.572452276s) [noise=true , address=104.36.82.34:4565 , piece_id=NPK7GSWSZWGHSUSETZCCOLVYUK6QE7RCZ5COSLSQ5UJ543W67MGQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841723480 (193h23m47.57299114s) [noise=true , address=104.36.82.20:4446 , piece_id=ZVIY47XJPM2KPHF6QWJYMGVR25PMANDTI3IGB5TTMW3QAT6NDPVQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841804182 (193h23m47.573071831s) [noise=true , address=104.36.82.39:4737 , piece_id=DC7GL4U6VY3SO6KZAXQNAK54AT2WFZBJUZM2WEFWLQKS5ULQJ3UQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.842218111 (193h23m47.573485761s) [noise=true , address=77.90.31.19:4870 , piece_id=76KXS2TZPI5OH3TESKHQNCKO34UP5YPFAQ5EPKB4LKST3PSWNY7Q, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.842347224 (193h23m47.573614874s) [noise=true , address=77.90.31.13:4657 , piece_id=3T2AY52BCUCXPSJHCPFDT4MNDY3RJVULG6X52HT4PKY7SJQ464SA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.843304817 (193h23m47.574572467s) [noise=true , address=104.36.82.37:4657 , piece_id=DOCMOQXG2TIS3MHSMBHQNEKZFUSXLKENOQXGWLQRYEYFD2OBJ2LA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.843418962 (193h23m47.574686612s) [noise=true , address=104.36.82.21:4476 , piece_id=H52MJNGMGSKORKKOPNBMVFOSFCKMCJOBET5NIQFAWZ5JDLTLY4ZQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844011178 (193h23m47.575278828s) [noise=true , address=45.91.116.5:4321 , piece_id=R4V5GAA7COM6Z2FAH7REIIDOMB7EJ2HUJHAWRWVNJRJV5WREPUSQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844142576 (193h23m47.575410225s) [noise=true , address=104.36.82.7:4933 , piece_id=GERLHPHJEVE5AVHI5VM4TCEDJC7PAAFHYAHPTETVC5NBMWTSFAFQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844882007 (193h23m47.576149657s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2F5PRGNYWIKKROX5EVNMCDUPJZPIOFJBN35YXEH4H5BKINRJKPQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.845386287 (193h23m47.576653947s) [noise=true , address=77.90.31.14:4681 , piece_id=F2C4U4NYLA5TGZSPC35WB2XH3YVQZNAYYPCGH66IIDLVSX7WZXKQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.845864367 (193h23m47.577132018s) [noise=true , address=45.91.116.10:4100 , piece_id=JMZXTBLEKC5X6I3T2P4XX32GGIXSH6IW4QCKFZFLTM5JQEBMLECQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.846491107 (193h23m47.577758757s) [noise=true , address=104.36.82.23:4447 , piece_id=H2XVFVY64HORCHUCFXZUQM7H4EWXQPV6YENXX7EEOOMCZTW4N6CA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.846703747 (193h23m47.577971408s) [noise=true , address=104.36.82.14:4230 , piece_id=WTOJ6THOEIOMF72YGNYOKRGYJQJF4FQP4VGDW2QQ2326DGTUSHCQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.847183361 (193h23m47.578451012s) [noise=true , address=77.90.31.10:4521 , piece_id=DJ2ZHTVZZ7SPBYTO2WH2BMDPS37K7MSYBPA3SHWXB3TM5FLTOZYQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.847384710 (193h23m47.57865236s) [noise=true , address=104.36.82.3:4793 , piece_id=47HFN7SSBLKV4Q2MTDVFC4GBNIPATKO6LRUOC4G2AW7A4MFAI6GA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.848437041 (193h23m47.579704692s) [noise=true , address=104.36.82.59:4313 , piece_id=J47ZWGLHUN7ECNRGXZZ42Q375WKFHUJN3XLYEGX2CMHC2RUWZJCA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.984012580 (193h23m47.71528023s) [upload=201259]: Next returned nil segment
Aug 16 18:50:06.984029241 (193h23m47.715296871s) [upload=201259]: Waiting for error group managing segments...
Aug 16 18:50:06.996112904 (193h23m47.727380564s) [noise=true , address=104.36.82.14:4230 , piece_id=WTOJ6THOEIOMF72YGNYOKRGYJQJF4FQP4VGDW2QQ2326DGTUSHCQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:06.999695960 (193h23m47.73096362s) [noise=true , address=104.36.82.39:4737 , piece_id=DC7GL4U6VY3SO6KZAXQNAK54AT2WFZBJUZM2WEFWLQKS5ULQJ3UQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.025463880 (193h23m47.756731529s) [noise=true , address=77.90.31.13:4657 , piece_id=3T2AY52BCUCXPSJHCPFDT4MNDY3RJVULG6X52HT4PKY7SJQ464SA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.027404303 (193h23m47.758671953s) [noise=true , address=104.36.82.21:4476 , piece_id=H52MJNGMGSKORKKOPNBMVFOSFCKMCJOBET5NIQFAWZ5JDLTLY4ZQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.031728906 (193h23m47.762996565s) [noise=true , address=77.90.31.14:4681 , piece_id=F2C4U4NYLA5TGZSPC35WB2XH3YVQZNAYYPCGH66IIDLVSX7WZXKQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.032687090 (193h23m47.76395474s) [noise=true , address=104.36.82.59:4313 , piece_id=J47ZWGLHUN7ECNRGXZZ42Q375WKFHUJN3XLYEGX2CMHC2RUWZJCA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.037670705 (193h23m47.768938354s) [noise=true , address=77.90.31.19:4870 , piece_id=76KXS2TZPI5OH3TESKHQNCKO34UP5YPFAQ5EPKB4LKST3PSWNY7Q, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.039026547 (193h23m47.770294198s) [noise=true , address=104.36.82.35:4587 , piece_id=5JFLAGKDPOYPDZFSKF2DJT6EHCPJHQBHGMV3T4RAPKFOXP5YDVYQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.039608773 (193h23m47.770876424s) [noise=true , address=104.36.82.20:4446 , piece_id=ZVIY47XJPM2KPHF6QWJYMGVR25PMANDTI3IGB5TTMW3QAT6NDPVQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.052389308 (193h23m47.783656959s) [noise=true , address=104.36.82.7:4933 , piece_id=GERLHPHJEVE5AVHI5VM4TCEDJC7PAAFHYAHPTETVC5NBMWTSFAFQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.052813196 (193h23m47.784080856s) [noise=true , address=104.36.82.37:4657 , piece_id=DOCMOQXG2TIS3MHSMBHQNEKZFUSXLKENOQXGWLQRYEYFD2OBJ2LA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.067727990 (193h23m47.79899564s) [noise=true , address=45.91.116.10:4100 , piece_id=JMZXTBLEKC5X6I3T2P4XX32GGIXSH6IW4QCKFZFLTM5JQEBMLECQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.077757915 (193h23m47.809025565s) [noise=true , address=104.36.82.34:4565 , piece_id=NPK7GSWSZWGHSUSETZCCOLVYUK6QE7RCZ5COSLSQ5UJ543W67MGQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.088885418 (193h23m47.820153067s) [noise=true , address=104.36.82.3:4793 , piece_id=47HFN7SSBLKV4Q2MTDVFC4GBNIPATKO6LRUOC4G2AW7A4MFAI6GA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.088946764 (193h23m47.820214414s) [seg_pos={0 0}, upload=201259]: Segment reached optimal threshold of 14 pieces.
Aug 16 18:50:07.089255815 (193h23m47.820523475s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2F5PRGNYWIKKROX5EVNMCDUPJZPIOFJBN35YXEH4H5BKINRJKPQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sJfMr1nMTpizd5PZ2bZ6M8tZWhFL2ukdJ3cNSRQtdUHNJhg81): protocol: expected piece hash; context canceled; EOF
Aug 16 18:50:07.089271314 (193h23m47.820538974s) [noise=true , address=104.36.82.23:4447 , piece_id=H2XVFVY64HORCHUCFXZUQM7H4EWXQPV6YENXX7EEOOMCZTW4N6CA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fqT9xA7kXTG8K9XwTUxL6FXibV35AkPHDK6grKGHg17fk91fP): protocol: write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection; write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection
Aug 16 18:50:07.089329323 (193h23m47.820596973s) [noise=true , address=77.90.31.10:4521 , piece_id=DJ2ZHTVZZ7SPBYTO2WH2BMDPS37K7MSYBPA3SHWXB3TM5FLTOZYQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WpVJa7SXkANKParDWYrC1cN8aLHTkUSPrRJGKQ6fvA5oDEkoa): protocol: write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection; write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection
Aug 16 18:50:07.089440162 (193h23m47.820707812s) [noise=true , address=45.91.116.5:4321 , piece_id=R4V5GAA7COM6Z2FAH7REIIDOMB7EJ2HUJHAWRWVNJRJV5WREPUSQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12m3Lw8yL9wVq38nW514iaLooMVgikbQBGA9vrFsr66jx5w1xXj): protocol: write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection; write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection
Aug 16 18:50:07.089461401 (193h23m47.820729052s) [seg_pos={0 0}, upload=201259]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 18:50:07.089583131 (193h23m47.820850791s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 18:50:07.089622546 (193h23m47.820890196s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 18:50:07.183064911 (193h23m47.914332561s) [upload=201259]: Done uploading segments...
Aug 16 18:50:07.183080390 (193h23m47.91434804s) [upload=201259]: Upload finished. err: <nil>
Duration: 980.856537ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [........X............................X......X.............X.] duration:
787.094711ms
FAIL (2025-08-16 18:51:21 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 18:50:06.795231389 (193h23m47.52649904s) [upload=201259]: Starting upload
Aug 16 18:50:06.795294448 (193h23m47.526562098s) [upload=201259]: Done starting upload
Aug 16 18:50:06.795449339 (193h23m47.526716989s) [upload=201259]: Uploading segments...
Aug 16 18:50:06.795693649 (193h23m47.5269613s) [upload=201259]: Got next segment. Inline: false
Aug 16 18:50:06.795759203 (193h23m47.527026853s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 18:50:06.795765165 (193h23m47.527032824s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 18:50:06.841060252 (193h23m47.572327901s) [seg_pos={0 0}, upload=201259]: Begin upload segment...
Aug 16 18:50:06.841119362 (193h23m47.572387012s) [seg_pos={0 0}, upload=201259]: Done begin upload segment.
Aug 16 18:50:06.841151233 (193h23m47.572418883s) [noise=true , address=104.36.82.35:4587 , piece_id=5JFLAGKDPOYPDZFSKF2DJT6EHCPJHQBHGMV3T4RAPKFOXP5YDVYQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841184625 (193h23m47.572452276s) [noise=true , address=104.36.82.34:4565 , piece_id=NPK7GSWSZWGHSUSETZCCOLVYUK6QE7RCZ5COSLSQ5UJ543W67MGQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841723480 (193h23m47.57299114s) [noise=true , address=104.36.82.20:4446 , piece_id=ZVIY47XJPM2KPHF6QWJYMGVR25PMANDTI3IGB5TTMW3QAT6NDPVQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841804182 (193h23m47.573071831s) [noise=true , address=104.36.82.39:4737 , piece_id=DC7GL4U6VY3SO6KZAXQNAK54AT2WFZBJUZM2WEFWLQKS5ULQJ3UQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.842218111 (193h23m47.573485761s) [noise=true , address=77.90.31.19:4870 , piece_id=76KXS2TZPI5OH3TESKHQNCKO34UP5YPFAQ5EPKB4LKST3PSWNY7Q, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.842347224 (193h23m47.573614874s) [noise=true , address=77.90.31.13:4657 , piece_id=3T2AY52BCUCXPSJHCPFDT4MNDY3RJVULG6X52HT4PKY7SJQ464SA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.843304817 (193h23m47.574572467s) [noise=true , address=104.36.82.37:4657 , piece_id=DOCMOQXG2TIS3MHSMBHQNEKZFUSXLKENOQXGWLQRYEYFD2OBJ2LA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.843418962 (193h23m47.574686612s) [noise=true , address=104.36.82.21:4476 , piece_id=H52MJNGMGSKORKKOPNBMVFOSFCKMCJOBET5NIQFAWZ5JDLTLY4ZQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844011178 (193h23m47.575278828s) [noise=true , address=45.91.116.5:4321 , piece_id=R4V5GAA7COM6Z2FAH7REIIDOMB7EJ2HUJHAWRWVNJRJV5WREPUSQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844142576 (193h23m47.575410225s) [noise=true , address=104.36.82.7:4933 , piece_id=GERLHPHJEVE5AVHI5VM4TCEDJC7PAAFHYAHPTETVC5NBMWTSFAFQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844882007 (193h23m47.576149657s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2F5PRGNYWIKKROX5EVNMCDUPJZPIOFJBN35YXEH4H5BKINRJKPQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.845386287 (193h23m47.576653947s) [noise=true , address=77.90.31.14:4681 , piece_id=F2C4U4NYLA5TGZSPC35WB2XH3YVQZNAYYPCGH66IIDLVSX7WZXKQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.845864367 (193h23m47.577132018s) [noise=true , address=45.91.116.10:4100 , piece_id=JMZXTBLEKC5X6I3T2P4XX32GGIXSH6IW4QCKFZFLTM5JQEBMLECQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.846491107 (193h23m47.577758757s) [noise=true , address=104.36.82.23:4447 , piece_id=H2XVFVY64HORCHUCFXZUQM7H4EWXQPV6YENXX7EEOOMCZTW4N6CA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.846703747 (193h23m47.577971408s) [noise=true , address=104.36.82.14:4230 , piece_id=WTOJ6THOEIOMF72YGNYOKRGYJQJF4FQP4VGDW2QQ2326DGTUSHCQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.847183361 (193h23m47.578451012s) [noise=true , address=77.90.31.10:4521 , piece_id=DJ2ZHTVZZ7SPBYTO2WH2BMDPS37K7MSYBPA3SHWXB3TM5FLTOZYQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.847384710 (193h23m47.57865236s) [noise=true , address=104.36.82.3:4793 , piece_id=47HFN7SSBLKV4Q2MTDVFC4GBNIPATKO6LRUOC4G2AW7A4MFAI6GA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.848437041 (193h23m47.579704692s) [noise=true , address=104.36.82.59:4313 , piece_id=J47ZWGLHUN7ECNRGXZZ42Q375WKFHUJN3XLYEGX2CMHC2RUWZJCA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.984012580 (193h23m47.71528023s) [upload=201259]: Next returned nil segment
Aug 16 18:50:06.984029241 (193h23m47.715296871s) [upload=201259]: Waiting for error group managing segments...
Aug 16 18:50:06.996112904 (193h23m47.727380564s) [noise=true , address=104.36.82.14:4230 , piece_id=WTOJ6THOEIOMF72YGNYOKRGYJQJF4FQP4VGDW2QQ2326DGTUSHCQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:06.999695960 (193h23m47.73096362s) [noise=true , address=104.36.82.39:4737 , piece_id=DC7GL4U6VY3SO6KZAXQNAK54AT2WFZBJUZM2WEFWLQKS5ULQJ3UQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.025463880 (193h23m47.756731529s) [noise=true , address=77.90.31.13:4657 , piece_id=3T2AY52BCUCXPSJHCPFDT4MNDY3RJVULG6X52HT4PKY7SJQ464SA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.027404303 (193h23m47.758671953s) [noise=true , address=104.36.82.21:4476 , piece_id=H52MJNGMGSKORKKOPNBMVFOSFCKMCJOBET5NIQFAWZ5JDLTLY4ZQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.031728906 (193h23m47.762996565s) [noise=true , address=77.90.31.14:4681 , piece_id=F2C4U4NYLA5TGZSPC35WB2XH3YVQZNAYYPCGH66IIDLVSX7WZXKQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.032687090 (193h23m47.76395474s) [noise=true , address=104.36.82.59:4313 , piece_id=J47ZWGLHUN7ECNRGXZZ42Q375WKFHUJN3XLYEGX2CMHC2RUWZJCA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.037670705 (193h23m47.768938354s) [noise=true , address=77.90.31.19:4870 , piece_id=76KXS2TZPI5OH3TESKHQNCKO34UP5YPFAQ5EPKB4LKST3PSWNY7Q, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.039026547 (193h23m47.770294198s) [noise=true , address=104.36.82.35:4587 , piece_id=5JFLAGKDPOYPDZFSKF2DJT6EHCPJHQBHGMV3T4RAPKFOXP5YDVYQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.039608773 (193h23m47.770876424s) [noise=true , address=104.36.82.20:4446 , piece_id=ZVIY47XJPM2KPHF6QWJYMGVR25PMANDTI3IGB5TTMW3QAT6NDPVQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.052389308 (193h23m47.783656959s) [noise=true , address=104.36.82.7:4933 , piece_id=GERLHPHJEVE5AVHI5VM4TCEDJC7PAAFHYAHPTETVC5NBMWTSFAFQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.052813196 (193h23m47.784080856s) [noise=true , address=104.36.82.37:4657 , piece_id=DOCMOQXG2TIS3MHSMBHQNEKZFUSXLKENOQXGWLQRYEYFD2OBJ2LA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.067727990 (193h23m47.79899564s) [noise=true , address=45.91.116.10:4100 , piece_id=JMZXTBLEKC5X6I3T2P4XX32GGIXSH6IW4QCKFZFLTM5JQEBMLECQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.077757915 (193h23m47.809025565s) [noise=true , address=104.36.82.34:4565 , piece_id=NPK7GSWSZWGHSUSETZCCOLVYUK6QE7RCZ5COSLSQ5UJ543W67MGQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.088885418 (193h23m47.820153067s) [noise=true , address=104.36.82.3:4793 , piece_id=47HFN7SSBLKV4Q2MTDVFC4GBNIPATKO6LRUOC4G2AW7A4MFAI6GA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.088946764 (193h23m47.820214414s) [seg_pos={0 0}, upload=201259]: Segment reached optimal threshold of 14 pieces.
Aug 16 18:50:07.089255815 (193h23m47.820523475s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2F5PRGNYWIKKROX5EVNMCDUPJZPIOFJBN35YXEH4H5BKINRJKPQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sJfMr1nMTpizd5PZ2bZ6M8tZWhFL2ukdJ3cNSRQtdUHNJhg81): protocol: expected piece hash; context canceled; EOF
Aug 16 18:50:07.089271314 (193h23m47.820538974s) [noise=true , address=104.36.82.23:4447 , piece_id=H2XVFVY64HORCHUCFXZUQM7H4EWXQPV6YENXX7EEOOMCZTW4N6CA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fqT9xA7kXTG8K9XwTUxL6FXibV35AkPHDK6grKGHg17fk91fP): protocol: write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection; write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection
Aug 16 18:50:07.089329323 (193h23m47.820596973s) [noise=true , address=77.90.31.10:4521 , piece_id=DJ2ZHTVZZ7SPBYTO2WH2BMDPS37K7MSYBPA3SHWXB3TM5FLTOZYQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WpVJa7SXkANKParDWYrC1cN8aLHTkUSPrRJGKQ6fvA5oDEkoa): protocol: write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection; write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection
Aug 16 18:50:07.089440162 (193h23m47.820707812s) [noise=true , address=45.91.116.5:4321 , piece_id=R4V5GAA7COM6Z2FAH7REIIDOMB7EJ2HUJHAWRWVNJRJV5WREPUSQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12m3Lw8yL9wVq38nW514iaLooMVgikbQBGA9vrFsr66jx5w1xXj): protocol: write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection; write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection
Aug 16 18:50:07.089461401 (193h23m47.820729052s) [seg_pos={0 0}, upload=201259]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 18:50:07.089583131 (193h23m47.820850791s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 18:50:07.089622546 (193h23m47.820890196s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 18:50:07.183064911 (193h23m47.914332561s) [upload=201259]: Done uploading segments...
Aug 16 18:50:07.183080390 (193h23m47.91434804s) [upload=201259]: Upload finished. err: <nil>
Duration: 787.113546ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......................X...........X.........................] duration:
173.945426ms
FAIL (2025-08-16 18:51:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 18:30:20.656629884 (193h4m1.387897535s) [upload=200914]: Starting upload Aug 16 18:30:20.656698023 (193h4m1.387965672s) [upload=200914]: Done starting upload Aug 16 18:30:20.656779016 (193h4m1.388046665s) [upload=200914]: Uploading segments... Aug 16 18:30:20.656835431 (193h4m1.388103081s) [upload=200914]: Got next segment. Inline: true Aug 16 18:30:20.656842083 (193h4m1.388109744s) [upload=200914]: Waiting for error group managing segments... Aug 16 18:30:20.656913488 (193h4m1.388181139s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 18:30:20.656919560 (193h4m1.38818721s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 18:30:20.656923327 (193h4m1.388190977s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 18:30:20.659031257 (193h4m1.390298906s) [upload=200914]: Done uploading segments... Aug 16 18:30:20.659043129 (193h4m1.390310778s) [upload=200914]: Upload finished. err: metaclient: Too Many Requests
Duration: 174.073047ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......................X...........X........................] duration:
347.484856ms
FAIL (2025-08-16 18:50:28 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 18:30:20.656629884 (193h4m1.387897535s) [upload=200914]: Starting upload Aug 16 18:30:20.656698023 (193h4m1.387965672s) [upload=200914]: Done starting upload Aug 16 18:30:20.656779016 (193h4m1.388046665s) [upload=200914]: Uploading segments... Aug 16 18:30:20.656835431 (193h4m1.388103081s) [upload=200914]: Got next segment. Inline: true Aug 16 18:30:20.656842083 (193h4m1.388109744s) [upload=200914]: Waiting for error group managing segments... Aug 16 18:30:20.656913488 (193h4m1.388181139s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 18:30:20.656919560 (193h4m1.38818721s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 18:30:20.656923327 (193h4m1.388190977s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 18:30:20.659031257 (193h4m1.390298906s) [upload=200914]: Done uploading segments... Aug 16 18:30:20.659043129 (193h4m1.390310778s) [upload=200914]: Upload finished. err: metaclient: Too Many Requests
Duration: 347.515423ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.........X............................X......X.............X] duration:
528.918583ms
FAIL (2025-08-16 18:50:07 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 18:50:06.795231389 (193h23m47.52649904s) [upload=201259]: Starting upload
Aug 16 18:50:06.795294448 (193h23m47.526562098s) [upload=201259]: Done starting upload
Aug 16 18:50:06.795449339 (193h23m47.526716989s) [upload=201259]: Uploading segments...
Aug 16 18:50:06.795693649 (193h23m47.5269613s) [upload=201259]: Got next segment. Inline: false
Aug 16 18:50:06.795759203 (193h23m47.527026853s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 18:50:06.795765165 (193h23m47.527032824s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 18:50:06.841060252 (193h23m47.572327901s) [seg_pos={0 0}, upload=201259]: Begin upload segment...
Aug 16 18:50:06.841119362 (193h23m47.572387012s) [seg_pos={0 0}, upload=201259]: Done begin upload segment.
Aug 16 18:50:06.841151233 (193h23m47.572418883s) [noise=true , address=104.36.82.35:4587 , piece_id=5JFLAGKDPOYPDZFSKF2DJT6EHCPJHQBHGMV3T4RAPKFOXP5YDVYQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841184625 (193h23m47.572452276s) [noise=true , address=104.36.82.34:4565 , piece_id=NPK7GSWSZWGHSUSETZCCOLVYUK6QE7RCZ5COSLSQ5UJ543W67MGQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841723480 (193h23m47.57299114s) [noise=true , address=104.36.82.20:4446 , piece_id=ZVIY47XJPM2KPHF6QWJYMGVR25PMANDTI3IGB5TTMW3QAT6NDPVQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841804182 (193h23m47.573071831s) [noise=true , address=104.36.82.39:4737 , piece_id=DC7GL4U6VY3SO6KZAXQNAK54AT2WFZBJUZM2WEFWLQKS5ULQJ3UQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.842218111 (193h23m47.573485761s) [noise=true , address=77.90.31.19:4870 , piece_id=76KXS2TZPI5OH3TESKHQNCKO34UP5YPFAQ5EPKB4LKST3PSWNY7Q, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.842347224 (193h23m47.573614874s) [noise=true , address=77.90.31.13:4657 , piece_id=3T2AY52BCUCXPSJHCPFDT4MNDY3RJVULG6X52HT4PKY7SJQ464SA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.843304817 (193h23m47.574572467s) [noise=true , address=104.36.82.37:4657 , piece_id=DOCMOQXG2TIS3MHSMBHQNEKZFUSXLKENOQXGWLQRYEYFD2OBJ2LA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.843418962 (193h23m47.574686612s) [noise=true , address=104.36.82.21:4476 , piece_id=H52MJNGMGSKORKKOPNBMVFOSFCKMCJOBET5NIQFAWZ5JDLTLY4ZQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844011178 (193h23m47.575278828s) [noise=true , address=45.91.116.5:4321 , piece_id=R4V5GAA7COM6Z2FAH7REIIDOMB7EJ2HUJHAWRWVNJRJV5WREPUSQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844142576 (193h23m47.575410225s) [noise=true , address=104.36.82.7:4933 , piece_id=GERLHPHJEVE5AVHI5VM4TCEDJC7PAAFHYAHPTETVC5NBMWTSFAFQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844882007 (193h23m47.576149657s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2F5PRGNYWIKKROX5EVNMCDUPJZPIOFJBN35YXEH4H5BKINRJKPQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.845386287 (193h23m47.576653947s) [noise=true , address=77.90.31.14:4681 , piece_id=F2C4U4NYLA5TGZSPC35WB2XH3YVQZNAYYPCGH66IIDLVSX7WZXKQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.845864367 (193h23m47.577132018s) [noise=true , address=45.91.116.10:4100 , piece_id=JMZXTBLEKC5X6I3T2P4XX32GGIXSH6IW4QCKFZFLTM5JQEBMLECQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.846491107 (193h23m47.577758757s) [noise=true , address=104.36.82.23:4447 , piece_id=H2XVFVY64HORCHUCFXZUQM7H4EWXQPV6YENXX7EEOOMCZTW4N6CA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.846703747 (193h23m47.577971408s) [noise=true , address=104.36.82.14:4230 , piece_id=WTOJ6THOEIOMF72YGNYOKRGYJQJF4FQP4VGDW2QQ2326DGTUSHCQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.847183361 (193h23m47.578451012s) [noise=true , address=77.90.31.10:4521 , piece_id=DJ2ZHTVZZ7SPBYTO2WH2BMDPS37K7MSYBPA3SHWXB3TM5FLTOZYQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.847384710 (193h23m47.57865236s) [noise=true , address=104.36.82.3:4793 , piece_id=47HFN7SSBLKV4Q2MTDVFC4GBNIPATKO6LRUOC4G2AW7A4MFAI6GA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.848437041 (193h23m47.579704692s) [noise=true , address=104.36.82.59:4313 , piece_id=J47ZWGLHUN7ECNRGXZZ42Q375WKFHUJN3XLYEGX2CMHC2RUWZJCA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.984012580 (193h23m47.71528023s) [upload=201259]: Next returned nil segment
Aug 16 18:50:06.984029241 (193h23m47.715296871s) [upload=201259]: Waiting for error group managing segments...
Aug 16 18:50:06.996112904 (193h23m47.727380564s) [noise=true , address=104.36.82.14:4230 , piece_id=WTOJ6THOEIOMF72YGNYOKRGYJQJF4FQP4VGDW2QQ2326DGTUSHCQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:06.999695960 (193h23m47.73096362s) [noise=true , address=104.36.82.39:4737 , piece_id=DC7GL4U6VY3SO6KZAXQNAK54AT2WFZBJUZM2WEFWLQKS5ULQJ3UQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.025463880 (193h23m47.756731529s) [noise=true , address=77.90.31.13:4657 , piece_id=3T2AY52BCUCXPSJHCPFDT4MNDY3RJVULG6X52HT4PKY7SJQ464SA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.027404303 (193h23m47.758671953s) [noise=true , address=104.36.82.21:4476 , piece_id=H52MJNGMGSKORKKOPNBMVFOSFCKMCJOBET5NIQFAWZ5JDLTLY4ZQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.031728906 (193h23m47.762996565s) [noise=true , address=77.90.31.14:4681 , piece_id=F2C4U4NYLA5TGZSPC35WB2XH3YVQZNAYYPCGH66IIDLVSX7WZXKQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.032687090 (193h23m47.76395474s) [noise=true , address=104.36.82.59:4313 , piece_id=J47ZWGLHUN7ECNRGXZZ42Q375WKFHUJN3XLYEGX2CMHC2RUWZJCA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.037670705 (193h23m47.768938354s) [noise=true , address=77.90.31.19:4870 , piece_id=76KXS2TZPI5OH3TESKHQNCKO34UP5YPFAQ5EPKB4LKST3PSWNY7Q, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.039026547 (193h23m47.770294198s) [noise=true , address=104.36.82.35:4587 , piece_id=5JFLAGKDPOYPDZFSKF2DJT6EHCPJHQBHGMV3T4RAPKFOXP5YDVYQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.039608773 (193h23m47.770876424s) [noise=true , address=104.36.82.20:4446 , piece_id=ZVIY47XJPM2KPHF6QWJYMGVR25PMANDTI3IGB5TTMW3QAT6NDPVQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.052389308 (193h23m47.783656959s) [noise=true , address=104.36.82.7:4933 , piece_id=GERLHPHJEVE5AVHI5VM4TCEDJC7PAAFHYAHPTETVC5NBMWTSFAFQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.052813196 (193h23m47.784080856s) [noise=true , address=104.36.82.37:4657 , piece_id=DOCMOQXG2TIS3MHSMBHQNEKZFUSXLKENOQXGWLQRYEYFD2OBJ2LA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.067727990 (193h23m47.79899564s) [noise=true , address=45.91.116.10:4100 , piece_id=JMZXTBLEKC5X6I3T2P4XX32GGIXSH6IW4QCKFZFLTM5JQEBMLECQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.077757915 (193h23m47.809025565s) [noise=true , address=104.36.82.34:4565 , piece_id=NPK7GSWSZWGHSUSETZCCOLVYUK6QE7RCZ5COSLSQ5UJ543W67MGQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.088885418 (193h23m47.820153067s) [noise=true , address=104.36.82.3:4793 , piece_id=47HFN7SSBLKV4Q2MTDVFC4GBNIPATKO6LRUOC4G2AW7A4MFAI6GA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.088946764 (193h23m47.820214414s) [seg_pos={0 0}, upload=201259]: Segment reached optimal threshold of 14 pieces.
Aug 16 18:50:07.089255815 (193h23m47.820523475s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2F5PRGNYWIKKROX5EVNMCDUPJZPIOFJBN35YXEH4H5BKINRJKPQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sJfMr1nMTpizd5PZ2bZ6M8tZWhFL2ukdJ3cNSRQtdUHNJhg81): protocol: expected piece hash; context canceled; EOF
Aug 16 18:50:07.089271314 (193h23m47.820538974s) [noise=true , address=104.36.82.23:4447 , piece_id=H2XVFVY64HORCHUCFXZUQM7H4EWXQPV6YENXX7EEOOMCZTW4N6CA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fqT9xA7kXTG8K9XwTUxL6FXibV35AkPHDK6grKGHg17fk91fP): protocol: write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection; write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection
Aug 16 18:50:07.089329323 (193h23m47.820596973s) [noise=true , address=77.90.31.10:4521 , piece_id=DJ2ZHTVZZ7SPBYTO2WH2BMDPS37K7MSYBPA3SHWXB3TM5FLTOZYQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WpVJa7SXkANKParDWYrC1cN8aLHTkUSPrRJGKQ6fvA5oDEkoa): protocol: write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection; write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection
Aug 16 18:50:07.089440162 (193h23m47.820707812s) [noise=true , address=45.91.116.5:4321 , piece_id=R4V5GAA7COM6Z2FAH7REIIDOMB7EJ2HUJHAWRWVNJRJV5WREPUSQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12m3Lw8yL9wVq38nW514iaLooMVgikbQBGA9vrFsr66jx5w1xXj): protocol: write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection; write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection
Aug 16 18:50:07.089461401 (193h23m47.820729052s) [seg_pos={0 0}, upload=201259]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 18:50:07.089583131 (193h23m47.820850791s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 18:50:07.089622546 (193h23m47.820890196s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 18:50:07.183064911 (193h23m47.914332561s) [upload=201259]: Done uploading segments...
Aug 16 18:50:07.183080390 (193h23m47.91434804s) [upload=201259]: Upload finished. err: <nil>
Duration: 528.941606ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........................X...........X.......................] duration:
718.15828ms
FAIL (2025-08-16 18:49:33 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 18:30:20.656629884 (193h4m1.387897535s) [upload=200914]: Starting upload Aug 16 18:30:20.656698023 (193h4m1.387965672s) [upload=200914]: Done starting upload Aug 16 18:30:20.656779016 (193h4m1.388046665s) [upload=200914]: Uploading segments... Aug 16 18:30:20.656835431 (193h4m1.388103081s) [upload=200914]: Got next segment. Inline: true Aug 16 18:30:20.656842083 (193h4m1.388109744s) [upload=200914]: Waiting for error group managing segments... Aug 16 18:30:20.656913488 (193h4m1.388181139s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 18:30:20.656919560 (193h4m1.38818721s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 18:30:20.656923327 (193h4m1.388190977s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 18:30:20.659031257 (193h4m1.390298906s) [upload=200914]: Done uploading segments... Aug 16 18:30:20.659043129 (193h4m1.390310778s) [upload=200914]: Upload finished. err: metaclient: Too Many Requests
Duration: 718.176835ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..........X............................X......X.............] duration:
849.423351ms
FAIL (2025-08-16 18:49:27 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 18:40:18.801390613 (193h13m59.532658243s) [upload=201098]: Starting upload Aug 16 18:40:18.801435428 (193h13m59.532703048s) [upload=201098]: Done starting upload Aug 16 18:40:18.801531669 (193h13m59.532799299s) [upload=201098]: Uploading segments... Aug 16 18:40:18.801736705 (193h13m59.533004335s) [upload=201098]: Got next segment. Inline: false Aug 16 18:40:18.801765299 (193h13m59.533032929s) [upload=201098]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 18:40:18.801769106 (193h13m59.533036726s) [upload=201098]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 18:40:18.804610396 (193h13m59.535878016s) [upload=201098]: Next segment err: metaclient: Too Many Requests Aug 16 18:40:18.804622538 (193h13m59.535890169s) [upload=201098]: Done uploading segments... Aug 16 18:40:18.804631306 (193h13m59.535898936s) [upload=201098]: Upload finished. err: metaclient: Too Many Requests
Duration: 849.440653ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...........X............................X......X............] duration:
586.251558ms
FAIL (2025-08-16 18:48:59 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 18:40:18.801390613 (193h13m59.532658243s) [upload=201098]: Starting upload Aug 16 18:40:18.801435428 (193h13m59.532703048s) [upload=201098]: Done starting upload Aug 16 18:40:18.801531669 (193h13m59.532799299s) [upload=201098]: Uploading segments... Aug 16 18:40:18.801736705 (193h13m59.533004335s) [upload=201098]: Got next segment. Inline: false Aug 16 18:40:18.801765299 (193h13m59.533032929s) [upload=201098]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 18:40:18.801769106 (193h13m59.533036726s) [upload=201098]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 18:40:18.804610396 (193h13m59.535878016s) [upload=201098]: Next segment err: metaclient: Too Many Requests Aug 16 18:40:18.804622538 (193h13m59.535890169s) [upload=201098]: Done uploading segments... Aug 16 18:40:18.804631306 (193h13m59.535898936s) [upload=201098]: Upload finished. err: metaclient: Too Many Requests
Duration: 586.270243ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........................X...........X......................] duration:
261.613189ms
FAIL (2025-08-16 18:48:42 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 18:30:20.656629884 (193h4m1.387897535s) [upload=200914]: Starting upload Aug 16 18:30:20.656698023 (193h4m1.387965672s) [upload=200914]: Done starting upload Aug 16 18:30:20.656779016 (193h4m1.388046665s) [upload=200914]: Uploading segments... Aug 16 18:30:20.656835431 (193h4m1.388103081s) [upload=200914]: Got next segment. Inline: true Aug 16 18:30:20.656842083 (193h4m1.388109744s) [upload=200914]: Waiting for error group managing segments... Aug 16 18:30:20.656913488 (193h4m1.388181139s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 18:30:20.656919560 (193h4m1.38818721s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 18:30:20.656923327 (193h4m1.388190977s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 18:30:20.659031257 (193h4m1.390298906s) [upload=200914]: Done uploading segments... Aug 16 18:30:20.659043129 (193h4m1.390310778s) [upload=200914]: Upload finished. err: metaclient: Too Many Requests
Duration: 261.634169ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [............X............................X......X...........] duration:
936.746404ms
FAIL (2025-08-16 18:48:11 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 18:40:18.801390613 (193h13m59.532658243s) [upload=201098]: Starting upload Aug 16 18:40:18.801435428 (193h13m59.532703048s) [upload=201098]: Done starting upload Aug 16 18:40:18.801531669 (193h13m59.532799299s) [upload=201098]: Uploading segments... Aug 16 18:40:18.801736705 (193h13m59.533004335s) [upload=201098]: Got next segment. Inline: false Aug 16 18:40:18.801765299 (193h13m59.533032929s) [upload=201098]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 18:40:18.801769106 (193h13m59.533036726s) [upload=201098]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 18:40:18.804610396 (193h13m59.535878016s) [upload=201098]: Next segment err: metaclient: Too Many Requests Aug 16 18:40:18.804622538 (193h13m59.535890169s) [upload=201098]: Done uploading segments... Aug 16 18:40:18.804631306 (193h13m59.535898936s) [upload=201098]: Upload finished. err: metaclient: Too Many Requests
Duration: 936.764518ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........................X...........X.....................] duration:
210.745306ms
FAIL (2025-08-16 18:47:42 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 18:30:20.656629884 (193h4m1.387897535s) [upload=200914]: Starting upload Aug 16 18:30:20.656698023 (193h4m1.387965672s) [upload=200914]: Done starting upload Aug 16 18:30:20.656779016 (193h4m1.388046665s) [upload=200914]: Uploading segments... Aug 16 18:30:20.656835431 (193h4m1.388103081s) [upload=200914]: Got next segment. Inline: true Aug 16 18:30:20.656842083 (193h4m1.388109744s) [upload=200914]: Waiting for error group managing segments... Aug 16 18:30:20.656913488 (193h4m1.388181139s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 18:30:20.656919560 (193h4m1.38818721s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 18:30:20.656923327 (193h4m1.388190977s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 18:30:20.659031257 (193h4m1.390298906s) [upload=200914]: Done uploading segments... Aug 16 18:30:20.659043129 (193h4m1.390310778s) [upload=200914]: Upload finished. err: metaclient: Too Many Requests
Duration: 210.784822ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.............X............................X......X..........] duration:
916.40028ms
FAIL (2025-08-16 18:47:40 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 18:40:18.801390613 (193h13m59.532658243s) [upload=201098]: Starting upload Aug 16 18:40:18.801435428 (193h13m59.532703048s) [upload=201098]: Done starting upload Aug 16 18:40:18.801531669 (193h13m59.532799299s) [upload=201098]: Uploading segments... Aug 16 18:40:18.801736705 (193h13m59.533004335s) [upload=201098]: Got next segment. Inline: false Aug 16 18:40:18.801765299 (193h13m59.533032929s) [upload=201098]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 18:40:18.801769106 (193h13m59.533036726s) [upload=201098]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 18:40:18.804610396 (193h13m59.535878016s) [upload=201098]: Next segment err: metaclient: Too Many Requests Aug 16 18:40:18.804622538 (193h13m59.535890169s) [upload=201098]: Done uploading segments... Aug 16 18:40:18.804631306 (193h13m59.535898936s) [upload=201098]: Upload finished. err: metaclient: Too Many Requests
Duration: 916.417803ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..............X............................X......X.........] duration:
665.960787ms
FAIL (2025-08-16 18:47:11 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 18:40:18.801390613 (193h13m59.532658243s) [upload=201098]: Starting upload Aug 16 18:40:18.801435428 (193h13m59.532703048s) [upload=201098]: Done starting upload Aug 16 18:40:18.801531669 (193h13m59.532799299s) [upload=201098]: Uploading segments... Aug 16 18:40:18.801736705 (193h13m59.533004335s) [upload=201098]: Got next segment. Inline: false Aug 16 18:40:18.801765299 (193h13m59.533032929s) [upload=201098]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 18:40:18.801769106 (193h13m59.533036726s) [upload=201098]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 18:40:18.804610396 (193h13m59.535878016s) [upload=201098]: Next segment err: metaclient: Too Many Requests Aug 16 18:40:18.804622538 (193h13m59.535890169s) [upload=201098]: Done uploading segments... Aug 16 18:40:18.804631306 (193h13m59.535898936s) [upload=201098]: Upload finished. err: metaclient: Too Many Requests
Duration: 665.988319ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........................X...........X....................] duration:
173.896754ms
FAIL (2025-08-16 18:46:53 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 18:30:20.656629884 (193h4m1.387897535s) [upload=200914]: Starting upload Aug 16 18:30:20.656698023 (193h4m1.387965672s) [upload=200914]: Done starting upload Aug 16 18:30:20.656779016 (193h4m1.388046665s) [upload=200914]: Uploading segments... Aug 16 18:30:20.656835431 (193h4m1.388103081s) [upload=200914]: Got next segment. Inline: true Aug 16 18:30:20.656842083 (193h4m1.388109744s) [upload=200914]: Waiting for error group managing segments... Aug 16 18:30:20.656913488 (193h4m1.388181139s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 18:30:20.656919560 (193h4m1.38818721s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 18:30:20.656923327 (193h4m1.388190977s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 18:30:20.659031257 (193h4m1.390298906s) [upload=200914]: Done uploading segments... Aug 16 18:30:20.659043129 (193h4m1.390310778s) [upload=200914]: Upload finished. err: metaclient: Too Many Requests
Duration: 173.917615ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...............X............................X......X........] duration:
866.630398ms
FAIL (2025-08-16 18:46:35 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 18:40:18.801390613 (193h13m59.532658243s) [upload=201098]: Starting upload Aug 16 18:40:18.801435428 (193h13m59.532703048s) [upload=201098]: Done starting upload Aug 16 18:40:18.801531669 (193h13m59.532799299s) [upload=201098]: Uploading segments... Aug 16 18:40:18.801736705 (193h13m59.533004335s) [upload=201098]: Got next segment. Inline: false Aug 16 18:40:18.801765299 (193h13m59.533032929s) [upload=201098]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 18:40:18.801769106 (193h13m59.533036726s) [upload=201098]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 18:40:18.804610396 (193h13m59.535878016s) [upload=201098]: Next segment err: metaclient: Too Many Requests Aug 16 18:40:18.804622538 (193h13m59.535890169s) [upload=201098]: Done uploading segments... Aug 16 18:40:18.804631306 (193h13m59.535898936s) [upload=201098]: Upload finished. err: metaclient: Too Many Requests
Duration: 866.653ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [............................X...........X...................] duration:
242.783173ms
FAIL (2025-08-16 18:46:10 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 18:30:20.656629884 (193h4m1.387897535s) [upload=200914]: Starting upload Aug 16 18:30:20.656698023 (193h4m1.387965672s) [upload=200914]: Done starting upload Aug 16 18:30:20.656779016 (193h4m1.388046665s) [upload=200914]: Uploading segments... Aug 16 18:30:20.656835431 (193h4m1.388103081s) [upload=200914]: Got next segment. Inline: true Aug 16 18:30:20.656842083 (193h4m1.388109744s) [upload=200914]: Waiting for error group managing segments... Aug 16 18:30:20.656913488 (193h4m1.388181139s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 18:30:20.656919560 (193h4m1.38818721s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 18:30:20.656923327 (193h4m1.388190977s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 18:30:20.659031257 (193h4m1.390298906s) [upload=200914]: Done uploading segments... Aug 16 18:30:20.659043129 (193h4m1.390310778s) [upload=200914]: Upload finished. err: metaclient: Too Many Requests
Duration: 242.800175ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [................X............................X......X.......] duration:
586.236217ms
FAIL (2025-08-16 18:46:08 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 18:40:18.801390613 (193h13m59.532658243s) [upload=201098]: Starting upload Aug 16 18:40:18.801435428 (193h13m59.532703048s) [upload=201098]: Done starting upload Aug 16 18:40:18.801531669 (193h13m59.532799299s) [upload=201098]: Uploading segments... Aug 16 18:40:18.801736705 (193h13m59.533004335s) [upload=201098]: Got next segment. Inline: false Aug 16 18:40:18.801765299 (193h13m59.533032929s) [upload=201098]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 18:40:18.801769106 (193h13m59.533036726s) [upload=201098]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 18:40:18.804610396 (193h13m59.535878016s) [upload=201098]: Next segment err: metaclient: Too Many Requests Aug 16 18:40:18.804622538 (193h13m59.535890169s) [upload=201098]: Done uploading segments... Aug 16 18:40:18.804631306 (193h13m59.535898936s) [upload=201098]: Upload finished. err: metaclient: Too Many Requests
Duration: 586.268187ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............................X...........X..................] duration:
221.502862ms
FAIL (2025-08-16 18:45:08 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 18:30:20.656629884 (193h4m1.387897535s) [upload=200914]: Starting upload Aug 16 18:30:20.656698023 (193h4m1.387965672s) [upload=200914]: Done starting upload Aug 16 18:30:20.656779016 (193h4m1.388046665s) [upload=200914]: Uploading segments... Aug 16 18:30:20.656835431 (193h4m1.388103081s) [upload=200914]: Got next segment. Inline: true Aug 16 18:30:20.656842083 (193h4m1.388109744s) [upload=200914]: Waiting for error group managing segments... Aug 16 18:30:20.656913488 (193h4m1.388181139s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 18:30:20.656919560 (193h4m1.38818721s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 18:30:20.656923327 (193h4m1.388190977s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 18:30:20.659031257 (193h4m1.390298906s) [upload=200914]: Done uploading segments... Aug 16 18:30:20.659043129 (193h4m1.390310778s) [upload=200914]: Upload finished. err: metaclient: Too Many Requests
Duration: 221.523041ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.................X............................X......X......] duration:
655.25043ms
FAIL (2025-08-16 18:45:05 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 18:40:18.801390613 (193h13m59.532658243s) [upload=201098]: Starting upload Aug 16 18:40:18.801435428 (193h13m59.532703048s) [upload=201098]: Done starting upload Aug 16 18:40:18.801531669 (193h13m59.532799299s) [upload=201098]: Uploading segments... Aug 16 18:40:18.801736705 (193h13m59.533004335s) [upload=201098]: Got next segment. Inline: false Aug 16 18:40:18.801765299 (193h13m59.533032929s) [upload=201098]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 18:40:18.801769106 (193h13m59.533036726s) [upload=201098]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 18:40:18.804610396 (193h13m59.535878016s) [upload=201098]: Next segment err: metaclient: Too Many Requests Aug 16 18:40:18.804622538 (193h13m59.535890169s) [upload=201098]: Done uploading segments... Aug 16 18:40:18.804631306 (193h13m59.535898936s) [upload=201098]: Upload finished. err: metaclient: Too Many Requests
Duration: 655.268283ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............................X...........X.................] duration:
207.907194ms
FAIL (2025-08-16 18:44:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 18:30:20.656629884 (193h4m1.387897535s) [upload=200914]: Starting upload Aug 16 18:30:20.656698023 (193h4m1.387965672s) [upload=200914]: Done starting upload Aug 16 18:30:20.656779016 (193h4m1.388046665s) [upload=200914]: Uploading segments... Aug 16 18:30:20.656835431 (193h4m1.388103081s) [upload=200914]: Got next segment. Inline: true Aug 16 18:30:20.656842083 (193h4m1.388109744s) [upload=200914]: Waiting for error group managing segments... Aug 16 18:30:20.656913488 (193h4m1.388181139s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 18:30:20.656919560 (193h4m1.38818721s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 18:30:20.656923327 (193h4m1.388190977s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 18:30:20.659031257 (193h4m1.390298906s) [upload=200914]: Done uploading segments... Aug 16 18:30:20.659043129 (193h4m1.390310778s) [upload=200914]: Upload finished. err: metaclient: Too Many Requests
Duration: 207.924346ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..................X............................X......X.....] duration:
836.234518ms
FAIL (2025-08-16 18:43:55 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 18:40:18.801390613 (193h13m59.532658243s) [upload=201098]: Starting upload Aug 16 18:40:18.801435428 (193h13m59.532703048s) [upload=201098]: Done starting upload Aug 16 18:40:18.801531669 (193h13m59.532799299s) [upload=201098]: Uploading segments... Aug 16 18:40:18.801736705 (193h13m59.533004335s) [upload=201098]: Got next segment. Inline: false Aug 16 18:40:18.801765299 (193h13m59.533032929s) [upload=201098]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 18:40:18.801769106 (193h13m59.533036726s) [upload=201098]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 18:40:18.804610396 (193h13m59.535878016s) [upload=201098]: Next segment err: metaclient: Too Many Requests Aug 16 18:40:18.804622538 (193h13m59.535890169s) [upload=201098]: Done uploading segments... Aug 16 18:40:18.804631306 (193h13m59.535898936s) [upload=201098]: Upload finished. err: metaclient: Too Many Requests
Duration: 836.259004ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............................X...........X................] duration:
428.853727ms
FAIL (2025-08-16 18:43:25 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 18:30:20.656629884 (193h4m1.387897535s) [upload=200914]: Starting upload Aug 16 18:30:20.656698023 (193h4m1.387965672s) [upload=200914]: Done starting upload Aug 16 18:30:20.656779016 (193h4m1.388046665s) [upload=200914]: Uploading segments... Aug 16 18:30:20.656835431 (193h4m1.388103081s) [upload=200914]: Got next segment. Inline: true Aug 16 18:30:20.656842083 (193h4m1.388109744s) [upload=200914]: Waiting for error group managing segments... Aug 16 18:30:20.656913488 (193h4m1.388181139s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 18:30:20.656919560 (193h4m1.38818721s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 18:30:20.656923327 (193h4m1.388190977s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 18:30:20.659031257 (193h4m1.390298906s) [upload=200914]: Done uploading segments... Aug 16 18:30:20.659043129 (193h4m1.390310778s) [upload=200914]: Upload finished. err: metaclient: Too Many Requests
Duration: 428.871912ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...................X............................X......X....] duration:
820.517733ms
FAIL (2025-08-16 18:43:01 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 18:40:18.801390613 (193h13m59.532658243s) [upload=201098]: Starting upload Aug 16 18:40:18.801435428 (193h13m59.532703048s) [upload=201098]: Done starting upload Aug 16 18:40:18.801531669 (193h13m59.532799299s) [upload=201098]: Uploading segments... Aug 16 18:40:18.801736705 (193h13m59.533004335s) [upload=201098]: Got next segment. Inline: false Aug 16 18:40:18.801765299 (193h13m59.533032929s) [upload=201098]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 18:40:18.801769106 (193h13m59.533036726s) [upload=201098]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 18:40:18.804610396 (193h13m59.535878016s) [upload=201098]: Next segment err: metaclient: Too Many Requests Aug 16 18:40:18.804622538 (193h13m59.535890169s) [upload=201098]: Done uploading segments... Aug 16 18:40:18.804631306 (193h13m59.535898936s) [upload=201098]: Upload finished. err: metaclient: Too Many Requests
Duration: 820.535857ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [................................X...........X...............] duration:
181.067566ms
FAIL (2025-08-16 18:42:43 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 18:30:20.656629884 (193h4m1.387897535s) [upload=200914]: Starting upload Aug 16 18:30:20.656698023 (193h4m1.387965672s) [upload=200914]: Done starting upload Aug 16 18:30:20.656779016 (193h4m1.388046665s) [upload=200914]: Uploading segments... Aug 16 18:30:20.656835431 (193h4m1.388103081s) [upload=200914]: Got next segment. Inline: true Aug 16 18:30:20.656842083 (193h4m1.388109744s) [upload=200914]: Waiting for error group managing segments... Aug 16 18:30:20.656913488 (193h4m1.388181139s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 18:30:20.656919560 (193h4m1.38818721s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 18:30:20.656923327 (193h4m1.388190977s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 18:30:20.659031257 (193h4m1.390298906s) [upload=200914]: Done uploading segments... Aug 16 18:30:20.659043129 (193h4m1.390310778s) [upload=200914]: Upload finished. err: metaclient: Too Many Requests
Duration: 181.089607ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [....................X............................X......X...] duration:
707.138652ms
FAIL (2025-08-16 18:42:19 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 18:40:18.801390613 (193h13m59.532658243s) [upload=201098]: Starting upload Aug 16 18:40:18.801435428 (193h13m59.532703048s) [upload=201098]: Done starting upload Aug 16 18:40:18.801531669 (193h13m59.532799299s) [upload=201098]: Uploading segments... Aug 16 18:40:18.801736705 (193h13m59.533004335s) [upload=201098]: Got next segment. Inline: false Aug 16 18:40:18.801765299 (193h13m59.533032929s) [upload=201098]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 18:40:18.801769106 (193h13m59.533036726s) [upload=201098]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 18:40:18.804610396 (193h13m59.535878016s) [upload=201098]: Next segment err: metaclient: Too Many Requests Aug 16 18:40:18.804622538 (193h13m59.535890169s) [upload=201098]: Done uploading segments... Aug 16 18:40:18.804631306 (193h13m59.535898936s) [upload=201098]: Upload finished. err: metaclient: Too Many Requests
Duration: 707.163189ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................................X...........X..............] duration:
170.95582ms
FAIL (2025-08-16 18:41:36 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 18:30:20.656629884 (193h4m1.387897535s) [upload=200914]: Starting upload Aug 16 18:30:20.656698023 (193h4m1.387965672s) [upload=200914]: Done starting upload Aug 16 18:30:20.656779016 (193h4m1.388046665s) [upload=200914]: Uploading segments... Aug 16 18:30:20.656835431 (193h4m1.388103081s) [upload=200914]: Got next segment. Inline: true Aug 16 18:30:20.656842083 (193h4m1.388109744s) [upload=200914]: Waiting for error group managing segments... Aug 16 18:30:20.656913488 (193h4m1.388181139s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 18:30:20.656919560 (193h4m1.38818721s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 18:30:20.656923327 (193h4m1.388190977s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 18:30:20.659031257 (193h4m1.390298906s) [upload=200914]: Done uploading segments... Aug 16 18:30:20.659043129 (193h4m1.390310778s) [upload=200914]: Upload finished. err: metaclient: Too Many Requests
Duration: 170.981497ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....................X............................X......X..] duration:
1.004976413s
FAIL (2025-08-16 18:41:26 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 18:40:18.801390613 (193h13m59.532658243s) [upload=201098]: Starting upload Aug 16 18:40:18.801435428 (193h13m59.532703048s) [upload=201098]: Done starting upload Aug 16 18:40:18.801531669 (193h13m59.532799299s) [upload=201098]: Uploading segments... Aug 16 18:40:18.801736705 (193h13m59.533004335s) [upload=201098]: Got next segment. Inline: false Aug 16 18:40:18.801765299 (193h13m59.533032929s) [upload=201098]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 18:40:18.801769106 (193h13m59.533036726s) [upload=201098]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 18:40:18.804610396 (193h13m59.535878016s) [upload=201098]: Next segment err: metaclient: Too Many Requests Aug 16 18:40:18.804622538 (193h13m59.535890169s) [upload=201098]: Done uploading segments... Aug 16 18:40:18.804631306 (193h13m59.535898936s) [upload=201098]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.004990119s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......................X............................X......X.] duration:
677.02516ms
FAIL (2025-08-16 18:41:05 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 18:40:18.801390613 (193h13m59.532658243s) [upload=201098]: Starting upload Aug 16 18:40:18.801435428 (193h13m59.532703048s) [upload=201098]: Done starting upload Aug 16 18:40:18.801531669 (193h13m59.532799299s) [upload=201098]: Uploading segments... Aug 16 18:40:18.801736705 (193h13m59.533004335s) [upload=201098]: Got next segment. Inline: false Aug 16 18:40:18.801765299 (193h13m59.533032929s) [upload=201098]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 18:40:18.801769106 (193h13m59.533036726s) [upload=201098]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 18:40:18.804610396 (193h13m59.535878016s) [upload=201098]: Next segment err: metaclient: Too Many Requests Aug 16 18:40:18.804622538 (193h13m59.535890169s) [upload=201098]: Done uploading segments... Aug 16 18:40:18.804631306 (193h13m59.535898936s) [upload=201098]: Upload finished. err: metaclient: Too Many Requests
Duration: 677.046019ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................................X...........X.............] duration:
164.126562ms
FAIL (2025-08-16 18:40:43 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 18:30:20.656629884 (193h4m1.387897535s) [upload=200914]: Starting upload Aug 16 18:30:20.656698023 (193h4m1.387965672s) [upload=200914]: Done starting upload Aug 16 18:30:20.656779016 (193h4m1.388046665s) [upload=200914]: Uploading segments... Aug 16 18:30:20.656835431 (193h4m1.388103081s) [upload=200914]: Got next segment. Inline: true Aug 16 18:30:20.656842083 (193h4m1.388109744s) [upload=200914]: Waiting for error group managing segments... Aug 16 18:30:20.656913488 (193h4m1.388181139s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 18:30:20.656919560 (193h4m1.38818721s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 18:30:20.656923327 (193h4m1.388190977s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 18:30:20.659031257 (193h4m1.390298906s) [upload=200914]: Done uploading segments... Aug 16 18:30:20.659043129 (193h4m1.390310778s) [upload=200914]: Upload finished. err: metaclient: Too Many Requests
Duration: 164.152441ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......................X............................X......X] duration:
16.397026ms
FAIL (2025-08-16 18:40:18 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 18:40:18.801390613 (193h13m59.532658243s) [upload=201098]: Starting upload Aug 16 18:40:18.801435428 (193h13m59.532703048s) [upload=201098]: Done starting upload Aug 16 18:40:18.801531669 (193h13m59.532799299s) [upload=201098]: Uploading segments... Aug 16 18:40:18.801736705 (193h13m59.533004335s) [upload=201098]: Got next segment. Inline: false Aug 16 18:40:18.801765299 (193h13m59.533032929s) [upload=201098]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 18:40:18.801769106 (193h13m59.533036726s) [upload=201098]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 18:40:18.804610396 (193h13m59.535878016s) [upload=201098]: Next segment err: metaclient: Too Many Requests Aug 16 18:40:18.804622538 (193h13m59.535890169s) [upload=201098]: Done uploading segments... Aug 16 18:40:18.804631306 (193h13m59.535898936s) [upload=201098]: Upload finished. err: metaclient: Too Many Requests
Duration: 16.430868ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [X..................................X...........X............] duration:
274.552276ms
FAIL (2025-08-16 18:40:06 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 18:30:20.656629884 (193h4m1.387897535s) [upload=200914]: Starting upload Aug 16 18:30:20.656698023 (193h4m1.387965672s) [upload=200914]: Done starting upload Aug 16 18:30:20.656779016 (193h4m1.388046665s) [upload=200914]: Uploading segments... Aug 16 18:30:20.656835431 (193h4m1.388103081s) [upload=200914]: Got next segment. Inline: true Aug 16 18:30:20.656842083 (193h4m1.388109744s) [upload=200914]: Waiting for error group managing segments... Aug 16 18:30:20.656913488 (193h4m1.388181139s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 18:30:20.656919560 (193h4m1.38818721s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 18:30:20.656923327 (193h4m1.388190977s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 18:30:20.659031257 (193h4m1.390298906s) [upload=200914]: Done uploading segments... Aug 16 18:30:20.659043129 (193h4m1.390310778s) [upload=200914]: Upload finished. err: metaclient: Too Many Requests
Duration: 274.573136ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........................X............................X......] duration:
500.798103ms
FAIL (2025-08-16 18:39:34 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 18:34:33.908332876 (193h8m14.639600496s) [upload=200990]: Starting upload Aug 16 18:34:33.908371991 (193h8m14.639639611s) [upload=200990]: Done starting upload Aug 16 18:34:33.908443294 (193h8m14.639710914s) [upload=200990]: Uploading segments... Aug 16 18:34:33.908688737 (193h8m14.639956367s) [upload=200990]: Got next segment. Inline: false Aug 16 18:34:33.908730625 (193h8m14.639998255s) [upload=200990]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 18:34:33.908736747 (193h8m14.640004377s) [upload=200990]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 18:34:33.911117299 (193h8m14.642384929s) [upload=200990]: Next segment err: metaclient: Too Many Requests Aug 16 18:34:33.911125695 (193h8m14.642393325s) [upload=200990]: Done uploading segments... Aug 16 18:34:33.911133600 (193h8m14.64240123s) [upload=200990]: Upload finished. err: metaclient: Too Many Requests
Duration: 500.817839ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.X..................................X...........X...........] duration:
322.48976ms
FAIL (2025-08-16 18:39:10 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 18:30:20.656629884 (193h4m1.387897535s) [upload=200914]: Starting upload Aug 16 18:30:20.656698023 (193h4m1.387965672s) [upload=200914]: Done starting upload Aug 16 18:30:20.656779016 (193h4m1.388046665s) [upload=200914]: Uploading segments... Aug 16 18:30:20.656835431 (193h4m1.388103081s) [upload=200914]: Got next segment. Inline: true Aug 16 18:30:20.656842083 (193h4m1.388109744s) [upload=200914]: Waiting for error group managing segments... Aug 16 18:30:20.656913488 (193h4m1.388181139s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 18:30:20.656919560 (193h4m1.38818721s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 18:30:20.656923327 (193h4m1.388190977s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 18:30:20.659031257 (193h4m1.390298906s) [upload=200914]: Done uploading segments... Aug 16 18:30:20.659043129 (193h4m1.390310778s) [upload=200914]: Upload finished. err: metaclient: Too Many Requests
Duration: 322.513766ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........................X............................X.....] duration:
701.06784ms
FAIL (2025-08-16 18:38:59 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 18:34:33.908332876 (193h8m14.639600496s) [upload=200990]: Starting upload Aug 16 18:34:33.908371991 (193h8m14.639639611s) [upload=200990]: Done starting upload Aug 16 18:34:33.908443294 (193h8m14.639710914s) [upload=200990]: Uploading segments... Aug 16 18:34:33.908688737 (193h8m14.639956367s) [upload=200990]: Got next segment. Inline: false Aug 16 18:34:33.908730625 (193h8m14.639998255s) [upload=200990]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 18:34:33.908736747 (193h8m14.640004377s) [upload=200990]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 18:34:33.911117299 (193h8m14.642384929s) [upload=200990]: Next segment err: metaclient: Too Many Requests Aug 16 18:34:33.911125695 (193h8m14.642393325s) [upload=200990]: Done uploading segments... Aug 16 18:34:33.911133600 (193h8m14.64240123s) [upload=200990]: Upload finished. err: metaclient: Too Many Requests
Duration: 701.085354ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..X..................................X...........X..........] duration:
334.84747ms
FAIL (2025-08-16 18:38:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 18:30:20.656629884 (193h4m1.387897535s) [upload=200914]: Starting upload Aug 16 18:30:20.656698023 (193h4m1.387965672s) [upload=200914]: Done starting upload Aug 16 18:30:20.656779016 (193h4m1.388046665s) [upload=200914]: Uploading segments... Aug 16 18:30:20.656835431 (193h4m1.388103081s) [upload=200914]: Got next segment. Inline: true Aug 16 18:30:20.656842083 (193h4m1.388109744s) [upload=200914]: Waiting for error group managing segments... Aug 16 18:30:20.656913488 (193h4m1.388181139s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 18:30:20.656919560 (193h4m1.38818721s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 18:30:20.656923327 (193h4m1.388190977s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 18:30:20.659031257 (193h4m1.390298906s) [upload=200914]: Done uploading segments... Aug 16 18:30:20.659043129 (193h4m1.390310778s) [upload=200914]: Upload finished. err: metaclient: Too Many Requests
Duration: 334.87484ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........................X............................X....] duration:
559.653477ms
FAIL (2025-08-16 18:38:14 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 18:34:33.908332876 (193h8m14.639600496s) [upload=200990]: Starting upload Aug 16 18:34:33.908371991 (193h8m14.639639611s) [upload=200990]: Done starting upload Aug 16 18:34:33.908443294 (193h8m14.639710914s) [upload=200990]: Uploading segments... Aug 16 18:34:33.908688737 (193h8m14.639956367s) [upload=200990]: Got next segment. Inline: false Aug 16 18:34:33.908730625 (193h8m14.639998255s) [upload=200990]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 18:34:33.908736747 (193h8m14.640004377s) [upload=200990]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 18:34:33.911117299 (193h8m14.642384929s) [upload=200990]: Next segment err: metaclient: Too Many Requests Aug 16 18:34:33.911125695 (193h8m14.642393325s) [upload=200990]: Done uploading segments... Aug 16 18:34:33.911133600 (193h8m14.64240123s) [upload=200990]: Upload finished. err: metaclient: Too Many Requests
Duration: 559.667733ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...X..................................X...........X.........] duration:
261.909119ms
FAIL (2025-08-16 18:37:48 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 18:30:20.656629884 (193h4m1.387897535s) [upload=200914]: Starting upload Aug 16 18:30:20.656698023 (193h4m1.387965672s) [upload=200914]: Done starting upload Aug 16 18:30:20.656779016 (193h4m1.388046665s) [upload=200914]: Uploading segments... Aug 16 18:30:20.656835431 (193h4m1.388103081s) [upload=200914]: Got next segment. Inline: true Aug 16 18:30:20.656842083 (193h4m1.388109744s) [upload=200914]: Waiting for error group managing segments... Aug 16 18:30:20.656913488 (193h4m1.388181139s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 18:30:20.656919560 (193h4m1.38818721s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 18:30:20.656923327 (193h4m1.388190977s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 18:30:20.659031257 (193h4m1.390298906s) [upload=200914]: Done uploading segments... Aug 16 18:30:20.659043129 (193h4m1.390310778s) [upload=200914]: Upload finished. err: metaclient: Too Many Requests
Duration: 261.928526ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....X..................................X...........X........] duration:
157.524209ms
FAIL (2025-08-16 18:37:29 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 18:30:20.656629884 (193h4m1.387897535s) [upload=200914]: Starting upload Aug 16 18:30:20.656698023 (193h4m1.387965672s) [upload=200914]: Done starting upload Aug 16 18:30:20.656779016 (193h4m1.388046665s) [upload=200914]: Uploading segments... Aug 16 18:30:20.656835431 (193h4m1.388103081s) [upload=200914]: Got next segment. Inline: true Aug 16 18:30:20.656842083 (193h4m1.388109744s) [upload=200914]: Waiting for error group managing segments... Aug 16 18:30:20.656913488 (193h4m1.388181139s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 18:30:20.656919560 (193h4m1.38818721s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 18:30:20.656923327 (193h4m1.388190977s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 18:30:20.659031257 (193h4m1.390298906s) [upload=200914]: Done uploading segments... Aug 16 18:30:20.659043129 (193h4m1.390310778s) [upload=200914]: Upload finished. err: metaclient: Too Many Requests
Duration: 157.5462ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........................X............................X...] duration:
689.172915ms
FAIL (2025-08-16 18:37:03 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 18:34:33.908332876 (193h8m14.639600496s) [upload=200990]: Starting upload Aug 16 18:34:33.908371991 (193h8m14.639639611s) [upload=200990]: Done starting upload Aug 16 18:34:33.908443294 (193h8m14.639710914s) [upload=200990]: Uploading segments... Aug 16 18:34:33.908688737 (193h8m14.639956367s) [upload=200990]: Got next segment. Inline: false Aug 16 18:34:33.908730625 (193h8m14.639998255s) [upload=200990]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 18:34:33.908736747 (193h8m14.640004377s) [upload=200990]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 18:34:33.911117299 (193h8m14.642384929s) [upload=200990]: Next segment err: metaclient: Too Many Requests Aug 16 18:34:33.911125695 (193h8m14.642393325s) [upload=200990]: Done uploading segments... Aug 16 18:34:33.911133600 (193h8m14.64240123s) [upload=200990]: Upload finished. err: metaclient: Too Many Requests
Duration: 689.195128ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....X..................................X...........X.......] duration:
1.455985159s
FAIL (2025-08-16 18:36:16 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 18:30:20.656629884 (193h4m1.387897535s) [upload=200914]: Starting upload Aug 16 18:30:20.656698023 (193h4m1.387965672s) [upload=200914]: Done starting upload Aug 16 18:30:20.656779016 (193h4m1.388046665s) [upload=200914]: Uploading segments... Aug 16 18:30:20.656835431 (193h4m1.388103081s) [upload=200914]: Got next segment. Inline: true Aug 16 18:30:20.656842083 (193h4m1.388109744s) [upload=200914]: Waiting for error group managing segments... Aug 16 18:30:20.656913488 (193h4m1.388181139s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 18:30:20.656919560 (193h4m1.38818721s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 18:30:20.656923327 (193h4m1.388190977s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 18:30:20.659031257 (193h4m1.390298906s) [upload=200914]: Done uploading segments... Aug 16 18:30:20.659043129 (193h4m1.390310778s) [upload=200914]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.456009164s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [............................X............................X..] duration:
885.901733ms
FAIL (2025-08-16 18:36:05 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 18:34:33.908332876 (193h8m14.639600496s) [upload=200990]: Starting upload Aug 16 18:34:33.908371991 (193h8m14.639639611s) [upload=200990]: Done starting upload Aug 16 18:34:33.908443294 (193h8m14.639710914s) [upload=200990]: Uploading segments... Aug 16 18:34:33.908688737 (193h8m14.639956367s) [upload=200990]: Got next segment. Inline: false Aug 16 18:34:33.908730625 (193h8m14.639998255s) [upload=200990]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 18:34:33.908736747 (193h8m14.640004377s) [upload=200990]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 18:34:33.911117299 (193h8m14.642384929s) [upload=200990]: Next segment err: metaclient: Too Many Requests Aug 16 18:34:33.911125695 (193h8m14.642393325s) [upload=200990]: Done uploading segments... Aug 16 18:34:33.911133600 (193h8m14.64240123s) [upload=200990]: Upload finished. err: metaclient: Too Many Requests
Duration: 885.92083ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [......X..................................X...........X......] duration:
231.98794ms
FAIL (2025-08-16 18:35:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 18:30:20.656629884 (193h4m1.387897535s) [upload=200914]: Starting upload Aug 16 18:30:20.656698023 (193h4m1.387965672s) [upload=200914]: Done starting upload Aug 16 18:30:20.656779016 (193h4m1.388046665s) [upload=200914]: Uploading segments... Aug 16 18:30:20.656835431 (193h4m1.388103081s) [upload=200914]: Got next segment. Inline: true Aug 16 18:30:20.656842083 (193h4m1.388109744s) [upload=200914]: Waiting for error group managing segments... Aug 16 18:30:20.656913488 (193h4m1.388181139s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 18:30:20.656919560 (193h4m1.38818721s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 18:30:20.656923327 (193h4m1.388190977s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 18:30:20.659031257 (193h4m1.390298906s) [upload=200914]: Done uploading segments... Aug 16 18:30:20.659043129 (193h4m1.390310778s) [upload=200914]: Upload finished. err: metaclient: Too Many Requests
Duration: 232.002137ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............................X............................X.] duration:
820.128666ms
FAIL (2025-08-16 18:35:11 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 18:34:33.908332876 (193h8m14.639600496s) [upload=200990]: Starting upload Aug 16 18:34:33.908371991 (193h8m14.639639611s) [upload=200990]: Done starting upload Aug 16 18:34:33.908443294 (193h8m14.639710914s) [upload=200990]: Uploading segments... Aug 16 18:34:33.908688737 (193h8m14.639956367s) [upload=200990]: Got next segment. Inline: false Aug 16 18:34:33.908730625 (193h8m14.639998255s) [upload=200990]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 18:34:33.908736747 (193h8m14.640004377s) [upload=200990]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 18:34:33.911117299 (193h8m14.642384929s) [upload=200990]: Next segment err: metaclient: Too Many Requests Aug 16 18:34:33.911125695 (193h8m14.642393325s) [upload=200990]: Done uploading segments... Aug 16 18:34:33.911133600 (193h8m14.64240123s) [upload=200990]: Upload finished. err: metaclient: Too Many Requests
Duration: 820.14691ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............................X............................X] duration:
15.294909ms
FAIL (2025-08-16 18:34:33 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 18:34:33.908332876 (193h8m14.639600496s) [upload=200990]: Starting upload Aug 16 18:34:33.908371991 (193h8m14.639639611s) [upload=200990]: Done starting upload Aug 16 18:34:33.908443294 (193h8m14.639710914s) [upload=200990]: Uploading segments... Aug 16 18:34:33.908688737 (193h8m14.639956367s) [upload=200990]: Got next segment. Inline: false Aug 16 18:34:33.908730625 (193h8m14.639998255s) [upload=200990]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 18:34:33.908736747 (193h8m14.640004377s) [upload=200990]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 18:34:33.911117299 (193h8m14.642384929s) [upload=200990]: Next segment err: metaclient: Too Many Requests Aug 16 18:34:33.911125695 (193h8m14.642393325s) [upload=200990]: Done uploading segments... Aug 16 18:34:33.911133600 (193h8m14.64240123s) [upload=200990]: Upload finished. err: metaclient: Too Many Requests
Duration: 15.309367ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.......X..................................X...........X.....] duration:
281.242234ms
FAIL (2025-08-16 18:34:33 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 18:30:20.656629884 (193h4m1.387897535s) [upload=200914]: Starting upload Aug 16 18:30:20.656698023 (193h4m1.387965672s) [upload=200914]: Done starting upload Aug 16 18:30:20.656779016 (193h4m1.388046665s) [upload=200914]: Uploading segments... Aug 16 18:30:20.656835431 (193h4m1.388103081s) [upload=200914]: Got next segment. Inline: true Aug 16 18:30:20.656842083 (193h4m1.388109744s) [upload=200914]: Waiting for error group managing segments... Aug 16 18:30:20.656913488 (193h4m1.388181139s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 18:30:20.656919560 (193h4m1.38818721s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 18:30:20.656923327 (193h4m1.388190977s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 18:30:20.659031257 (193h4m1.390298906s) [upload=200914]: Done uploading segments... Aug 16 18:30:20.659043129 (193h4m1.390310778s) [upload=200914]: Upload finished. err: metaclient: Too Many Requests
Duration: 281.259847ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [........X..................................X...........X....] duration:
465.973531ms
FAIL (2025-08-16 18:33:40 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 18:30:20.656629884 (193h4m1.387897535s) [upload=200914]: Starting upload Aug 16 18:30:20.656698023 (193h4m1.387965672s) [upload=200914]: Done starting upload Aug 16 18:30:20.656779016 (193h4m1.388046665s) [upload=200914]: Uploading segments... Aug 16 18:30:20.656835431 (193h4m1.388103081s) [upload=200914]: Got next segment. Inline: true Aug 16 18:30:20.656842083 (193h4m1.388109744s) [upload=200914]: Waiting for error group managing segments... Aug 16 18:30:20.656913488 (193h4m1.388181139s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 18:30:20.656919560 (193h4m1.38818721s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 18:30:20.656923327 (193h4m1.388190977s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 18:30:20.659031257 (193h4m1.390298906s) [upload=200914]: Done uploading segments... Aug 16 18:30:20.659043129 (193h4m1.390310778s) [upload=200914]: Upload finished. err: metaclient: Too Many Requests
Duration: 466.002104ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
641.19131ms
FAIL (2025-08-16 18:33:38 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 18:11:59.810950376 (192h45m40.542218036s) [upload=200598]: Starting upload Aug 16 18:11:59.811018714 (192h45m40.542286364s) [upload=200598]: Done starting upload Aug 16 18:11:59.811129794 (192h45m40.542397443s) [upload=200598]: Uploading segments... Aug 16 18:11:59.811478050 (192h45m40.5427457s) [upload=200598]: Got next segment. Inline: false Aug 16 18:11:59.811525849 (192h45m40.542793499s) [upload=200598]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 18:11:59.811532352 (192h45m40.542800001s) [upload=200598]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 18:11:59.813997655 (192h45m40.545265306s) [upload=200598]: Next segment err: metaclient: Too Many Requests Aug 16 18:11:59.814013364 (192h45m40.545281015s) [upload=200598]: Done uploading segments... Aug 16 18:11:59.814026319 (192h45m40.545293969s) [upload=200598]: Upload finished. err: metaclient: Too Many Requests
Duration: 641.220513ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
691.761758ms
FAIL (2025-08-16 18:33:14 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 18:11:59.810950376 (192h45m40.542218036s) [upload=200598]: Starting upload Aug 16 18:11:59.811018714 (192h45m40.542286364s) [upload=200598]: Done starting upload Aug 16 18:11:59.811129794 (192h45m40.542397443s) [upload=200598]: Uploading segments... Aug 16 18:11:59.811478050 (192h45m40.5427457s) [upload=200598]: Got next segment. Inline: false Aug 16 18:11:59.811525849 (192h45m40.542793499s) [upload=200598]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 18:11:59.811532352 (192h45m40.542800001s) [upload=200598]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 18:11:59.813997655 (192h45m40.545265306s) [upload=200598]: Next segment err: metaclient: Too Many Requests Aug 16 18:11:59.814013364 (192h45m40.545281015s) [upload=200598]: Done uploading segments... Aug 16 18:11:59.814026319 (192h45m40.545293969s) [upload=200598]: Upload finished. err: metaclient: Too Many Requests
Duration: 691.787047ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.........X..................................X...........X...] duration:
377.457662ms
FAIL (2025-08-16 18:32:26 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 18:30:20.656629884 (193h4m1.387897535s) [upload=200914]: Starting upload Aug 16 18:30:20.656698023 (193h4m1.387965672s) [upload=200914]: Done starting upload Aug 16 18:30:20.656779016 (193h4m1.388046665s) [upload=200914]: Uploading segments... Aug 16 18:30:20.656835431 (193h4m1.388103081s) [upload=200914]: Got next segment. Inline: true Aug 16 18:30:20.656842083 (193h4m1.388109744s) [upload=200914]: Waiting for error group managing segments... Aug 16 18:30:20.656913488 (193h4m1.388181139s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 18:30:20.656919560 (193h4m1.38818721s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 18:30:20.656923327 (193h4m1.388190977s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 18:30:20.659031257 (193h4m1.390298906s) [upload=200914]: Done uploading segments... Aug 16 18:30:20.659043129 (193h4m1.390310778s) [upload=200914]: Upload finished. err: metaclient: Too Many Requests
Duration: 377.475515ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|