Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..........X......X.............X............................] duration:
583.96425ms
FAIL (2025-08-16 19:10:14 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 18:50:06.795231389 (193h23m47.52649904s) [upload=201259]: Starting upload
Aug 16 18:50:06.795294448 (193h23m47.526562098s) [upload=201259]: Done starting upload
Aug 16 18:50:06.795449339 (193h23m47.526716989s) [upload=201259]: Uploading segments...
Aug 16 18:50:06.795693649 (193h23m47.5269613s) [upload=201259]: Got next segment. Inline: false
Aug 16 18:50:06.795759203 (193h23m47.527026853s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 18:50:06.795765165 (193h23m47.527032824s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 18:50:06.841060252 (193h23m47.572327901s) [seg_pos={0 0}, upload=201259]: Begin upload segment...
Aug 16 18:50:06.841119362 (193h23m47.572387012s) [seg_pos={0 0}, upload=201259]: Done begin upload segment.
Aug 16 18:50:06.841151233 (193h23m47.572418883s) [noise=true , address=104.36.82.35:4587 , piece_id=5JFLAGKDPOYPDZFSKF2DJT6EHCPJHQBHGMV3T4RAPKFOXP5YDVYQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841184625 (193h23m47.572452276s) [noise=true , address=104.36.82.34:4565 , piece_id=NPK7GSWSZWGHSUSETZCCOLVYUK6QE7RCZ5COSLSQ5UJ543W67MGQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841723480 (193h23m47.57299114s) [noise=true , address=104.36.82.20:4446 , piece_id=ZVIY47XJPM2KPHF6QWJYMGVR25PMANDTI3IGB5TTMW3QAT6NDPVQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841804182 (193h23m47.573071831s) [noise=true , address=104.36.82.39:4737 , piece_id=DC7GL4U6VY3SO6KZAXQNAK54AT2WFZBJUZM2WEFWLQKS5ULQJ3UQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.842218111 (193h23m47.573485761s) [noise=true , address=77.90.31.19:4870 , piece_id=76KXS2TZPI5OH3TESKHQNCKO34UP5YPFAQ5EPKB4LKST3PSWNY7Q, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.842347224 (193h23m47.573614874s) [noise=true , address=77.90.31.13:4657 , piece_id=3T2AY52BCUCXPSJHCPFDT4MNDY3RJVULG6X52HT4PKY7SJQ464SA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.843304817 (193h23m47.574572467s) [noise=true , address=104.36.82.37:4657 , piece_id=DOCMOQXG2TIS3MHSMBHQNEKZFUSXLKENOQXGWLQRYEYFD2OBJ2LA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.843418962 (193h23m47.574686612s) [noise=true , address=104.36.82.21:4476 , piece_id=H52MJNGMGSKORKKOPNBMVFOSFCKMCJOBET5NIQFAWZ5JDLTLY4ZQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844011178 (193h23m47.575278828s) [noise=true , address=45.91.116.5:4321 , piece_id=R4V5GAA7COM6Z2FAH7REIIDOMB7EJ2HUJHAWRWVNJRJV5WREPUSQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844142576 (193h23m47.575410225s) [noise=true , address=104.36.82.7:4933 , piece_id=GERLHPHJEVE5AVHI5VM4TCEDJC7PAAFHYAHPTETVC5NBMWTSFAFQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844882007 (193h23m47.576149657s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2F5PRGNYWIKKROX5EVNMCDUPJZPIOFJBN35YXEH4H5BKINRJKPQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.845386287 (193h23m47.576653947s) [noise=true , address=77.90.31.14:4681 , piece_id=F2C4U4NYLA5TGZSPC35WB2XH3YVQZNAYYPCGH66IIDLVSX7WZXKQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.845864367 (193h23m47.577132018s) [noise=true , address=45.91.116.10:4100 , piece_id=JMZXTBLEKC5X6I3T2P4XX32GGIXSH6IW4QCKFZFLTM5JQEBMLECQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.846491107 (193h23m47.577758757s) [noise=true , address=104.36.82.23:4447 , piece_id=H2XVFVY64HORCHUCFXZUQM7H4EWXQPV6YENXX7EEOOMCZTW4N6CA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.846703747 (193h23m47.577971408s) [noise=true , address=104.36.82.14:4230 , piece_id=WTOJ6THOEIOMF72YGNYOKRGYJQJF4FQP4VGDW2QQ2326DGTUSHCQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.847183361 (193h23m47.578451012s) [noise=true , address=77.90.31.10:4521 , piece_id=DJ2ZHTVZZ7SPBYTO2WH2BMDPS37K7MSYBPA3SHWXB3TM5FLTOZYQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.847384710 (193h23m47.57865236s) [noise=true , address=104.36.82.3:4793 , piece_id=47HFN7SSBLKV4Q2MTDVFC4GBNIPATKO6LRUOC4G2AW7A4MFAI6GA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.848437041 (193h23m47.579704692s) [noise=true , address=104.36.82.59:4313 , piece_id=J47ZWGLHUN7ECNRGXZZ42Q375WKFHUJN3XLYEGX2CMHC2RUWZJCA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.984012580 (193h23m47.71528023s) [upload=201259]: Next returned nil segment
Aug 16 18:50:06.984029241 (193h23m47.715296871s) [upload=201259]: Waiting for error group managing segments...
Aug 16 18:50:06.996112904 (193h23m47.727380564s) [noise=true , address=104.36.82.14:4230 , piece_id=WTOJ6THOEIOMF72YGNYOKRGYJQJF4FQP4VGDW2QQ2326DGTUSHCQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:06.999695960 (193h23m47.73096362s) [noise=true , address=104.36.82.39:4737 , piece_id=DC7GL4U6VY3SO6KZAXQNAK54AT2WFZBJUZM2WEFWLQKS5ULQJ3UQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.025463880 (193h23m47.756731529s) [noise=true , address=77.90.31.13:4657 , piece_id=3T2AY52BCUCXPSJHCPFDT4MNDY3RJVULG6X52HT4PKY7SJQ464SA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.027404303 (193h23m47.758671953s) [noise=true , address=104.36.82.21:4476 , piece_id=H52MJNGMGSKORKKOPNBMVFOSFCKMCJOBET5NIQFAWZ5JDLTLY4ZQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.031728906 (193h23m47.762996565s) [noise=true , address=77.90.31.14:4681 , piece_id=F2C4U4NYLA5TGZSPC35WB2XH3YVQZNAYYPCGH66IIDLVSX7WZXKQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.032687090 (193h23m47.76395474s) [noise=true , address=104.36.82.59:4313 , piece_id=J47ZWGLHUN7ECNRGXZZ42Q375WKFHUJN3XLYEGX2CMHC2RUWZJCA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.037670705 (193h23m47.768938354s) [noise=true , address=77.90.31.19:4870 , piece_id=76KXS2TZPI5OH3TESKHQNCKO34UP5YPFAQ5EPKB4LKST3PSWNY7Q, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.039026547 (193h23m47.770294198s) [noise=true , address=104.36.82.35:4587 , piece_id=5JFLAGKDPOYPDZFSKF2DJT6EHCPJHQBHGMV3T4RAPKFOXP5YDVYQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.039608773 (193h23m47.770876424s) [noise=true , address=104.36.82.20:4446 , piece_id=ZVIY47XJPM2KPHF6QWJYMGVR25PMANDTI3IGB5TTMW3QAT6NDPVQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.052389308 (193h23m47.783656959s) [noise=true , address=104.36.82.7:4933 , piece_id=GERLHPHJEVE5AVHI5VM4TCEDJC7PAAFHYAHPTETVC5NBMWTSFAFQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.052813196 (193h23m47.784080856s) [noise=true , address=104.36.82.37:4657 , piece_id=DOCMOQXG2TIS3MHSMBHQNEKZFUSXLKENOQXGWLQRYEYFD2OBJ2LA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.067727990 (193h23m47.79899564s) [noise=true , address=45.91.116.10:4100 , piece_id=JMZXTBLEKC5X6I3T2P4XX32GGIXSH6IW4QCKFZFLTM5JQEBMLECQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.077757915 (193h23m47.809025565s) [noise=true , address=104.36.82.34:4565 , piece_id=NPK7GSWSZWGHSUSETZCCOLVYUK6QE7RCZ5COSLSQ5UJ543W67MGQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.088885418 (193h23m47.820153067s) [noise=true , address=104.36.82.3:4793 , piece_id=47HFN7SSBLKV4Q2MTDVFC4GBNIPATKO6LRUOC4G2AW7A4MFAI6GA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.088946764 (193h23m47.820214414s) [seg_pos={0 0}, upload=201259]: Segment reached optimal threshold of 14 pieces.
Aug 16 18:50:07.089255815 (193h23m47.820523475s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2F5PRGNYWIKKROX5EVNMCDUPJZPIOFJBN35YXEH4H5BKINRJKPQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sJfMr1nMTpizd5PZ2bZ6M8tZWhFL2ukdJ3cNSRQtdUHNJhg81): protocol: expected piece hash; context canceled; EOF
Aug 16 18:50:07.089271314 (193h23m47.820538974s) [noise=true , address=104.36.82.23:4447 , piece_id=H2XVFVY64HORCHUCFXZUQM7H4EWXQPV6YENXX7EEOOMCZTW4N6CA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fqT9xA7kXTG8K9XwTUxL6FXibV35AkPHDK6grKGHg17fk91fP): protocol: write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection; write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection
Aug 16 18:50:07.089329323 (193h23m47.820596973s) [noise=true , address=77.90.31.10:4521 , piece_id=DJ2ZHTVZZ7SPBYTO2WH2BMDPS37K7MSYBPA3SHWXB3TM5FLTOZYQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WpVJa7SXkANKParDWYrC1cN8aLHTkUSPrRJGKQ6fvA5oDEkoa): protocol: write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection; write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection
Aug 16 18:50:07.089440162 (193h23m47.820707812s) [noise=true , address=45.91.116.5:4321 , piece_id=R4V5GAA7COM6Z2FAH7REIIDOMB7EJ2HUJHAWRWVNJRJV5WREPUSQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12m3Lw8yL9wVq38nW514iaLooMVgikbQBGA9vrFsr66jx5w1xXj): protocol: write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection; write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection
Aug 16 18:50:07.089461401 (193h23m47.820729052s) [seg_pos={0 0}, upload=201259]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 18:50:07.089583131 (193h23m47.820850791s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 18:50:07.089622546 (193h23m47.820890196s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 18:50:07.183064911 (193h23m47.914332561s) [upload=201259]: Done uploading segments...
Aug 16 18:50:07.183080390 (193h23m47.91434804s) [upload=201259]: Upload finished. err: <nil>
Duration: 583.992235ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...........X......X.............X...........................] duration:
615.949266ms
FAIL (2025-08-16 19:09:58 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 18:50:06.795231389 (193h23m47.52649904s) [upload=201259]: Starting upload
Aug 16 18:50:06.795294448 (193h23m47.526562098s) [upload=201259]: Done starting upload
Aug 16 18:50:06.795449339 (193h23m47.526716989s) [upload=201259]: Uploading segments...
Aug 16 18:50:06.795693649 (193h23m47.5269613s) [upload=201259]: Got next segment. Inline: false
Aug 16 18:50:06.795759203 (193h23m47.527026853s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 18:50:06.795765165 (193h23m47.527032824s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 18:50:06.841060252 (193h23m47.572327901s) [seg_pos={0 0}, upload=201259]: Begin upload segment...
Aug 16 18:50:06.841119362 (193h23m47.572387012s) [seg_pos={0 0}, upload=201259]: Done begin upload segment.
Aug 16 18:50:06.841151233 (193h23m47.572418883s) [noise=true , address=104.36.82.35:4587 , piece_id=5JFLAGKDPOYPDZFSKF2DJT6EHCPJHQBHGMV3T4RAPKFOXP5YDVYQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841184625 (193h23m47.572452276s) [noise=true , address=104.36.82.34:4565 , piece_id=NPK7GSWSZWGHSUSETZCCOLVYUK6QE7RCZ5COSLSQ5UJ543W67MGQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841723480 (193h23m47.57299114s) [noise=true , address=104.36.82.20:4446 , piece_id=ZVIY47XJPM2KPHF6QWJYMGVR25PMANDTI3IGB5TTMW3QAT6NDPVQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841804182 (193h23m47.573071831s) [noise=true , address=104.36.82.39:4737 , piece_id=DC7GL4U6VY3SO6KZAXQNAK54AT2WFZBJUZM2WEFWLQKS5ULQJ3UQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.842218111 (193h23m47.573485761s) [noise=true , address=77.90.31.19:4870 , piece_id=76KXS2TZPI5OH3TESKHQNCKO34UP5YPFAQ5EPKB4LKST3PSWNY7Q, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.842347224 (193h23m47.573614874s) [noise=true , address=77.90.31.13:4657 , piece_id=3T2AY52BCUCXPSJHCPFDT4MNDY3RJVULG6X52HT4PKY7SJQ464SA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.843304817 (193h23m47.574572467s) [noise=true , address=104.36.82.37:4657 , piece_id=DOCMOQXG2TIS3MHSMBHQNEKZFUSXLKENOQXGWLQRYEYFD2OBJ2LA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.843418962 (193h23m47.574686612s) [noise=true , address=104.36.82.21:4476 , piece_id=H52MJNGMGSKORKKOPNBMVFOSFCKMCJOBET5NIQFAWZ5JDLTLY4ZQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844011178 (193h23m47.575278828s) [noise=true , address=45.91.116.5:4321 , piece_id=R4V5GAA7COM6Z2FAH7REIIDOMB7EJ2HUJHAWRWVNJRJV5WREPUSQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844142576 (193h23m47.575410225s) [noise=true , address=104.36.82.7:4933 , piece_id=GERLHPHJEVE5AVHI5VM4TCEDJC7PAAFHYAHPTETVC5NBMWTSFAFQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844882007 (193h23m47.576149657s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2F5PRGNYWIKKROX5EVNMCDUPJZPIOFJBN35YXEH4H5BKINRJKPQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.845386287 (193h23m47.576653947s) [noise=true , address=77.90.31.14:4681 , piece_id=F2C4U4NYLA5TGZSPC35WB2XH3YVQZNAYYPCGH66IIDLVSX7WZXKQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.845864367 (193h23m47.577132018s) [noise=true , address=45.91.116.10:4100 , piece_id=JMZXTBLEKC5X6I3T2P4XX32GGIXSH6IW4QCKFZFLTM5JQEBMLECQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.846491107 (193h23m47.577758757s) [noise=true , address=104.36.82.23:4447 , piece_id=H2XVFVY64HORCHUCFXZUQM7H4EWXQPV6YENXX7EEOOMCZTW4N6CA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.846703747 (193h23m47.577971408s) [noise=true , address=104.36.82.14:4230 , piece_id=WTOJ6THOEIOMF72YGNYOKRGYJQJF4FQP4VGDW2QQ2326DGTUSHCQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.847183361 (193h23m47.578451012s) [noise=true , address=77.90.31.10:4521 , piece_id=DJ2ZHTVZZ7SPBYTO2WH2BMDPS37K7MSYBPA3SHWXB3TM5FLTOZYQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.847384710 (193h23m47.57865236s) [noise=true , address=104.36.82.3:4793 , piece_id=47HFN7SSBLKV4Q2MTDVFC4GBNIPATKO6LRUOC4G2AW7A4MFAI6GA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.848437041 (193h23m47.579704692s) [noise=true , address=104.36.82.59:4313 , piece_id=J47ZWGLHUN7ECNRGXZZ42Q375WKFHUJN3XLYEGX2CMHC2RUWZJCA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.984012580 (193h23m47.71528023s) [upload=201259]: Next returned nil segment
Aug 16 18:50:06.984029241 (193h23m47.715296871s) [upload=201259]: Waiting for error group managing segments...
Aug 16 18:50:06.996112904 (193h23m47.727380564s) [noise=true , address=104.36.82.14:4230 , piece_id=WTOJ6THOEIOMF72YGNYOKRGYJQJF4FQP4VGDW2QQ2326DGTUSHCQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:06.999695960 (193h23m47.73096362s) [noise=true , address=104.36.82.39:4737 , piece_id=DC7GL4U6VY3SO6KZAXQNAK54AT2WFZBJUZM2WEFWLQKS5ULQJ3UQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.025463880 (193h23m47.756731529s) [noise=true , address=77.90.31.13:4657 , piece_id=3T2AY52BCUCXPSJHCPFDT4MNDY3RJVULG6X52HT4PKY7SJQ464SA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.027404303 (193h23m47.758671953s) [noise=true , address=104.36.82.21:4476 , piece_id=H52MJNGMGSKORKKOPNBMVFOSFCKMCJOBET5NIQFAWZ5JDLTLY4ZQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.031728906 (193h23m47.762996565s) [noise=true , address=77.90.31.14:4681 , piece_id=F2C4U4NYLA5TGZSPC35WB2XH3YVQZNAYYPCGH66IIDLVSX7WZXKQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.032687090 (193h23m47.76395474s) [noise=true , address=104.36.82.59:4313 , piece_id=J47ZWGLHUN7ECNRGXZZ42Q375WKFHUJN3XLYEGX2CMHC2RUWZJCA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.037670705 (193h23m47.768938354s) [noise=true , address=77.90.31.19:4870 , piece_id=76KXS2TZPI5OH3TESKHQNCKO34UP5YPFAQ5EPKB4LKST3PSWNY7Q, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.039026547 (193h23m47.770294198s) [noise=true , address=104.36.82.35:4587 , piece_id=5JFLAGKDPOYPDZFSKF2DJT6EHCPJHQBHGMV3T4RAPKFOXP5YDVYQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.039608773 (193h23m47.770876424s) [noise=true , address=104.36.82.20:4446 , piece_id=ZVIY47XJPM2KPHF6QWJYMGVR25PMANDTI3IGB5TTMW3QAT6NDPVQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.052389308 (193h23m47.783656959s) [noise=true , address=104.36.82.7:4933 , piece_id=GERLHPHJEVE5AVHI5VM4TCEDJC7PAAFHYAHPTETVC5NBMWTSFAFQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.052813196 (193h23m47.784080856s) [noise=true , address=104.36.82.37:4657 , piece_id=DOCMOQXG2TIS3MHSMBHQNEKZFUSXLKENOQXGWLQRYEYFD2OBJ2LA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.067727990 (193h23m47.79899564s) [noise=true , address=45.91.116.10:4100 , piece_id=JMZXTBLEKC5X6I3T2P4XX32GGIXSH6IW4QCKFZFLTM5JQEBMLECQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.077757915 (193h23m47.809025565s) [noise=true , address=104.36.82.34:4565 , piece_id=NPK7GSWSZWGHSUSETZCCOLVYUK6QE7RCZ5COSLSQ5UJ543W67MGQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.088885418 (193h23m47.820153067s) [noise=true , address=104.36.82.3:4793 , piece_id=47HFN7SSBLKV4Q2MTDVFC4GBNIPATKO6LRUOC4G2AW7A4MFAI6GA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.088946764 (193h23m47.820214414s) [seg_pos={0 0}, upload=201259]: Segment reached optimal threshold of 14 pieces.
Aug 16 18:50:07.089255815 (193h23m47.820523475s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2F5PRGNYWIKKROX5EVNMCDUPJZPIOFJBN35YXEH4H5BKINRJKPQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sJfMr1nMTpizd5PZ2bZ6M8tZWhFL2ukdJ3cNSRQtdUHNJhg81): protocol: expected piece hash; context canceled; EOF
Aug 16 18:50:07.089271314 (193h23m47.820538974s) [noise=true , address=104.36.82.23:4447 , piece_id=H2XVFVY64HORCHUCFXZUQM7H4EWXQPV6YENXX7EEOOMCZTW4N6CA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fqT9xA7kXTG8K9XwTUxL6FXibV35AkPHDK6grKGHg17fk91fP): protocol: write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection; write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection
Aug 16 18:50:07.089329323 (193h23m47.820596973s) [noise=true , address=77.90.31.10:4521 , piece_id=DJ2ZHTVZZ7SPBYTO2WH2BMDPS37K7MSYBPA3SHWXB3TM5FLTOZYQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WpVJa7SXkANKParDWYrC1cN8aLHTkUSPrRJGKQ6fvA5oDEkoa): protocol: write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection; write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection
Aug 16 18:50:07.089440162 (193h23m47.820707812s) [noise=true , address=45.91.116.5:4321 , piece_id=R4V5GAA7COM6Z2FAH7REIIDOMB7EJ2HUJHAWRWVNJRJV5WREPUSQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12m3Lw8yL9wVq38nW514iaLooMVgikbQBGA9vrFsr66jx5w1xXj): protocol: write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection; write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection
Aug 16 18:50:07.089461401 (193h23m47.820729052s) [seg_pos={0 0}, upload=201259]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 18:50:07.089583131 (193h23m47.820850791s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 18:50:07.089622546 (193h23m47.820890196s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 18:50:07.183064911 (193h23m47.914332561s) [upload=201259]: Done uploading segments...
Aug 16 18:50:07.183080390 (193h23m47.91434804s) [upload=201259]: Upload finished. err: <nil>
Duration: 615.967211ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
259.078886ms
FAIL (2025-08-16 19:09:48 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 18:30:20.656629884 (193h4m1.387897535s) [upload=200914]: Starting upload Aug 16 18:30:20.656698023 (193h4m1.387965672s) [upload=200914]: Done starting upload Aug 16 18:30:20.656779016 (193h4m1.388046665s) [upload=200914]: Uploading segments... Aug 16 18:30:20.656835431 (193h4m1.388103081s) [upload=200914]: Got next segment. Inline: true Aug 16 18:30:20.656842083 (193h4m1.388109744s) [upload=200914]: Waiting for error group managing segments... Aug 16 18:30:20.656913488 (193h4m1.388181139s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 18:30:20.656919560 (193h4m1.38818721s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 18:30:20.656923327 (193h4m1.388190977s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 18:30:20.659031257 (193h4m1.390298906s) [upload=200914]: Done uploading segments... Aug 16 18:30:20.659043129 (193h4m1.390310778s) [upload=200914]: Upload finished. err: metaclient: Too Many Requests
Duration: 259.108321ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
253.713764ms
FAIL (2025-08-16 19:08:54 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 18:30:20.656629884 (193h4m1.387897535s) [upload=200914]: Starting upload Aug 16 18:30:20.656698023 (193h4m1.387965672s) [upload=200914]: Done starting upload Aug 16 18:30:20.656779016 (193h4m1.388046665s) [upload=200914]: Uploading segments... Aug 16 18:30:20.656835431 (193h4m1.388103081s) [upload=200914]: Got next segment. Inline: true Aug 16 18:30:20.656842083 (193h4m1.388109744s) [upload=200914]: Waiting for error group managing segments... Aug 16 18:30:20.656913488 (193h4m1.388181139s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 18:30:20.656919560 (193h4m1.38818721s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 18:30:20.656923327 (193h4m1.388190977s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 18:30:20.659031257 (193h4m1.390298906s) [upload=200914]: Done uploading segments... Aug 16 18:30:20.659043129 (193h4m1.390310778s) [upload=200914]: Upload finished. err: metaclient: Too Many Requests
Duration: 253.736026ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [............X......X.............X..........................] duration:
643.083989ms
FAIL (2025-08-16 19:08:44 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 18:50:06.795231389 (193h23m47.52649904s) [upload=201259]: Starting upload
Aug 16 18:50:06.795294448 (193h23m47.526562098s) [upload=201259]: Done starting upload
Aug 16 18:50:06.795449339 (193h23m47.526716989s) [upload=201259]: Uploading segments...
Aug 16 18:50:06.795693649 (193h23m47.5269613s) [upload=201259]: Got next segment. Inline: false
Aug 16 18:50:06.795759203 (193h23m47.527026853s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 18:50:06.795765165 (193h23m47.527032824s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 18:50:06.841060252 (193h23m47.572327901s) [seg_pos={0 0}, upload=201259]: Begin upload segment...
Aug 16 18:50:06.841119362 (193h23m47.572387012s) [seg_pos={0 0}, upload=201259]: Done begin upload segment.
Aug 16 18:50:06.841151233 (193h23m47.572418883s) [noise=true , address=104.36.82.35:4587 , piece_id=5JFLAGKDPOYPDZFSKF2DJT6EHCPJHQBHGMV3T4RAPKFOXP5YDVYQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841184625 (193h23m47.572452276s) [noise=true , address=104.36.82.34:4565 , piece_id=NPK7GSWSZWGHSUSETZCCOLVYUK6QE7RCZ5COSLSQ5UJ543W67MGQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841723480 (193h23m47.57299114s) [noise=true , address=104.36.82.20:4446 , piece_id=ZVIY47XJPM2KPHF6QWJYMGVR25PMANDTI3IGB5TTMW3QAT6NDPVQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841804182 (193h23m47.573071831s) [noise=true , address=104.36.82.39:4737 , piece_id=DC7GL4U6VY3SO6KZAXQNAK54AT2WFZBJUZM2WEFWLQKS5ULQJ3UQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.842218111 (193h23m47.573485761s) [noise=true , address=77.90.31.19:4870 , piece_id=76KXS2TZPI5OH3TESKHQNCKO34UP5YPFAQ5EPKB4LKST3PSWNY7Q, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.842347224 (193h23m47.573614874s) [noise=true , address=77.90.31.13:4657 , piece_id=3T2AY52BCUCXPSJHCPFDT4MNDY3RJVULG6X52HT4PKY7SJQ464SA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.843304817 (193h23m47.574572467s) [noise=true , address=104.36.82.37:4657 , piece_id=DOCMOQXG2TIS3MHSMBHQNEKZFUSXLKENOQXGWLQRYEYFD2OBJ2LA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.843418962 (193h23m47.574686612s) [noise=true , address=104.36.82.21:4476 , piece_id=H52MJNGMGSKORKKOPNBMVFOSFCKMCJOBET5NIQFAWZ5JDLTLY4ZQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844011178 (193h23m47.575278828s) [noise=true , address=45.91.116.5:4321 , piece_id=R4V5GAA7COM6Z2FAH7REIIDOMB7EJ2HUJHAWRWVNJRJV5WREPUSQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844142576 (193h23m47.575410225s) [noise=true , address=104.36.82.7:4933 , piece_id=GERLHPHJEVE5AVHI5VM4TCEDJC7PAAFHYAHPTETVC5NBMWTSFAFQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844882007 (193h23m47.576149657s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2F5PRGNYWIKKROX5EVNMCDUPJZPIOFJBN35YXEH4H5BKINRJKPQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.845386287 (193h23m47.576653947s) [noise=true , address=77.90.31.14:4681 , piece_id=F2C4U4NYLA5TGZSPC35WB2XH3YVQZNAYYPCGH66IIDLVSX7WZXKQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.845864367 (193h23m47.577132018s) [noise=true , address=45.91.116.10:4100 , piece_id=JMZXTBLEKC5X6I3T2P4XX32GGIXSH6IW4QCKFZFLTM5JQEBMLECQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.846491107 (193h23m47.577758757s) [noise=true , address=104.36.82.23:4447 , piece_id=H2XVFVY64HORCHUCFXZUQM7H4EWXQPV6YENXX7EEOOMCZTW4N6CA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.846703747 (193h23m47.577971408s) [noise=true , address=104.36.82.14:4230 , piece_id=WTOJ6THOEIOMF72YGNYOKRGYJQJF4FQP4VGDW2QQ2326DGTUSHCQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.847183361 (193h23m47.578451012s) [noise=true , address=77.90.31.10:4521 , piece_id=DJ2ZHTVZZ7SPBYTO2WH2BMDPS37K7MSYBPA3SHWXB3TM5FLTOZYQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.847384710 (193h23m47.57865236s) [noise=true , address=104.36.82.3:4793 , piece_id=47HFN7SSBLKV4Q2MTDVFC4GBNIPATKO6LRUOC4G2AW7A4MFAI6GA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.848437041 (193h23m47.579704692s) [noise=true , address=104.36.82.59:4313 , piece_id=J47ZWGLHUN7ECNRGXZZ42Q375WKFHUJN3XLYEGX2CMHC2RUWZJCA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.984012580 (193h23m47.71528023s) [upload=201259]: Next returned nil segment
Aug 16 18:50:06.984029241 (193h23m47.715296871s) [upload=201259]: Waiting for error group managing segments...
Aug 16 18:50:06.996112904 (193h23m47.727380564s) [noise=true , address=104.36.82.14:4230 , piece_id=WTOJ6THOEIOMF72YGNYOKRGYJQJF4FQP4VGDW2QQ2326DGTUSHCQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:06.999695960 (193h23m47.73096362s) [noise=true , address=104.36.82.39:4737 , piece_id=DC7GL4U6VY3SO6KZAXQNAK54AT2WFZBJUZM2WEFWLQKS5ULQJ3UQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.025463880 (193h23m47.756731529s) [noise=true , address=77.90.31.13:4657 , piece_id=3T2AY52BCUCXPSJHCPFDT4MNDY3RJVULG6X52HT4PKY7SJQ464SA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.027404303 (193h23m47.758671953s) [noise=true , address=104.36.82.21:4476 , piece_id=H52MJNGMGSKORKKOPNBMVFOSFCKMCJOBET5NIQFAWZ5JDLTLY4ZQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.031728906 (193h23m47.762996565s) [noise=true , address=77.90.31.14:4681 , piece_id=F2C4U4NYLA5TGZSPC35WB2XH3YVQZNAYYPCGH66IIDLVSX7WZXKQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.032687090 (193h23m47.76395474s) [noise=true , address=104.36.82.59:4313 , piece_id=J47ZWGLHUN7ECNRGXZZ42Q375WKFHUJN3XLYEGX2CMHC2RUWZJCA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.037670705 (193h23m47.768938354s) [noise=true , address=77.90.31.19:4870 , piece_id=76KXS2TZPI5OH3TESKHQNCKO34UP5YPFAQ5EPKB4LKST3PSWNY7Q, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.039026547 (193h23m47.770294198s) [noise=true , address=104.36.82.35:4587 , piece_id=5JFLAGKDPOYPDZFSKF2DJT6EHCPJHQBHGMV3T4RAPKFOXP5YDVYQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.039608773 (193h23m47.770876424s) [noise=true , address=104.36.82.20:4446 , piece_id=ZVIY47XJPM2KPHF6QWJYMGVR25PMANDTI3IGB5TTMW3QAT6NDPVQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.052389308 (193h23m47.783656959s) [noise=true , address=104.36.82.7:4933 , piece_id=GERLHPHJEVE5AVHI5VM4TCEDJC7PAAFHYAHPTETVC5NBMWTSFAFQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.052813196 (193h23m47.784080856s) [noise=true , address=104.36.82.37:4657 , piece_id=DOCMOQXG2TIS3MHSMBHQNEKZFUSXLKENOQXGWLQRYEYFD2OBJ2LA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.067727990 (193h23m47.79899564s) [noise=true , address=45.91.116.10:4100 , piece_id=JMZXTBLEKC5X6I3T2P4XX32GGIXSH6IW4QCKFZFLTM5JQEBMLECQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.077757915 (193h23m47.809025565s) [noise=true , address=104.36.82.34:4565 , piece_id=NPK7GSWSZWGHSUSETZCCOLVYUK6QE7RCZ5COSLSQ5UJ543W67MGQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.088885418 (193h23m47.820153067s) [noise=true , address=104.36.82.3:4793 , piece_id=47HFN7SSBLKV4Q2MTDVFC4GBNIPATKO6LRUOC4G2AW7A4MFAI6GA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.088946764 (193h23m47.820214414s) [seg_pos={0 0}, upload=201259]: Segment reached optimal threshold of 14 pieces.
Aug 16 18:50:07.089255815 (193h23m47.820523475s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2F5PRGNYWIKKROX5EVNMCDUPJZPIOFJBN35YXEH4H5BKINRJKPQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sJfMr1nMTpizd5PZ2bZ6M8tZWhFL2ukdJ3cNSRQtdUHNJhg81): protocol: expected piece hash; context canceled; EOF
Aug 16 18:50:07.089271314 (193h23m47.820538974s) [noise=true , address=104.36.82.23:4447 , piece_id=H2XVFVY64HORCHUCFXZUQM7H4EWXQPV6YENXX7EEOOMCZTW4N6CA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fqT9xA7kXTG8K9XwTUxL6FXibV35AkPHDK6grKGHg17fk91fP): protocol: write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection; write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection
Aug 16 18:50:07.089329323 (193h23m47.820596973s) [noise=true , address=77.90.31.10:4521 , piece_id=DJ2ZHTVZZ7SPBYTO2WH2BMDPS37K7MSYBPA3SHWXB3TM5FLTOZYQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WpVJa7SXkANKParDWYrC1cN8aLHTkUSPrRJGKQ6fvA5oDEkoa): protocol: write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection; write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection
Aug 16 18:50:07.089440162 (193h23m47.820707812s) [noise=true , address=45.91.116.5:4321 , piece_id=R4V5GAA7COM6Z2FAH7REIIDOMB7EJ2HUJHAWRWVNJRJV5WREPUSQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12m3Lw8yL9wVq38nW514iaLooMVgikbQBGA9vrFsr66jx5w1xXj): protocol: write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection; write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection
Aug 16 18:50:07.089461401 (193h23m47.820729052s) [seg_pos={0 0}, upload=201259]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 18:50:07.089583131 (193h23m47.820850791s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 18:50:07.089622546 (193h23m47.820890196s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 18:50:07.183064911 (193h23m47.914332561s) [upload=201259]: Done uploading segments...
Aug 16 18:50:07.183080390 (193h23m47.91434804s) [upload=201259]: Upload finished. err: <nil>
Duration: 643.102542ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
260.863756ms
FAIL (2025-08-16 19:08:25 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 18:30:20.656629884 (193h4m1.387897535s) [upload=200914]: Starting upload Aug 16 18:30:20.656698023 (193h4m1.387965672s) [upload=200914]: Done starting upload Aug 16 18:30:20.656779016 (193h4m1.388046665s) [upload=200914]: Uploading segments... Aug 16 18:30:20.656835431 (193h4m1.388103081s) [upload=200914]: Got next segment. Inline: true Aug 16 18:30:20.656842083 (193h4m1.388109744s) [upload=200914]: Waiting for error group managing segments... Aug 16 18:30:20.656913488 (193h4m1.388181139s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 18:30:20.656919560 (193h4m1.38818721s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 18:30:20.656923327 (193h4m1.388190977s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 18:30:20.659031257 (193h4m1.390298906s) [upload=200914]: Done uploading segments... Aug 16 18:30:20.659043129 (193h4m1.390310778s) [upload=200914]: Upload finished. err: metaclient: Too Many Requests
Duration: 260.883273ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.............X......X.............X.........................] duration:
527.481158ms
FAIL (2025-08-16 19:08:03 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 18:50:06.795231389 (193h23m47.52649904s) [upload=201259]: Starting upload
Aug 16 18:50:06.795294448 (193h23m47.526562098s) [upload=201259]: Done starting upload
Aug 16 18:50:06.795449339 (193h23m47.526716989s) [upload=201259]: Uploading segments...
Aug 16 18:50:06.795693649 (193h23m47.5269613s) [upload=201259]: Got next segment. Inline: false
Aug 16 18:50:06.795759203 (193h23m47.527026853s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 18:50:06.795765165 (193h23m47.527032824s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 18:50:06.841060252 (193h23m47.572327901s) [seg_pos={0 0}, upload=201259]: Begin upload segment...
Aug 16 18:50:06.841119362 (193h23m47.572387012s) [seg_pos={0 0}, upload=201259]: Done begin upload segment.
Aug 16 18:50:06.841151233 (193h23m47.572418883s) [noise=true , address=104.36.82.35:4587 , piece_id=5JFLAGKDPOYPDZFSKF2DJT6EHCPJHQBHGMV3T4RAPKFOXP5YDVYQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841184625 (193h23m47.572452276s) [noise=true , address=104.36.82.34:4565 , piece_id=NPK7GSWSZWGHSUSETZCCOLVYUK6QE7RCZ5COSLSQ5UJ543W67MGQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841723480 (193h23m47.57299114s) [noise=true , address=104.36.82.20:4446 , piece_id=ZVIY47XJPM2KPHF6QWJYMGVR25PMANDTI3IGB5TTMW3QAT6NDPVQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841804182 (193h23m47.573071831s) [noise=true , address=104.36.82.39:4737 , piece_id=DC7GL4U6VY3SO6KZAXQNAK54AT2WFZBJUZM2WEFWLQKS5ULQJ3UQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.842218111 (193h23m47.573485761s) [noise=true , address=77.90.31.19:4870 , piece_id=76KXS2TZPI5OH3TESKHQNCKO34UP5YPFAQ5EPKB4LKST3PSWNY7Q, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.842347224 (193h23m47.573614874s) [noise=true , address=77.90.31.13:4657 , piece_id=3T2AY52BCUCXPSJHCPFDT4MNDY3RJVULG6X52HT4PKY7SJQ464SA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.843304817 (193h23m47.574572467s) [noise=true , address=104.36.82.37:4657 , piece_id=DOCMOQXG2TIS3MHSMBHQNEKZFUSXLKENOQXGWLQRYEYFD2OBJ2LA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.843418962 (193h23m47.574686612s) [noise=true , address=104.36.82.21:4476 , piece_id=H52MJNGMGSKORKKOPNBMVFOSFCKMCJOBET5NIQFAWZ5JDLTLY4ZQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844011178 (193h23m47.575278828s) [noise=true , address=45.91.116.5:4321 , piece_id=R4V5GAA7COM6Z2FAH7REIIDOMB7EJ2HUJHAWRWVNJRJV5WREPUSQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844142576 (193h23m47.575410225s) [noise=true , address=104.36.82.7:4933 , piece_id=GERLHPHJEVE5AVHI5VM4TCEDJC7PAAFHYAHPTETVC5NBMWTSFAFQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844882007 (193h23m47.576149657s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2F5PRGNYWIKKROX5EVNMCDUPJZPIOFJBN35YXEH4H5BKINRJKPQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.845386287 (193h23m47.576653947s) [noise=true , address=77.90.31.14:4681 , piece_id=F2C4U4NYLA5TGZSPC35WB2XH3YVQZNAYYPCGH66IIDLVSX7WZXKQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.845864367 (193h23m47.577132018s) [noise=true , address=45.91.116.10:4100 , piece_id=JMZXTBLEKC5X6I3T2P4XX32GGIXSH6IW4QCKFZFLTM5JQEBMLECQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.846491107 (193h23m47.577758757s) [noise=true , address=104.36.82.23:4447 , piece_id=H2XVFVY64HORCHUCFXZUQM7H4EWXQPV6YENXX7EEOOMCZTW4N6CA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.846703747 (193h23m47.577971408s) [noise=true , address=104.36.82.14:4230 , piece_id=WTOJ6THOEIOMF72YGNYOKRGYJQJF4FQP4VGDW2QQ2326DGTUSHCQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.847183361 (193h23m47.578451012s) [noise=true , address=77.90.31.10:4521 , piece_id=DJ2ZHTVZZ7SPBYTO2WH2BMDPS37K7MSYBPA3SHWXB3TM5FLTOZYQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.847384710 (193h23m47.57865236s) [noise=true , address=104.36.82.3:4793 , piece_id=47HFN7SSBLKV4Q2MTDVFC4GBNIPATKO6LRUOC4G2AW7A4MFAI6GA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.848437041 (193h23m47.579704692s) [noise=true , address=104.36.82.59:4313 , piece_id=J47ZWGLHUN7ECNRGXZZ42Q375WKFHUJN3XLYEGX2CMHC2RUWZJCA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.984012580 (193h23m47.71528023s) [upload=201259]: Next returned nil segment
Aug 16 18:50:06.984029241 (193h23m47.715296871s) [upload=201259]: Waiting for error group managing segments...
Aug 16 18:50:06.996112904 (193h23m47.727380564s) [noise=true , address=104.36.82.14:4230 , piece_id=WTOJ6THOEIOMF72YGNYOKRGYJQJF4FQP4VGDW2QQ2326DGTUSHCQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:06.999695960 (193h23m47.73096362s) [noise=true , address=104.36.82.39:4737 , piece_id=DC7GL4U6VY3SO6KZAXQNAK54AT2WFZBJUZM2WEFWLQKS5ULQJ3UQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.025463880 (193h23m47.756731529s) [noise=true , address=77.90.31.13:4657 , piece_id=3T2AY52BCUCXPSJHCPFDT4MNDY3RJVULG6X52HT4PKY7SJQ464SA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.027404303 (193h23m47.758671953s) [noise=true , address=104.36.82.21:4476 , piece_id=H52MJNGMGSKORKKOPNBMVFOSFCKMCJOBET5NIQFAWZ5JDLTLY4ZQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.031728906 (193h23m47.762996565s) [noise=true , address=77.90.31.14:4681 , piece_id=F2C4U4NYLA5TGZSPC35WB2XH3YVQZNAYYPCGH66IIDLVSX7WZXKQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.032687090 (193h23m47.76395474s) [noise=true , address=104.36.82.59:4313 , piece_id=J47ZWGLHUN7ECNRGXZZ42Q375WKFHUJN3XLYEGX2CMHC2RUWZJCA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.037670705 (193h23m47.768938354s) [noise=true , address=77.90.31.19:4870 , piece_id=76KXS2TZPI5OH3TESKHQNCKO34UP5YPFAQ5EPKB4LKST3PSWNY7Q, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.039026547 (193h23m47.770294198s) [noise=true , address=104.36.82.35:4587 , piece_id=5JFLAGKDPOYPDZFSKF2DJT6EHCPJHQBHGMV3T4RAPKFOXP5YDVYQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.039608773 (193h23m47.770876424s) [noise=true , address=104.36.82.20:4446 , piece_id=ZVIY47XJPM2KPHF6QWJYMGVR25PMANDTI3IGB5TTMW3QAT6NDPVQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.052389308 (193h23m47.783656959s) [noise=true , address=104.36.82.7:4933 , piece_id=GERLHPHJEVE5AVHI5VM4TCEDJC7PAAFHYAHPTETVC5NBMWTSFAFQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.052813196 (193h23m47.784080856s) [noise=true , address=104.36.82.37:4657 , piece_id=DOCMOQXG2TIS3MHSMBHQNEKZFUSXLKENOQXGWLQRYEYFD2OBJ2LA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.067727990 (193h23m47.79899564s) [noise=true , address=45.91.116.10:4100 , piece_id=JMZXTBLEKC5X6I3T2P4XX32GGIXSH6IW4QCKFZFLTM5JQEBMLECQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.077757915 (193h23m47.809025565s) [noise=true , address=104.36.82.34:4565 , piece_id=NPK7GSWSZWGHSUSETZCCOLVYUK6QE7RCZ5COSLSQ5UJ543W67MGQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.088885418 (193h23m47.820153067s) [noise=true , address=104.36.82.3:4793 , piece_id=47HFN7SSBLKV4Q2MTDVFC4GBNIPATKO6LRUOC4G2AW7A4MFAI6GA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.088946764 (193h23m47.820214414s) [seg_pos={0 0}, upload=201259]: Segment reached optimal threshold of 14 pieces.
Aug 16 18:50:07.089255815 (193h23m47.820523475s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2F5PRGNYWIKKROX5EVNMCDUPJZPIOFJBN35YXEH4H5BKINRJKPQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sJfMr1nMTpizd5PZ2bZ6M8tZWhFL2ukdJ3cNSRQtdUHNJhg81): protocol: expected piece hash; context canceled; EOF
Aug 16 18:50:07.089271314 (193h23m47.820538974s) [noise=true , address=104.36.82.23:4447 , piece_id=H2XVFVY64HORCHUCFXZUQM7H4EWXQPV6YENXX7EEOOMCZTW4N6CA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fqT9xA7kXTG8K9XwTUxL6FXibV35AkPHDK6grKGHg17fk91fP): protocol: write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection; write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection
Aug 16 18:50:07.089329323 (193h23m47.820596973s) [noise=true , address=77.90.31.10:4521 , piece_id=DJ2ZHTVZZ7SPBYTO2WH2BMDPS37K7MSYBPA3SHWXB3TM5FLTOZYQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WpVJa7SXkANKParDWYrC1cN8aLHTkUSPrRJGKQ6fvA5oDEkoa): protocol: write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection; write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection
Aug 16 18:50:07.089440162 (193h23m47.820707812s) [noise=true , address=45.91.116.5:4321 , piece_id=R4V5GAA7COM6Z2FAH7REIIDOMB7EJ2HUJHAWRWVNJRJV5WREPUSQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12m3Lw8yL9wVq38nW514iaLooMVgikbQBGA9vrFsr66jx5w1xXj): protocol: write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection; write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection
Aug 16 18:50:07.089461401 (193h23m47.820729052s) [seg_pos={0 0}, upload=201259]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 18:50:07.089583131 (193h23m47.820850791s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 18:50:07.089622546 (193h23m47.820890196s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 18:50:07.183064911 (193h23m47.914332561s) [upload=201259]: Done uploading segments...
Aug 16 18:50:07.183080390 (193h23m47.91434804s) [upload=201259]: Upload finished. err: <nil>
Duration: 527.506956ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [X...........X...............................................] duration:
183.45419ms
FAIL (2025-08-16 19:07:43 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 18:30:20.656629884 (193h4m1.387897535s) [upload=200914]: Starting upload Aug 16 18:30:20.656698023 (193h4m1.387965672s) [upload=200914]: Done starting upload Aug 16 18:30:20.656779016 (193h4m1.388046665s) [upload=200914]: Uploading segments... Aug 16 18:30:20.656835431 (193h4m1.388103081s) [upload=200914]: Got next segment. Inline: true Aug 16 18:30:20.656842083 (193h4m1.388109744s) [upload=200914]: Waiting for error group managing segments... Aug 16 18:30:20.656913488 (193h4m1.388181139s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 18:30:20.656919560 (193h4m1.38818721s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 18:30:20.656923327 (193h4m1.388190977s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 18:30:20.659031257 (193h4m1.390298906s) [upload=200914]: Done uploading segments... Aug 16 18:30:20.659043129 (193h4m1.390310778s) [upload=200914]: Upload finished. err: metaclient: Too Many Requests
Duration: 183.4757ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..............X......X.............X........................] duration:
686.575498ms
FAIL (2025-08-16 19:07:33 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 18:50:06.795231389 (193h23m47.52649904s) [upload=201259]: Starting upload
Aug 16 18:50:06.795294448 (193h23m47.526562098s) [upload=201259]: Done starting upload
Aug 16 18:50:06.795449339 (193h23m47.526716989s) [upload=201259]: Uploading segments...
Aug 16 18:50:06.795693649 (193h23m47.5269613s) [upload=201259]: Got next segment. Inline: false
Aug 16 18:50:06.795759203 (193h23m47.527026853s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 18:50:06.795765165 (193h23m47.527032824s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 18:50:06.841060252 (193h23m47.572327901s) [seg_pos={0 0}, upload=201259]: Begin upload segment...
Aug 16 18:50:06.841119362 (193h23m47.572387012s) [seg_pos={0 0}, upload=201259]: Done begin upload segment.
Aug 16 18:50:06.841151233 (193h23m47.572418883s) [noise=true , address=104.36.82.35:4587 , piece_id=5JFLAGKDPOYPDZFSKF2DJT6EHCPJHQBHGMV3T4RAPKFOXP5YDVYQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841184625 (193h23m47.572452276s) [noise=true , address=104.36.82.34:4565 , piece_id=NPK7GSWSZWGHSUSETZCCOLVYUK6QE7RCZ5COSLSQ5UJ543W67MGQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841723480 (193h23m47.57299114s) [noise=true , address=104.36.82.20:4446 , piece_id=ZVIY47XJPM2KPHF6QWJYMGVR25PMANDTI3IGB5TTMW3QAT6NDPVQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841804182 (193h23m47.573071831s) [noise=true , address=104.36.82.39:4737 , piece_id=DC7GL4U6VY3SO6KZAXQNAK54AT2WFZBJUZM2WEFWLQKS5ULQJ3UQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.842218111 (193h23m47.573485761s) [noise=true , address=77.90.31.19:4870 , piece_id=76KXS2TZPI5OH3TESKHQNCKO34UP5YPFAQ5EPKB4LKST3PSWNY7Q, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.842347224 (193h23m47.573614874s) [noise=true , address=77.90.31.13:4657 , piece_id=3T2AY52BCUCXPSJHCPFDT4MNDY3RJVULG6X52HT4PKY7SJQ464SA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.843304817 (193h23m47.574572467s) [noise=true , address=104.36.82.37:4657 , piece_id=DOCMOQXG2TIS3MHSMBHQNEKZFUSXLKENOQXGWLQRYEYFD2OBJ2LA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.843418962 (193h23m47.574686612s) [noise=true , address=104.36.82.21:4476 , piece_id=H52MJNGMGSKORKKOPNBMVFOSFCKMCJOBET5NIQFAWZ5JDLTLY4ZQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844011178 (193h23m47.575278828s) [noise=true , address=45.91.116.5:4321 , piece_id=R4V5GAA7COM6Z2FAH7REIIDOMB7EJ2HUJHAWRWVNJRJV5WREPUSQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844142576 (193h23m47.575410225s) [noise=true , address=104.36.82.7:4933 , piece_id=GERLHPHJEVE5AVHI5VM4TCEDJC7PAAFHYAHPTETVC5NBMWTSFAFQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844882007 (193h23m47.576149657s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2F5PRGNYWIKKROX5EVNMCDUPJZPIOFJBN35YXEH4H5BKINRJKPQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.845386287 (193h23m47.576653947s) [noise=true , address=77.90.31.14:4681 , piece_id=F2C4U4NYLA5TGZSPC35WB2XH3YVQZNAYYPCGH66IIDLVSX7WZXKQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.845864367 (193h23m47.577132018s) [noise=true , address=45.91.116.10:4100 , piece_id=JMZXTBLEKC5X6I3T2P4XX32GGIXSH6IW4QCKFZFLTM5JQEBMLECQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.846491107 (193h23m47.577758757s) [noise=true , address=104.36.82.23:4447 , piece_id=H2XVFVY64HORCHUCFXZUQM7H4EWXQPV6YENXX7EEOOMCZTW4N6CA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.846703747 (193h23m47.577971408s) [noise=true , address=104.36.82.14:4230 , piece_id=WTOJ6THOEIOMF72YGNYOKRGYJQJF4FQP4VGDW2QQ2326DGTUSHCQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.847183361 (193h23m47.578451012s) [noise=true , address=77.90.31.10:4521 , piece_id=DJ2ZHTVZZ7SPBYTO2WH2BMDPS37K7MSYBPA3SHWXB3TM5FLTOZYQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.847384710 (193h23m47.57865236s) [noise=true , address=104.36.82.3:4793 , piece_id=47HFN7SSBLKV4Q2MTDVFC4GBNIPATKO6LRUOC4G2AW7A4MFAI6GA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.848437041 (193h23m47.579704692s) [noise=true , address=104.36.82.59:4313 , piece_id=J47ZWGLHUN7ECNRGXZZ42Q375WKFHUJN3XLYEGX2CMHC2RUWZJCA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.984012580 (193h23m47.71528023s) [upload=201259]: Next returned nil segment
Aug 16 18:50:06.984029241 (193h23m47.715296871s) [upload=201259]: Waiting for error group managing segments...
Aug 16 18:50:06.996112904 (193h23m47.727380564s) [noise=true , address=104.36.82.14:4230 , piece_id=WTOJ6THOEIOMF72YGNYOKRGYJQJF4FQP4VGDW2QQ2326DGTUSHCQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:06.999695960 (193h23m47.73096362s) [noise=true , address=104.36.82.39:4737 , piece_id=DC7GL4U6VY3SO6KZAXQNAK54AT2WFZBJUZM2WEFWLQKS5ULQJ3UQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.025463880 (193h23m47.756731529s) [noise=true , address=77.90.31.13:4657 , piece_id=3T2AY52BCUCXPSJHCPFDT4MNDY3RJVULG6X52HT4PKY7SJQ464SA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.027404303 (193h23m47.758671953s) [noise=true , address=104.36.82.21:4476 , piece_id=H52MJNGMGSKORKKOPNBMVFOSFCKMCJOBET5NIQFAWZ5JDLTLY4ZQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.031728906 (193h23m47.762996565s) [noise=true , address=77.90.31.14:4681 , piece_id=F2C4U4NYLA5TGZSPC35WB2XH3YVQZNAYYPCGH66IIDLVSX7WZXKQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.032687090 (193h23m47.76395474s) [noise=true , address=104.36.82.59:4313 , piece_id=J47ZWGLHUN7ECNRGXZZ42Q375WKFHUJN3XLYEGX2CMHC2RUWZJCA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.037670705 (193h23m47.768938354s) [noise=true , address=77.90.31.19:4870 , piece_id=76KXS2TZPI5OH3TESKHQNCKO34UP5YPFAQ5EPKB4LKST3PSWNY7Q, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.039026547 (193h23m47.770294198s) [noise=true , address=104.36.82.35:4587 , piece_id=5JFLAGKDPOYPDZFSKF2DJT6EHCPJHQBHGMV3T4RAPKFOXP5YDVYQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.039608773 (193h23m47.770876424s) [noise=true , address=104.36.82.20:4446 , piece_id=ZVIY47XJPM2KPHF6QWJYMGVR25PMANDTI3IGB5TTMW3QAT6NDPVQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.052389308 (193h23m47.783656959s) [noise=true , address=104.36.82.7:4933 , piece_id=GERLHPHJEVE5AVHI5VM4TCEDJC7PAAFHYAHPTETVC5NBMWTSFAFQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.052813196 (193h23m47.784080856s) [noise=true , address=104.36.82.37:4657 , piece_id=DOCMOQXG2TIS3MHSMBHQNEKZFUSXLKENOQXGWLQRYEYFD2OBJ2LA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.067727990 (193h23m47.79899564s) [noise=true , address=45.91.116.10:4100 , piece_id=JMZXTBLEKC5X6I3T2P4XX32GGIXSH6IW4QCKFZFLTM5JQEBMLECQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.077757915 (193h23m47.809025565s) [noise=true , address=104.36.82.34:4565 , piece_id=NPK7GSWSZWGHSUSETZCCOLVYUK6QE7RCZ5COSLSQ5UJ543W67MGQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.088885418 (193h23m47.820153067s) [noise=true , address=104.36.82.3:4793 , piece_id=47HFN7SSBLKV4Q2MTDVFC4GBNIPATKO6LRUOC4G2AW7A4MFAI6GA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.088946764 (193h23m47.820214414s) [seg_pos={0 0}, upload=201259]: Segment reached optimal threshold of 14 pieces.
Aug 16 18:50:07.089255815 (193h23m47.820523475s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2F5PRGNYWIKKROX5EVNMCDUPJZPIOFJBN35YXEH4H5BKINRJKPQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sJfMr1nMTpizd5PZ2bZ6M8tZWhFL2ukdJ3cNSRQtdUHNJhg81): protocol: expected piece hash; context canceled; EOF
Aug 16 18:50:07.089271314 (193h23m47.820538974s) [noise=true , address=104.36.82.23:4447 , piece_id=H2XVFVY64HORCHUCFXZUQM7H4EWXQPV6YENXX7EEOOMCZTW4N6CA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fqT9xA7kXTG8K9XwTUxL6FXibV35AkPHDK6grKGHg17fk91fP): protocol: write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection; write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection
Aug 16 18:50:07.089329323 (193h23m47.820596973s) [noise=true , address=77.90.31.10:4521 , piece_id=DJ2ZHTVZZ7SPBYTO2WH2BMDPS37K7MSYBPA3SHWXB3TM5FLTOZYQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WpVJa7SXkANKParDWYrC1cN8aLHTkUSPrRJGKQ6fvA5oDEkoa): protocol: write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection; write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection
Aug 16 18:50:07.089440162 (193h23m47.820707812s) [noise=true , address=45.91.116.5:4321 , piece_id=R4V5GAA7COM6Z2FAH7REIIDOMB7EJ2HUJHAWRWVNJRJV5WREPUSQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12m3Lw8yL9wVq38nW514iaLooMVgikbQBGA9vrFsr66jx5w1xXj): protocol: write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection; write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection
Aug 16 18:50:07.089461401 (193h23m47.820729052s) [seg_pos={0 0}, upload=201259]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 18:50:07.089583131 (193h23m47.820850791s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 18:50:07.089622546 (193h23m47.820890196s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 18:50:07.183064911 (193h23m47.914332561s) [upload=201259]: Done uploading segments...
Aug 16 18:50:07.183080390 (193h23m47.91434804s) [upload=201259]: Upload finished. err: <nil>
Duration: 686.597921ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...............X......X.............X.......................] duration:
767.130861ms
FAIL (2025-08-16 19:06:56 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 18:50:06.795231389 (193h23m47.52649904s) [upload=201259]: Starting upload
Aug 16 18:50:06.795294448 (193h23m47.526562098s) [upload=201259]: Done starting upload
Aug 16 18:50:06.795449339 (193h23m47.526716989s) [upload=201259]: Uploading segments...
Aug 16 18:50:06.795693649 (193h23m47.5269613s) [upload=201259]: Got next segment. Inline: false
Aug 16 18:50:06.795759203 (193h23m47.527026853s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 18:50:06.795765165 (193h23m47.527032824s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 18:50:06.841060252 (193h23m47.572327901s) [seg_pos={0 0}, upload=201259]: Begin upload segment...
Aug 16 18:50:06.841119362 (193h23m47.572387012s) [seg_pos={0 0}, upload=201259]: Done begin upload segment.
Aug 16 18:50:06.841151233 (193h23m47.572418883s) [noise=true , address=104.36.82.35:4587 , piece_id=5JFLAGKDPOYPDZFSKF2DJT6EHCPJHQBHGMV3T4RAPKFOXP5YDVYQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841184625 (193h23m47.572452276s) [noise=true , address=104.36.82.34:4565 , piece_id=NPK7GSWSZWGHSUSETZCCOLVYUK6QE7RCZ5COSLSQ5UJ543W67MGQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841723480 (193h23m47.57299114s) [noise=true , address=104.36.82.20:4446 , piece_id=ZVIY47XJPM2KPHF6QWJYMGVR25PMANDTI3IGB5TTMW3QAT6NDPVQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841804182 (193h23m47.573071831s) [noise=true , address=104.36.82.39:4737 , piece_id=DC7GL4U6VY3SO6KZAXQNAK54AT2WFZBJUZM2WEFWLQKS5ULQJ3UQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.842218111 (193h23m47.573485761s) [noise=true , address=77.90.31.19:4870 , piece_id=76KXS2TZPI5OH3TESKHQNCKO34UP5YPFAQ5EPKB4LKST3PSWNY7Q, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.842347224 (193h23m47.573614874s) [noise=true , address=77.90.31.13:4657 , piece_id=3T2AY52BCUCXPSJHCPFDT4MNDY3RJVULG6X52HT4PKY7SJQ464SA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.843304817 (193h23m47.574572467s) [noise=true , address=104.36.82.37:4657 , piece_id=DOCMOQXG2TIS3MHSMBHQNEKZFUSXLKENOQXGWLQRYEYFD2OBJ2LA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.843418962 (193h23m47.574686612s) [noise=true , address=104.36.82.21:4476 , piece_id=H52MJNGMGSKORKKOPNBMVFOSFCKMCJOBET5NIQFAWZ5JDLTLY4ZQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844011178 (193h23m47.575278828s) [noise=true , address=45.91.116.5:4321 , piece_id=R4V5GAA7COM6Z2FAH7REIIDOMB7EJ2HUJHAWRWVNJRJV5WREPUSQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844142576 (193h23m47.575410225s) [noise=true , address=104.36.82.7:4933 , piece_id=GERLHPHJEVE5AVHI5VM4TCEDJC7PAAFHYAHPTETVC5NBMWTSFAFQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844882007 (193h23m47.576149657s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2F5PRGNYWIKKROX5EVNMCDUPJZPIOFJBN35YXEH4H5BKINRJKPQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.845386287 (193h23m47.576653947s) [noise=true , address=77.90.31.14:4681 , piece_id=F2C4U4NYLA5TGZSPC35WB2XH3YVQZNAYYPCGH66IIDLVSX7WZXKQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.845864367 (193h23m47.577132018s) [noise=true , address=45.91.116.10:4100 , piece_id=JMZXTBLEKC5X6I3T2P4XX32GGIXSH6IW4QCKFZFLTM5JQEBMLECQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.846491107 (193h23m47.577758757s) [noise=true , address=104.36.82.23:4447 , piece_id=H2XVFVY64HORCHUCFXZUQM7H4EWXQPV6YENXX7EEOOMCZTW4N6CA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.846703747 (193h23m47.577971408s) [noise=true , address=104.36.82.14:4230 , piece_id=WTOJ6THOEIOMF72YGNYOKRGYJQJF4FQP4VGDW2QQ2326DGTUSHCQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.847183361 (193h23m47.578451012s) [noise=true , address=77.90.31.10:4521 , piece_id=DJ2ZHTVZZ7SPBYTO2WH2BMDPS37K7MSYBPA3SHWXB3TM5FLTOZYQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.847384710 (193h23m47.57865236s) [noise=true , address=104.36.82.3:4793 , piece_id=47HFN7SSBLKV4Q2MTDVFC4GBNIPATKO6LRUOC4G2AW7A4MFAI6GA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.848437041 (193h23m47.579704692s) [noise=true , address=104.36.82.59:4313 , piece_id=J47ZWGLHUN7ECNRGXZZ42Q375WKFHUJN3XLYEGX2CMHC2RUWZJCA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.984012580 (193h23m47.71528023s) [upload=201259]: Next returned nil segment
Aug 16 18:50:06.984029241 (193h23m47.715296871s) [upload=201259]: Waiting for error group managing segments...
Aug 16 18:50:06.996112904 (193h23m47.727380564s) [noise=true , address=104.36.82.14:4230 , piece_id=WTOJ6THOEIOMF72YGNYOKRGYJQJF4FQP4VGDW2QQ2326DGTUSHCQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:06.999695960 (193h23m47.73096362s) [noise=true , address=104.36.82.39:4737 , piece_id=DC7GL4U6VY3SO6KZAXQNAK54AT2WFZBJUZM2WEFWLQKS5ULQJ3UQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.025463880 (193h23m47.756731529s) [noise=true , address=77.90.31.13:4657 , piece_id=3T2AY52BCUCXPSJHCPFDT4MNDY3RJVULG6X52HT4PKY7SJQ464SA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.027404303 (193h23m47.758671953s) [noise=true , address=104.36.82.21:4476 , piece_id=H52MJNGMGSKORKKOPNBMVFOSFCKMCJOBET5NIQFAWZ5JDLTLY4ZQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.031728906 (193h23m47.762996565s) [noise=true , address=77.90.31.14:4681 , piece_id=F2C4U4NYLA5TGZSPC35WB2XH3YVQZNAYYPCGH66IIDLVSX7WZXKQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.032687090 (193h23m47.76395474s) [noise=true , address=104.36.82.59:4313 , piece_id=J47ZWGLHUN7ECNRGXZZ42Q375WKFHUJN3XLYEGX2CMHC2RUWZJCA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.037670705 (193h23m47.768938354s) [noise=true , address=77.90.31.19:4870 , piece_id=76KXS2TZPI5OH3TESKHQNCKO34UP5YPFAQ5EPKB4LKST3PSWNY7Q, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.039026547 (193h23m47.770294198s) [noise=true , address=104.36.82.35:4587 , piece_id=5JFLAGKDPOYPDZFSKF2DJT6EHCPJHQBHGMV3T4RAPKFOXP5YDVYQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.039608773 (193h23m47.770876424s) [noise=true , address=104.36.82.20:4446 , piece_id=ZVIY47XJPM2KPHF6QWJYMGVR25PMANDTI3IGB5TTMW3QAT6NDPVQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.052389308 (193h23m47.783656959s) [noise=true , address=104.36.82.7:4933 , piece_id=GERLHPHJEVE5AVHI5VM4TCEDJC7PAAFHYAHPTETVC5NBMWTSFAFQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.052813196 (193h23m47.784080856s) [noise=true , address=104.36.82.37:4657 , piece_id=DOCMOQXG2TIS3MHSMBHQNEKZFUSXLKENOQXGWLQRYEYFD2OBJ2LA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.067727990 (193h23m47.79899564s) [noise=true , address=45.91.116.10:4100 , piece_id=JMZXTBLEKC5X6I3T2P4XX32GGIXSH6IW4QCKFZFLTM5JQEBMLECQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.077757915 (193h23m47.809025565s) [noise=true , address=104.36.82.34:4565 , piece_id=NPK7GSWSZWGHSUSETZCCOLVYUK6QE7RCZ5COSLSQ5UJ543W67MGQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.088885418 (193h23m47.820153067s) [noise=true , address=104.36.82.3:4793 , piece_id=47HFN7SSBLKV4Q2MTDVFC4GBNIPATKO6LRUOC4G2AW7A4MFAI6GA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.088946764 (193h23m47.820214414s) [seg_pos={0 0}, upload=201259]: Segment reached optimal threshold of 14 pieces.
Aug 16 18:50:07.089255815 (193h23m47.820523475s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2F5PRGNYWIKKROX5EVNMCDUPJZPIOFJBN35YXEH4H5BKINRJKPQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sJfMr1nMTpizd5PZ2bZ6M8tZWhFL2ukdJ3cNSRQtdUHNJhg81): protocol: expected piece hash; context canceled; EOF
Aug 16 18:50:07.089271314 (193h23m47.820538974s) [noise=true , address=104.36.82.23:4447 , piece_id=H2XVFVY64HORCHUCFXZUQM7H4EWXQPV6YENXX7EEOOMCZTW4N6CA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fqT9xA7kXTG8K9XwTUxL6FXibV35AkPHDK6grKGHg17fk91fP): protocol: write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection; write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection
Aug 16 18:50:07.089329323 (193h23m47.820596973s) [noise=true , address=77.90.31.10:4521 , piece_id=DJ2ZHTVZZ7SPBYTO2WH2BMDPS37K7MSYBPA3SHWXB3TM5FLTOZYQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WpVJa7SXkANKParDWYrC1cN8aLHTkUSPrRJGKQ6fvA5oDEkoa): protocol: write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection; write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection
Aug 16 18:50:07.089440162 (193h23m47.820707812s) [noise=true , address=45.91.116.5:4321 , piece_id=R4V5GAA7COM6Z2FAH7REIIDOMB7EJ2HUJHAWRWVNJRJV5WREPUSQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12m3Lw8yL9wVq38nW514iaLooMVgikbQBGA9vrFsr66jx5w1xXj): protocol: write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection; write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection
Aug 16 18:50:07.089461401 (193h23m47.820729052s) [seg_pos={0 0}, upload=201259]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 18:50:07.089583131 (193h23m47.820850791s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 18:50:07.089622546 (193h23m47.820890196s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 18:50:07.183064911 (193h23m47.914332561s) [upload=201259]: Done uploading segments...
Aug 16 18:50:07.183080390 (193h23m47.91434804s) [upload=201259]: Upload finished. err: <nil>
Duration: 767.146671ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.X...........X..............................................] duration:
184.399481ms
FAIL (2025-08-16 19:06:47 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 18:30:20.656629884 (193h4m1.387897535s) [upload=200914]: Starting upload Aug 16 18:30:20.656698023 (193h4m1.387965672s) [upload=200914]: Done starting upload Aug 16 18:30:20.656779016 (193h4m1.388046665s) [upload=200914]: Uploading segments... Aug 16 18:30:20.656835431 (193h4m1.388103081s) [upload=200914]: Got next segment. Inline: true Aug 16 18:30:20.656842083 (193h4m1.388109744s) [upload=200914]: Waiting for error group managing segments... Aug 16 18:30:20.656913488 (193h4m1.388181139s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 18:30:20.656919560 (193h4m1.38818721s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 18:30:20.656923327 (193h4m1.388190977s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 18:30:20.659031257 (193h4m1.390298906s) [upload=200914]: Done uploading segments... Aug 16 18:30:20.659043129 (193h4m1.390310778s) [upload=200914]: Upload finished. err: metaclient: Too Many Requests
Duration: 184.431532ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..X...........X.............................................] duration:
160.511571ms
FAIL (2025-08-16 19:06:14 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 18:30:20.656629884 (193h4m1.387897535s) [upload=200914]: Starting upload Aug 16 18:30:20.656698023 (193h4m1.387965672s) [upload=200914]: Done starting upload Aug 16 18:30:20.656779016 (193h4m1.388046665s) [upload=200914]: Uploading segments... Aug 16 18:30:20.656835431 (193h4m1.388103081s) [upload=200914]: Got next segment. Inline: true Aug 16 18:30:20.656842083 (193h4m1.388109744s) [upload=200914]: Waiting for error group managing segments... Aug 16 18:30:20.656913488 (193h4m1.388181139s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 18:30:20.656919560 (193h4m1.38818721s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 18:30:20.656923327 (193h4m1.388190977s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 18:30:20.659031257 (193h4m1.390298906s) [upload=200914]: Done uploading segments... Aug 16 18:30:20.659043129 (193h4m1.390310778s) [upload=200914]: Upload finished. err: metaclient: Too Many Requests
Duration: 160.53185ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [................X......X.............X......................] duration:
495.832504ms
FAIL (2025-08-16 19:06:12 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 18:50:06.795231389 (193h23m47.52649904s) [upload=201259]: Starting upload
Aug 16 18:50:06.795294448 (193h23m47.526562098s) [upload=201259]: Done starting upload
Aug 16 18:50:06.795449339 (193h23m47.526716989s) [upload=201259]: Uploading segments...
Aug 16 18:50:06.795693649 (193h23m47.5269613s) [upload=201259]: Got next segment. Inline: false
Aug 16 18:50:06.795759203 (193h23m47.527026853s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 18:50:06.795765165 (193h23m47.527032824s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 18:50:06.841060252 (193h23m47.572327901s) [seg_pos={0 0}, upload=201259]: Begin upload segment...
Aug 16 18:50:06.841119362 (193h23m47.572387012s) [seg_pos={0 0}, upload=201259]: Done begin upload segment.
Aug 16 18:50:06.841151233 (193h23m47.572418883s) [noise=true , address=104.36.82.35:4587 , piece_id=5JFLAGKDPOYPDZFSKF2DJT6EHCPJHQBHGMV3T4RAPKFOXP5YDVYQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841184625 (193h23m47.572452276s) [noise=true , address=104.36.82.34:4565 , piece_id=NPK7GSWSZWGHSUSETZCCOLVYUK6QE7RCZ5COSLSQ5UJ543W67MGQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841723480 (193h23m47.57299114s) [noise=true , address=104.36.82.20:4446 , piece_id=ZVIY47XJPM2KPHF6QWJYMGVR25PMANDTI3IGB5TTMW3QAT6NDPVQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841804182 (193h23m47.573071831s) [noise=true , address=104.36.82.39:4737 , piece_id=DC7GL4U6VY3SO6KZAXQNAK54AT2WFZBJUZM2WEFWLQKS5ULQJ3UQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.842218111 (193h23m47.573485761s) [noise=true , address=77.90.31.19:4870 , piece_id=76KXS2TZPI5OH3TESKHQNCKO34UP5YPFAQ5EPKB4LKST3PSWNY7Q, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.842347224 (193h23m47.573614874s) [noise=true , address=77.90.31.13:4657 , piece_id=3T2AY52BCUCXPSJHCPFDT4MNDY3RJVULG6X52HT4PKY7SJQ464SA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.843304817 (193h23m47.574572467s) [noise=true , address=104.36.82.37:4657 , piece_id=DOCMOQXG2TIS3MHSMBHQNEKZFUSXLKENOQXGWLQRYEYFD2OBJ2LA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.843418962 (193h23m47.574686612s) [noise=true , address=104.36.82.21:4476 , piece_id=H52MJNGMGSKORKKOPNBMVFOSFCKMCJOBET5NIQFAWZ5JDLTLY4ZQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844011178 (193h23m47.575278828s) [noise=true , address=45.91.116.5:4321 , piece_id=R4V5GAA7COM6Z2FAH7REIIDOMB7EJ2HUJHAWRWVNJRJV5WREPUSQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844142576 (193h23m47.575410225s) [noise=true , address=104.36.82.7:4933 , piece_id=GERLHPHJEVE5AVHI5VM4TCEDJC7PAAFHYAHPTETVC5NBMWTSFAFQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844882007 (193h23m47.576149657s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2F5PRGNYWIKKROX5EVNMCDUPJZPIOFJBN35YXEH4H5BKINRJKPQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.845386287 (193h23m47.576653947s) [noise=true , address=77.90.31.14:4681 , piece_id=F2C4U4NYLA5TGZSPC35WB2XH3YVQZNAYYPCGH66IIDLVSX7WZXKQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.845864367 (193h23m47.577132018s) [noise=true , address=45.91.116.10:4100 , piece_id=JMZXTBLEKC5X6I3T2P4XX32GGIXSH6IW4QCKFZFLTM5JQEBMLECQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.846491107 (193h23m47.577758757s) [noise=true , address=104.36.82.23:4447 , piece_id=H2XVFVY64HORCHUCFXZUQM7H4EWXQPV6YENXX7EEOOMCZTW4N6CA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.846703747 (193h23m47.577971408s) [noise=true , address=104.36.82.14:4230 , piece_id=WTOJ6THOEIOMF72YGNYOKRGYJQJF4FQP4VGDW2QQ2326DGTUSHCQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.847183361 (193h23m47.578451012s) [noise=true , address=77.90.31.10:4521 , piece_id=DJ2ZHTVZZ7SPBYTO2WH2BMDPS37K7MSYBPA3SHWXB3TM5FLTOZYQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.847384710 (193h23m47.57865236s) [noise=true , address=104.36.82.3:4793 , piece_id=47HFN7SSBLKV4Q2MTDVFC4GBNIPATKO6LRUOC4G2AW7A4MFAI6GA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.848437041 (193h23m47.579704692s) [noise=true , address=104.36.82.59:4313 , piece_id=J47ZWGLHUN7ECNRGXZZ42Q375WKFHUJN3XLYEGX2CMHC2RUWZJCA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.984012580 (193h23m47.71528023s) [upload=201259]: Next returned nil segment
Aug 16 18:50:06.984029241 (193h23m47.715296871s) [upload=201259]: Waiting for error group managing segments...
Aug 16 18:50:06.996112904 (193h23m47.727380564s) [noise=true , address=104.36.82.14:4230 , piece_id=WTOJ6THOEIOMF72YGNYOKRGYJQJF4FQP4VGDW2QQ2326DGTUSHCQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:06.999695960 (193h23m47.73096362s) [noise=true , address=104.36.82.39:4737 , piece_id=DC7GL4U6VY3SO6KZAXQNAK54AT2WFZBJUZM2WEFWLQKS5ULQJ3UQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.025463880 (193h23m47.756731529s) [noise=true , address=77.90.31.13:4657 , piece_id=3T2AY52BCUCXPSJHCPFDT4MNDY3RJVULG6X52HT4PKY7SJQ464SA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.027404303 (193h23m47.758671953s) [noise=true , address=104.36.82.21:4476 , piece_id=H52MJNGMGSKORKKOPNBMVFOSFCKMCJOBET5NIQFAWZ5JDLTLY4ZQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.031728906 (193h23m47.762996565s) [noise=true , address=77.90.31.14:4681 , piece_id=F2C4U4NYLA5TGZSPC35WB2XH3YVQZNAYYPCGH66IIDLVSX7WZXKQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.032687090 (193h23m47.76395474s) [noise=true , address=104.36.82.59:4313 , piece_id=J47ZWGLHUN7ECNRGXZZ42Q375WKFHUJN3XLYEGX2CMHC2RUWZJCA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.037670705 (193h23m47.768938354s) [noise=true , address=77.90.31.19:4870 , piece_id=76KXS2TZPI5OH3TESKHQNCKO34UP5YPFAQ5EPKB4LKST3PSWNY7Q, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.039026547 (193h23m47.770294198s) [noise=true , address=104.36.82.35:4587 , piece_id=5JFLAGKDPOYPDZFSKF2DJT6EHCPJHQBHGMV3T4RAPKFOXP5YDVYQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.039608773 (193h23m47.770876424s) [noise=true , address=104.36.82.20:4446 , piece_id=ZVIY47XJPM2KPHF6QWJYMGVR25PMANDTI3IGB5TTMW3QAT6NDPVQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.052389308 (193h23m47.783656959s) [noise=true , address=104.36.82.7:4933 , piece_id=GERLHPHJEVE5AVHI5VM4TCEDJC7PAAFHYAHPTETVC5NBMWTSFAFQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.052813196 (193h23m47.784080856s) [noise=true , address=104.36.82.37:4657 , piece_id=DOCMOQXG2TIS3MHSMBHQNEKZFUSXLKENOQXGWLQRYEYFD2OBJ2LA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.067727990 (193h23m47.79899564s) [noise=true , address=45.91.116.10:4100 , piece_id=JMZXTBLEKC5X6I3T2P4XX32GGIXSH6IW4QCKFZFLTM5JQEBMLECQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.077757915 (193h23m47.809025565s) [noise=true , address=104.36.82.34:4565 , piece_id=NPK7GSWSZWGHSUSETZCCOLVYUK6QE7RCZ5COSLSQ5UJ543W67MGQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.088885418 (193h23m47.820153067s) [noise=true , address=104.36.82.3:4793 , piece_id=47HFN7SSBLKV4Q2MTDVFC4GBNIPATKO6LRUOC4G2AW7A4MFAI6GA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.088946764 (193h23m47.820214414s) [seg_pos={0 0}, upload=201259]: Segment reached optimal threshold of 14 pieces.
Aug 16 18:50:07.089255815 (193h23m47.820523475s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2F5PRGNYWIKKROX5EVNMCDUPJZPIOFJBN35YXEH4H5BKINRJKPQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sJfMr1nMTpizd5PZ2bZ6M8tZWhFL2ukdJ3cNSRQtdUHNJhg81): protocol: expected piece hash; context canceled; EOF
Aug 16 18:50:07.089271314 (193h23m47.820538974s) [noise=true , address=104.36.82.23:4447 , piece_id=H2XVFVY64HORCHUCFXZUQM7H4EWXQPV6YENXX7EEOOMCZTW4N6CA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fqT9xA7kXTG8K9XwTUxL6FXibV35AkPHDK6grKGHg17fk91fP): protocol: write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection; write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection
Aug 16 18:50:07.089329323 (193h23m47.820596973s) [noise=true , address=77.90.31.10:4521 , piece_id=DJ2ZHTVZZ7SPBYTO2WH2BMDPS37K7MSYBPA3SHWXB3TM5FLTOZYQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WpVJa7SXkANKParDWYrC1cN8aLHTkUSPrRJGKQ6fvA5oDEkoa): protocol: write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection; write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection
Aug 16 18:50:07.089440162 (193h23m47.820707812s) [noise=true , address=45.91.116.5:4321 , piece_id=R4V5GAA7COM6Z2FAH7REIIDOMB7EJ2HUJHAWRWVNJRJV5WREPUSQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12m3Lw8yL9wVq38nW514iaLooMVgikbQBGA9vrFsr66jx5w1xXj): protocol: write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection; write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection
Aug 16 18:50:07.089461401 (193h23m47.820729052s) [seg_pos={0 0}, upload=201259]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 18:50:07.089583131 (193h23m47.820850791s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 18:50:07.089622546 (193h23m47.820890196s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 18:50:07.183064911 (193h23m47.914332561s) [upload=201259]: Done uploading segments...
Aug 16 18:50:07.183080390 (193h23m47.91434804s) [upload=201259]: Upload finished. err: <nil>
Duration: 495.849385ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.................X......X.............X.....................] duration:
730.419736ms
FAIL (2025-08-16 19:05:56 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 18:50:06.795231389 (193h23m47.52649904s) [upload=201259]: Starting upload
Aug 16 18:50:06.795294448 (193h23m47.526562098s) [upload=201259]: Done starting upload
Aug 16 18:50:06.795449339 (193h23m47.526716989s) [upload=201259]: Uploading segments...
Aug 16 18:50:06.795693649 (193h23m47.5269613s) [upload=201259]: Got next segment. Inline: false
Aug 16 18:50:06.795759203 (193h23m47.527026853s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 18:50:06.795765165 (193h23m47.527032824s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 18:50:06.841060252 (193h23m47.572327901s) [seg_pos={0 0}, upload=201259]: Begin upload segment...
Aug 16 18:50:06.841119362 (193h23m47.572387012s) [seg_pos={0 0}, upload=201259]: Done begin upload segment.
Aug 16 18:50:06.841151233 (193h23m47.572418883s) [noise=true , address=104.36.82.35:4587 , piece_id=5JFLAGKDPOYPDZFSKF2DJT6EHCPJHQBHGMV3T4RAPKFOXP5YDVYQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841184625 (193h23m47.572452276s) [noise=true , address=104.36.82.34:4565 , piece_id=NPK7GSWSZWGHSUSETZCCOLVYUK6QE7RCZ5COSLSQ5UJ543W67MGQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841723480 (193h23m47.57299114s) [noise=true , address=104.36.82.20:4446 , piece_id=ZVIY47XJPM2KPHF6QWJYMGVR25PMANDTI3IGB5TTMW3QAT6NDPVQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841804182 (193h23m47.573071831s) [noise=true , address=104.36.82.39:4737 , piece_id=DC7GL4U6VY3SO6KZAXQNAK54AT2WFZBJUZM2WEFWLQKS5ULQJ3UQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.842218111 (193h23m47.573485761s) [noise=true , address=77.90.31.19:4870 , piece_id=76KXS2TZPI5OH3TESKHQNCKO34UP5YPFAQ5EPKB4LKST3PSWNY7Q, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.842347224 (193h23m47.573614874s) [noise=true , address=77.90.31.13:4657 , piece_id=3T2AY52BCUCXPSJHCPFDT4MNDY3RJVULG6X52HT4PKY7SJQ464SA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.843304817 (193h23m47.574572467s) [noise=true , address=104.36.82.37:4657 , piece_id=DOCMOQXG2TIS3MHSMBHQNEKZFUSXLKENOQXGWLQRYEYFD2OBJ2LA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.843418962 (193h23m47.574686612s) [noise=true , address=104.36.82.21:4476 , piece_id=H52MJNGMGSKORKKOPNBMVFOSFCKMCJOBET5NIQFAWZ5JDLTLY4ZQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844011178 (193h23m47.575278828s) [noise=true , address=45.91.116.5:4321 , piece_id=R4V5GAA7COM6Z2FAH7REIIDOMB7EJ2HUJHAWRWVNJRJV5WREPUSQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844142576 (193h23m47.575410225s) [noise=true , address=104.36.82.7:4933 , piece_id=GERLHPHJEVE5AVHI5VM4TCEDJC7PAAFHYAHPTETVC5NBMWTSFAFQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844882007 (193h23m47.576149657s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2F5PRGNYWIKKROX5EVNMCDUPJZPIOFJBN35YXEH4H5BKINRJKPQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.845386287 (193h23m47.576653947s) [noise=true , address=77.90.31.14:4681 , piece_id=F2C4U4NYLA5TGZSPC35WB2XH3YVQZNAYYPCGH66IIDLVSX7WZXKQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.845864367 (193h23m47.577132018s) [noise=true , address=45.91.116.10:4100 , piece_id=JMZXTBLEKC5X6I3T2P4XX32GGIXSH6IW4QCKFZFLTM5JQEBMLECQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.846491107 (193h23m47.577758757s) [noise=true , address=104.36.82.23:4447 , piece_id=H2XVFVY64HORCHUCFXZUQM7H4EWXQPV6YENXX7EEOOMCZTW4N6CA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.846703747 (193h23m47.577971408s) [noise=true , address=104.36.82.14:4230 , piece_id=WTOJ6THOEIOMF72YGNYOKRGYJQJF4FQP4VGDW2QQ2326DGTUSHCQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.847183361 (193h23m47.578451012s) [noise=true , address=77.90.31.10:4521 , piece_id=DJ2ZHTVZZ7SPBYTO2WH2BMDPS37K7MSYBPA3SHWXB3TM5FLTOZYQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.847384710 (193h23m47.57865236s) [noise=true , address=104.36.82.3:4793 , piece_id=47HFN7SSBLKV4Q2MTDVFC4GBNIPATKO6LRUOC4G2AW7A4MFAI6GA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.848437041 (193h23m47.579704692s) [noise=true , address=104.36.82.59:4313 , piece_id=J47ZWGLHUN7ECNRGXZZ42Q375WKFHUJN3XLYEGX2CMHC2RUWZJCA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.984012580 (193h23m47.71528023s) [upload=201259]: Next returned nil segment
Aug 16 18:50:06.984029241 (193h23m47.715296871s) [upload=201259]: Waiting for error group managing segments...
Aug 16 18:50:06.996112904 (193h23m47.727380564s) [noise=true , address=104.36.82.14:4230 , piece_id=WTOJ6THOEIOMF72YGNYOKRGYJQJF4FQP4VGDW2QQ2326DGTUSHCQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:06.999695960 (193h23m47.73096362s) [noise=true , address=104.36.82.39:4737 , piece_id=DC7GL4U6VY3SO6KZAXQNAK54AT2WFZBJUZM2WEFWLQKS5ULQJ3UQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.025463880 (193h23m47.756731529s) [noise=true , address=77.90.31.13:4657 , piece_id=3T2AY52BCUCXPSJHCPFDT4MNDY3RJVULG6X52HT4PKY7SJQ464SA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.027404303 (193h23m47.758671953s) [noise=true , address=104.36.82.21:4476 , piece_id=H52MJNGMGSKORKKOPNBMVFOSFCKMCJOBET5NIQFAWZ5JDLTLY4ZQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.031728906 (193h23m47.762996565s) [noise=true , address=77.90.31.14:4681 , piece_id=F2C4U4NYLA5TGZSPC35WB2XH3YVQZNAYYPCGH66IIDLVSX7WZXKQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.032687090 (193h23m47.76395474s) [noise=true , address=104.36.82.59:4313 , piece_id=J47ZWGLHUN7ECNRGXZZ42Q375WKFHUJN3XLYEGX2CMHC2RUWZJCA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.037670705 (193h23m47.768938354s) [noise=true , address=77.90.31.19:4870 , piece_id=76KXS2TZPI5OH3TESKHQNCKO34UP5YPFAQ5EPKB4LKST3PSWNY7Q, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.039026547 (193h23m47.770294198s) [noise=true , address=104.36.82.35:4587 , piece_id=5JFLAGKDPOYPDZFSKF2DJT6EHCPJHQBHGMV3T4RAPKFOXP5YDVYQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.039608773 (193h23m47.770876424s) [noise=true , address=104.36.82.20:4446 , piece_id=ZVIY47XJPM2KPHF6QWJYMGVR25PMANDTI3IGB5TTMW3QAT6NDPVQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.052389308 (193h23m47.783656959s) [noise=true , address=104.36.82.7:4933 , piece_id=GERLHPHJEVE5AVHI5VM4TCEDJC7PAAFHYAHPTETVC5NBMWTSFAFQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.052813196 (193h23m47.784080856s) [noise=true , address=104.36.82.37:4657 , piece_id=DOCMOQXG2TIS3MHSMBHQNEKZFUSXLKENOQXGWLQRYEYFD2OBJ2LA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.067727990 (193h23m47.79899564s) [noise=true , address=45.91.116.10:4100 , piece_id=JMZXTBLEKC5X6I3T2P4XX32GGIXSH6IW4QCKFZFLTM5JQEBMLECQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.077757915 (193h23m47.809025565s) [noise=true , address=104.36.82.34:4565 , piece_id=NPK7GSWSZWGHSUSETZCCOLVYUK6QE7RCZ5COSLSQ5UJ543W67MGQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.088885418 (193h23m47.820153067s) [noise=true , address=104.36.82.3:4793 , piece_id=47HFN7SSBLKV4Q2MTDVFC4GBNIPATKO6LRUOC4G2AW7A4MFAI6GA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.088946764 (193h23m47.820214414s) [seg_pos={0 0}, upload=201259]: Segment reached optimal threshold of 14 pieces.
Aug 16 18:50:07.089255815 (193h23m47.820523475s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2F5PRGNYWIKKROX5EVNMCDUPJZPIOFJBN35YXEH4H5BKINRJKPQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sJfMr1nMTpizd5PZ2bZ6M8tZWhFL2ukdJ3cNSRQtdUHNJhg81): protocol: expected piece hash; context canceled; EOF
Aug 16 18:50:07.089271314 (193h23m47.820538974s) [noise=true , address=104.36.82.23:4447 , piece_id=H2XVFVY64HORCHUCFXZUQM7H4EWXQPV6YENXX7EEOOMCZTW4N6CA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fqT9xA7kXTG8K9XwTUxL6FXibV35AkPHDK6grKGHg17fk91fP): protocol: write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection; write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection
Aug 16 18:50:07.089329323 (193h23m47.820596973s) [noise=true , address=77.90.31.10:4521 , piece_id=DJ2ZHTVZZ7SPBYTO2WH2BMDPS37K7MSYBPA3SHWXB3TM5FLTOZYQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WpVJa7SXkANKParDWYrC1cN8aLHTkUSPrRJGKQ6fvA5oDEkoa): protocol: write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection; write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection
Aug 16 18:50:07.089440162 (193h23m47.820707812s) [noise=true , address=45.91.116.5:4321 , piece_id=R4V5GAA7COM6Z2FAH7REIIDOMB7EJ2HUJHAWRWVNJRJV5WREPUSQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12m3Lw8yL9wVq38nW514iaLooMVgikbQBGA9vrFsr66jx5w1xXj): protocol: write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection; write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection
Aug 16 18:50:07.089461401 (193h23m47.820729052s) [seg_pos={0 0}, upload=201259]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 18:50:07.089583131 (193h23m47.820850791s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 18:50:07.089622546 (193h23m47.820890196s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 18:50:07.183064911 (193h23m47.914332561s) [upload=201259]: Done uploading segments...
Aug 16 18:50:07.183080390 (193h23m47.91434804s) [upload=201259]: Upload finished. err: <nil>
Duration: 730.441776ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...X...........X............................................] duration:
156.012008ms
FAIL (2025-08-16 19:05:17 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 18:30:20.656629884 (193h4m1.387897535s) [upload=200914]: Starting upload Aug 16 18:30:20.656698023 (193h4m1.387965672s) [upload=200914]: Done starting upload Aug 16 18:30:20.656779016 (193h4m1.388046665s) [upload=200914]: Uploading segments... Aug 16 18:30:20.656835431 (193h4m1.388103081s) [upload=200914]: Got next segment. Inline: true Aug 16 18:30:20.656842083 (193h4m1.388109744s) [upload=200914]: Waiting for error group managing segments... Aug 16 18:30:20.656913488 (193h4m1.388181139s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 18:30:20.656919560 (193h4m1.38818721s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 18:30:20.656923327 (193h4m1.388190977s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 18:30:20.659031257 (193h4m1.390298906s) [upload=200914]: Done uploading segments... Aug 16 18:30:20.659043129 (193h4m1.390310778s) [upload=200914]: Upload finished. err: metaclient: Too Many Requests
Duration: 156.042526ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..................X......X.............X....................] duration:
514.446995ms
FAIL (2025-08-16 19:04:56 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 18:50:06.795231389 (193h23m47.52649904s) [upload=201259]: Starting upload
Aug 16 18:50:06.795294448 (193h23m47.526562098s) [upload=201259]: Done starting upload
Aug 16 18:50:06.795449339 (193h23m47.526716989s) [upload=201259]: Uploading segments...
Aug 16 18:50:06.795693649 (193h23m47.5269613s) [upload=201259]: Got next segment. Inline: false
Aug 16 18:50:06.795759203 (193h23m47.527026853s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 18:50:06.795765165 (193h23m47.527032824s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 18:50:06.841060252 (193h23m47.572327901s) [seg_pos={0 0}, upload=201259]: Begin upload segment...
Aug 16 18:50:06.841119362 (193h23m47.572387012s) [seg_pos={0 0}, upload=201259]: Done begin upload segment.
Aug 16 18:50:06.841151233 (193h23m47.572418883s) [noise=true , address=104.36.82.35:4587 , piece_id=5JFLAGKDPOYPDZFSKF2DJT6EHCPJHQBHGMV3T4RAPKFOXP5YDVYQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841184625 (193h23m47.572452276s) [noise=true , address=104.36.82.34:4565 , piece_id=NPK7GSWSZWGHSUSETZCCOLVYUK6QE7RCZ5COSLSQ5UJ543W67MGQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841723480 (193h23m47.57299114s) [noise=true , address=104.36.82.20:4446 , piece_id=ZVIY47XJPM2KPHF6QWJYMGVR25PMANDTI3IGB5TTMW3QAT6NDPVQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841804182 (193h23m47.573071831s) [noise=true , address=104.36.82.39:4737 , piece_id=DC7GL4U6VY3SO6KZAXQNAK54AT2WFZBJUZM2WEFWLQKS5ULQJ3UQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.842218111 (193h23m47.573485761s) [noise=true , address=77.90.31.19:4870 , piece_id=76KXS2TZPI5OH3TESKHQNCKO34UP5YPFAQ5EPKB4LKST3PSWNY7Q, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.842347224 (193h23m47.573614874s) [noise=true , address=77.90.31.13:4657 , piece_id=3T2AY52BCUCXPSJHCPFDT4MNDY3RJVULG6X52HT4PKY7SJQ464SA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.843304817 (193h23m47.574572467s) [noise=true , address=104.36.82.37:4657 , piece_id=DOCMOQXG2TIS3MHSMBHQNEKZFUSXLKENOQXGWLQRYEYFD2OBJ2LA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.843418962 (193h23m47.574686612s) [noise=true , address=104.36.82.21:4476 , piece_id=H52MJNGMGSKORKKOPNBMVFOSFCKMCJOBET5NIQFAWZ5JDLTLY4ZQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844011178 (193h23m47.575278828s) [noise=true , address=45.91.116.5:4321 , piece_id=R4V5GAA7COM6Z2FAH7REIIDOMB7EJ2HUJHAWRWVNJRJV5WREPUSQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844142576 (193h23m47.575410225s) [noise=true , address=104.36.82.7:4933 , piece_id=GERLHPHJEVE5AVHI5VM4TCEDJC7PAAFHYAHPTETVC5NBMWTSFAFQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844882007 (193h23m47.576149657s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2F5PRGNYWIKKROX5EVNMCDUPJZPIOFJBN35YXEH4H5BKINRJKPQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.845386287 (193h23m47.576653947s) [noise=true , address=77.90.31.14:4681 , piece_id=F2C4U4NYLA5TGZSPC35WB2XH3YVQZNAYYPCGH66IIDLVSX7WZXKQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.845864367 (193h23m47.577132018s) [noise=true , address=45.91.116.10:4100 , piece_id=JMZXTBLEKC5X6I3T2P4XX32GGIXSH6IW4QCKFZFLTM5JQEBMLECQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.846491107 (193h23m47.577758757s) [noise=true , address=104.36.82.23:4447 , piece_id=H2XVFVY64HORCHUCFXZUQM7H4EWXQPV6YENXX7EEOOMCZTW4N6CA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.846703747 (193h23m47.577971408s) [noise=true , address=104.36.82.14:4230 , piece_id=WTOJ6THOEIOMF72YGNYOKRGYJQJF4FQP4VGDW2QQ2326DGTUSHCQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.847183361 (193h23m47.578451012s) [noise=true , address=77.90.31.10:4521 , piece_id=DJ2ZHTVZZ7SPBYTO2WH2BMDPS37K7MSYBPA3SHWXB3TM5FLTOZYQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.847384710 (193h23m47.57865236s) [noise=true , address=104.36.82.3:4793 , piece_id=47HFN7SSBLKV4Q2MTDVFC4GBNIPATKO6LRUOC4G2AW7A4MFAI6GA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.848437041 (193h23m47.579704692s) [noise=true , address=104.36.82.59:4313 , piece_id=J47ZWGLHUN7ECNRGXZZ42Q375WKFHUJN3XLYEGX2CMHC2RUWZJCA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.984012580 (193h23m47.71528023s) [upload=201259]: Next returned nil segment
Aug 16 18:50:06.984029241 (193h23m47.715296871s) [upload=201259]: Waiting for error group managing segments...
Aug 16 18:50:06.996112904 (193h23m47.727380564s) [noise=true , address=104.36.82.14:4230 , piece_id=WTOJ6THOEIOMF72YGNYOKRGYJQJF4FQP4VGDW2QQ2326DGTUSHCQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:06.999695960 (193h23m47.73096362s) [noise=true , address=104.36.82.39:4737 , piece_id=DC7GL4U6VY3SO6KZAXQNAK54AT2WFZBJUZM2WEFWLQKS5ULQJ3UQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.025463880 (193h23m47.756731529s) [noise=true , address=77.90.31.13:4657 , piece_id=3T2AY52BCUCXPSJHCPFDT4MNDY3RJVULG6X52HT4PKY7SJQ464SA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.027404303 (193h23m47.758671953s) [noise=true , address=104.36.82.21:4476 , piece_id=H52MJNGMGSKORKKOPNBMVFOSFCKMCJOBET5NIQFAWZ5JDLTLY4ZQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.031728906 (193h23m47.762996565s) [noise=true , address=77.90.31.14:4681 , piece_id=F2C4U4NYLA5TGZSPC35WB2XH3YVQZNAYYPCGH66IIDLVSX7WZXKQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.032687090 (193h23m47.76395474s) [noise=true , address=104.36.82.59:4313 , piece_id=J47ZWGLHUN7ECNRGXZZ42Q375WKFHUJN3XLYEGX2CMHC2RUWZJCA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.037670705 (193h23m47.768938354s) [noise=true , address=77.90.31.19:4870 , piece_id=76KXS2TZPI5OH3TESKHQNCKO34UP5YPFAQ5EPKB4LKST3PSWNY7Q, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.039026547 (193h23m47.770294198s) [noise=true , address=104.36.82.35:4587 , piece_id=5JFLAGKDPOYPDZFSKF2DJT6EHCPJHQBHGMV3T4RAPKFOXP5YDVYQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.039608773 (193h23m47.770876424s) [noise=true , address=104.36.82.20:4446 , piece_id=ZVIY47XJPM2KPHF6QWJYMGVR25PMANDTI3IGB5TTMW3QAT6NDPVQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.052389308 (193h23m47.783656959s) [noise=true , address=104.36.82.7:4933 , piece_id=GERLHPHJEVE5AVHI5VM4TCEDJC7PAAFHYAHPTETVC5NBMWTSFAFQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.052813196 (193h23m47.784080856s) [noise=true , address=104.36.82.37:4657 , piece_id=DOCMOQXG2TIS3MHSMBHQNEKZFUSXLKENOQXGWLQRYEYFD2OBJ2LA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.067727990 (193h23m47.79899564s) [noise=true , address=45.91.116.10:4100 , piece_id=JMZXTBLEKC5X6I3T2P4XX32GGIXSH6IW4QCKFZFLTM5JQEBMLECQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.077757915 (193h23m47.809025565s) [noise=true , address=104.36.82.34:4565 , piece_id=NPK7GSWSZWGHSUSETZCCOLVYUK6QE7RCZ5COSLSQ5UJ543W67MGQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.088885418 (193h23m47.820153067s) [noise=true , address=104.36.82.3:4793 , piece_id=47HFN7SSBLKV4Q2MTDVFC4GBNIPATKO6LRUOC4G2AW7A4MFAI6GA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.088946764 (193h23m47.820214414s) [seg_pos={0 0}, upload=201259]: Segment reached optimal threshold of 14 pieces.
Aug 16 18:50:07.089255815 (193h23m47.820523475s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2F5PRGNYWIKKROX5EVNMCDUPJZPIOFJBN35YXEH4H5BKINRJKPQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sJfMr1nMTpizd5PZ2bZ6M8tZWhFL2ukdJ3cNSRQtdUHNJhg81): protocol: expected piece hash; context canceled; EOF
Aug 16 18:50:07.089271314 (193h23m47.820538974s) [noise=true , address=104.36.82.23:4447 , piece_id=H2XVFVY64HORCHUCFXZUQM7H4EWXQPV6YENXX7EEOOMCZTW4N6CA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fqT9xA7kXTG8K9XwTUxL6FXibV35AkPHDK6grKGHg17fk91fP): protocol: write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection; write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection
Aug 16 18:50:07.089329323 (193h23m47.820596973s) [noise=true , address=77.90.31.10:4521 , piece_id=DJ2ZHTVZZ7SPBYTO2WH2BMDPS37K7MSYBPA3SHWXB3TM5FLTOZYQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WpVJa7SXkANKParDWYrC1cN8aLHTkUSPrRJGKQ6fvA5oDEkoa): protocol: write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection; write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection
Aug 16 18:50:07.089440162 (193h23m47.820707812s) [noise=true , address=45.91.116.5:4321 , piece_id=R4V5GAA7COM6Z2FAH7REIIDOMB7EJ2HUJHAWRWVNJRJV5WREPUSQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12m3Lw8yL9wVq38nW514iaLooMVgikbQBGA9vrFsr66jx5w1xXj): protocol: write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection; write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection
Aug 16 18:50:07.089461401 (193h23m47.820729052s) [seg_pos={0 0}, upload=201259]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 18:50:07.089583131 (193h23m47.820850791s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 18:50:07.089622546 (193h23m47.820890196s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 18:50:07.183064911 (193h23m47.914332561s) [upload=201259]: Done uploading segments...
Aug 16 18:50:07.183080390 (193h23m47.91434804s) [upload=201259]: Upload finished. err: <nil>
Duration: 514.470219ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....X...........X...........................................] duration:
333.692238ms
FAIL (2025-08-16 19:04:16 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 18:30:20.656629884 (193h4m1.387897535s) [upload=200914]: Starting upload Aug 16 18:30:20.656698023 (193h4m1.387965672s) [upload=200914]: Done starting upload Aug 16 18:30:20.656779016 (193h4m1.388046665s) [upload=200914]: Uploading segments... Aug 16 18:30:20.656835431 (193h4m1.388103081s) [upload=200914]: Got next segment. Inline: true Aug 16 18:30:20.656842083 (193h4m1.388109744s) [upload=200914]: Waiting for error group managing segments... Aug 16 18:30:20.656913488 (193h4m1.388181139s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 18:30:20.656919560 (193h4m1.38818721s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 18:30:20.656923327 (193h4m1.388190977s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 18:30:20.659031257 (193h4m1.390298906s) [upload=200914]: Done uploading segments... Aug 16 18:30:20.659043129 (193h4m1.390310778s) [upload=200914]: Upload finished. err: metaclient: Too Many Requests
Duration: 333.775104ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...................X......X.............X...................] duration:
416.011447ms
FAIL (2025-08-16 19:03:51 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 18:50:06.795231389 (193h23m47.52649904s) [upload=201259]: Starting upload
Aug 16 18:50:06.795294448 (193h23m47.526562098s) [upload=201259]: Done starting upload
Aug 16 18:50:06.795449339 (193h23m47.526716989s) [upload=201259]: Uploading segments...
Aug 16 18:50:06.795693649 (193h23m47.5269613s) [upload=201259]: Got next segment. Inline: false
Aug 16 18:50:06.795759203 (193h23m47.527026853s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 18:50:06.795765165 (193h23m47.527032824s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 18:50:06.841060252 (193h23m47.572327901s) [seg_pos={0 0}, upload=201259]: Begin upload segment...
Aug 16 18:50:06.841119362 (193h23m47.572387012s) [seg_pos={0 0}, upload=201259]: Done begin upload segment.
Aug 16 18:50:06.841151233 (193h23m47.572418883s) [noise=true , address=104.36.82.35:4587 , piece_id=5JFLAGKDPOYPDZFSKF2DJT6EHCPJHQBHGMV3T4RAPKFOXP5YDVYQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841184625 (193h23m47.572452276s) [noise=true , address=104.36.82.34:4565 , piece_id=NPK7GSWSZWGHSUSETZCCOLVYUK6QE7RCZ5COSLSQ5UJ543W67MGQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841723480 (193h23m47.57299114s) [noise=true , address=104.36.82.20:4446 , piece_id=ZVIY47XJPM2KPHF6QWJYMGVR25PMANDTI3IGB5TTMW3QAT6NDPVQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841804182 (193h23m47.573071831s) [noise=true , address=104.36.82.39:4737 , piece_id=DC7GL4U6VY3SO6KZAXQNAK54AT2WFZBJUZM2WEFWLQKS5ULQJ3UQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.842218111 (193h23m47.573485761s) [noise=true , address=77.90.31.19:4870 , piece_id=76KXS2TZPI5OH3TESKHQNCKO34UP5YPFAQ5EPKB4LKST3PSWNY7Q, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.842347224 (193h23m47.573614874s) [noise=true , address=77.90.31.13:4657 , piece_id=3T2AY52BCUCXPSJHCPFDT4MNDY3RJVULG6X52HT4PKY7SJQ464SA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.843304817 (193h23m47.574572467s) [noise=true , address=104.36.82.37:4657 , piece_id=DOCMOQXG2TIS3MHSMBHQNEKZFUSXLKENOQXGWLQRYEYFD2OBJ2LA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.843418962 (193h23m47.574686612s) [noise=true , address=104.36.82.21:4476 , piece_id=H52MJNGMGSKORKKOPNBMVFOSFCKMCJOBET5NIQFAWZ5JDLTLY4ZQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844011178 (193h23m47.575278828s) [noise=true , address=45.91.116.5:4321 , piece_id=R4V5GAA7COM6Z2FAH7REIIDOMB7EJ2HUJHAWRWVNJRJV5WREPUSQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844142576 (193h23m47.575410225s) [noise=true , address=104.36.82.7:4933 , piece_id=GERLHPHJEVE5AVHI5VM4TCEDJC7PAAFHYAHPTETVC5NBMWTSFAFQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844882007 (193h23m47.576149657s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2F5PRGNYWIKKROX5EVNMCDUPJZPIOFJBN35YXEH4H5BKINRJKPQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.845386287 (193h23m47.576653947s) [noise=true , address=77.90.31.14:4681 , piece_id=F2C4U4NYLA5TGZSPC35WB2XH3YVQZNAYYPCGH66IIDLVSX7WZXKQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.845864367 (193h23m47.577132018s) [noise=true , address=45.91.116.10:4100 , piece_id=JMZXTBLEKC5X6I3T2P4XX32GGIXSH6IW4QCKFZFLTM5JQEBMLECQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.846491107 (193h23m47.577758757s) [noise=true , address=104.36.82.23:4447 , piece_id=H2XVFVY64HORCHUCFXZUQM7H4EWXQPV6YENXX7EEOOMCZTW4N6CA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.846703747 (193h23m47.577971408s) [noise=true , address=104.36.82.14:4230 , piece_id=WTOJ6THOEIOMF72YGNYOKRGYJQJF4FQP4VGDW2QQ2326DGTUSHCQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.847183361 (193h23m47.578451012s) [noise=true , address=77.90.31.10:4521 , piece_id=DJ2ZHTVZZ7SPBYTO2WH2BMDPS37K7MSYBPA3SHWXB3TM5FLTOZYQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.847384710 (193h23m47.57865236s) [noise=true , address=104.36.82.3:4793 , piece_id=47HFN7SSBLKV4Q2MTDVFC4GBNIPATKO6LRUOC4G2AW7A4MFAI6GA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.848437041 (193h23m47.579704692s) [noise=true , address=104.36.82.59:4313 , piece_id=J47ZWGLHUN7ECNRGXZZ42Q375WKFHUJN3XLYEGX2CMHC2RUWZJCA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.984012580 (193h23m47.71528023s) [upload=201259]: Next returned nil segment
Aug 16 18:50:06.984029241 (193h23m47.715296871s) [upload=201259]: Waiting for error group managing segments...
Aug 16 18:50:06.996112904 (193h23m47.727380564s) [noise=true , address=104.36.82.14:4230 , piece_id=WTOJ6THOEIOMF72YGNYOKRGYJQJF4FQP4VGDW2QQ2326DGTUSHCQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:06.999695960 (193h23m47.73096362s) [noise=true , address=104.36.82.39:4737 , piece_id=DC7GL4U6VY3SO6KZAXQNAK54AT2WFZBJUZM2WEFWLQKS5ULQJ3UQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.025463880 (193h23m47.756731529s) [noise=true , address=77.90.31.13:4657 , piece_id=3T2AY52BCUCXPSJHCPFDT4MNDY3RJVULG6X52HT4PKY7SJQ464SA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.027404303 (193h23m47.758671953s) [noise=true , address=104.36.82.21:4476 , piece_id=H52MJNGMGSKORKKOPNBMVFOSFCKMCJOBET5NIQFAWZ5JDLTLY4ZQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.031728906 (193h23m47.762996565s) [noise=true , address=77.90.31.14:4681 , piece_id=F2C4U4NYLA5TGZSPC35WB2XH3YVQZNAYYPCGH66IIDLVSX7WZXKQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.032687090 (193h23m47.76395474s) [noise=true , address=104.36.82.59:4313 , piece_id=J47ZWGLHUN7ECNRGXZZ42Q375WKFHUJN3XLYEGX2CMHC2RUWZJCA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.037670705 (193h23m47.768938354s) [noise=true , address=77.90.31.19:4870 , piece_id=76KXS2TZPI5OH3TESKHQNCKO34UP5YPFAQ5EPKB4LKST3PSWNY7Q, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.039026547 (193h23m47.770294198s) [noise=true , address=104.36.82.35:4587 , piece_id=5JFLAGKDPOYPDZFSKF2DJT6EHCPJHQBHGMV3T4RAPKFOXP5YDVYQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.039608773 (193h23m47.770876424s) [noise=true , address=104.36.82.20:4446 , piece_id=ZVIY47XJPM2KPHF6QWJYMGVR25PMANDTI3IGB5TTMW3QAT6NDPVQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.052389308 (193h23m47.783656959s) [noise=true , address=104.36.82.7:4933 , piece_id=GERLHPHJEVE5AVHI5VM4TCEDJC7PAAFHYAHPTETVC5NBMWTSFAFQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.052813196 (193h23m47.784080856s) [noise=true , address=104.36.82.37:4657 , piece_id=DOCMOQXG2TIS3MHSMBHQNEKZFUSXLKENOQXGWLQRYEYFD2OBJ2LA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.067727990 (193h23m47.79899564s) [noise=true , address=45.91.116.10:4100 , piece_id=JMZXTBLEKC5X6I3T2P4XX32GGIXSH6IW4QCKFZFLTM5JQEBMLECQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.077757915 (193h23m47.809025565s) [noise=true , address=104.36.82.34:4565 , piece_id=NPK7GSWSZWGHSUSETZCCOLVYUK6QE7RCZ5COSLSQ5UJ543W67MGQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.088885418 (193h23m47.820153067s) [noise=true , address=104.36.82.3:4793 , piece_id=47HFN7SSBLKV4Q2MTDVFC4GBNIPATKO6LRUOC4G2AW7A4MFAI6GA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.088946764 (193h23m47.820214414s) [seg_pos={0 0}, upload=201259]: Segment reached optimal threshold of 14 pieces.
Aug 16 18:50:07.089255815 (193h23m47.820523475s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2F5PRGNYWIKKROX5EVNMCDUPJZPIOFJBN35YXEH4H5BKINRJKPQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sJfMr1nMTpizd5PZ2bZ6M8tZWhFL2ukdJ3cNSRQtdUHNJhg81): protocol: expected piece hash; context canceled; EOF
Aug 16 18:50:07.089271314 (193h23m47.820538974s) [noise=true , address=104.36.82.23:4447 , piece_id=H2XVFVY64HORCHUCFXZUQM7H4EWXQPV6YENXX7EEOOMCZTW4N6CA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fqT9xA7kXTG8K9XwTUxL6FXibV35AkPHDK6grKGHg17fk91fP): protocol: write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection; write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection
Aug 16 18:50:07.089329323 (193h23m47.820596973s) [noise=true , address=77.90.31.10:4521 , piece_id=DJ2ZHTVZZ7SPBYTO2WH2BMDPS37K7MSYBPA3SHWXB3TM5FLTOZYQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WpVJa7SXkANKParDWYrC1cN8aLHTkUSPrRJGKQ6fvA5oDEkoa): protocol: write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection; write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection
Aug 16 18:50:07.089440162 (193h23m47.820707812s) [noise=true , address=45.91.116.5:4321 , piece_id=R4V5GAA7COM6Z2FAH7REIIDOMB7EJ2HUJHAWRWVNJRJV5WREPUSQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12m3Lw8yL9wVq38nW514iaLooMVgikbQBGA9vrFsr66jx5w1xXj): protocol: write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection; write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection
Aug 16 18:50:07.089461401 (193h23m47.820729052s) [seg_pos={0 0}, upload=201259]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 18:50:07.089583131 (193h23m47.820850791s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 18:50:07.089622546 (193h23m47.820890196s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 18:50:07.183064911 (193h23m47.914332561s) [upload=201259]: Done uploading segments...
Aug 16 18:50:07.183080390 (193h23m47.91434804s) [upload=201259]: Upload finished. err: <nil>
Duration: 416.026043ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....X...........X..........................................] duration:
201.528964ms
FAIL (2025-08-16 19:03:46 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 18:30:20.656629884 (193h4m1.387897535s) [upload=200914]: Starting upload Aug 16 18:30:20.656698023 (193h4m1.387965672s) [upload=200914]: Done starting upload Aug 16 18:30:20.656779016 (193h4m1.388046665s) [upload=200914]: Uploading segments... Aug 16 18:30:20.656835431 (193h4m1.388103081s) [upload=200914]: Got next segment. Inline: true Aug 16 18:30:20.656842083 (193h4m1.388109744s) [upload=200914]: Waiting for error group managing segments... Aug 16 18:30:20.656913488 (193h4m1.388181139s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 18:30:20.656919560 (193h4m1.38818721s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 18:30:20.656923327 (193h4m1.388190977s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 18:30:20.659031257 (193h4m1.390298906s) [upload=200914]: Done uploading segments... Aug 16 18:30:20.659043129 (193h4m1.390310778s) [upload=200914]: Upload finished. err: metaclient: Too Many Requests
Duration: 201.587764ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......X...........X.........................................] duration:
164.575202ms
FAIL (2025-08-16 19:03:09 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 18:30:20.656629884 (193h4m1.387897535s) [upload=200914]: Starting upload Aug 16 18:30:20.656698023 (193h4m1.387965672s) [upload=200914]: Done starting upload Aug 16 18:30:20.656779016 (193h4m1.388046665s) [upload=200914]: Uploading segments... Aug 16 18:30:20.656835431 (193h4m1.388103081s) [upload=200914]: Got next segment. Inline: true Aug 16 18:30:20.656842083 (193h4m1.388109744s) [upload=200914]: Waiting for error group managing segments... Aug 16 18:30:20.656913488 (193h4m1.388181139s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 18:30:20.656919560 (193h4m1.38818721s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 18:30:20.656923327 (193h4m1.388190977s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 18:30:20.659031257 (193h4m1.390298906s) [upload=200914]: Done uploading segments... Aug 16 18:30:20.659043129 (193h4m1.390310778s) [upload=200914]: Upload finished. err: metaclient: Too Many Requests
Duration: 164.594508ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [....................X......X.............X..................] duration:
833.71956ms
FAIL (2025-08-16 19:03:03 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 18:50:06.795231389 (193h23m47.52649904s) [upload=201259]: Starting upload
Aug 16 18:50:06.795294448 (193h23m47.526562098s) [upload=201259]: Done starting upload
Aug 16 18:50:06.795449339 (193h23m47.526716989s) [upload=201259]: Uploading segments...
Aug 16 18:50:06.795693649 (193h23m47.5269613s) [upload=201259]: Got next segment. Inline: false
Aug 16 18:50:06.795759203 (193h23m47.527026853s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 18:50:06.795765165 (193h23m47.527032824s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 18:50:06.841060252 (193h23m47.572327901s) [seg_pos={0 0}, upload=201259]: Begin upload segment...
Aug 16 18:50:06.841119362 (193h23m47.572387012s) [seg_pos={0 0}, upload=201259]: Done begin upload segment.
Aug 16 18:50:06.841151233 (193h23m47.572418883s) [noise=true , address=104.36.82.35:4587 , piece_id=5JFLAGKDPOYPDZFSKF2DJT6EHCPJHQBHGMV3T4RAPKFOXP5YDVYQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841184625 (193h23m47.572452276s) [noise=true , address=104.36.82.34:4565 , piece_id=NPK7GSWSZWGHSUSETZCCOLVYUK6QE7RCZ5COSLSQ5UJ543W67MGQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841723480 (193h23m47.57299114s) [noise=true , address=104.36.82.20:4446 , piece_id=ZVIY47XJPM2KPHF6QWJYMGVR25PMANDTI3IGB5TTMW3QAT6NDPVQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841804182 (193h23m47.573071831s) [noise=true , address=104.36.82.39:4737 , piece_id=DC7GL4U6VY3SO6KZAXQNAK54AT2WFZBJUZM2WEFWLQKS5ULQJ3UQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.842218111 (193h23m47.573485761s) [noise=true , address=77.90.31.19:4870 , piece_id=76KXS2TZPI5OH3TESKHQNCKO34UP5YPFAQ5EPKB4LKST3PSWNY7Q, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.842347224 (193h23m47.573614874s) [noise=true , address=77.90.31.13:4657 , piece_id=3T2AY52BCUCXPSJHCPFDT4MNDY3RJVULG6X52HT4PKY7SJQ464SA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.843304817 (193h23m47.574572467s) [noise=true , address=104.36.82.37:4657 , piece_id=DOCMOQXG2TIS3MHSMBHQNEKZFUSXLKENOQXGWLQRYEYFD2OBJ2LA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.843418962 (193h23m47.574686612s) [noise=true , address=104.36.82.21:4476 , piece_id=H52MJNGMGSKORKKOPNBMVFOSFCKMCJOBET5NIQFAWZ5JDLTLY4ZQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844011178 (193h23m47.575278828s) [noise=true , address=45.91.116.5:4321 , piece_id=R4V5GAA7COM6Z2FAH7REIIDOMB7EJ2HUJHAWRWVNJRJV5WREPUSQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844142576 (193h23m47.575410225s) [noise=true , address=104.36.82.7:4933 , piece_id=GERLHPHJEVE5AVHI5VM4TCEDJC7PAAFHYAHPTETVC5NBMWTSFAFQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844882007 (193h23m47.576149657s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2F5PRGNYWIKKROX5EVNMCDUPJZPIOFJBN35YXEH4H5BKINRJKPQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.845386287 (193h23m47.576653947s) [noise=true , address=77.90.31.14:4681 , piece_id=F2C4U4NYLA5TGZSPC35WB2XH3YVQZNAYYPCGH66IIDLVSX7WZXKQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.845864367 (193h23m47.577132018s) [noise=true , address=45.91.116.10:4100 , piece_id=JMZXTBLEKC5X6I3T2P4XX32GGIXSH6IW4QCKFZFLTM5JQEBMLECQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.846491107 (193h23m47.577758757s) [noise=true , address=104.36.82.23:4447 , piece_id=H2XVFVY64HORCHUCFXZUQM7H4EWXQPV6YENXX7EEOOMCZTW4N6CA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.846703747 (193h23m47.577971408s) [noise=true , address=104.36.82.14:4230 , piece_id=WTOJ6THOEIOMF72YGNYOKRGYJQJF4FQP4VGDW2QQ2326DGTUSHCQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.847183361 (193h23m47.578451012s) [noise=true , address=77.90.31.10:4521 , piece_id=DJ2ZHTVZZ7SPBYTO2WH2BMDPS37K7MSYBPA3SHWXB3TM5FLTOZYQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.847384710 (193h23m47.57865236s) [noise=true , address=104.36.82.3:4793 , piece_id=47HFN7SSBLKV4Q2MTDVFC4GBNIPATKO6LRUOC4G2AW7A4MFAI6GA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.848437041 (193h23m47.579704692s) [noise=true , address=104.36.82.59:4313 , piece_id=J47ZWGLHUN7ECNRGXZZ42Q375WKFHUJN3XLYEGX2CMHC2RUWZJCA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.984012580 (193h23m47.71528023s) [upload=201259]: Next returned nil segment
Aug 16 18:50:06.984029241 (193h23m47.715296871s) [upload=201259]: Waiting for error group managing segments...
Aug 16 18:50:06.996112904 (193h23m47.727380564s) [noise=true , address=104.36.82.14:4230 , piece_id=WTOJ6THOEIOMF72YGNYOKRGYJQJF4FQP4VGDW2QQ2326DGTUSHCQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:06.999695960 (193h23m47.73096362s) [noise=true , address=104.36.82.39:4737 , piece_id=DC7GL4U6VY3SO6KZAXQNAK54AT2WFZBJUZM2WEFWLQKS5ULQJ3UQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.025463880 (193h23m47.756731529s) [noise=true , address=77.90.31.13:4657 , piece_id=3T2AY52BCUCXPSJHCPFDT4MNDY3RJVULG6X52HT4PKY7SJQ464SA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.027404303 (193h23m47.758671953s) [noise=true , address=104.36.82.21:4476 , piece_id=H52MJNGMGSKORKKOPNBMVFOSFCKMCJOBET5NIQFAWZ5JDLTLY4ZQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.031728906 (193h23m47.762996565s) [noise=true , address=77.90.31.14:4681 , piece_id=F2C4U4NYLA5TGZSPC35WB2XH3YVQZNAYYPCGH66IIDLVSX7WZXKQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.032687090 (193h23m47.76395474s) [noise=true , address=104.36.82.59:4313 , piece_id=J47ZWGLHUN7ECNRGXZZ42Q375WKFHUJN3XLYEGX2CMHC2RUWZJCA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.037670705 (193h23m47.768938354s) [noise=true , address=77.90.31.19:4870 , piece_id=76KXS2TZPI5OH3TESKHQNCKO34UP5YPFAQ5EPKB4LKST3PSWNY7Q, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.039026547 (193h23m47.770294198s) [noise=true , address=104.36.82.35:4587 , piece_id=5JFLAGKDPOYPDZFSKF2DJT6EHCPJHQBHGMV3T4RAPKFOXP5YDVYQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.039608773 (193h23m47.770876424s) [noise=true , address=104.36.82.20:4446 , piece_id=ZVIY47XJPM2KPHF6QWJYMGVR25PMANDTI3IGB5TTMW3QAT6NDPVQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.052389308 (193h23m47.783656959s) [noise=true , address=104.36.82.7:4933 , piece_id=GERLHPHJEVE5AVHI5VM4TCEDJC7PAAFHYAHPTETVC5NBMWTSFAFQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.052813196 (193h23m47.784080856s) [noise=true , address=104.36.82.37:4657 , piece_id=DOCMOQXG2TIS3MHSMBHQNEKZFUSXLKENOQXGWLQRYEYFD2OBJ2LA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.067727990 (193h23m47.79899564s) [noise=true , address=45.91.116.10:4100 , piece_id=JMZXTBLEKC5X6I3T2P4XX32GGIXSH6IW4QCKFZFLTM5JQEBMLECQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.077757915 (193h23m47.809025565s) [noise=true , address=104.36.82.34:4565 , piece_id=NPK7GSWSZWGHSUSETZCCOLVYUK6QE7RCZ5COSLSQ5UJ543W67MGQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.088885418 (193h23m47.820153067s) [noise=true , address=104.36.82.3:4793 , piece_id=47HFN7SSBLKV4Q2MTDVFC4GBNIPATKO6LRUOC4G2AW7A4MFAI6GA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.088946764 (193h23m47.820214414s) [seg_pos={0 0}, upload=201259]: Segment reached optimal threshold of 14 pieces.
Aug 16 18:50:07.089255815 (193h23m47.820523475s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2F5PRGNYWIKKROX5EVNMCDUPJZPIOFJBN35YXEH4H5BKINRJKPQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sJfMr1nMTpizd5PZ2bZ6M8tZWhFL2ukdJ3cNSRQtdUHNJhg81): protocol: expected piece hash; context canceled; EOF
Aug 16 18:50:07.089271314 (193h23m47.820538974s) [noise=true , address=104.36.82.23:4447 , piece_id=H2XVFVY64HORCHUCFXZUQM7H4EWXQPV6YENXX7EEOOMCZTW4N6CA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fqT9xA7kXTG8K9XwTUxL6FXibV35AkPHDK6grKGHg17fk91fP): protocol: write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection; write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection
Aug 16 18:50:07.089329323 (193h23m47.820596973s) [noise=true , address=77.90.31.10:4521 , piece_id=DJ2ZHTVZZ7SPBYTO2WH2BMDPS37K7MSYBPA3SHWXB3TM5FLTOZYQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WpVJa7SXkANKParDWYrC1cN8aLHTkUSPrRJGKQ6fvA5oDEkoa): protocol: write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection; write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection
Aug 16 18:50:07.089440162 (193h23m47.820707812s) [noise=true , address=45.91.116.5:4321 , piece_id=R4V5GAA7COM6Z2FAH7REIIDOMB7EJ2HUJHAWRWVNJRJV5WREPUSQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12m3Lw8yL9wVq38nW514iaLooMVgikbQBGA9vrFsr66jx5w1xXj): protocol: write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection; write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection
Aug 16 18:50:07.089461401 (193h23m47.820729052s) [seg_pos={0 0}, upload=201259]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 18:50:07.089583131 (193h23m47.820850791s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 18:50:07.089622546 (193h23m47.820890196s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 18:50:07.183064911 (193h23m47.914332561s) [upload=201259]: Done uploading segments...
Aug 16 18:50:07.183080390 (193h23m47.91434804s) [upload=201259]: Upload finished. err: <nil>
Duration: 833.742533ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......X...........X........................................] duration:
237.320197ms
FAIL (2025-08-16 19:02:31 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 18:30:20.656629884 (193h4m1.387897535s) [upload=200914]: Starting upload Aug 16 18:30:20.656698023 (193h4m1.387965672s) [upload=200914]: Done starting upload Aug 16 18:30:20.656779016 (193h4m1.388046665s) [upload=200914]: Uploading segments... Aug 16 18:30:20.656835431 (193h4m1.388103081s) [upload=200914]: Got next segment. Inline: true Aug 16 18:30:20.656842083 (193h4m1.388109744s) [upload=200914]: Waiting for error group managing segments... Aug 16 18:30:20.656913488 (193h4m1.388181139s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 18:30:20.656919560 (193h4m1.38818721s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 18:30:20.656923327 (193h4m1.388190977s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 18:30:20.659031257 (193h4m1.390298906s) [upload=200914]: Done uploading segments... Aug 16 18:30:20.659043129 (193h4m1.390310778s) [upload=200914]: Upload finished. err: metaclient: Too Many Requests
Duration: 237.345154ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....................X......X.............X.................] duration:
834.501834ms
FAIL (2025-08-16 19:02:13 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 18:50:06.795231389 (193h23m47.52649904s) [upload=201259]: Starting upload
Aug 16 18:50:06.795294448 (193h23m47.526562098s) [upload=201259]: Done starting upload
Aug 16 18:50:06.795449339 (193h23m47.526716989s) [upload=201259]: Uploading segments...
Aug 16 18:50:06.795693649 (193h23m47.5269613s) [upload=201259]: Got next segment. Inline: false
Aug 16 18:50:06.795759203 (193h23m47.527026853s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 18:50:06.795765165 (193h23m47.527032824s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 18:50:06.841060252 (193h23m47.572327901s) [seg_pos={0 0}, upload=201259]: Begin upload segment...
Aug 16 18:50:06.841119362 (193h23m47.572387012s) [seg_pos={0 0}, upload=201259]: Done begin upload segment.
Aug 16 18:50:06.841151233 (193h23m47.572418883s) [noise=true , address=104.36.82.35:4587 , piece_id=5JFLAGKDPOYPDZFSKF2DJT6EHCPJHQBHGMV3T4RAPKFOXP5YDVYQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841184625 (193h23m47.572452276s) [noise=true , address=104.36.82.34:4565 , piece_id=NPK7GSWSZWGHSUSETZCCOLVYUK6QE7RCZ5COSLSQ5UJ543W67MGQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841723480 (193h23m47.57299114s) [noise=true , address=104.36.82.20:4446 , piece_id=ZVIY47XJPM2KPHF6QWJYMGVR25PMANDTI3IGB5TTMW3QAT6NDPVQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841804182 (193h23m47.573071831s) [noise=true , address=104.36.82.39:4737 , piece_id=DC7GL4U6VY3SO6KZAXQNAK54AT2WFZBJUZM2WEFWLQKS5ULQJ3UQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.842218111 (193h23m47.573485761s) [noise=true , address=77.90.31.19:4870 , piece_id=76KXS2TZPI5OH3TESKHQNCKO34UP5YPFAQ5EPKB4LKST3PSWNY7Q, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.842347224 (193h23m47.573614874s) [noise=true , address=77.90.31.13:4657 , piece_id=3T2AY52BCUCXPSJHCPFDT4MNDY3RJVULG6X52HT4PKY7SJQ464SA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.843304817 (193h23m47.574572467s) [noise=true , address=104.36.82.37:4657 , piece_id=DOCMOQXG2TIS3MHSMBHQNEKZFUSXLKENOQXGWLQRYEYFD2OBJ2LA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.843418962 (193h23m47.574686612s) [noise=true , address=104.36.82.21:4476 , piece_id=H52MJNGMGSKORKKOPNBMVFOSFCKMCJOBET5NIQFAWZ5JDLTLY4ZQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844011178 (193h23m47.575278828s) [noise=true , address=45.91.116.5:4321 , piece_id=R4V5GAA7COM6Z2FAH7REIIDOMB7EJ2HUJHAWRWVNJRJV5WREPUSQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844142576 (193h23m47.575410225s) [noise=true , address=104.36.82.7:4933 , piece_id=GERLHPHJEVE5AVHI5VM4TCEDJC7PAAFHYAHPTETVC5NBMWTSFAFQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844882007 (193h23m47.576149657s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2F5PRGNYWIKKROX5EVNMCDUPJZPIOFJBN35YXEH4H5BKINRJKPQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.845386287 (193h23m47.576653947s) [noise=true , address=77.90.31.14:4681 , piece_id=F2C4U4NYLA5TGZSPC35WB2XH3YVQZNAYYPCGH66IIDLVSX7WZXKQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.845864367 (193h23m47.577132018s) [noise=true , address=45.91.116.10:4100 , piece_id=JMZXTBLEKC5X6I3T2P4XX32GGIXSH6IW4QCKFZFLTM5JQEBMLECQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.846491107 (193h23m47.577758757s) [noise=true , address=104.36.82.23:4447 , piece_id=H2XVFVY64HORCHUCFXZUQM7H4EWXQPV6YENXX7EEOOMCZTW4N6CA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.846703747 (193h23m47.577971408s) [noise=true , address=104.36.82.14:4230 , piece_id=WTOJ6THOEIOMF72YGNYOKRGYJQJF4FQP4VGDW2QQ2326DGTUSHCQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.847183361 (193h23m47.578451012s) [noise=true , address=77.90.31.10:4521 , piece_id=DJ2ZHTVZZ7SPBYTO2WH2BMDPS37K7MSYBPA3SHWXB3TM5FLTOZYQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.847384710 (193h23m47.57865236s) [noise=true , address=104.36.82.3:4793 , piece_id=47HFN7SSBLKV4Q2MTDVFC4GBNIPATKO6LRUOC4G2AW7A4MFAI6GA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.848437041 (193h23m47.579704692s) [noise=true , address=104.36.82.59:4313 , piece_id=J47ZWGLHUN7ECNRGXZZ42Q375WKFHUJN3XLYEGX2CMHC2RUWZJCA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.984012580 (193h23m47.71528023s) [upload=201259]: Next returned nil segment
Aug 16 18:50:06.984029241 (193h23m47.715296871s) [upload=201259]: Waiting for error group managing segments...
Aug 16 18:50:06.996112904 (193h23m47.727380564s) [noise=true , address=104.36.82.14:4230 , piece_id=WTOJ6THOEIOMF72YGNYOKRGYJQJF4FQP4VGDW2QQ2326DGTUSHCQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:06.999695960 (193h23m47.73096362s) [noise=true , address=104.36.82.39:4737 , piece_id=DC7GL4U6VY3SO6KZAXQNAK54AT2WFZBJUZM2WEFWLQKS5ULQJ3UQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.025463880 (193h23m47.756731529s) [noise=true , address=77.90.31.13:4657 , piece_id=3T2AY52BCUCXPSJHCPFDT4MNDY3RJVULG6X52HT4PKY7SJQ464SA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.027404303 (193h23m47.758671953s) [noise=true , address=104.36.82.21:4476 , piece_id=H52MJNGMGSKORKKOPNBMVFOSFCKMCJOBET5NIQFAWZ5JDLTLY4ZQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.031728906 (193h23m47.762996565s) [noise=true , address=77.90.31.14:4681 , piece_id=F2C4U4NYLA5TGZSPC35WB2XH3YVQZNAYYPCGH66IIDLVSX7WZXKQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.032687090 (193h23m47.76395474s) [noise=true , address=104.36.82.59:4313 , piece_id=J47ZWGLHUN7ECNRGXZZ42Q375WKFHUJN3XLYEGX2CMHC2RUWZJCA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.037670705 (193h23m47.768938354s) [noise=true , address=77.90.31.19:4870 , piece_id=76KXS2TZPI5OH3TESKHQNCKO34UP5YPFAQ5EPKB4LKST3PSWNY7Q, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.039026547 (193h23m47.770294198s) [noise=true , address=104.36.82.35:4587 , piece_id=5JFLAGKDPOYPDZFSKF2DJT6EHCPJHQBHGMV3T4RAPKFOXP5YDVYQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.039608773 (193h23m47.770876424s) [noise=true , address=104.36.82.20:4446 , piece_id=ZVIY47XJPM2KPHF6QWJYMGVR25PMANDTI3IGB5TTMW3QAT6NDPVQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.052389308 (193h23m47.783656959s) [noise=true , address=104.36.82.7:4933 , piece_id=GERLHPHJEVE5AVHI5VM4TCEDJC7PAAFHYAHPTETVC5NBMWTSFAFQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.052813196 (193h23m47.784080856s) [noise=true , address=104.36.82.37:4657 , piece_id=DOCMOQXG2TIS3MHSMBHQNEKZFUSXLKENOQXGWLQRYEYFD2OBJ2LA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.067727990 (193h23m47.79899564s) [noise=true , address=45.91.116.10:4100 , piece_id=JMZXTBLEKC5X6I3T2P4XX32GGIXSH6IW4QCKFZFLTM5JQEBMLECQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.077757915 (193h23m47.809025565s) [noise=true , address=104.36.82.34:4565 , piece_id=NPK7GSWSZWGHSUSETZCCOLVYUK6QE7RCZ5COSLSQ5UJ543W67MGQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.088885418 (193h23m47.820153067s) [noise=true , address=104.36.82.3:4793 , piece_id=47HFN7SSBLKV4Q2MTDVFC4GBNIPATKO6LRUOC4G2AW7A4MFAI6GA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.088946764 (193h23m47.820214414s) [seg_pos={0 0}, upload=201259]: Segment reached optimal threshold of 14 pieces.
Aug 16 18:50:07.089255815 (193h23m47.820523475s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2F5PRGNYWIKKROX5EVNMCDUPJZPIOFJBN35YXEH4H5BKINRJKPQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sJfMr1nMTpizd5PZ2bZ6M8tZWhFL2ukdJ3cNSRQtdUHNJhg81): protocol: expected piece hash; context canceled; EOF
Aug 16 18:50:07.089271314 (193h23m47.820538974s) [noise=true , address=104.36.82.23:4447 , piece_id=H2XVFVY64HORCHUCFXZUQM7H4EWXQPV6YENXX7EEOOMCZTW4N6CA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fqT9xA7kXTG8K9XwTUxL6FXibV35AkPHDK6grKGHg17fk91fP): protocol: write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection; write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection
Aug 16 18:50:07.089329323 (193h23m47.820596973s) [noise=true , address=77.90.31.10:4521 , piece_id=DJ2ZHTVZZ7SPBYTO2WH2BMDPS37K7MSYBPA3SHWXB3TM5FLTOZYQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WpVJa7SXkANKParDWYrC1cN8aLHTkUSPrRJGKQ6fvA5oDEkoa): protocol: write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection; write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection
Aug 16 18:50:07.089440162 (193h23m47.820707812s) [noise=true , address=45.91.116.5:4321 , piece_id=R4V5GAA7COM6Z2FAH7REIIDOMB7EJ2HUJHAWRWVNJRJV5WREPUSQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12m3Lw8yL9wVq38nW514iaLooMVgikbQBGA9vrFsr66jx5w1xXj): protocol: write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection; write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection
Aug 16 18:50:07.089461401 (193h23m47.820729052s) [seg_pos={0 0}, upload=201259]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 18:50:07.089583131 (193h23m47.820850791s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 18:50:07.089622546 (193h23m47.820890196s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 18:50:07.183064911 (193h23m47.914332561s) [upload=201259]: Done uploading segments...
Aug 16 18:50:07.183080390 (193h23m47.91434804s) [upload=201259]: Upload finished. err: <nil>
Duration: 834.521292ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......................X......X.............X................] duration:
671.315156ms
FAIL (2025-08-16 19:01:36 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 18:50:06.795231389 (193h23m47.52649904s) [upload=201259]: Starting upload
Aug 16 18:50:06.795294448 (193h23m47.526562098s) [upload=201259]: Done starting upload
Aug 16 18:50:06.795449339 (193h23m47.526716989s) [upload=201259]: Uploading segments...
Aug 16 18:50:06.795693649 (193h23m47.5269613s) [upload=201259]: Got next segment. Inline: false
Aug 16 18:50:06.795759203 (193h23m47.527026853s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 18:50:06.795765165 (193h23m47.527032824s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 18:50:06.841060252 (193h23m47.572327901s) [seg_pos={0 0}, upload=201259]: Begin upload segment...
Aug 16 18:50:06.841119362 (193h23m47.572387012s) [seg_pos={0 0}, upload=201259]: Done begin upload segment.
Aug 16 18:50:06.841151233 (193h23m47.572418883s) [noise=true , address=104.36.82.35:4587 , piece_id=5JFLAGKDPOYPDZFSKF2DJT6EHCPJHQBHGMV3T4RAPKFOXP5YDVYQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841184625 (193h23m47.572452276s) [noise=true , address=104.36.82.34:4565 , piece_id=NPK7GSWSZWGHSUSETZCCOLVYUK6QE7RCZ5COSLSQ5UJ543W67MGQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841723480 (193h23m47.57299114s) [noise=true , address=104.36.82.20:4446 , piece_id=ZVIY47XJPM2KPHF6QWJYMGVR25PMANDTI3IGB5TTMW3QAT6NDPVQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841804182 (193h23m47.573071831s) [noise=true , address=104.36.82.39:4737 , piece_id=DC7GL4U6VY3SO6KZAXQNAK54AT2WFZBJUZM2WEFWLQKS5ULQJ3UQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.842218111 (193h23m47.573485761s) [noise=true , address=77.90.31.19:4870 , piece_id=76KXS2TZPI5OH3TESKHQNCKO34UP5YPFAQ5EPKB4LKST3PSWNY7Q, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.842347224 (193h23m47.573614874s) [noise=true , address=77.90.31.13:4657 , piece_id=3T2AY52BCUCXPSJHCPFDT4MNDY3RJVULG6X52HT4PKY7SJQ464SA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.843304817 (193h23m47.574572467s) [noise=true , address=104.36.82.37:4657 , piece_id=DOCMOQXG2TIS3MHSMBHQNEKZFUSXLKENOQXGWLQRYEYFD2OBJ2LA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.843418962 (193h23m47.574686612s) [noise=true , address=104.36.82.21:4476 , piece_id=H52MJNGMGSKORKKOPNBMVFOSFCKMCJOBET5NIQFAWZ5JDLTLY4ZQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844011178 (193h23m47.575278828s) [noise=true , address=45.91.116.5:4321 , piece_id=R4V5GAA7COM6Z2FAH7REIIDOMB7EJ2HUJHAWRWVNJRJV5WREPUSQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844142576 (193h23m47.575410225s) [noise=true , address=104.36.82.7:4933 , piece_id=GERLHPHJEVE5AVHI5VM4TCEDJC7PAAFHYAHPTETVC5NBMWTSFAFQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844882007 (193h23m47.576149657s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2F5PRGNYWIKKROX5EVNMCDUPJZPIOFJBN35YXEH4H5BKINRJKPQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.845386287 (193h23m47.576653947s) [noise=true , address=77.90.31.14:4681 , piece_id=F2C4U4NYLA5TGZSPC35WB2XH3YVQZNAYYPCGH66IIDLVSX7WZXKQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.845864367 (193h23m47.577132018s) [noise=true , address=45.91.116.10:4100 , piece_id=JMZXTBLEKC5X6I3T2P4XX32GGIXSH6IW4QCKFZFLTM5JQEBMLECQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.846491107 (193h23m47.577758757s) [noise=true , address=104.36.82.23:4447 , piece_id=H2XVFVY64HORCHUCFXZUQM7H4EWXQPV6YENXX7EEOOMCZTW4N6CA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.846703747 (193h23m47.577971408s) [noise=true , address=104.36.82.14:4230 , piece_id=WTOJ6THOEIOMF72YGNYOKRGYJQJF4FQP4VGDW2QQ2326DGTUSHCQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.847183361 (193h23m47.578451012s) [noise=true , address=77.90.31.10:4521 , piece_id=DJ2ZHTVZZ7SPBYTO2WH2BMDPS37K7MSYBPA3SHWXB3TM5FLTOZYQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.847384710 (193h23m47.57865236s) [noise=true , address=104.36.82.3:4793 , piece_id=47HFN7SSBLKV4Q2MTDVFC4GBNIPATKO6LRUOC4G2AW7A4MFAI6GA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.848437041 (193h23m47.579704692s) [noise=true , address=104.36.82.59:4313 , piece_id=J47ZWGLHUN7ECNRGXZZ42Q375WKFHUJN3XLYEGX2CMHC2RUWZJCA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.984012580 (193h23m47.71528023s) [upload=201259]: Next returned nil segment
Aug 16 18:50:06.984029241 (193h23m47.715296871s) [upload=201259]: Waiting for error group managing segments...
Aug 16 18:50:06.996112904 (193h23m47.727380564s) [noise=true , address=104.36.82.14:4230 , piece_id=WTOJ6THOEIOMF72YGNYOKRGYJQJF4FQP4VGDW2QQ2326DGTUSHCQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:06.999695960 (193h23m47.73096362s) [noise=true , address=104.36.82.39:4737 , piece_id=DC7GL4U6VY3SO6KZAXQNAK54AT2WFZBJUZM2WEFWLQKS5ULQJ3UQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.025463880 (193h23m47.756731529s) [noise=true , address=77.90.31.13:4657 , piece_id=3T2AY52BCUCXPSJHCPFDT4MNDY3RJVULG6X52HT4PKY7SJQ464SA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.027404303 (193h23m47.758671953s) [noise=true , address=104.36.82.21:4476 , piece_id=H52MJNGMGSKORKKOPNBMVFOSFCKMCJOBET5NIQFAWZ5JDLTLY4ZQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.031728906 (193h23m47.762996565s) [noise=true , address=77.90.31.14:4681 , piece_id=F2C4U4NYLA5TGZSPC35WB2XH3YVQZNAYYPCGH66IIDLVSX7WZXKQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.032687090 (193h23m47.76395474s) [noise=true , address=104.36.82.59:4313 , piece_id=J47ZWGLHUN7ECNRGXZZ42Q375WKFHUJN3XLYEGX2CMHC2RUWZJCA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.037670705 (193h23m47.768938354s) [noise=true , address=77.90.31.19:4870 , piece_id=76KXS2TZPI5OH3TESKHQNCKO34UP5YPFAQ5EPKB4LKST3PSWNY7Q, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.039026547 (193h23m47.770294198s) [noise=true , address=104.36.82.35:4587 , piece_id=5JFLAGKDPOYPDZFSKF2DJT6EHCPJHQBHGMV3T4RAPKFOXP5YDVYQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.039608773 (193h23m47.770876424s) [noise=true , address=104.36.82.20:4446 , piece_id=ZVIY47XJPM2KPHF6QWJYMGVR25PMANDTI3IGB5TTMW3QAT6NDPVQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.052389308 (193h23m47.783656959s) [noise=true , address=104.36.82.7:4933 , piece_id=GERLHPHJEVE5AVHI5VM4TCEDJC7PAAFHYAHPTETVC5NBMWTSFAFQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.052813196 (193h23m47.784080856s) [noise=true , address=104.36.82.37:4657 , piece_id=DOCMOQXG2TIS3MHSMBHQNEKZFUSXLKENOQXGWLQRYEYFD2OBJ2LA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.067727990 (193h23m47.79899564s) [noise=true , address=45.91.116.10:4100 , piece_id=JMZXTBLEKC5X6I3T2P4XX32GGIXSH6IW4QCKFZFLTM5JQEBMLECQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.077757915 (193h23m47.809025565s) [noise=true , address=104.36.82.34:4565 , piece_id=NPK7GSWSZWGHSUSETZCCOLVYUK6QE7RCZ5COSLSQ5UJ543W67MGQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.088885418 (193h23m47.820153067s) [noise=true , address=104.36.82.3:4793 , piece_id=47HFN7SSBLKV4Q2MTDVFC4GBNIPATKO6LRUOC4G2AW7A4MFAI6GA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.088946764 (193h23m47.820214414s) [seg_pos={0 0}, upload=201259]: Segment reached optimal threshold of 14 pieces.
Aug 16 18:50:07.089255815 (193h23m47.820523475s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2F5PRGNYWIKKROX5EVNMCDUPJZPIOFJBN35YXEH4H5BKINRJKPQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sJfMr1nMTpizd5PZ2bZ6M8tZWhFL2ukdJ3cNSRQtdUHNJhg81): protocol: expected piece hash; context canceled; EOF
Aug 16 18:50:07.089271314 (193h23m47.820538974s) [noise=true , address=104.36.82.23:4447 , piece_id=H2XVFVY64HORCHUCFXZUQM7H4EWXQPV6YENXX7EEOOMCZTW4N6CA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fqT9xA7kXTG8K9XwTUxL6FXibV35AkPHDK6grKGHg17fk91fP): protocol: write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection; write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection
Aug 16 18:50:07.089329323 (193h23m47.820596973s) [noise=true , address=77.90.31.10:4521 , piece_id=DJ2ZHTVZZ7SPBYTO2WH2BMDPS37K7MSYBPA3SHWXB3TM5FLTOZYQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WpVJa7SXkANKParDWYrC1cN8aLHTkUSPrRJGKQ6fvA5oDEkoa): protocol: write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection; write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection
Aug 16 18:50:07.089440162 (193h23m47.820707812s) [noise=true , address=45.91.116.5:4321 , piece_id=R4V5GAA7COM6Z2FAH7REIIDOMB7EJ2HUJHAWRWVNJRJV5WREPUSQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12m3Lw8yL9wVq38nW514iaLooMVgikbQBGA9vrFsr66jx5w1xXj): protocol: write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection; write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection
Aug 16 18:50:07.089461401 (193h23m47.820729052s) [seg_pos={0 0}, upload=201259]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 18:50:07.089583131 (193h23m47.820850791s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 18:50:07.089622546 (193h23m47.820890196s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 18:50:07.183064911 (193h23m47.914332561s) [upload=201259]: Done uploading segments...
Aug 16 18:50:07.183080390 (193h23m47.91434804s) [upload=201259]: Upload finished. err: <nil>
Duration: 671.337028ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........X...........X.......................................] duration:
194.895711ms
FAIL (2025-08-16 19:01:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 18:30:20.656629884 (193h4m1.387897535s) [upload=200914]: Starting upload Aug 16 18:30:20.656698023 (193h4m1.387965672s) [upload=200914]: Done starting upload Aug 16 18:30:20.656779016 (193h4m1.388046665s) [upload=200914]: Uploading segments... Aug 16 18:30:20.656835431 (193h4m1.388103081s) [upload=200914]: Got next segment. Inline: true Aug 16 18:30:20.656842083 (193h4m1.388109744s) [upload=200914]: Waiting for error group managing segments... Aug 16 18:30:20.656913488 (193h4m1.388181139s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 18:30:20.656919560 (193h4m1.38818721s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 18:30:20.656923327 (193h4m1.388190977s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 18:30:20.659031257 (193h4m1.390298906s) [upload=200914]: Done uploading segments... Aug 16 18:30:20.659043129 (193h4m1.390310778s) [upload=200914]: Upload finished. err: metaclient: Too Many Requests
Duration: 194.922552ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......................X......X.............X...............] duration:
470.016626ms
FAIL (2025-08-16 19:00:58 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 18:50:06.795231389 (193h23m47.52649904s) [upload=201259]: Starting upload
Aug 16 18:50:06.795294448 (193h23m47.526562098s) [upload=201259]: Done starting upload
Aug 16 18:50:06.795449339 (193h23m47.526716989s) [upload=201259]: Uploading segments...
Aug 16 18:50:06.795693649 (193h23m47.5269613s) [upload=201259]: Got next segment. Inline: false
Aug 16 18:50:06.795759203 (193h23m47.527026853s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 18:50:06.795765165 (193h23m47.527032824s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 18:50:06.841060252 (193h23m47.572327901s) [seg_pos={0 0}, upload=201259]: Begin upload segment...
Aug 16 18:50:06.841119362 (193h23m47.572387012s) [seg_pos={0 0}, upload=201259]: Done begin upload segment.
Aug 16 18:50:06.841151233 (193h23m47.572418883s) [noise=true , address=104.36.82.35:4587 , piece_id=5JFLAGKDPOYPDZFSKF2DJT6EHCPJHQBHGMV3T4RAPKFOXP5YDVYQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841184625 (193h23m47.572452276s) [noise=true , address=104.36.82.34:4565 , piece_id=NPK7GSWSZWGHSUSETZCCOLVYUK6QE7RCZ5COSLSQ5UJ543W67MGQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841723480 (193h23m47.57299114s) [noise=true , address=104.36.82.20:4446 , piece_id=ZVIY47XJPM2KPHF6QWJYMGVR25PMANDTI3IGB5TTMW3QAT6NDPVQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841804182 (193h23m47.573071831s) [noise=true , address=104.36.82.39:4737 , piece_id=DC7GL4U6VY3SO6KZAXQNAK54AT2WFZBJUZM2WEFWLQKS5ULQJ3UQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.842218111 (193h23m47.573485761s) [noise=true , address=77.90.31.19:4870 , piece_id=76KXS2TZPI5OH3TESKHQNCKO34UP5YPFAQ5EPKB4LKST3PSWNY7Q, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.842347224 (193h23m47.573614874s) [noise=true , address=77.90.31.13:4657 , piece_id=3T2AY52BCUCXPSJHCPFDT4MNDY3RJVULG6X52HT4PKY7SJQ464SA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.843304817 (193h23m47.574572467s) [noise=true , address=104.36.82.37:4657 , piece_id=DOCMOQXG2TIS3MHSMBHQNEKZFUSXLKENOQXGWLQRYEYFD2OBJ2LA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.843418962 (193h23m47.574686612s) [noise=true , address=104.36.82.21:4476 , piece_id=H52MJNGMGSKORKKOPNBMVFOSFCKMCJOBET5NIQFAWZ5JDLTLY4ZQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844011178 (193h23m47.575278828s) [noise=true , address=45.91.116.5:4321 , piece_id=R4V5GAA7COM6Z2FAH7REIIDOMB7EJ2HUJHAWRWVNJRJV5WREPUSQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844142576 (193h23m47.575410225s) [noise=true , address=104.36.82.7:4933 , piece_id=GERLHPHJEVE5AVHI5VM4TCEDJC7PAAFHYAHPTETVC5NBMWTSFAFQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844882007 (193h23m47.576149657s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2F5PRGNYWIKKROX5EVNMCDUPJZPIOFJBN35YXEH4H5BKINRJKPQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.845386287 (193h23m47.576653947s) [noise=true , address=77.90.31.14:4681 , piece_id=F2C4U4NYLA5TGZSPC35WB2XH3YVQZNAYYPCGH66IIDLVSX7WZXKQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.845864367 (193h23m47.577132018s) [noise=true , address=45.91.116.10:4100 , piece_id=JMZXTBLEKC5X6I3T2P4XX32GGIXSH6IW4QCKFZFLTM5JQEBMLECQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.846491107 (193h23m47.577758757s) [noise=true , address=104.36.82.23:4447 , piece_id=H2XVFVY64HORCHUCFXZUQM7H4EWXQPV6YENXX7EEOOMCZTW4N6CA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.846703747 (193h23m47.577971408s) [noise=true , address=104.36.82.14:4230 , piece_id=WTOJ6THOEIOMF72YGNYOKRGYJQJF4FQP4VGDW2QQ2326DGTUSHCQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.847183361 (193h23m47.578451012s) [noise=true , address=77.90.31.10:4521 , piece_id=DJ2ZHTVZZ7SPBYTO2WH2BMDPS37K7MSYBPA3SHWXB3TM5FLTOZYQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.847384710 (193h23m47.57865236s) [noise=true , address=104.36.82.3:4793 , piece_id=47HFN7SSBLKV4Q2MTDVFC4GBNIPATKO6LRUOC4G2AW7A4MFAI6GA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.848437041 (193h23m47.579704692s) [noise=true , address=104.36.82.59:4313 , piece_id=J47ZWGLHUN7ECNRGXZZ42Q375WKFHUJN3XLYEGX2CMHC2RUWZJCA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.984012580 (193h23m47.71528023s) [upload=201259]: Next returned nil segment
Aug 16 18:50:06.984029241 (193h23m47.715296871s) [upload=201259]: Waiting for error group managing segments...
Aug 16 18:50:06.996112904 (193h23m47.727380564s) [noise=true , address=104.36.82.14:4230 , piece_id=WTOJ6THOEIOMF72YGNYOKRGYJQJF4FQP4VGDW2QQ2326DGTUSHCQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:06.999695960 (193h23m47.73096362s) [noise=true , address=104.36.82.39:4737 , piece_id=DC7GL4U6VY3SO6KZAXQNAK54AT2WFZBJUZM2WEFWLQKS5ULQJ3UQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.025463880 (193h23m47.756731529s) [noise=true , address=77.90.31.13:4657 , piece_id=3T2AY52BCUCXPSJHCPFDT4MNDY3RJVULG6X52HT4PKY7SJQ464SA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.027404303 (193h23m47.758671953s) [noise=true , address=104.36.82.21:4476 , piece_id=H52MJNGMGSKORKKOPNBMVFOSFCKMCJOBET5NIQFAWZ5JDLTLY4ZQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.031728906 (193h23m47.762996565s) [noise=true , address=77.90.31.14:4681 , piece_id=F2C4U4NYLA5TGZSPC35WB2XH3YVQZNAYYPCGH66IIDLVSX7WZXKQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.032687090 (193h23m47.76395474s) [noise=true , address=104.36.82.59:4313 , piece_id=J47ZWGLHUN7ECNRGXZZ42Q375WKFHUJN3XLYEGX2CMHC2RUWZJCA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.037670705 (193h23m47.768938354s) [noise=true , address=77.90.31.19:4870 , piece_id=76KXS2TZPI5OH3TESKHQNCKO34UP5YPFAQ5EPKB4LKST3PSWNY7Q, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.039026547 (193h23m47.770294198s) [noise=true , address=104.36.82.35:4587 , piece_id=5JFLAGKDPOYPDZFSKF2DJT6EHCPJHQBHGMV3T4RAPKFOXP5YDVYQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.039608773 (193h23m47.770876424s) [noise=true , address=104.36.82.20:4446 , piece_id=ZVIY47XJPM2KPHF6QWJYMGVR25PMANDTI3IGB5TTMW3QAT6NDPVQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.052389308 (193h23m47.783656959s) [noise=true , address=104.36.82.7:4933 , piece_id=GERLHPHJEVE5AVHI5VM4TCEDJC7PAAFHYAHPTETVC5NBMWTSFAFQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.052813196 (193h23m47.784080856s) [noise=true , address=104.36.82.37:4657 , piece_id=DOCMOQXG2TIS3MHSMBHQNEKZFUSXLKENOQXGWLQRYEYFD2OBJ2LA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.067727990 (193h23m47.79899564s) [noise=true , address=45.91.116.10:4100 , piece_id=JMZXTBLEKC5X6I3T2P4XX32GGIXSH6IW4QCKFZFLTM5JQEBMLECQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.077757915 (193h23m47.809025565s) [noise=true , address=104.36.82.34:4565 , piece_id=NPK7GSWSZWGHSUSETZCCOLVYUK6QE7RCZ5COSLSQ5UJ543W67MGQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.088885418 (193h23m47.820153067s) [noise=true , address=104.36.82.3:4793 , piece_id=47HFN7SSBLKV4Q2MTDVFC4GBNIPATKO6LRUOC4G2AW7A4MFAI6GA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.088946764 (193h23m47.820214414s) [seg_pos={0 0}, upload=201259]: Segment reached optimal threshold of 14 pieces.
Aug 16 18:50:07.089255815 (193h23m47.820523475s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2F5PRGNYWIKKROX5EVNMCDUPJZPIOFJBN35YXEH4H5BKINRJKPQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sJfMr1nMTpizd5PZ2bZ6M8tZWhFL2ukdJ3cNSRQtdUHNJhg81): protocol: expected piece hash; context canceled; EOF
Aug 16 18:50:07.089271314 (193h23m47.820538974s) [noise=true , address=104.36.82.23:4447 , piece_id=H2XVFVY64HORCHUCFXZUQM7H4EWXQPV6YENXX7EEOOMCZTW4N6CA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fqT9xA7kXTG8K9XwTUxL6FXibV35AkPHDK6grKGHg17fk91fP): protocol: write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection; write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection
Aug 16 18:50:07.089329323 (193h23m47.820596973s) [noise=true , address=77.90.31.10:4521 , piece_id=DJ2ZHTVZZ7SPBYTO2WH2BMDPS37K7MSYBPA3SHWXB3TM5FLTOZYQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WpVJa7SXkANKParDWYrC1cN8aLHTkUSPrRJGKQ6fvA5oDEkoa): protocol: write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection; write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection
Aug 16 18:50:07.089440162 (193h23m47.820707812s) [noise=true , address=45.91.116.5:4321 , piece_id=R4V5GAA7COM6Z2FAH7REIIDOMB7EJ2HUJHAWRWVNJRJV5WREPUSQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12m3Lw8yL9wVq38nW514iaLooMVgikbQBGA9vrFsr66jx5w1xXj): protocol: write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection; write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection
Aug 16 18:50:07.089461401 (193h23m47.820729052s) [seg_pos={0 0}, upload=201259]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 18:50:07.089583131 (193h23m47.820850791s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 18:50:07.089622546 (193h23m47.820890196s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 18:50:07.183064911 (193h23m47.914332561s) [upload=201259]: Done uploading segments...
Aug 16 18:50:07.183080390 (193h23m47.91434804s) [upload=201259]: Upload finished. err: <nil>
Duration: 470.053967ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [........................X......X.............X..............] duration:
601.136013ms
FAIL (2025-08-16 19:00:37 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 18:50:06.795231389 (193h23m47.52649904s) [upload=201259]: Starting upload
Aug 16 18:50:06.795294448 (193h23m47.526562098s) [upload=201259]: Done starting upload
Aug 16 18:50:06.795449339 (193h23m47.526716989s) [upload=201259]: Uploading segments...
Aug 16 18:50:06.795693649 (193h23m47.5269613s) [upload=201259]: Got next segment. Inline: false
Aug 16 18:50:06.795759203 (193h23m47.527026853s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 18:50:06.795765165 (193h23m47.527032824s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 18:50:06.841060252 (193h23m47.572327901s) [seg_pos={0 0}, upload=201259]: Begin upload segment...
Aug 16 18:50:06.841119362 (193h23m47.572387012s) [seg_pos={0 0}, upload=201259]: Done begin upload segment.
Aug 16 18:50:06.841151233 (193h23m47.572418883s) [noise=true , address=104.36.82.35:4587 , piece_id=5JFLAGKDPOYPDZFSKF2DJT6EHCPJHQBHGMV3T4RAPKFOXP5YDVYQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841184625 (193h23m47.572452276s) [noise=true , address=104.36.82.34:4565 , piece_id=NPK7GSWSZWGHSUSETZCCOLVYUK6QE7RCZ5COSLSQ5UJ543W67MGQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841723480 (193h23m47.57299114s) [noise=true , address=104.36.82.20:4446 , piece_id=ZVIY47XJPM2KPHF6QWJYMGVR25PMANDTI3IGB5TTMW3QAT6NDPVQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841804182 (193h23m47.573071831s) [noise=true , address=104.36.82.39:4737 , piece_id=DC7GL4U6VY3SO6KZAXQNAK54AT2WFZBJUZM2WEFWLQKS5ULQJ3UQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.842218111 (193h23m47.573485761s) [noise=true , address=77.90.31.19:4870 , piece_id=76KXS2TZPI5OH3TESKHQNCKO34UP5YPFAQ5EPKB4LKST3PSWNY7Q, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.842347224 (193h23m47.573614874s) [noise=true , address=77.90.31.13:4657 , piece_id=3T2AY52BCUCXPSJHCPFDT4MNDY3RJVULG6X52HT4PKY7SJQ464SA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.843304817 (193h23m47.574572467s) [noise=true , address=104.36.82.37:4657 , piece_id=DOCMOQXG2TIS3MHSMBHQNEKZFUSXLKENOQXGWLQRYEYFD2OBJ2LA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.843418962 (193h23m47.574686612s) [noise=true , address=104.36.82.21:4476 , piece_id=H52MJNGMGSKORKKOPNBMVFOSFCKMCJOBET5NIQFAWZ5JDLTLY4ZQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844011178 (193h23m47.575278828s) [noise=true , address=45.91.116.5:4321 , piece_id=R4V5GAA7COM6Z2FAH7REIIDOMB7EJ2HUJHAWRWVNJRJV5WREPUSQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844142576 (193h23m47.575410225s) [noise=true , address=104.36.82.7:4933 , piece_id=GERLHPHJEVE5AVHI5VM4TCEDJC7PAAFHYAHPTETVC5NBMWTSFAFQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844882007 (193h23m47.576149657s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2F5PRGNYWIKKROX5EVNMCDUPJZPIOFJBN35YXEH4H5BKINRJKPQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.845386287 (193h23m47.576653947s) [noise=true , address=77.90.31.14:4681 , piece_id=F2C4U4NYLA5TGZSPC35WB2XH3YVQZNAYYPCGH66IIDLVSX7WZXKQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.845864367 (193h23m47.577132018s) [noise=true , address=45.91.116.10:4100 , piece_id=JMZXTBLEKC5X6I3T2P4XX32GGIXSH6IW4QCKFZFLTM5JQEBMLECQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.846491107 (193h23m47.577758757s) [noise=true , address=104.36.82.23:4447 , piece_id=H2XVFVY64HORCHUCFXZUQM7H4EWXQPV6YENXX7EEOOMCZTW4N6CA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.846703747 (193h23m47.577971408s) [noise=true , address=104.36.82.14:4230 , piece_id=WTOJ6THOEIOMF72YGNYOKRGYJQJF4FQP4VGDW2QQ2326DGTUSHCQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.847183361 (193h23m47.578451012s) [noise=true , address=77.90.31.10:4521 , piece_id=DJ2ZHTVZZ7SPBYTO2WH2BMDPS37K7MSYBPA3SHWXB3TM5FLTOZYQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.847384710 (193h23m47.57865236s) [noise=true , address=104.36.82.3:4793 , piece_id=47HFN7SSBLKV4Q2MTDVFC4GBNIPATKO6LRUOC4G2AW7A4MFAI6GA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.848437041 (193h23m47.579704692s) [noise=true , address=104.36.82.59:4313 , piece_id=J47ZWGLHUN7ECNRGXZZ42Q375WKFHUJN3XLYEGX2CMHC2RUWZJCA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.984012580 (193h23m47.71528023s) [upload=201259]: Next returned nil segment
Aug 16 18:50:06.984029241 (193h23m47.715296871s) [upload=201259]: Waiting for error group managing segments...
Aug 16 18:50:06.996112904 (193h23m47.727380564s) [noise=true , address=104.36.82.14:4230 , piece_id=WTOJ6THOEIOMF72YGNYOKRGYJQJF4FQP4VGDW2QQ2326DGTUSHCQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:06.999695960 (193h23m47.73096362s) [noise=true , address=104.36.82.39:4737 , piece_id=DC7GL4U6VY3SO6KZAXQNAK54AT2WFZBJUZM2WEFWLQKS5ULQJ3UQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.025463880 (193h23m47.756731529s) [noise=true , address=77.90.31.13:4657 , piece_id=3T2AY52BCUCXPSJHCPFDT4MNDY3RJVULG6X52HT4PKY7SJQ464SA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.027404303 (193h23m47.758671953s) [noise=true , address=104.36.82.21:4476 , piece_id=H52MJNGMGSKORKKOPNBMVFOSFCKMCJOBET5NIQFAWZ5JDLTLY4ZQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.031728906 (193h23m47.762996565s) [noise=true , address=77.90.31.14:4681 , piece_id=F2C4U4NYLA5TGZSPC35WB2XH3YVQZNAYYPCGH66IIDLVSX7WZXKQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.032687090 (193h23m47.76395474s) [noise=true , address=104.36.82.59:4313 , piece_id=J47ZWGLHUN7ECNRGXZZ42Q375WKFHUJN3XLYEGX2CMHC2RUWZJCA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.037670705 (193h23m47.768938354s) [noise=true , address=77.90.31.19:4870 , piece_id=76KXS2TZPI5OH3TESKHQNCKO34UP5YPFAQ5EPKB4LKST3PSWNY7Q, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.039026547 (193h23m47.770294198s) [noise=true , address=104.36.82.35:4587 , piece_id=5JFLAGKDPOYPDZFSKF2DJT6EHCPJHQBHGMV3T4RAPKFOXP5YDVYQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.039608773 (193h23m47.770876424s) [noise=true , address=104.36.82.20:4446 , piece_id=ZVIY47XJPM2KPHF6QWJYMGVR25PMANDTI3IGB5TTMW3QAT6NDPVQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.052389308 (193h23m47.783656959s) [noise=true , address=104.36.82.7:4933 , piece_id=GERLHPHJEVE5AVHI5VM4TCEDJC7PAAFHYAHPTETVC5NBMWTSFAFQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.052813196 (193h23m47.784080856s) [noise=true , address=104.36.82.37:4657 , piece_id=DOCMOQXG2TIS3MHSMBHQNEKZFUSXLKENOQXGWLQRYEYFD2OBJ2LA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.067727990 (193h23m47.79899564s) [noise=true , address=45.91.116.10:4100 , piece_id=JMZXTBLEKC5X6I3T2P4XX32GGIXSH6IW4QCKFZFLTM5JQEBMLECQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.077757915 (193h23m47.809025565s) [noise=true , address=104.36.82.34:4565 , piece_id=NPK7GSWSZWGHSUSETZCCOLVYUK6QE7RCZ5COSLSQ5UJ543W67MGQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.088885418 (193h23m47.820153067s) [noise=true , address=104.36.82.3:4793 , piece_id=47HFN7SSBLKV4Q2MTDVFC4GBNIPATKO6LRUOC4G2AW7A4MFAI6GA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.088946764 (193h23m47.820214414s) [seg_pos={0 0}, upload=201259]: Segment reached optimal threshold of 14 pieces.
Aug 16 18:50:07.089255815 (193h23m47.820523475s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2F5PRGNYWIKKROX5EVNMCDUPJZPIOFJBN35YXEH4H5BKINRJKPQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sJfMr1nMTpizd5PZ2bZ6M8tZWhFL2ukdJ3cNSRQtdUHNJhg81): protocol: expected piece hash; context canceled; EOF
Aug 16 18:50:07.089271314 (193h23m47.820538974s) [noise=true , address=104.36.82.23:4447 , piece_id=H2XVFVY64HORCHUCFXZUQM7H4EWXQPV6YENXX7EEOOMCZTW4N6CA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fqT9xA7kXTG8K9XwTUxL6FXibV35AkPHDK6grKGHg17fk91fP): protocol: write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection; write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection
Aug 16 18:50:07.089329323 (193h23m47.820596973s) [noise=true , address=77.90.31.10:4521 , piece_id=DJ2ZHTVZZ7SPBYTO2WH2BMDPS37K7MSYBPA3SHWXB3TM5FLTOZYQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WpVJa7SXkANKParDWYrC1cN8aLHTkUSPrRJGKQ6fvA5oDEkoa): protocol: write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection; write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection
Aug 16 18:50:07.089440162 (193h23m47.820707812s) [noise=true , address=45.91.116.5:4321 , piece_id=R4V5GAA7COM6Z2FAH7REIIDOMB7EJ2HUJHAWRWVNJRJV5WREPUSQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12m3Lw8yL9wVq38nW514iaLooMVgikbQBGA9vrFsr66jx5w1xXj): protocol: write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection; write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection
Aug 16 18:50:07.089461401 (193h23m47.820729052s) [seg_pos={0 0}, upload=201259]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 18:50:07.089583131 (193h23m47.820850791s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 18:50:07.089622546 (193h23m47.820890196s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 18:50:07.183064911 (193h23m47.914332561s) [upload=201259]: Done uploading segments...
Aug 16 18:50:07.183080390 (193h23m47.91434804s) [upload=201259]: Upload finished. err: <nil>
Duration: 601.157545ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........X...........X......................................] duration:
219.86608ms
FAIL (2025-08-16 19:00:07 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 18:30:20.656629884 (193h4m1.387897535s) [upload=200914]: Starting upload Aug 16 18:30:20.656698023 (193h4m1.387965672s) [upload=200914]: Done starting upload Aug 16 18:30:20.656779016 (193h4m1.388046665s) [upload=200914]: Uploading segments... Aug 16 18:30:20.656835431 (193h4m1.388103081s) [upload=200914]: Got next segment. Inline: true Aug 16 18:30:20.656842083 (193h4m1.388109744s) [upload=200914]: Waiting for error group managing segments... Aug 16 18:30:20.656913488 (193h4m1.388181139s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 18:30:20.656919560 (193h4m1.38818721s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 18:30:20.656923327 (193h4m1.388190977s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 18:30:20.659031257 (193h4m1.390298906s) [upload=200914]: Done uploading segments... Aug 16 18:30:20.659043129 (193h4m1.390310778s) [upload=200914]: Upload finished. err: metaclient: Too Many Requests
Duration: 219.937864ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........X...........X.....................................] duration:
342.072113ms
FAIL (2025-08-16 18:59:46 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 18:30:20.656629884 (193h4m1.387897535s) [upload=200914]: Starting upload Aug 16 18:30:20.656698023 (193h4m1.387965672s) [upload=200914]: Done starting upload Aug 16 18:30:20.656779016 (193h4m1.388046665s) [upload=200914]: Uploading segments... Aug 16 18:30:20.656835431 (193h4m1.388103081s) [upload=200914]: Got next segment. Inline: true Aug 16 18:30:20.656842083 (193h4m1.388109744s) [upload=200914]: Waiting for error group managing segments... Aug 16 18:30:20.656913488 (193h4m1.388181139s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 18:30:20.656919560 (193h4m1.38818721s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 18:30:20.656923327 (193h4m1.388190977s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 18:30:20.659031257 (193h4m1.390298906s) [upload=200914]: Done uploading segments... Aug 16 18:30:20.659043129 (193h4m1.390310778s) [upload=200914]: Upload finished. err: metaclient: Too Many Requests
Duration: 342.095748ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.........................X......X.............X.............] duration:
497.07877ms
FAIL (2025-08-16 18:59:24 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 18:50:06.795231389 (193h23m47.52649904s) [upload=201259]: Starting upload
Aug 16 18:50:06.795294448 (193h23m47.526562098s) [upload=201259]: Done starting upload
Aug 16 18:50:06.795449339 (193h23m47.526716989s) [upload=201259]: Uploading segments...
Aug 16 18:50:06.795693649 (193h23m47.5269613s) [upload=201259]: Got next segment. Inline: false
Aug 16 18:50:06.795759203 (193h23m47.527026853s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 18:50:06.795765165 (193h23m47.527032824s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 18:50:06.841060252 (193h23m47.572327901s) [seg_pos={0 0}, upload=201259]: Begin upload segment...
Aug 16 18:50:06.841119362 (193h23m47.572387012s) [seg_pos={0 0}, upload=201259]: Done begin upload segment.
Aug 16 18:50:06.841151233 (193h23m47.572418883s) [noise=true , address=104.36.82.35:4587 , piece_id=5JFLAGKDPOYPDZFSKF2DJT6EHCPJHQBHGMV3T4RAPKFOXP5YDVYQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841184625 (193h23m47.572452276s) [noise=true , address=104.36.82.34:4565 , piece_id=NPK7GSWSZWGHSUSETZCCOLVYUK6QE7RCZ5COSLSQ5UJ543W67MGQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841723480 (193h23m47.57299114s) [noise=true , address=104.36.82.20:4446 , piece_id=ZVIY47XJPM2KPHF6QWJYMGVR25PMANDTI3IGB5TTMW3QAT6NDPVQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841804182 (193h23m47.573071831s) [noise=true , address=104.36.82.39:4737 , piece_id=DC7GL4U6VY3SO6KZAXQNAK54AT2WFZBJUZM2WEFWLQKS5ULQJ3UQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.842218111 (193h23m47.573485761s) [noise=true , address=77.90.31.19:4870 , piece_id=76KXS2TZPI5OH3TESKHQNCKO34UP5YPFAQ5EPKB4LKST3PSWNY7Q, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.842347224 (193h23m47.573614874s) [noise=true , address=77.90.31.13:4657 , piece_id=3T2AY52BCUCXPSJHCPFDT4MNDY3RJVULG6X52HT4PKY7SJQ464SA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.843304817 (193h23m47.574572467s) [noise=true , address=104.36.82.37:4657 , piece_id=DOCMOQXG2TIS3MHSMBHQNEKZFUSXLKENOQXGWLQRYEYFD2OBJ2LA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.843418962 (193h23m47.574686612s) [noise=true , address=104.36.82.21:4476 , piece_id=H52MJNGMGSKORKKOPNBMVFOSFCKMCJOBET5NIQFAWZ5JDLTLY4ZQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844011178 (193h23m47.575278828s) [noise=true , address=45.91.116.5:4321 , piece_id=R4V5GAA7COM6Z2FAH7REIIDOMB7EJ2HUJHAWRWVNJRJV5WREPUSQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844142576 (193h23m47.575410225s) [noise=true , address=104.36.82.7:4933 , piece_id=GERLHPHJEVE5AVHI5VM4TCEDJC7PAAFHYAHPTETVC5NBMWTSFAFQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844882007 (193h23m47.576149657s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2F5PRGNYWIKKROX5EVNMCDUPJZPIOFJBN35YXEH4H5BKINRJKPQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.845386287 (193h23m47.576653947s) [noise=true , address=77.90.31.14:4681 , piece_id=F2C4U4NYLA5TGZSPC35WB2XH3YVQZNAYYPCGH66IIDLVSX7WZXKQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.845864367 (193h23m47.577132018s) [noise=true , address=45.91.116.10:4100 , piece_id=JMZXTBLEKC5X6I3T2P4XX32GGIXSH6IW4QCKFZFLTM5JQEBMLECQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.846491107 (193h23m47.577758757s) [noise=true , address=104.36.82.23:4447 , piece_id=H2XVFVY64HORCHUCFXZUQM7H4EWXQPV6YENXX7EEOOMCZTW4N6CA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.846703747 (193h23m47.577971408s) [noise=true , address=104.36.82.14:4230 , piece_id=WTOJ6THOEIOMF72YGNYOKRGYJQJF4FQP4VGDW2QQ2326DGTUSHCQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.847183361 (193h23m47.578451012s) [noise=true , address=77.90.31.10:4521 , piece_id=DJ2ZHTVZZ7SPBYTO2WH2BMDPS37K7MSYBPA3SHWXB3TM5FLTOZYQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.847384710 (193h23m47.57865236s) [noise=true , address=104.36.82.3:4793 , piece_id=47HFN7SSBLKV4Q2MTDVFC4GBNIPATKO6LRUOC4G2AW7A4MFAI6GA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.848437041 (193h23m47.579704692s) [noise=true , address=104.36.82.59:4313 , piece_id=J47ZWGLHUN7ECNRGXZZ42Q375WKFHUJN3XLYEGX2CMHC2RUWZJCA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.984012580 (193h23m47.71528023s) [upload=201259]: Next returned nil segment
Aug 16 18:50:06.984029241 (193h23m47.715296871s) [upload=201259]: Waiting for error group managing segments...
Aug 16 18:50:06.996112904 (193h23m47.727380564s) [noise=true , address=104.36.82.14:4230 , piece_id=WTOJ6THOEIOMF72YGNYOKRGYJQJF4FQP4VGDW2QQ2326DGTUSHCQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:06.999695960 (193h23m47.73096362s) [noise=true , address=104.36.82.39:4737 , piece_id=DC7GL4U6VY3SO6KZAXQNAK54AT2WFZBJUZM2WEFWLQKS5ULQJ3UQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.025463880 (193h23m47.756731529s) [noise=true , address=77.90.31.13:4657 , piece_id=3T2AY52BCUCXPSJHCPFDT4MNDY3RJVULG6X52HT4PKY7SJQ464SA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.027404303 (193h23m47.758671953s) [noise=true , address=104.36.82.21:4476 , piece_id=H52MJNGMGSKORKKOPNBMVFOSFCKMCJOBET5NIQFAWZ5JDLTLY4ZQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.031728906 (193h23m47.762996565s) [noise=true , address=77.90.31.14:4681 , piece_id=F2C4U4NYLA5TGZSPC35WB2XH3YVQZNAYYPCGH66IIDLVSX7WZXKQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.032687090 (193h23m47.76395474s) [noise=true , address=104.36.82.59:4313 , piece_id=J47ZWGLHUN7ECNRGXZZ42Q375WKFHUJN3XLYEGX2CMHC2RUWZJCA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.037670705 (193h23m47.768938354s) [noise=true , address=77.90.31.19:4870 , piece_id=76KXS2TZPI5OH3TESKHQNCKO34UP5YPFAQ5EPKB4LKST3PSWNY7Q, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.039026547 (193h23m47.770294198s) [noise=true , address=104.36.82.35:4587 , piece_id=5JFLAGKDPOYPDZFSKF2DJT6EHCPJHQBHGMV3T4RAPKFOXP5YDVYQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.039608773 (193h23m47.770876424s) [noise=true , address=104.36.82.20:4446 , piece_id=ZVIY47XJPM2KPHF6QWJYMGVR25PMANDTI3IGB5TTMW3QAT6NDPVQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.052389308 (193h23m47.783656959s) [noise=true , address=104.36.82.7:4933 , piece_id=GERLHPHJEVE5AVHI5VM4TCEDJC7PAAFHYAHPTETVC5NBMWTSFAFQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.052813196 (193h23m47.784080856s) [noise=true , address=104.36.82.37:4657 , piece_id=DOCMOQXG2TIS3MHSMBHQNEKZFUSXLKENOQXGWLQRYEYFD2OBJ2LA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.067727990 (193h23m47.79899564s) [noise=true , address=45.91.116.10:4100 , piece_id=JMZXTBLEKC5X6I3T2P4XX32GGIXSH6IW4QCKFZFLTM5JQEBMLECQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.077757915 (193h23m47.809025565s) [noise=true , address=104.36.82.34:4565 , piece_id=NPK7GSWSZWGHSUSETZCCOLVYUK6QE7RCZ5COSLSQ5UJ543W67MGQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.088885418 (193h23m47.820153067s) [noise=true , address=104.36.82.3:4793 , piece_id=47HFN7SSBLKV4Q2MTDVFC4GBNIPATKO6LRUOC4G2AW7A4MFAI6GA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.088946764 (193h23m47.820214414s) [seg_pos={0 0}, upload=201259]: Segment reached optimal threshold of 14 pieces.
Aug 16 18:50:07.089255815 (193h23m47.820523475s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2F5PRGNYWIKKROX5EVNMCDUPJZPIOFJBN35YXEH4H5BKINRJKPQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sJfMr1nMTpizd5PZ2bZ6M8tZWhFL2ukdJ3cNSRQtdUHNJhg81): protocol: expected piece hash; context canceled; EOF
Aug 16 18:50:07.089271314 (193h23m47.820538974s) [noise=true , address=104.36.82.23:4447 , piece_id=H2XVFVY64HORCHUCFXZUQM7H4EWXQPV6YENXX7EEOOMCZTW4N6CA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fqT9xA7kXTG8K9XwTUxL6FXibV35AkPHDK6grKGHg17fk91fP): protocol: write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection; write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection
Aug 16 18:50:07.089329323 (193h23m47.820596973s) [noise=true , address=77.90.31.10:4521 , piece_id=DJ2ZHTVZZ7SPBYTO2WH2BMDPS37K7MSYBPA3SHWXB3TM5FLTOZYQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WpVJa7SXkANKParDWYrC1cN8aLHTkUSPrRJGKQ6fvA5oDEkoa): protocol: write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection; write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection
Aug 16 18:50:07.089440162 (193h23m47.820707812s) [noise=true , address=45.91.116.5:4321 , piece_id=R4V5GAA7COM6Z2FAH7REIIDOMB7EJ2HUJHAWRWVNJRJV5WREPUSQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12m3Lw8yL9wVq38nW514iaLooMVgikbQBGA9vrFsr66jx5w1xXj): protocol: write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection; write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection
Aug 16 18:50:07.089461401 (193h23m47.820729052s) [seg_pos={0 0}, upload=201259]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 18:50:07.089583131 (193h23m47.820850791s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 18:50:07.089622546 (193h23m47.820890196s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 18:50:07.183064911 (193h23m47.914332561s) [upload=201259]: Done uploading segments...
Aug 16 18:50:07.183080390 (193h23m47.91434804s) [upload=201259]: Upload finished. err: <nil>
Duration: 497.100552ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........X...........X....................................] duration:
378.176649ms
FAIL (2025-08-16 18:59:17 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 18:30:20.656629884 (193h4m1.387897535s) [upload=200914]: Starting upload Aug 16 18:30:20.656698023 (193h4m1.387965672s) [upload=200914]: Done starting upload Aug 16 18:30:20.656779016 (193h4m1.388046665s) [upload=200914]: Uploading segments... Aug 16 18:30:20.656835431 (193h4m1.388103081s) [upload=200914]: Got next segment. Inline: true Aug 16 18:30:20.656842083 (193h4m1.388109744s) [upload=200914]: Waiting for error group managing segments... Aug 16 18:30:20.656913488 (193h4m1.388181139s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 18:30:20.656919560 (193h4m1.38818721s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 18:30:20.656923327 (193h4m1.388190977s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 18:30:20.659031257 (193h4m1.390298906s) [upload=200914]: Done uploading segments... Aug 16 18:30:20.659043129 (193h4m1.390310778s) [upload=200914]: Upload finished. err: metaclient: Too Many Requests
Duration: 378.197899ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..........................X......X.............X............] duration:
762.829861ms
FAIL (2025-08-16 18:58:38 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 18:50:06.795231389 (193h23m47.52649904s) [upload=201259]: Starting upload
Aug 16 18:50:06.795294448 (193h23m47.526562098s) [upload=201259]: Done starting upload
Aug 16 18:50:06.795449339 (193h23m47.526716989s) [upload=201259]: Uploading segments...
Aug 16 18:50:06.795693649 (193h23m47.5269613s) [upload=201259]: Got next segment. Inline: false
Aug 16 18:50:06.795759203 (193h23m47.527026853s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 18:50:06.795765165 (193h23m47.527032824s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 18:50:06.841060252 (193h23m47.572327901s) [seg_pos={0 0}, upload=201259]: Begin upload segment...
Aug 16 18:50:06.841119362 (193h23m47.572387012s) [seg_pos={0 0}, upload=201259]: Done begin upload segment.
Aug 16 18:50:06.841151233 (193h23m47.572418883s) [noise=true , address=104.36.82.35:4587 , piece_id=5JFLAGKDPOYPDZFSKF2DJT6EHCPJHQBHGMV3T4RAPKFOXP5YDVYQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841184625 (193h23m47.572452276s) [noise=true , address=104.36.82.34:4565 , piece_id=NPK7GSWSZWGHSUSETZCCOLVYUK6QE7RCZ5COSLSQ5UJ543W67MGQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841723480 (193h23m47.57299114s) [noise=true , address=104.36.82.20:4446 , piece_id=ZVIY47XJPM2KPHF6QWJYMGVR25PMANDTI3IGB5TTMW3QAT6NDPVQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841804182 (193h23m47.573071831s) [noise=true , address=104.36.82.39:4737 , piece_id=DC7GL4U6VY3SO6KZAXQNAK54AT2WFZBJUZM2WEFWLQKS5ULQJ3UQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.842218111 (193h23m47.573485761s) [noise=true , address=77.90.31.19:4870 , piece_id=76KXS2TZPI5OH3TESKHQNCKO34UP5YPFAQ5EPKB4LKST3PSWNY7Q, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.842347224 (193h23m47.573614874s) [noise=true , address=77.90.31.13:4657 , piece_id=3T2AY52BCUCXPSJHCPFDT4MNDY3RJVULG6X52HT4PKY7SJQ464SA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.843304817 (193h23m47.574572467s) [noise=true , address=104.36.82.37:4657 , piece_id=DOCMOQXG2TIS3MHSMBHQNEKZFUSXLKENOQXGWLQRYEYFD2OBJ2LA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.843418962 (193h23m47.574686612s) [noise=true , address=104.36.82.21:4476 , piece_id=H52MJNGMGSKORKKOPNBMVFOSFCKMCJOBET5NIQFAWZ5JDLTLY4ZQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844011178 (193h23m47.575278828s) [noise=true , address=45.91.116.5:4321 , piece_id=R4V5GAA7COM6Z2FAH7REIIDOMB7EJ2HUJHAWRWVNJRJV5WREPUSQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844142576 (193h23m47.575410225s) [noise=true , address=104.36.82.7:4933 , piece_id=GERLHPHJEVE5AVHI5VM4TCEDJC7PAAFHYAHPTETVC5NBMWTSFAFQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844882007 (193h23m47.576149657s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2F5PRGNYWIKKROX5EVNMCDUPJZPIOFJBN35YXEH4H5BKINRJKPQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.845386287 (193h23m47.576653947s) [noise=true , address=77.90.31.14:4681 , piece_id=F2C4U4NYLA5TGZSPC35WB2XH3YVQZNAYYPCGH66IIDLVSX7WZXKQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.845864367 (193h23m47.577132018s) [noise=true , address=45.91.116.10:4100 , piece_id=JMZXTBLEKC5X6I3T2P4XX32GGIXSH6IW4QCKFZFLTM5JQEBMLECQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.846491107 (193h23m47.577758757s) [noise=true , address=104.36.82.23:4447 , piece_id=H2XVFVY64HORCHUCFXZUQM7H4EWXQPV6YENXX7EEOOMCZTW4N6CA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.846703747 (193h23m47.577971408s) [noise=true , address=104.36.82.14:4230 , piece_id=WTOJ6THOEIOMF72YGNYOKRGYJQJF4FQP4VGDW2QQ2326DGTUSHCQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.847183361 (193h23m47.578451012s) [noise=true , address=77.90.31.10:4521 , piece_id=DJ2ZHTVZZ7SPBYTO2WH2BMDPS37K7MSYBPA3SHWXB3TM5FLTOZYQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.847384710 (193h23m47.57865236s) [noise=true , address=104.36.82.3:4793 , piece_id=47HFN7SSBLKV4Q2MTDVFC4GBNIPATKO6LRUOC4G2AW7A4MFAI6GA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.848437041 (193h23m47.579704692s) [noise=true , address=104.36.82.59:4313 , piece_id=J47ZWGLHUN7ECNRGXZZ42Q375WKFHUJN3XLYEGX2CMHC2RUWZJCA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.984012580 (193h23m47.71528023s) [upload=201259]: Next returned nil segment
Aug 16 18:50:06.984029241 (193h23m47.715296871s) [upload=201259]: Waiting for error group managing segments...
Aug 16 18:50:06.996112904 (193h23m47.727380564s) [noise=true , address=104.36.82.14:4230 , piece_id=WTOJ6THOEIOMF72YGNYOKRGYJQJF4FQP4VGDW2QQ2326DGTUSHCQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:06.999695960 (193h23m47.73096362s) [noise=true , address=104.36.82.39:4737 , piece_id=DC7GL4U6VY3SO6KZAXQNAK54AT2WFZBJUZM2WEFWLQKS5ULQJ3UQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.025463880 (193h23m47.756731529s) [noise=true , address=77.90.31.13:4657 , piece_id=3T2AY52BCUCXPSJHCPFDT4MNDY3RJVULG6X52HT4PKY7SJQ464SA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.027404303 (193h23m47.758671953s) [noise=true , address=104.36.82.21:4476 , piece_id=H52MJNGMGSKORKKOPNBMVFOSFCKMCJOBET5NIQFAWZ5JDLTLY4ZQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.031728906 (193h23m47.762996565s) [noise=true , address=77.90.31.14:4681 , piece_id=F2C4U4NYLA5TGZSPC35WB2XH3YVQZNAYYPCGH66IIDLVSX7WZXKQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.032687090 (193h23m47.76395474s) [noise=true , address=104.36.82.59:4313 , piece_id=J47ZWGLHUN7ECNRGXZZ42Q375WKFHUJN3XLYEGX2CMHC2RUWZJCA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.037670705 (193h23m47.768938354s) [noise=true , address=77.90.31.19:4870 , piece_id=76KXS2TZPI5OH3TESKHQNCKO34UP5YPFAQ5EPKB4LKST3PSWNY7Q, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.039026547 (193h23m47.770294198s) [noise=true , address=104.36.82.35:4587 , piece_id=5JFLAGKDPOYPDZFSKF2DJT6EHCPJHQBHGMV3T4RAPKFOXP5YDVYQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.039608773 (193h23m47.770876424s) [noise=true , address=104.36.82.20:4446 , piece_id=ZVIY47XJPM2KPHF6QWJYMGVR25PMANDTI3IGB5TTMW3QAT6NDPVQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.052389308 (193h23m47.783656959s) [noise=true , address=104.36.82.7:4933 , piece_id=GERLHPHJEVE5AVHI5VM4TCEDJC7PAAFHYAHPTETVC5NBMWTSFAFQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.052813196 (193h23m47.784080856s) [noise=true , address=104.36.82.37:4657 , piece_id=DOCMOQXG2TIS3MHSMBHQNEKZFUSXLKENOQXGWLQRYEYFD2OBJ2LA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.067727990 (193h23m47.79899564s) [noise=true , address=45.91.116.10:4100 , piece_id=JMZXTBLEKC5X6I3T2P4XX32GGIXSH6IW4QCKFZFLTM5JQEBMLECQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.077757915 (193h23m47.809025565s) [noise=true , address=104.36.82.34:4565 , piece_id=NPK7GSWSZWGHSUSETZCCOLVYUK6QE7RCZ5COSLSQ5UJ543W67MGQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.088885418 (193h23m47.820153067s) [noise=true , address=104.36.82.3:4793 , piece_id=47HFN7SSBLKV4Q2MTDVFC4GBNIPATKO6LRUOC4G2AW7A4MFAI6GA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.088946764 (193h23m47.820214414s) [seg_pos={0 0}, upload=201259]: Segment reached optimal threshold of 14 pieces.
Aug 16 18:50:07.089255815 (193h23m47.820523475s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2F5PRGNYWIKKROX5EVNMCDUPJZPIOFJBN35YXEH4H5BKINRJKPQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sJfMr1nMTpizd5PZ2bZ6M8tZWhFL2ukdJ3cNSRQtdUHNJhg81): protocol: expected piece hash; context canceled; EOF
Aug 16 18:50:07.089271314 (193h23m47.820538974s) [noise=true , address=104.36.82.23:4447 , piece_id=H2XVFVY64HORCHUCFXZUQM7H4EWXQPV6YENXX7EEOOMCZTW4N6CA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fqT9xA7kXTG8K9XwTUxL6FXibV35AkPHDK6grKGHg17fk91fP): protocol: write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection; write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection
Aug 16 18:50:07.089329323 (193h23m47.820596973s) [noise=true , address=77.90.31.10:4521 , piece_id=DJ2ZHTVZZ7SPBYTO2WH2BMDPS37K7MSYBPA3SHWXB3TM5FLTOZYQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WpVJa7SXkANKParDWYrC1cN8aLHTkUSPrRJGKQ6fvA5oDEkoa): protocol: write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection; write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection
Aug 16 18:50:07.089440162 (193h23m47.820707812s) [noise=true , address=45.91.116.5:4321 , piece_id=R4V5GAA7COM6Z2FAH7REIIDOMB7EJ2HUJHAWRWVNJRJV5WREPUSQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12m3Lw8yL9wVq38nW514iaLooMVgikbQBGA9vrFsr66jx5w1xXj): protocol: write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection; write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection
Aug 16 18:50:07.089461401 (193h23m47.820729052s) [seg_pos={0 0}, upload=201259]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 18:50:07.089583131 (193h23m47.820850791s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 18:50:07.089622546 (193h23m47.820890196s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 18:50:07.183064911 (193h23m47.914332561s) [upload=201259]: Done uploading segments...
Aug 16 18:50:07.183080390 (193h23m47.91434804s) [upload=201259]: Upload finished. err: <nil>
Duration: 762.849599ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...........................X......X.............X...........] duration:
605.644735ms
FAIL (2025-08-16 18:58:19 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 18:50:06.795231389 (193h23m47.52649904s) [upload=201259]: Starting upload
Aug 16 18:50:06.795294448 (193h23m47.526562098s) [upload=201259]: Done starting upload
Aug 16 18:50:06.795449339 (193h23m47.526716989s) [upload=201259]: Uploading segments...
Aug 16 18:50:06.795693649 (193h23m47.5269613s) [upload=201259]: Got next segment. Inline: false
Aug 16 18:50:06.795759203 (193h23m47.527026853s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 18:50:06.795765165 (193h23m47.527032824s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 18:50:06.841060252 (193h23m47.572327901s) [seg_pos={0 0}, upload=201259]: Begin upload segment...
Aug 16 18:50:06.841119362 (193h23m47.572387012s) [seg_pos={0 0}, upload=201259]: Done begin upload segment.
Aug 16 18:50:06.841151233 (193h23m47.572418883s) [noise=true , address=104.36.82.35:4587 , piece_id=5JFLAGKDPOYPDZFSKF2DJT6EHCPJHQBHGMV3T4RAPKFOXP5YDVYQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841184625 (193h23m47.572452276s) [noise=true , address=104.36.82.34:4565 , piece_id=NPK7GSWSZWGHSUSETZCCOLVYUK6QE7RCZ5COSLSQ5UJ543W67MGQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841723480 (193h23m47.57299114s) [noise=true , address=104.36.82.20:4446 , piece_id=ZVIY47XJPM2KPHF6QWJYMGVR25PMANDTI3IGB5TTMW3QAT6NDPVQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841804182 (193h23m47.573071831s) [noise=true , address=104.36.82.39:4737 , piece_id=DC7GL4U6VY3SO6KZAXQNAK54AT2WFZBJUZM2WEFWLQKS5ULQJ3UQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.842218111 (193h23m47.573485761s) [noise=true , address=77.90.31.19:4870 , piece_id=76KXS2TZPI5OH3TESKHQNCKO34UP5YPFAQ5EPKB4LKST3PSWNY7Q, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.842347224 (193h23m47.573614874s) [noise=true , address=77.90.31.13:4657 , piece_id=3T2AY52BCUCXPSJHCPFDT4MNDY3RJVULG6X52HT4PKY7SJQ464SA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.843304817 (193h23m47.574572467s) [noise=true , address=104.36.82.37:4657 , piece_id=DOCMOQXG2TIS3MHSMBHQNEKZFUSXLKENOQXGWLQRYEYFD2OBJ2LA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.843418962 (193h23m47.574686612s) [noise=true , address=104.36.82.21:4476 , piece_id=H52MJNGMGSKORKKOPNBMVFOSFCKMCJOBET5NIQFAWZ5JDLTLY4ZQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844011178 (193h23m47.575278828s) [noise=true , address=45.91.116.5:4321 , piece_id=R4V5GAA7COM6Z2FAH7REIIDOMB7EJ2HUJHAWRWVNJRJV5WREPUSQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844142576 (193h23m47.575410225s) [noise=true , address=104.36.82.7:4933 , piece_id=GERLHPHJEVE5AVHI5VM4TCEDJC7PAAFHYAHPTETVC5NBMWTSFAFQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844882007 (193h23m47.576149657s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2F5PRGNYWIKKROX5EVNMCDUPJZPIOFJBN35YXEH4H5BKINRJKPQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.845386287 (193h23m47.576653947s) [noise=true , address=77.90.31.14:4681 , piece_id=F2C4U4NYLA5TGZSPC35WB2XH3YVQZNAYYPCGH66IIDLVSX7WZXKQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.845864367 (193h23m47.577132018s) [noise=true , address=45.91.116.10:4100 , piece_id=JMZXTBLEKC5X6I3T2P4XX32GGIXSH6IW4QCKFZFLTM5JQEBMLECQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.846491107 (193h23m47.577758757s) [noise=true , address=104.36.82.23:4447 , piece_id=H2XVFVY64HORCHUCFXZUQM7H4EWXQPV6YENXX7EEOOMCZTW4N6CA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.846703747 (193h23m47.577971408s) [noise=true , address=104.36.82.14:4230 , piece_id=WTOJ6THOEIOMF72YGNYOKRGYJQJF4FQP4VGDW2QQ2326DGTUSHCQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.847183361 (193h23m47.578451012s) [noise=true , address=77.90.31.10:4521 , piece_id=DJ2ZHTVZZ7SPBYTO2WH2BMDPS37K7MSYBPA3SHWXB3TM5FLTOZYQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.847384710 (193h23m47.57865236s) [noise=true , address=104.36.82.3:4793 , piece_id=47HFN7SSBLKV4Q2MTDVFC4GBNIPATKO6LRUOC4G2AW7A4MFAI6GA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.848437041 (193h23m47.579704692s) [noise=true , address=104.36.82.59:4313 , piece_id=J47ZWGLHUN7ECNRGXZZ42Q375WKFHUJN3XLYEGX2CMHC2RUWZJCA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.984012580 (193h23m47.71528023s) [upload=201259]: Next returned nil segment
Aug 16 18:50:06.984029241 (193h23m47.715296871s) [upload=201259]: Waiting for error group managing segments...
Aug 16 18:50:06.996112904 (193h23m47.727380564s) [noise=true , address=104.36.82.14:4230 , piece_id=WTOJ6THOEIOMF72YGNYOKRGYJQJF4FQP4VGDW2QQ2326DGTUSHCQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:06.999695960 (193h23m47.73096362s) [noise=true , address=104.36.82.39:4737 , piece_id=DC7GL4U6VY3SO6KZAXQNAK54AT2WFZBJUZM2WEFWLQKS5ULQJ3UQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.025463880 (193h23m47.756731529s) [noise=true , address=77.90.31.13:4657 , piece_id=3T2AY52BCUCXPSJHCPFDT4MNDY3RJVULG6X52HT4PKY7SJQ464SA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.027404303 (193h23m47.758671953s) [noise=true , address=104.36.82.21:4476 , piece_id=H52MJNGMGSKORKKOPNBMVFOSFCKMCJOBET5NIQFAWZ5JDLTLY4ZQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.031728906 (193h23m47.762996565s) [noise=true , address=77.90.31.14:4681 , piece_id=F2C4U4NYLA5TGZSPC35WB2XH3YVQZNAYYPCGH66IIDLVSX7WZXKQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.032687090 (193h23m47.76395474s) [noise=true , address=104.36.82.59:4313 , piece_id=J47ZWGLHUN7ECNRGXZZ42Q375WKFHUJN3XLYEGX2CMHC2RUWZJCA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.037670705 (193h23m47.768938354s) [noise=true , address=77.90.31.19:4870 , piece_id=76KXS2TZPI5OH3TESKHQNCKO34UP5YPFAQ5EPKB4LKST3PSWNY7Q, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.039026547 (193h23m47.770294198s) [noise=true , address=104.36.82.35:4587 , piece_id=5JFLAGKDPOYPDZFSKF2DJT6EHCPJHQBHGMV3T4RAPKFOXP5YDVYQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.039608773 (193h23m47.770876424s) [noise=true , address=104.36.82.20:4446 , piece_id=ZVIY47XJPM2KPHF6QWJYMGVR25PMANDTI3IGB5TTMW3QAT6NDPVQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.052389308 (193h23m47.783656959s) [noise=true , address=104.36.82.7:4933 , piece_id=GERLHPHJEVE5AVHI5VM4TCEDJC7PAAFHYAHPTETVC5NBMWTSFAFQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.052813196 (193h23m47.784080856s) [noise=true , address=104.36.82.37:4657 , piece_id=DOCMOQXG2TIS3MHSMBHQNEKZFUSXLKENOQXGWLQRYEYFD2OBJ2LA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.067727990 (193h23m47.79899564s) [noise=true , address=45.91.116.10:4100 , piece_id=JMZXTBLEKC5X6I3T2P4XX32GGIXSH6IW4QCKFZFLTM5JQEBMLECQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.077757915 (193h23m47.809025565s) [noise=true , address=104.36.82.34:4565 , piece_id=NPK7GSWSZWGHSUSETZCCOLVYUK6QE7RCZ5COSLSQ5UJ543W67MGQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.088885418 (193h23m47.820153067s) [noise=true , address=104.36.82.3:4793 , piece_id=47HFN7SSBLKV4Q2MTDVFC4GBNIPATKO6LRUOC4G2AW7A4MFAI6GA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.088946764 (193h23m47.820214414s) [seg_pos={0 0}, upload=201259]: Segment reached optimal threshold of 14 pieces.
Aug 16 18:50:07.089255815 (193h23m47.820523475s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2F5PRGNYWIKKROX5EVNMCDUPJZPIOFJBN35YXEH4H5BKINRJKPQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sJfMr1nMTpizd5PZ2bZ6M8tZWhFL2ukdJ3cNSRQtdUHNJhg81): protocol: expected piece hash; context canceled; EOF
Aug 16 18:50:07.089271314 (193h23m47.820538974s) [noise=true , address=104.36.82.23:4447 , piece_id=H2XVFVY64HORCHUCFXZUQM7H4EWXQPV6YENXX7EEOOMCZTW4N6CA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fqT9xA7kXTG8K9XwTUxL6FXibV35AkPHDK6grKGHg17fk91fP): protocol: write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection; write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection
Aug 16 18:50:07.089329323 (193h23m47.820596973s) [noise=true , address=77.90.31.10:4521 , piece_id=DJ2ZHTVZZ7SPBYTO2WH2BMDPS37K7MSYBPA3SHWXB3TM5FLTOZYQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WpVJa7SXkANKParDWYrC1cN8aLHTkUSPrRJGKQ6fvA5oDEkoa): protocol: write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection; write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection
Aug 16 18:50:07.089440162 (193h23m47.820707812s) [noise=true , address=45.91.116.5:4321 , piece_id=R4V5GAA7COM6Z2FAH7REIIDOMB7EJ2HUJHAWRWVNJRJV5WREPUSQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12m3Lw8yL9wVq38nW514iaLooMVgikbQBGA9vrFsr66jx5w1xXj): protocol: write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection; write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection
Aug 16 18:50:07.089461401 (193h23m47.820729052s) [seg_pos={0 0}, upload=201259]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 18:50:07.089583131 (193h23m47.820850791s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 18:50:07.089622546 (193h23m47.820890196s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 18:50:07.183064911 (193h23m47.914332561s) [upload=201259]: Done uploading segments...
Aug 16 18:50:07.183080390 (193h23m47.91434804s) [upload=201259]: Upload finished. err: <nil>
Duration: 605.670203ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [............X...........X...................................] duration:
487.139498ms
FAIL (2025-08-16 18:58:16 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 18:30:20.656629884 (193h4m1.387897535s) [upload=200914]: Starting upload Aug 16 18:30:20.656698023 (193h4m1.387965672s) [upload=200914]: Done starting upload Aug 16 18:30:20.656779016 (193h4m1.388046665s) [upload=200914]: Uploading segments... Aug 16 18:30:20.656835431 (193h4m1.388103081s) [upload=200914]: Got next segment. Inline: true Aug 16 18:30:20.656842083 (193h4m1.388109744s) [upload=200914]: Waiting for error group managing segments... Aug 16 18:30:20.656913488 (193h4m1.388181139s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 18:30:20.656919560 (193h4m1.38818721s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 18:30:20.656923327 (193h4m1.388190977s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 18:30:20.659031257 (193h4m1.390298906s) [upload=200914]: Done uploading segments... Aug 16 18:30:20.659043129 (193h4m1.390310778s) [upload=200914]: Upload finished. err: metaclient: Too Many Requests
Duration: 487.159717ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............X...........X..................................] duration:
261.369147ms
FAIL (2025-08-16 18:57:45 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 18:30:20.656629884 (193h4m1.387897535s) [upload=200914]: Starting upload Aug 16 18:30:20.656698023 (193h4m1.387965672s) [upload=200914]: Done starting upload Aug 16 18:30:20.656779016 (193h4m1.388046665s) [upload=200914]: Uploading segments... Aug 16 18:30:20.656835431 (193h4m1.388103081s) [upload=200914]: Got next segment. Inline: true Aug 16 18:30:20.656842083 (193h4m1.388109744s) [upload=200914]: Waiting for error group managing segments... Aug 16 18:30:20.656913488 (193h4m1.388181139s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 18:30:20.656919560 (193h4m1.38818721s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 18:30:20.656923327 (193h4m1.388190977s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 18:30:20.659031257 (193h4m1.390298906s) [upload=200914]: Done uploading segments... Aug 16 18:30:20.659043129 (193h4m1.390310778s) [upload=200914]: Upload finished. err: metaclient: Too Many Requests
Duration: 261.394354ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [............................X......X.............X..........] duration:
531.820279ms
FAIL (2025-08-16 18:57:40 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 18:50:06.795231389 (193h23m47.52649904s) [upload=201259]: Starting upload
Aug 16 18:50:06.795294448 (193h23m47.526562098s) [upload=201259]: Done starting upload
Aug 16 18:50:06.795449339 (193h23m47.526716989s) [upload=201259]: Uploading segments...
Aug 16 18:50:06.795693649 (193h23m47.5269613s) [upload=201259]: Got next segment. Inline: false
Aug 16 18:50:06.795759203 (193h23m47.527026853s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 18:50:06.795765165 (193h23m47.527032824s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 18:50:06.841060252 (193h23m47.572327901s) [seg_pos={0 0}, upload=201259]: Begin upload segment...
Aug 16 18:50:06.841119362 (193h23m47.572387012s) [seg_pos={0 0}, upload=201259]: Done begin upload segment.
Aug 16 18:50:06.841151233 (193h23m47.572418883s) [noise=true , address=104.36.82.35:4587 , piece_id=5JFLAGKDPOYPDZFSKF2DJT6EHCPJHQBHGMV3T4RAPKFOXP5YDVYQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841184625 (193h23m47.572452276s) [noise=true , address=104.36.82.34:4565 , piece_id=NPK7GSWSZWGHSUSETZCCOLVYUK6QE7RCZ5COSLSQ5UJ543W67MGQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841723480 (193h23m47.57299114s) [noise=true , address=104.36.82.20:4446 , piece_id=ZVIY47XJPM2KPHF6QWJYMGVR25PMANDTI3IGB5TTMW3QAT6NDPVQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841804182 (193h23m47.573071831s) [noise=true , address=104.36.82.39:4737 , piece_id=DC7GL4U6VY3SO6KZAXQNAK54AT2WFZBJUZM2WEFWLQKS5ULQJ3UQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.842218111 (193h23m47.573485761s) [noise=true , address=77.90.31.19:4870 , piece_id=76KXS2TZPI5OH3TESKHQNCKO34UP5YPFAQ5EPKB4LKST3PSWNY7Q, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.842347224 (193h23m47.573614874s) [noise=true , address=77.90.31.13:4657 , piece_id=3T2AY52BCUCXPSJHCPFDT4MNDY3RJVULG6X52HT4PKY7SJQ464SA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.843304817 (193h23m47.574572467s) [noise=true , address=104.36.82.37:4657 , piece_id=DOCMOQXG2TIS3MHSMBHQNEKZFUSXLKENOQXGWLQRYEYFD2OBJ2LA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.843418962 (193h23m47.574686612s) [noise=true , address=104.36.82.21:4476 , piece_id=H52MJNGMGSKORKKOPNBMVFOSFCKMCJOBET5NIQFAWZ5JDLTLY4ZQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844011178 (193h23m47.575278828s) [noise=true , address=45.91.116.5:4321 , piece_id=R4V5GAA7COM6Z2FAH7REIIDOMB7EJ2HUJHAWRWVNJRJV5WREPUSQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844142576 (193h23m47.575410225s) [noise=true , address=104.36.82.7:4933 , piece_id=GERLHPHJEVE5AVHI5VM4TCEDJC7PAAFHYAHPTETVC5NBMWTSFAFQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844882007 (193h23m47.576149657s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2F5PRGNYWIKKROX5EVNMCDUPJZPIOFJBN35YXEH4H5BKINRJKPQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.845386287 (193h23m47.576653947s) [noise=true , address=77.90.31.14:4681 , piece_id=F2C4U4NYLA5TGZSPC35WB2XH3YVQZNAYYPCGH66IIDLVSX7WZXKQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.845864367 (193h23m47.577132018s) [noise=true , address=45.91.116.10:4100 , piece_id=JMZXTBLEKC5X6I3T2P4XX32GGIXSH6IW4QCKFZFLTM5JQEBMLECQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.846491107 (193h23m47.577758757s) [noise=true , address=104.36.82.23:4447 , piece_id=H2XVFVY64HORCHUCFXZUQM7H4EWXQPV6YENXX7EEOOMCZTW4N6CA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.846703747 (193h23m47.577971408s) [noise=true , address=104.36.82.14:4230 , piece_id=WTOJ6THOEIOMF72YGNYOKRGYJQJF4FQP4VGDW2QQ2326DGTUSHCQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.847183361 (193h23m47.578451012s) [noise=true , address=77.90.31.10:4521 , piece_id=DJ2ZHTVZZ7SPBYTO2WH2BMDPS37K7MSYBPA3SHWXB3TM5FLTOZYQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.847384710 (193h23m47.57865236s) [noise=true , address=104.36.82.3:4793 , piece_id=47HFN7SSBLKV4Q2MTDVFC4GBNIPATKO6LRUOC4G2AW7A4MFAI6GA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.848437041 (193h23m47.579704692s) [noise=true , address=104.36.82.59:4313 , piece_id=J47ZWGLHUN7ECNRGXZZ42Q375WKFHUJN3XLYEGX2CMHC2RUWZJCA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.984012580 (193h23m47.71528023s) [upload=201259]: Next returned nil segment
Aug 16 18:50:06.984029241 (193h23m47.715296871s) [upload=201259]: Waiting for error group managing segments...
Aug 16 18:50:06.996112904 (193h23m47.727380564s) [noise=true , address=104.36.82.14:4230 , piece_id=WTOJ6THOEIOMF72YGNYOKRGYJQJF4FQP4VGDW2QQ2326DGTUSHCQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:06.999695960 (193h23m47.73096362s) [noise=true , address=104.36.82.39:4737 , piece_id=DC7GL4U6VY3SO6KZAXQNAK54AT2WFZBJUZM2WEFWLQKS5ULQJ3UQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.025463880 (193h23m47.756731529s) [noise=true , address=77.90.31.13:4657 , piece_id=3T2AY52BCUCXPSJHCPFDT4MNDY3RJVULG6X52HT4PKY7SJQ464SA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.027404303 (193h23m47.758671953s) [noise=true , address=104.36.82.21:4476 , piece_id=H52MJNGMGSKORKKOPNBMVFOSFCKMCJOBET5NIQFAWZ5JDLTLY4ZQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.031728906 (193h23m47.762996565s) [noise=true , address=77.90.31.14:4681 , piece_id=F2C4U4NYLA5TGZSPC35WB2XH3YVQZNAYYPCGH66IIDLVSX7WZXKQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.032687090 (193h23m47.76395474s) [noise=true , address=104.36.82.59:4313 , piece_id=J47ZWGLHUN7ECNRGXZZ42Q375WKFHUJN3XLYEGX2CMHC2RUWZJCA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.037670705 (193h23m47.768938354s) [noise=true , address=77.90.31.19:4870 , piece_id=76KXS2TZPI5OH3TESKHQNCKO34UP5YPFAQ5EPKB4LKST3PSWNY7Q, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.039026547 (193h23m47.770294198s) [noise=true , address=104.36.82.35:4587 , piece_id=5JFLAGKDPOYPDZFSKF2DJT6EHCPJHQBHGMV3T4RAPKFOXP5YDVYQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.039608773 (193h23m47.770876424s) [noise=true , address=104.36.82.20:4446 , piece_id=ZVIY47XJPM2KPHF6QWJYMGVR25PMANDTI3IGB5TTMW3QAT6NDPVQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.052389308 (193h23m47.783656959s) [noise=true , address=104.36.82.7:4933 , piece_id=GERLHPHJEVE5AVHI5VM4TCEDJC7PAAFHYAHPTETVC5NBMWTSFAFQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.052813196 (193h23m47.784080856s) [noise=true , address=104.36.82.37:4657 , piece_id=DOCMOQXG2TIS3MHSMBHQNEKZFUSXLKENOQXGWLQRYEYFD2OBJ2LA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.067727990 (193h23m47.79899564s) [noise=true , address=45.91.116.10:4100 , piece_id=JMZXTBLEKC5X6I3T2P4XX32GGIXSH6IW4QCKFZFLTM5JQEBMLECQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.077757915 (193h23m47.809025565s) [noise=true , address=104.36.82.34:4565 , piece_id=NPK7GSWSZWGHSUSETZCCOLVYUK6QE7RCZ5COSLSQ5UJ543W67MGQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.088885418 (193h23m47.820153067s) [noise=true , address=104.36.82.3:4793 , piece_id=47HFN7SSBLKV4Q2MTDVFC4GBNIPATKO6LRUOC4G2AW7A4MFAI6GA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.088946764 (193h23m47.820214414s) [seg_pos={0 0}, upload=201259]: Segment reached optimal threshold of 14 pieces.
Aug 16 18:50:07.089255815 (193h23m47.820523475s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2F5PRGNYWIKKROX5EVNMCDUPJZPIOFJBN35YXEH4H5BKINRJKPQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sJfMr1nMTpizd5PZ2bZ6M8tZWhFL2ukdJ3cNSRQtdUHNJhg81): protocol: expected piece hash; context canceled; EOF
Aug 16 18:50:07.089271314 (193h23m47.820538974s) [noise=true , address=104.36.82.23:4447 , piece_id=H2XVFVY64HORCHUCFXZUQM7H4EWXQPV6YENXX7EEOOMCZTW4N6CA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fqT9xA7kXTG8K9XwTUxL6FXibV35AkPHDK6grKGHg17fk91fP): protocol: write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection; write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection
Aug 16 18:50:07.089329323 (193h23m47.820596973s) [noise=true , address=77.90.31.10:4521 , piece_id=DJ2ZHTVZZ7SPBYTO2WH2BMDPS37K7MSYBPA3SHWXB3TM5FLTOZYQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WpVJa7SXkANKParDWYrC1cN8aLHTkUSPrRJGKQ6fvA5oDEkoa): protocol: write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection; write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection
Aug 16 18:50:07.089440162 (193h23m47.820707812s) [noise=true , address=45.91.116.5:4321 , piece_id=R4V5GAA7COM6Z2FAH7REIIDOMB7EJ2HUJHAWRWVNJRJV5WREPUSQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12m3Lw8yL9wVq38nW514iaLooMVgikbQBGA9vrFsr66jx5w1xXj): protocol: write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection; write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection
Aug 16 18:50:07.089461401 (193h23m47.820729052s) [seg_pos={0 0}, upload=201259]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 18:50:07.089583131 (193h23m47.820850791s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 18:50:07.089622546 (193h23m47.820890196s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 18:50:07.183064911 (193h23m47.914332561s) [upload=201259]: Done uploading segments...
Aug 16 18:50:07.183080390 (193h23m47.91434804s) [upload=201259]: Upload finished. err: <nil>
Duration: 531.849673ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............X...........X.................................] duration:
871.902907ms
FAIL (2025-08-16 18:57:25 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 18:30:20.656629884 (193h4m1.387897535s) [upload=200914]: Starting upload Aug 16 18:30:20.656698023 (193h4m1.387965672s) [upload=200914]: Done starting upload Aug 16 18:30:20.656779016 (193h4m1.388046665s) [upload=200914]: Uploading segments... Aug 16 18:30:20.656835431 (193h4m1.388103081s) [upload=200914]: Got next segment. Inline: true Aug 16 18:30:20.656842083 (193h4m1.388109744s) [upload=200914]: Waiting for error group managing segments... Aug 16 18:30:20.656913488 (193h4m1.388181139s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 18:30:20.656919560 (193h4m1.38818721s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 18:30:20.656923327 (193h4m1.388190977s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 18:30:20.659031257 (193h4m1.390298906s) [upload=200914]: Done uploading segments... Aug 16 18:30:20.659043129 (193h4m1.390310778s) [upload=200914]: Upload finished. err: metaclient: Too Many Requests
Duration: 871.928225ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [X............................X......X.............X.........] duration:
610.231972ms
FAIL (2025-08-16 18:57:05 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 18:50:06.795231389 (193h23m47.52649904s) [upload=201259]: Starting upload
Aug 16 18:50:06.795294448 (193h23m47.526562098s) [upload=201259]: Done starting upload
Aug 16 18:50:06.795449339 (193h23m47.526716989s) [upload=201259]: Uploading segments...
Aug 16 18:50:06.795693649 (193h23m47.5269613s) [upload=201259]: Got next segment. Inline: false
Aug 16 18:50:06.795759203 (193h23m47.527026853s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 18:50:06.795765165 (193h23m47.527032824s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 18:50:06.841060252 (193h23m47.572327901s) [seg_pos={0 0}, upload=201259]: Begin upload segment...
Aug 16 18:50:06.841119362 (193h23m47.572387012s) [seg_pos={0 0}, upload=201259]: Done begin upload segment.
Aug 16 18:50:06.841151233 (193h23m47.572418883s) [noise=true , address=104.36.82.35:4587 , piece_id=5JFLAGKDPOYPDZFSKF2DJT6EHCPJHQBHGMV3T4RAPKFOXP5YDVYQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841184625 (193h23m47.572452276s) [noise=true , address=104.36.82.34:4565 , piece_id=NPK7GSWSZWGHSUSETZCCOLVYUK6QE7RCZ5COSLSQ5UJ543W67MGQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841723480 (193h23m47.57299114s) [noise=true , address=104.36.82.20:4446 , piece_id=ZVIY47XJPM2KPHF6QWJYMGVR25PMANDTI3IGB5TTMW3QAT6NDPVQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841804182 (193h23m47.573071831s) [noise=true , address=104.36.82.39:4737 , piece_id=DC7GL4U6VY3SO6KZAXQNAK54AT2WFZBJUZM2WEFWLQKS5ULQJ3UQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.842218111 (193h23m47.573485761s) [noise=true , address=77.90.31.19:4870 , piece_id=76KXS2TZPI5OH3TESKHQNCKO34UP5YPFAQ5EPKB4LKST3PSWNY7Q, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.842347224 (193h23m47.573614874s) [noise=true , address=77.90.31.13:4657 , piece_id=3T2AY52BCUCXPSJHCPFDT4MNDY3RJVULG6X52HT4PKY7SJQ464SA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.843304817 (193h23m47.574572467s) [noise=true , address=104.36.82.37:4657 , piece_id=DOCMOQXG2TIS3MHSMBHQNEKZFUSXLKENOQXGWLQRYEYFD2OBJ2LA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.843418962 (193h23m47.574686612s) [noise=true , address=104.36.82.21:4476 , piece_id=H52MJNGMGSKORKKOPNBMVFOSFCKMCJOBET5NIQFAWZ5JDLTLY4ZQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844011178 (193h23m47.575278828s) [noise=true , address=45.91.116.5:4321 , piece_id=R4V5GAA7COM6Z2FAH7REIIDOMB7EJ2HUJHAWRWVNJRJV5WREPUSQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844142576 (193h23m47.575410225s) [noise=true , address=104.36.82.7:4933 , piece_id=GERLHPHJEVE5AVHI5VM4TCEDJC7PAAFHYAHPTETVC5NBMWTSFAFQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844882007 (193h23m47.576149657s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2F5PRGNYWIKKROX5EVNMCDUPJZPIOFJBN35YXEH4H5BKINRJKPQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.845386287 (193h23m47.576653947s) [noise=true , address=77.90.31.14:4681 , piece_id=F2C4U4NYLA5TGZSPC35WB2XH3YVQZNAYYPCGH66IIDLVSX7WZXKQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.845864367 (193h23m47.577132018s) [noise=true , address=45.91.116.10:4100 , piece_id=JMZXTBLEKC5X6I3T2P4XX32GGIXSH6IW4QCKFZFLTM5JQEBMLECQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.846491107 (193h23m47.577758757s) [noise=true , address=104.36.82.23:4447 , piece_id=H2XVFVY64HORCHUCFXZUQM7H4EWXQPV6YENXX7EEOOMCZTW4N6CA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.846703747 (193h23m47.577971408s) [noise=true , address=104.36.82.14:4230 , piece_id=WTOJ6THOEIOMF72YGNYOKRGYJQJF4FQP4VGDW2QQ2326DGTUSHCQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.847183361 (193h23m47.578451012s) [noise=true , address=77.90.31.10:4521 , piece_id=DJ2ZHTVZZ7SPBYTO2WH2BMDPS37K7MSYBPA3SHWXB3TM5FLTOZYQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.847384710 (193h23m47.57865236s) [noise=true , address=104.36.82.3:4793 , piece_id=47HFN7SSBLKV4Q2MTDVFC4GBNIPATKO6LRUOC4G2AW7A4MFAI6GA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.848437041 (193h23m47.579704692s) [noise=true , address=104.36.82.59:4313 , piece_id=J47ZWGLHUN7ECNRGXZZ42Q375WKFHUJN3XLYEGX2CMHC2RUWZJCA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.984012580 (193h23m47.71528023s) [upload=201259]: Next returned nil segment
Aug 16 18:50:06.984029241 (193h23m47.715296871s) [upload=201259]: Waiting for error group managing segments...
Aug 16 18:50:06.996112904 (193h23m47.727380564s) [noise=true , address=104.36.82.14:4230 , piece_id=WTOJ6THOEIOMF72YGNYOKRGYJQJF4FQP4VGDW2QQ2326DGTUSHCQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:06.999695960 (193h23m47.73096362s) [noise=true , address=104.36.82.39:4737 , piece_id=DC7GL4U6VY3SO6KZAXQNAK54AT2WFZBJUZM2WEFWLQKS5ULQJ3UQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.025463880 (193h23m47.756731529s) [noise=true , address=77.90.31.13:4657 , piece_id=3T2AY52BCUCXPSJHCPFDT4MNDY3RJVULG6X52HT4PKY7SJQ464SA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.027404303 (193h23m47.758671953s) [noise=true , address=104.36.82.21:4476 , piece_id=H52MJNGMGSKORKKOPNBMVFOSFCKMCJOBET5NIQFAWZ5JDLTLY4ZQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.031728906 (193h23m47.762996565s) [noise=true , address=77.90.31.14:4681 , piece_id=F2C4U4NYLA5TGZSPC35WB2XH3YVQZNAYYPCGH66IIDLVSX7WZXKQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.032687090 (193h23m47.76395474s) [noise=true , address=104.36.82.59:4313 , piece_id=J47ZWGLHUN7ECNRGXZZ42Q375WKFHUJN3XLYEGX2CMHC2RUWZJCA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.037670705 (193h23m47.768938354s) [noise=true , address=77.90.31.19:4870 , piece_id=76KXS2TZPI5OH3TESKHQNCKO34UP5YPFAQ5EPKB4LKST3PSWNY7Q, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.039026547 (193h23m47.770294198s) [noise=true , address=104.36.82.35:4587 , piece_id=5JFLAGKDPOYPDZFSKF2DJT6EHCPJHQBHGMV3T4RAPKFOXP5YDVYQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.039608773 (193h23m47.770876424s) [noise=true , address=104.36.82.20:4446 , piece_id=ZVIY47XJPM2KPHF6QWJYMGVR25PMANDTI3IGB5TTMW3QAT6NDPVQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.052389308 (193h23m47.783656959s) [noise=true , address=104.36.82.7:4933 , piece_id=GERLHPHJEVE5AVHI5VM4TCEDJC7PAAFHYAHPTETVC5NBMWTSFAFQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.052813196 (193h23m47.784080856s) [noise=true , address=104.36.82.37:4657 , piece_id=DOCMOQXG2TIS3MHSMBHQNEKZFUSXLKENOQXGWLQRYEYFD2OBJ2LA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.067727990 (193h23m47.79899564s) [noise=true , address=45.91.116.10:4100 , piece_id=JMZXTBLEKC5X6I3T2P4XX32GGIXSH6IW4QCKFZFLTM5JQEBMLECQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.077757915 (193h23m47.809025565s) [noise=true , address=104.36.82.34:4565 , piece_id=NPK7GSWSZWGHSUSETZCCOLVYUK6QE7RCZ5COSLSQ5UJ543W67MGQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.088885418 (193h23m47.820153067s) [noise=true , address=104.36.82.3:4793 , piece_id=47HFN7SSBLKV4Q2MTDVFC4GBNIPATKO6LRUOC4G2AW7A4MFAI6GA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.088946764 (193h23m47.820214414s) [seg_pos={0 0}, upload=201259]: Segment reached optimal threshold of 14 pieces.
Aug 16 18:50:07.089255815 (193h23m47.820523475s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2F5PRGNYWIKKROX5EVNMCDUPJZPIOFJBN35YXEH4H5BKINRJKPQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sJfMr1nMTpizd5PZ2bZ6M8tZWhFL2ukdJ3cNSRQtdUHNJhg81): protocol: expected piece hash; context canceled; EOF
Aug 16 18:50:07.089271314 (193h23m47.820538974s) [noise=true , address=104.36.82.23:4447 , piece_id=H2XVFVY64HORCHUCFXZUQM7H4EWXQPV6YENXX7EEOOMCZTW4N6CA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fqT9xA7kXTG8K9XwTUxL6FXibV35AkPHDK6grKGHg17fk91fP): protocol: write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection; write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection
Aug 16 18:50:07.089329323 (193h23m47.820596973s) [noise=true , address=77.90.31.10:4521 , piece_id=DJ2ZHTVZZ7SPBYTO2WH2BMDPS37K7MSYBPA3SHWXB3TM5FLTOZYQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WpVJa7SXkANKParDWYrC1cN8aLHTkUSPrRJGKQ6fvA5oDEkoa): protocol: write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection; write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection
Aug 16 18:50:07.089440162 (193h23m47.820707812s) [noise=true , address=45.91.116.5:4321 , piece_id=R4V5GAA7COM6Z2FAH7REIIDOMB7EJ2HUJHAWRWVNJRJV5WREPUSQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12m3Lw8yL9wVq38nW514iaLooMVgikbQBGA9vrFsr66jx5w1xXj): protocol: write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection; write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection
Aug 16 18:50:07.089461401 (193h23m47.820729052s) [seg_pos={0 0}, upload=201259]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 18:50:07.089583131 (193h23m47.820850791s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 18:50:07.089622546 (193h23m47.820890196s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 18:50:07.183064911 (193h23m47.914332561s) [upload=201259]: Done uploading segments...
Aug 16 18:50:07.183080390 (193h23m47.91434804s) [upload=201259]: Upload finished. err: <nil>
Duration: 610.260384ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............X...........X................................] duration:
323.413591ms
FAIL (2025-08-16 18:56:51 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 18:30:20.656629884 (193h4m1.387897535s) [upload=200914]: Starting upload Aug 16 18:30:20.656698023 (193h4m1.387965672s) [upload=200914]: Done starting upload Aug 16 18:30:20.656779016 (193h4m1.388046665s) [upload=200914]: Uploading segments... Aug 16 18:30:20.656835431 (193h4m1.388103081s) [upload=200914]: Got next segment. Inline: true Aug 16 18:30:20.656842083 (193h4m1.388109744s) [upload=200914]: Waiting for error group managing segments... Aug 16 18:30:20.656913488 (193h4m1.388181139s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 18:30:20.656919560 (193h4m1.38818721s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 18:30:20.656923327 (193h4m1.388190977s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 18:30:20.659031257 (193h4m1.390298906s) [upload=200914]: Done uploading segments... Aug 16 18:30:20.659043129 (193h4m1.390310778s) [upload=200914]: Upload finished. err: metaclient: Too Many Requests
Duration: 323.438498ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.X............................X......X.............X........] duration:
703.302395ms
FAIL (2025-08-16 18:56:10 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 18:50:06.795231389 (193h23m47.52649904s) [upload=201259]: Starting upload
Aug 16 18:50:06.795294448 (193h23m47.526562098s) [upload=201259]: Done starting upload
Aug 16 18:50:06.795449339 (193h23m47.526716989s) [upload=201259]: Uploading segments...
Aug 16 18:50:06.795693649 (193h23m47.5269613s) [upload=201259]: Got next segment. Inline: false
Aug 16 18:50:06.795759203 (193h23m47.527026853s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 18:50:06.795765165 (193h23m47.527032824s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 18:50:06.841060252 (193h23m47.572327901s) [seg_pos={0 0}, upload=201259]: Begin upload segment...
Aug 16 18:50:06.841119362 (193h23m47.572387012s) [seg_pos={0 0}, upload=201259]: Done begin upload segment.
Aug 16 18:50:06.841151233 (193h23m47.572418883s) [noise=true , address=104.36.82.35:4587 , piece_id=5JFLAGKDPOYPDZFSKF2DJT6EHCPJHQBHGMV3T4RAPKFOXP5YDVYQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841184625 (193h23m47.572452276s) [noise=true , address=104.36.82.34:4565 , piece_id=NPK7GSWSZWGHSUSETZCCOLVYUK6QE7RCZ5COSLSQ5UJ543W67MGQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841723480 (193h23m47.57299114s) [noise=true , address=104.36.82.20:4446 , piece_id=ZVIY47XJPM2KPHF6QWJYMGVR25PMANDTI3IGB5TTMW3QAT6NDPVQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841804182 (193h23m47.573071831s) [noise=true , address=104.36.82.39:4737 , piece_id=DC7GL4U6VY3SO6KZAXQNAK54AT2WFZBJUZM2WEFWLQKS5ULQJ3UQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.842218111 (193h23m47.573485761s) [noise=true , address=77.90.31.19:4870 , piece_id=76KXS2TZPI5OH3TESKHQNCKO34UP5YPFAQ5EPKB4LKST3PSWNY7Q, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.842347224 (193h23m47.573614874s) [noise=true , address=77.90.31.13:4657 , piece_id=3T2AY52BCUCXPSJHCPFDT4MNDY3RJVULG6X52HT4PKY7SJQ464SA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.843304817 (193h23m47.574572467s) [noise=true , address=104.36.82.37:4657 , piece_id=DOCMOQXG2TIS3MHSMBHQNEKZFUSXLKENOQXGWLQRYEYFD2OBJ2LA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.843418962 (193h23m47.574686612s) [noise=true , address=104.36.82.21:4476 , piece_id=H52MJNGMGSKORKKOPNBMVFOSFCKMCJOBET5NIQFAWZ5JDLTLY4ZQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844011178 (193h23m47.575278828s) [noise=true , address=45.91.116.5:4321 , piece_id=R4V5GAA7COM6Z2FAH7REIIDOMB7EJ2HUJHAWRWVNJRJV5WREPUSQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844142576 (193h23m47.575410225s) [noise=true , address=104.36.82.7:4933 , piece_id=GERLHPHJEVE5AVHI5VM4TCEDJC7PAAFHYAHPTETVC5NBMWTSFAFQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844882007 (193h23m47.576149657s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2F5PRGNYWIKKROX5EVNMCDUPJZPIOFJBN35YXEH4H5BKINRJKPQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.845386287 (193h23m47.576653947s) [noise=true , address=77.90.31.14:4681 , piece_id=F2C4U4NYLA5TGZSPC35WB2XH3YVQZNAYYPCGH66IIDLVSX7WZXKQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.845864367 (193h23m47.577132018s) [noise=true , address=45.91.116.10:4100 , piece_id=JMZXTBLEKC5X6I3T2P4XX32GGIXSH6IW4QCKFZFLTM5JQEBMLECQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.846491107 (193h23m47.577758757s) [noise=true , address=104.36.82.23:4447 , piece_id=H2XVFVY64HORCHUCFXZUQM7H4EWXQPV6YENXX7EEOOMCZTW4N6CA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.846703747 (193h23m47.577971408s) [noise=true , address=104.36.82.14:4230 , piece_id=WTOJ6THOEIOMF72YGNYOKRGYJQJF4FQP4VGDW2QQ2326DGTUSHCQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.847183361 (193h23m47.578451012s) [noise=true , address=77.90.31.10:4521 , piece_id=DJ2ZHTVZZ7SPBYTO2WH2BMDPS37K7MSYBPA3SHWXB3TM5FLTOZYQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.847384710 (193h23m47.57865236s) [noise=true , address=104.36.82.3:4793 , piece_id=47HFN7SSBLKV4Q2MTDVFC4GBNIPATKO6LRUOC4G2AW7A4MFAI6GA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.848437041 (193h23m47.579704692s) [noise=true , address=104.36.82.59:4313 , piece_id=J47ZWGLHUN7ECNRGXZZ42Q375WKFHUJN3XLYEGX2CMHC2RUWZJCA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.984012580 (193h23m47.71528023s) [upload=201259]: Next returned nil segment
Aug 16 18:50:06.984029241 (193h23m47.715296871s) [upload=201259]: Waiting for error group managing segments...
Aug 16 18:50:06.996112904 (193h23m47.727380564s) [noise=true , address=104.36.82.14:4230 , piece_id=WTOJ6THOEIOMF72YGNYOKRGYJQJF4FQP4VGDW2QQ2326DGTUSHCQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:06.999695960 (193h23m47.73096362s) [noise=true , address=104.36.82.39:4737 , piece_id=DC7GL4U6VY3SO6KZAXQNAK54AT2WFZBJUZM2WEFWLQKS5ULQJ3UQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.025463880 (193h23m47.756731529s) [noise=true , address=77.90.31.13:4657 , piece_id=3T2AY52BCUCXPSJHCPFDT4MNDY3RJVULG6X52HT4PKY7SJQ464SA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.027404303 (193h23m47.758671953s) [noise=true , address=104.36.82.21:4476 , piece_id=H52MJNGMGSKORKKOPNBMVFOSFCKMCJOBET5NIQFAWZ5JDLTLY4ZQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.031728906 (193h23m47.762996565s) [noise=true , address=77.90.31.14:4681 , piece_id=F2C4U4NYLA5TGZSPC35WB2XH3YVQZNAYYPCGH66IIDLVSX7WZXKQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.032687090 (193h23m47.76395474s) [noise=true , address=104.36.82.59:4313 , piece_id=J47ZWGLHUN7ECNRGXZZ42Q375WKFHUJN3XLYEGX2CMHC2RUWZJCA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.037670705 (193h23m47.768938354s) [noise=true , address=77.90.31.19:4870 , piece_id=76KXS2TZPI5OH3TESKHQNCKO34UP5YPFAQ5EPKB4LKST3PSWNY7Q, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.039026547 (193h23m47.770294198s) [noise=true , address=104.36.82.35:4587 , piece_id=5JFLAGKDPOYPDZFSKF2DJT6EHCPJHQBHGMV3T4RAPKFOXP5YDVYQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.039608773 (193h23m47.770876424s) [noise=true , address=104.36.82.20:4446 , piece_id=ZVIY47XJPM2KPHF6QWJYMGVR25PMANDTI3IGB5TTMW3QAT6NDPVQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.052389308 (193h23m47.783656959s) [noise=true , address=104.36.82.7:4933 , piece_id=GERLHPHJEVE5AVHI5VM4TCEDJC7PAAFHYAHPTETVC5NBMWTSFAFQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.052813196 (193h23m47.784080856s) [noise=true , address=104.36.82.37:4657 , piece_id=DOCMOQXG2TIS3MHSMBHQNEKZFUSXLKENOQXGWLQRYEYFD2OBJ2LA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.067727990 (193h23m47.79899564s) [noise=true , address=45.91.116.10:4100 , piece_id=JMZXTBLEKC5X6I3T2P4XX32GGIXSH6IW4QCKFZFLTM5JQEBMLECQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.077757915 (193h23m47.809025565s) [noise=true , address=104.36.82.34:4565 , piece_id=NPK7GSWSZWGHSUSETZCCOLVYUK6QE7RCZ5COSLSQ5UJ543W67MGQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.088885418 (193h23m47.820153067s) [noise=true , address=104.36.82.3:4793 , piece_id=47HFN7SSBLKV4Q2MTDVFC4GBNIPATKO6LRUOC4G2AW7A4MFAI6GA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.088946764 (193h23m47.820214414s) [seg_pos={0 0}, upload=201259]: Segment reached optimal threshold of 14 pieces.
Aug 16 18:50:07.089255815 (193h23m47.820523475s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2F5PRGNYWIKKROX5EVNMCDUPJZPIOFJBN35YXEH4H5BKINRJKPQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sJfMr1nMTpizd5PZ2bZ6M8tZWhFL2ukdJ3cNSRQtdUHNJhg81): protocol: expected piece hash; context canceled; EOF
Aug 16 18:50:07.089271314 (193h23m47.820538974s) [noise=true , address=104.36.82.23:4447 , piece_id=H2XVFVY64HORCHUCFXZUQM7H4EWXQPV6YENXX7EEOOMCZTW4N6CA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fqT9xA7kXTG8K9XwTUxL6FXibV35AkPHDK6grKGHg17fk91fP): protocol: write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection; write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection
Aug 16 18:50:07.089329323 (193h23m47.820596973s) [noise=true , address=77.90.31.10:4521 , piece_id=DJ2ZHTVZZ7SPBYTO2WH2BMDPS37K7MSYBPA3SHWXB3TM5FLTOZYQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WpVJa7SXkANKParDWYrC1cN8aLHTkUSPrRJGKQ6fvA5oDEkoa): protocol: write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection; write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection
Aug 16 18:50:07.089440162 (193h23m47.820707812s) [noise=true , address=45.91.116.5:4321 , piece_id=R4V5GAA7COM6Z2FAH7REIIDOMB7EJ2HUJHAWRWVNJRJV5WREPUSQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12m3Lw8yL9wVq38nW514iaLooMVgikbQBGA9vrFsr66jx5w1xXj): protocol: write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection; write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection
Aug 16 18:50:07.089461401 (193h23m47.820729052s) [seg_pos={0 0}, upload=201259]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 18:50:07.089583131 (193h23m47.820850791s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 18:50:07.089622546 (193h23m47.820890196s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 18:50:07.183064911 (193h23m47.914332561s) [upload=201259]: Done uploading segments...
Aug 16 18:50:07.183080390 (193h23m47.91434804s) [upload=201259]: Upload finished. err: <nil>
Duration: 703.321941ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [................X...........X...............................] duration:
187.934637ms
FAIL (2025-08-16 18:56:00 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 18:30:20.656629884 (193h4m1.387897535s) [upload=200914]: Starting upload Aug 16 18:30:20.656698023 (193h4m1.387965672s) [upload=200914]: Done starting upload Aug 16 18:30:20.656779016 (193h4m1.388046665s) [upload=200914]: Uploading segments... Aug 16 18:30:20.656835431 (193h4m1.388103081s) [upload=200914]: Got next segment. Inline: true Aug 16 18:30:20.656842083 (193h4m1.388109744s) [upload=200914]: Waiting for error group managing segments... Aug 16 18:30:20.656913488 (193h4m1.388181139s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 18:30:20.656919560 (193h4m1.38818721s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 18:30:20.656923327 (193h4m1.388190977s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 18:30:20.659031257 (193h4m1.390298906s) [upload=200914]: Done uploading segments... Aug 16 18:30:20.659043129 (193h4m1.390310778s) [upload=200914]: Upload finished. err: metaclient: Too Many Requests
Duration: 187.959594ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..X............................X......X.............X.......] duration:
586.251615ms
FAIL (2025-08-16 18:55:36 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 18:50:06.795231389 (193h23m47.52649904s) [upload=201259]: Starting upload
Aug 16 18:50:06.795294448 (193h23m47.526562098s) [upload=201259]: Done starting upload
Aug 16 18:50:06.795449339 (193h23m47.526716989s) [upload=201259]: Uploading segments...
Aug 16 18:50:06.795693649 (193h23m47.5269613s) [upload=201259]: Got next segment. Inline: false
Aug 16 18:50:06.795759203 (193h23m47.527026853s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 18:50:06.795765165 (193h23m47.527032824s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 18:50:06.841060252 (193h23m47.572327901s) [seg_pos={0 0}, upload=201259]: Begin upload segment...
Aug 16 18:50:06.841119362 (193h23m47.572387012s) [seg_pos={0 0}, upload=201259]: Done begin upload segment.
Aug 16 18:50:06.841151233 (193h23m47.572418883s) [noise=true , address=104.36.82.35:4587 , piece_id=5JFLAGKDPOYPDZFSKF2DJT6EHCPJHQBHGMV3T4RAPKFOXP5YDVYQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841184625 (193h23m47.572452276s) [noise=true , address=104.36.82.34:4565 , piece_id=NPK7GSWSZWGHSUSETZCCOLVYUK6QE7RCZ5COSLSQ5UJ543W67MGQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841723480 (193h23m47.57299114s) [noise=true , address=104.36.82.20:4446 , piece_id=ZVIY47XJPM2KPHF6QWJYMGVR25PMANDTI3IGB5TTMW3QAT6NDPVQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841804182 (193h23m47.573071831s) [noise=true , address=104.36.82.39:4737 , piece_id=DC7GL4U6VY3SO6KZAXQNAK54AT2WFZBJUZM2WEFWLQKS5ULQJ3UQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.842218111 (193h23m47.573485761s) [noise=true , address=77.90.31.19:4870 , piece_id=76KXS2TZPI5OH3TESKHQNCKO34UP5YPFAQ5EPKB4LKST3PSWNY7Q, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.842347224 (193h23m47.573614874s) [noise=true , address=77.90.31.13:4657 , piece_id=3T2AY52BCUCXPSJHCPFDT4MNDY3RJVULG6X52HT4PKY7SJQ464SA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.843304817 (193h23m47.574572467s) [noise=true , address=104.36.82.37:4657 , piece_id=DOCMOQXG2TIS3MHSMBHQNEKZFUSXLKENOQXGWLQRYEYFD2OBJ2LA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.843418962 (193h23m47.574686612s) [noise=true , address=104.36.82.21:4476 , piece_id=H52MJNGMGSKORKKOPNBMVFOSFCKMCJOBET5NIQFAWZ5JDLTLY4ZQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844011178 (193h23m47.575278828s) [noise=true , address=45.91.116.5:4321 , piece_id=R4V5GAA7COM6Z2FAH7REIIDOMB7EJ2HUJHAWRWVNJRJV5WREPUSQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844142576 (193h23m47.575410225s) [noise=true , address=104.36.82.7:4933 , piece_id=GERLHPHJEVE5AVHI5VM4TCEDJC7PAAFHYAHPTETVC5NBMWTSFAFQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844882007 (193h23m47.576149657s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2F5PRGNYWIKKROX5EVNMCDUPJZPIOFJBN35YXEH4H5BKINRJKPQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.845386287 (193h23m47.576653947s) [noise=true , address=77.90.31.14:4681 , piece_id=F2C4U4NYLA5TGZSPC35WB2XH3YVQZNAYYPCGH66IIDLVSX7WZXKQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.845864367 (193h23m47.577132018s) [noise=true , address=45.91.116.10:4100 , piece_id=JMZXTBLEKC5X6I3T2P4XX32GGIXSH6IW4QCKFZFLTM5JQEBMLECQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.846491107 (193h23m47.577758757s) [noise=true , address=104.36.82.23:4447 , piece_id=H2XVFVY64HORCHUCFXZUQM7H4EWXQPV6YENXX7EEOOMCZTW4N6CA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.846703747 (193h23m47.577971408s) [noise=true , address=104.36.82.14:4230 , piece_id=WTOJ6THOEIOMF72YGNYOKRGYJQJF4FQP4VGDW2QQ2326DGTUSHCQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.847183361 (193h23m47.578451012s) [noise=true , address=77.90.31.10:4521 , piece_id=DJ2ZHTVZZ7SPBYTO2WH2BMDPS37K7MSYBPA3SHWXB3TM5FLTOZYQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.847384710 (193h23m47.57865236s) [noise=true , address=104.36.82.3:4793 , piece_id=47HFN7SSBLKV4Q2MTDVFC4GBNIPATKO6LRUOC4G2AW7A4MFAI6GA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.848437041 (193h23m47.579704692s) [noise=true , address=104.36.82.59:4313 , piece_id=J47ZWGLHUN7ECNRGXZZ42Q375WKFHUJN3XLYEGX2CMHC2RUWZJCA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.984012580 (193h23m47.71528023s) [upload=201259]: Next returned nil segment
Aug 16 18:50:06.984029241 (193h23m47.715296871s) [upload=201259]: Waiting for error group managing segments...
Aug 16 18:50:06.996112904 (193h23m47.727380564s) [noise=true , address=104.36.82.14:4230 , piece_id=WTOJ6THOEIOMF72YGNYOKRGYJQJF4FQP4VGDW2QQ2326DGTUSHCQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:06.999695960 (193h23m47.73096362s) [noise=true , address=104.36.82.39:4737 , piece_id=DC7GL4U6VY3SO6KZAXQNAK54AT2WFZBJUZM2WEFWLQKS5ULQJ3UQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.025463880 (193h23m47.756731529s) [noise=true , address=77.90.31.13:4657 , piece_id=3T2AY52BCUCXPSJHCPFDT4MNDY3RJVULG6X52HT4PKY7SJQ464SA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.027404303 (193h23m47.758671953s) [noise=true , address=104.36.82.21:4476 , piece_id=H52MJNGMGSKORKKOPNBMVFOSFCKMCJOBET5NIQFAWZ5JDLTLY4ZQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.031728906 (193h23m47.762996565s) [noise=true , address=77.90.31.14:4681 , piece_id=F2C4U4NYLA5TGZSPC35WB2XH3YVQZNAYYPCGH66IIDLVSX7WZXKQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.032687090 (193h23m47.76395474s) [noise=true , address=104.36.82.59:4313 , piece_id=J47ZWGLHUN7ECNRGXZZ42Q375WKFHUJN3XLYEGX2CMHC2RUWZJCA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.037670705 (193h23m47.768938354s) [noise=true , address=77.90.31.19:4870 , piece_id=76KXS2TZPI5OH3TESKHQNCKO34UP5YPFAQ5EPKB4LKST3PSWNY7Q, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.039026547 (193h23m47.770294198s) [noise=true , address=104.36.82.35:4587 , piece_id=5JFLAGKDPOYPDZFSKF2DJT6EHCPJHQBHGMV3T4RAPKFOXP5YDVYQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.039608773 (193h23m47.770876424s) [noise=true , address=104.36.82.20:4446 , piece_id=ZVIY47XJPM2KPHF6QWJYMGVR25PMANDTI3IGB5TTMW3QAT6NDPVQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.052389308 (193h23m47.783656959s) [noise=true , address=104.36.82.7:4933 , piece_id=GERLHPHJEVE5AVHI5VM4TCEDJC7PAAFHYAHPTETVC5NBMWTSFAFQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.052813196 (193h23m47.784080856s) [noise=true , address=104.36.82.37:4657 , piece_id=DOCMOQXG2TIS3MHSMBHQNEKZFUSXLKENOQXGWLQRYEYFD2OBJ2LA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.067727990 (193h23m47.79899564s) [noise=true , address=45.91.116.10:4100 , piece_id=JMZXTBLEKC5X6I3T2P4XX32GGIXSH6IW4QCKFZFLTM5JQEBMLECQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.077757915 (193h23m47.809025565s) [noise=true , address=104.36.82.34:4565 , piece_id=NPK7GSWSZWGHSUSETZCCOLVYUK6QE7RCZ5COSLSQ5UJ543W67MGQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.088885418 (193h23m47.820153067s) [noise=true , address=104.36.82.3:4793 , piece_id=47HFN7SSBLKV4Q2MTDVFC4GBNIPATKO6LRUOC4G2AW7A4MFAI6GA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.088946764 (193h23m47.820214414s) [seg_pos={0 0}, upload=201259]: Segment reached optimal threshold of 14 pieces.
Aug 16 18:50:07.089255815 (193h23m47.820523475s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2F5PRGNYWIKKROX5EVNMCDUPJZPIOFJBN35YXEH4H5BKINRJKPQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sJfMr1nMTpizd5PZ2bZ6M8tZWhFL2ukdJ3cNSRQtdUHNJhg81): protocol: expected piece hash; context canceled; EOF
Aug 16 18:50:07.089271314 (193h23m47.820538974s) [noise=true , address=104.36.82.23:4447 , piece_id=H2XVFVY64HORCHUCFXZUQM7H4EWXQPV6YENXX7EEOOMCZTW4N6CA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fqT9xA7kXTG8K9XwTUxL6FXibV35AkPHDK6grKGHg17fk91fP): protocol: write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection; write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection
Aug 16 18:50:07.089329323 (193h23m47.820596973s) [noise=true , address=77.90.31.10:4521 , piece_id=DJ2ZHTVZZ7SPBYTO2WH2BMDPS37K7MSYBPA3SHWXB3TM5FLTOZYQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WpVJa7SXkANKParDWYrC1cN8aLHTkUSPrRJGKQ6fvA5oDEkoa): protocol: write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection; write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection
Aug 16 18:50:07.089440162 (193h23m47.820707812s) [noise=true , address=45.91.116.5:4321 , piece_id=R4V5GAA7COM6Z2FAH7REIIDOMB7EJ2HUJHAWRWVNJRJV5WREPUSQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12m3Lw8yL9wVq38nW514iaLooMVgikbQBGA9vrFsr66jx5w1xXj): protocol: write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection; write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection
Aug 16 18:50:07.089461401 (193h23m47.820729052s) [seg_pos={0 0}, upload=201259]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 18:50:07.089583131 (193h23m47.820850791s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 18:50:07.089622546 (193h23m47.820890196s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 18:50:07.183064911 (193h23m47.914332561s) [upload=201259]: Done uploading segments...
Aug 16 18:50:07.183080390 (193h23m47.91434804s) [upload=201259]: Upload finished. err: <nil>
Duration: 586.278407ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................X...........X..............................] duration:
218.662235ms
FAIL (2025-08-16 18:55:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 18:30:20.656629884 (193h4m1.387897535s) [upload=200914]: Starting upload Aug 16 18:30:20.656698023 (193h4m1.387965672s) [upload=200914]: Done starting upload Aug 16 18:30:20.656779016 (193h4m1.388046665s) [upload=200914]: Uploading segments... Aug 16 18:30:20.656835431 (193h4m1.388103081s) [upload=200914]: Got next segment. Inline: true Aug 16 18:30:20.656842083 (193h4m1.388109744s) [upload=200914]: Waiting for error group managing segments... Aug 16 18:30:20.656913488 (193h4m1.388181139s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 18:30:20.656919560 (193h4m1.38818721s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 18:30:20.656923327 (193h4m1.388190977s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 18:30:20.659031257 (193h4m1.390298906s) [upload=200914]: Done uploading segments... Aug 16 18:30:20.659043129 (193h4m1.390310778s) [upload=200914]: Upload finished. err: metaclient: Too Many Requests
Duration: 218.684897ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...X............................X......X.............X......] duration:
597.779251ms
FAIL (2025-08-16 18:54:35 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 18:50:06.795231389 (193h23m47.52649904s) [upload=201259]: Starting upload
Aug 16 18:50:06.795294448 (193h23m47.526562098s) [upload=201259]: Done starting upload
Aug 16 18:50:06.795449339 (193h23m47.526716989s) [upload=201259]: Uploading segments...
Aug 16 18:50:06.795693649 (193h23m47.5269613s) [upload=201259]: Got next segment. Inline: false
Aug 16 18:50:06.795759203 (193h23m47.527026853s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 18:50:06.795765165 (193h23m47.527032824s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 18:50:06.841060252 (193h23m47.572327901s) [seg_pos={0 0}, upload=201259]: Begin upload segment...
Aug 16 18:50:06.841119362 (193h23m47.572387012s) [seg_pos={0 0}, upload=201259]: Done begin upload segment.
Aug 16 18:50:06.841151233 (193h23m47.572418883s) [noise=true , address=104.36.82.35:4587 , piece_id=5JFLAGKDPOYPDZFSKF2DJT6EHCPJHQBHGMV3T4RAPKFOXP5YDVYQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841184625 (193h23m47.572452276s) [noise=true , address=104.36.82.34:4565 , piece_id=NPK7GSWSZWGHSUSETZCCOLVYUK6QE7RCZ5COSLSQ5UJ543W67MGQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841723480 (193h23m47.57299114s) [noise=true , address=104.36.82.20:4446 , piece_id=ZVIY47XJPM2KPHF6QWJYMGVR25PMANDTI3IGB5TTMW3QAT6NDPVQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841804182 (193h23m47.573071831s) [noise=true , address=104.36.82.39:4737 , piece_id=DC7GL4U6VY3SO6KZAXQNAK54AT2WFZBJUZM2WEFWLQKS5ULQJ3UQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.842218111 (193h23m47.573485761s) [noise=true , address=77.90.31.19:4870 , piece_id=76KXS2TZPI5OH3TESKHQNCKO34UP5YPFAQ5EPKB4LKST3PSWNY7Q, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.842347224 (193h23m47.573614874s) [noise=true , address=77.90.31.13:4657 , piece_id=3T2AY52BCUCXPSJHCPFDT4MNDY3RJVULG6X52HT4PKY7SJQ464SA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.843304817 (193h23m47.574572467s) [noise=true , address=104.36.82.37:4657 , piece_id=DOCMOQXG2TIS3MHSMBHQNEKZFUSXLKENOQXGWLQRYEYFD2OBJ2LA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.843418962 (193h23m47.574686612s) [noise=true , address=104.36.82.21:4476 , piece_id=H52MJNGMGSKORKKOPNBMVFOSFCKMCJOBET5NIQFAWZ5JDLTLY4ZQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844011178 (193h23m47.575278828s) [noise=true , address=45.91.116.5:4321 , piece_id=R4V5GAA7COM6Z2FAH7REIIDOMB7EJ2HUJHAWRWVNJRJV5WREPUSQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844142576 (193h23m47.575410225s) [noise=true , address=104.36.82.7:4933 , piece_id=GERLHPHJEVE5AVHI5VM4TCEDJC7PAAFHYAHPTETVC5NBMWTSFAFQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844882007 (193h23m47.576149657s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2F5PRGNYWIKKROX5EVNMCDUPJZPIOFJBN35YXEH4H5BKINRJKPQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.845386287 (193h23m47.576653947s) [noise=true , address=77.90.31.14:4681 , piece_id=F2C4U4NYLA5TGZSPC35WB2XH3YVQZNAYYPCGH66IIDLVSX7WZXKQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.845864367 (193h23m47.577132018s) [noise=true , address=45.91.116.10:4100 , piece_id=JMZXTBLEKC5X6I3T2P4XX32GGIXSH6IW4QCKFZFLTM5JQEBMLECQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.846491107 (193h23m47.577758757s) [noise=true , address=104.36.82.23:4447 , piece_id=H2XVFVY64HORCHUCFXZUQM7H4EWXQPV6YENXX7EEOOMCZTW4N6CA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.846703747 (193h23m47.577971408s) [noise=true , address=104.36.82.14:4230 , piece_id=WTOJ6THOEIOMF72YGNYOKRGYJQJF4FQP4VGDW2QQ2326DGTUSHCQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.847183361 (193h23m47.578451012s) [noise=true , address=77.90.31.10:4521 , piece_id=DJ2ZHTVZZ7SPBYTO2WH2BMDPS37K7MSYBPA3SHWXB3TM5FLTOZYQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.847384710 (193h23m47.57865236s) [noise=true , address=104.36.82.3:4793 , piece_id=47HFN7SSBLKV4Q2MTDVFC4GBNIPATKO6LRUOC4G2AW7A4MFAI6GA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.848437041 (193h23m47.579704692s) [noise=true , address=104.36.82.59:4313 , piece_id=J47ZWGLHUN7ECNRGXZZ42Q375WKFHUJN3XLYEGX2CMHC2RUWZJCA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.984012580 (193h23m47.71528023s) [upload=201259]: Next returned nil segment
Aug 16 18:50:06.984029241 (193h23m47.715296871s) [upload=201259]: Waiting for error group managing segments...
Aug 16 18:50:06.996112904 (193h23m47.727380564s) [noise=true , address=104.36.82.14:4230 , piece_id=WTOJ6THOEIOMF72YGNYOKRGYJQJF4FQP4VGDW2QQ2326DGTUSHCQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:06.999695960 (193h23m47.73096362s) [noise=true , address=104.36.82.39:4737 , piece_id=DC7GL4U6VY3SO6KZAXQNAK54AT2WFZBJUZM2WEFWLQKS5ULQJ3UQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.025463880 (193h23m47.756731529s) [noise=true , address=77.90.31.13:4657 , piece_id=3T2AY52BCUCXPSJHCPFDT4MNDY3RJVULG6X52HT4PKY7SJQ464SA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.027404303 (193h23m47.758671953s) [noise=true , address=104.36.82.21:4476 , piece_id=H52MJNGMGSKORKKOPNBMVFOSFCKMCJOBET5NIQFAWZ5JDLTLY4ZQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.031728906 (193h23m47.762996565s) [noise=true , address=77.90.31.14:4681 , piece_id=F2C4U4NYLA5TGZSPC35WB2XH3YVQZNAYYPCGH66IIDLVSX7WZXKQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.032687090 (193h23m47.76395474s) [noise=true , address=104.36.82.59:4313 , piece_id=J47ZWGLHUN7ECNRGXZZ42Q375WKFHUJN3XLYEGX2CMHC2RUWZJCA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.037670705 (193h23m47.768938354s) [noise=true , address=77.90.31.19:4870 , piece_id=76KXS2TZPI5OH3TESKHQNCKO34UP5YPFAQ5EPKB4LKST3PSWNY7Q, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.039026547 (193h23m47.770294198s) [noise=true , address=104.36.82.35:4587 , piece_id=5JFLAGKDPOYPDZFSKF2DJT6EHCPJHQBHGMV3T4RAPKFOXP5YDVYQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.039608773 (193h23m47.770876424s) [noise=true , address=104.36.82.20:4446 , piece_id=ZVIY47XJPM2KPHF6QWJYMGVR25PMANDTI3IGB5TTMW3QAT6NDPVQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.052389308 (193h23m47.783656959s) [noise=true , address=104.36.82.7:4933 , piece_id=GERLHPHJEVE5AVHI5VM4TCEDJC7PAAFHYAHPTETVC5NBMWTSFAFQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.052813196 (193h23m47.784080856s) [noise=true , address=104.36.82.37:4657 , piece_id=DOCMOQXG2TIS3MHSMBHQNEKZFUSXLKENOQXGWLQRYEYFD2OBJ2LA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.067727990 (193h23m47.79899564s) [noise=true , address=45.91.116.10:4100 , piece_id=JMZXTBLEKC5X6I3T2P4XX32GGIXSH6IW4QCKFZFLTM5JQEBMLECQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.077757915 (193h23m47.809025565s) [noise=true , address=104.36.82.34:4565 , piece_id=NPK7GSWSZWGHSUSETZCCOLVYUK6QE7RCZ5COSLSQ5UJ543W67MGQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.088885418 (193h23m47.820153067s) [noise=true , address=104.36.82.3:4793 , piece_id=47HFN7SSBLKV4Q2MTDVFC4GBNIPATKO6LRUOC4G2AW7A4MFAI6GA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.088946764 (193h23m47.820214414s) [seg_pos={0 0}, upload=201259]: Segment reached optimal threshold of 14 pieces.
Aug 16 18:50:07.089255815 (193h23m47.820523475s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2F5PRGNYWIKKROX5EVNMCDUPJZPIOFJBN35YXEH4H5BKINRJKPQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sJfMr1nMTpizd5PZ2bZ6M8tZWhFL2ukdJ3cNSRQtdUHNJhg81): protocol: expected piece hash; context canceled; EOF
Aug 16 18:50:07.089271314 (193h23m47.820538974s) [noise=true , address=104.36.82.23:4447 , piece_id=H2XVFVY64HORCHUCFXZUQM7H4EWXQPV6YENXX7EEOOMCZTW4N6CA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fqT9xA7kXTG8K9XwTUxL6FXibV35AkPHDK6grKGHg17fk91fP): protocol: write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection; write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection
Aug 16 18:50:07.089329323 (193h23m47.820596973s) [noise=true , address=77.90.31.10:4521 , piece_id=DJ2ZHTVZZ7SPBYTO2WH2BMDPS37K7MSYBPA3SHWXB3TM5FLTOZYQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WpVJa7SXkANKParDWYrC1cN8aLHTkUSPrRJGKQ6fvA5oDEkoa): protocol: write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection; write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection
Aug 16 18:50:07.089440162 (193h23m47.820707812s) [noise=true , address=45.91.116.5:4321 , piece_id=R4V5GAA7COM6Z2FAH7REIIDOMB7EJ2HUJHAWRWVNJRJV5WREPUSQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12m3Lw8yL9wVq38nW514iaLooMVgikbQBGA9vrFsr66jx5w1xXj): protocol: write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection; write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection
Aug 16 18:50:07.089461401 (193h23m47.820729052s) [seg_pos={0 0}, upload=201259]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 18:50:07.089583131 (193h23m47.820850791s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 18:50:07.089622546 (193h23m47.820890196s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 18:50:07.183064911 (193h23m47.914332561s) [upload=201259]: Done uploading segments...
Aug 16 18:50:07.183080390 (193h23m47.91434804s) [upload=201259]: Upload finished. err: <nil>
Duration: 597.801314ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................X...........X.............................] duration:
144.355251ms
FAIL (2025-08-16 18:54:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 18:30:20.656629884 (193h4m1.387897535s) [upload=200914]: Starting upload Aug 16 18:30:20.656698023 (193h4m1.387965672s) [upload=200914]: Done starting upload Aug 16 18:30:20.656779016 (193h4m1.388046665s) [upload=200914]: Uploading segments... Aug 16 18:30:20.656835431 (193h4m1.388103081s) [upload=200914]: Got next segment. Inline: true Aug 16 18:30:20.656842083 (193h4m1.388109744s) [upload=200914]: Waiting for error group managing segments... Aug 16 18:30:20.656913488 (193h4m1.388181139s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 18:30:20.656919560 (193h4m1.38818721s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 18:30:20.656923327 (193h4m1.388190977s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 18:30:20.659031257 (193h4m1.390298906s) [upload=200914]: Done uploading segments... Aug 16 18:30:20.659043129 (193h4m1.390310778s) [upload=200914]: Upload finished. err: metaclient: Too Many Requests
Duration: 144.377803ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [....X............................X......X.............X.....] duration:
1.002880672s
FAIL (2025-08-16 18:54:15 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 18:50:06.795231389 (193h23m47.52649904s) [upload=201259]: Starting upload
Aug 16 18:50:06.795294448 (193h23m47.526562098s) [upload=201259]: Done starting upload
Aug 16 18:50:06.795449339 (193h23m47.526716989s) [upload=201259]: Uploading segments...
Aug 16 18:50:06.795693649 (193h23m47.5269613s) [upload=201259]: Got next segment. Inline: false
Aug 16 18:50:06.795759203 (193h23m47.527026853s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 18:50:06.795765165 (193h23m47.527032824s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 18:50:06.841060252 (193h23m47.572327901s) [seg_pos={0 0}, upload=201259]: Begin upload segment...
Aug 16 18:50:06.841119362 (193h23m47.572387012s) [seg_pos={0 0}, upload=201259]: Done begin upload segment.
Aug 16 18:50:06.841151233 (193h23m47.572418883s) [noise=true , address=104.36.82.35:4587 , piece_id=5JFLAGKDPOYPDZFSKF2DJT6EHCPJHQBHGMV3T4RAPKFOXP5YDVYQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841184625 (193h23m47.572452276s) [noise=true , address=104.36.82.34:4565 , piece_id=NPK7GSWSZWGHSUSETZCCOLVYUK6QE7RCZ5COSLSQ5UJ543W67MGQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841723480 (193h23m47.57299114s) [noise=true , address=104.36.82.20:4446 , piece_id=ZVIY47XJPM2KPHF6QWJYMGVR25PMANDTI3IGB5TTMW3QAT6NDPVQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841804182 (193h23m47.573071831s) [noise=true , address=104.36.82.39:4737 , piece_id=DC7GL4U6VY3SO6KZAXQNAK54AT2WFZBJUZM2WEFWLQKS5ULQJ3UQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.842218111 (193h23m47.573485761s) [noise=true , address=77.90.31.19:4870 , piece_id=76KXS2TZPI5OH3TESKHQNCKO34UP5YPFAQ5EPKB4LKST3PSWNY7Q, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.842347224 (193h23m47.573614874s) [noise=true , address=77.90.31.13:4657 , piece_id=3T2AY52BCUCXPSJHCPFDT4MNDY3RJVULG6X52HT4PKY7SJQ464SA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.843304817 (193h23m47.574572467s) [noise=true , address=104.36.82.37:4657 , piece_id=DOCMOQXG2TIS3MHSMBHQNEKZFUSXLKENOQXGWLQRYEYFD2OBJ2LA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.843418962 (193h23m47.574686612s) [noise=true , address=104.36.82.21:4476 , piece_id=H52MJNGMGSKORKKOPNBMVFOSFCKMCJOBET5NIQFAWZ5JDLTLY4ZQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844011178 (193h23m47.575278828s) [noise=true , address=45.91.116.5:4321 , piece_id=R4V5GAA7COM6Z2FAH7REIIDOMB7EJ2HUJHAWRWVNJRJV5WREPUSQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844142576 (193h23m47.575410225s) [noise=true , address=104.36.82.7:4933 , piece_id=GERLHPHJEVE5AVHI5VM4TCEDJC7PAAFHYAHPTETVC5NBMWTSFAFQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844882007 (193h23m47.576149657s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2F5PRGNYWIKKROX5EVNMCDUPJZPIOFJBN35YXEH4H5BKINRJKPQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.845386287 (193h23m47.576653947s) [noise=true , address=77.90.31.14:4681 , piece_id=F2C4U4NYLA5TGZSPC35WB2XH3YVQZNAYYPCGH66IIDLVSX7WZXKQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.845864367 (193h23m47.577132018s) [noise=true , address=45.91.116.10:4100 , piece_id=JMZXTBLEKC5X6I3T2P4XX32GGIXSH6IW4QCKFZFLTM5JQEBMLECQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.846491107 (193h23m47.577758757s) [noise=true , address=104.36.82.23:4447 , piece_id=H2XVFVY64HORCHUCFXZUQM7H4EWXQPV6YENXX7EEOOMCZTW4N6CA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.846703747 (193h23m47.577971408s) [noise=true , address=104.36.82.14:4230 , piece_id=WTOJ6THOEIOMF72YGNYOKRGYJQJF4FQP4VGDW2QQ2326DGTUSHCQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.847183361 (193h23m47.578451012s) [noise=true , address=77.90.31.10:4521 , piece_id=DJ2ZHTVZZ7SPBYTO2WH2BMDPS37K7MSYBPA3SHWXB3TM5FLTOZYQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.847384710 (193h23m47.57865236s) [noise=true , address=104.36.82.3:4793 , piece_id=47HFN7SSBLKV4Q2MTDVFC4GBNIPATKO6LRUOC4G2AW7A4MFAI6GA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.848437041 (193h23m47.579704692s) [noise=true , address=104.36.82.59:4313 , piece_id=J47ZWGLHUN7ECNRGXZZ42Q375WKFHUJN3XLYEGX2CMHC2RUWZJCA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.984012580 (193h23m47.71528023s) [upload=201259]: Next returned nil segment
Aug 16 18:50:06.984029241 (193h23m47.715296871s) [upload=201259]: Waiting for error group managing segments...
Aug 16 18:50:06.996112904 (193h23m47.727380564s) [noise=true , address=104.36.82.14:4230 , piece_id=WTOJ6THOEIOMF72YGNYOKRGYJQJF4FQP4VGDW2QQ2326DGTUSHCQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:06.999695960 (193h23m47.73096362s) [noise=true , address=104.36.82.39:4737 , piece_id=DC7GL4U6VY3SO6KZAXQNAK54AT2WFZBJUZM2WEFWLQKS5ULQJ3UQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.025463880 (193h23m47.756731529s) [noise=true , address=77.90.31.13:4657 , piece_id=3T2AY52BCUCXPSJHCPFDT4MNDY3RJVULG6X52HT4PKY7SJQ464SA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.027404303 (193h23m47.758671953s) [noise=true , address=104.36.82.21:4476 , piece_id=H52MJNGMGSKORKKOPNBMVFOSFCKMCJOBET5NIQFAWZ5JDLTLY4ZQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.031728906 (193h23m47.762996565s) [noise=true , address=77.90.31.14:4681 , piece_id=F2C4U4NYLA5TGZSPC35WB2XH3YVQZNAYYPCGH66IIDLVSX7WZXKQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.032687090 (193h23m47.76395474s) [noise=true , address=104.36.82.59:4313 , piece_id=J47ZWGLHUN7ECNRGXZZ42Q375WKFHUJN3XLYEGX2CMHC2RUWZJCA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.037670705 (193h23m47.768938354s) [noise=true , address=77.90.31.19:4870 , piece_id=76KXS2TZPI5OH3TESKHQNCKO34UP5YPFAQ5EPKB4LKST3PSWNY7Q, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.039026547 (193h23m47.770294198s) [noise=true , address=104.36.82.35:4587 , piece_id=5JFLAGKDPOYPDZFSKF2DJT6EHCPJHQBHGMV3T4RAPKFOXP5YDVYQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.039608773 (193h23m47.770876424s) [noise=true , address=104.36.82.20:4446 , piece_id=ZVIY47XJPM2KPHF6QWJYMGVR25PMANDTI3IGB5TTMW3QAT6NDPVQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.052389308 (193h23m47.783656959s) [noise=true , address=104.36.82.7:4933 , piece_id=GERLHPHJEVE5AVHI5VM4TCEDJC7PAAFHYAHPTETVC5NBMWTSFAFQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.052813196 (193h23m47.784080856s) [noise=true , address=104.36.82.37:4657 , piece_id=DOCMOQXG2TIS3MHSMBHQNEKZFUSXLKENOQXGWLQRYEYFD2OBJ2LA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.067727990 (193h23m47.79899564s) [noise=true , address=45.91.116.10:4100 , piece_id=JMZXTBLEKC5X6I3T2P4XX32GGIXSH6IW4QCKFZFLTM5JQEBMLECQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.077757915 (193h23m47.809025565s) [noise=true , address=104.36.82.34:4565 , piece_id=NPK7GSWSZWGHSUSETZCCOLVYUK6QE7RCZ5COSLSQ5UJ543W67MGQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.088885418 (193h23m47.820153067s) [noise=true , address=104.36.82.3:4793 , piece_id=47HFN7SSBLKV4Q2MTDVFC4GBNIPATKO6LRUOC4G2AW7A4MFAI6GA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.088946764 (193h23m47.820214414s) [seg_pos={0 0}, upload=201259]: Segment reached optimal threshold of 14 pieces.
Aug 16 18:50:07.089255815 (193h23m47.820523475s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2F5PRGNYWIKKROX5EVNMCDUPJZPIOFJBN35YXEH4H5BKINRJKPQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sJfMr1nMTpizd5PZ2bZ6M8tZWhFL2ukdJ3cNSRQtdUHNJhg81): protocol: expected piece hash; context canceled; EOF
Aug 16 18:50:07.089271314 (193h23m47.820538974s) [noise=true , address=104.36.82.23:4447 , piece_id=H2XVFVY64HORCHUCFXZUQM7H4EWXQPV6YENXX7EEOOMCZTW4N6CA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fqT9xA7kXTG8K9XwTUxL6FXibV35AkPHDK6grKGHg17fk91fP): protocol: write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection; write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection
Aug 16 18:50:07.089329323 (193h23m47.820596973s) [noise=true , address=77.90.31.10:4521 , piece_id=DJ2ZHTVZZ7SPBYTO2WH2BMDPS37K7MSYBPA3SHWXB3TM5FLTOZYQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WpVJa7SXkANKParDWYrC1cN8aLHTkUSPrRJGKQ6fvA5oDEkoa): protocol: write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection; write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection
Aug 16 18:50:07.089440162 (193h23m47.820707812s) [noise=true , address=45.91.116.5:4321 , piece_id=R4V5GAA7COM6Z2FAH7REIIDOMB7EJ2HUJHAWRWVNJRJV5WREPUSQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12m3Lw8yL9wVq38nW514iaLooMVgikbQBGA9vrFsr66jx5w1xXj): protocol: write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection; write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection
Aug 16 18:50:07.089461401 (193h23m47.820729052s) [seg_pos={0 0}, upload=201259]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 18:50:07.089583131 (193h23m47.820850791s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 18:50:07.089622546 (193h23m47.820890196s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 18:50:07.183064911 (193h23m47.914332561s) [upload=201259]: Done uploading segments...
Aug 16 18:50:07.183080390 (193h23m47.91434804s) [upload=201259]: Upload finished. err: <nil>
Duration: 1.002914275s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...................X...........X............................] duration:
200.589405ms
FAIL (2025-08-16 18:53:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 18:30:20.656629884 (193h4m1.387897535s) [upload=200914]: Starting upload Aug 16 18:30:20.656698023 (193h4m1.387965672s) [upload=200914]: Done starting upload Aug 16 18:30:20.656779016 (193h4m1.388046665s) [upload=200914]: Uploading segments... Aug 16 18:30:20.656835431 (193h4m1.388103081s) [upload=200914]: Got next segment. Inline: true Aug 16 18:30:20.656842083 (193h4m1.388109744s) [upload=200914]: Waiting for error group managing segments... Aug 16 18:30:20.656913488 (193h4m1.388181139s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 18:30:20.656919560 (193h4m1.38818721s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 18:30:20.656923327 (193h4m1.388190977s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 18:30:20.659031257 (193h4m1.390298906s) [upload=200914]: Done uploading segments... Aug 16 18:30:20.659043129 (193h4m1.390310778s) [upload=200914]: Upload finished. err: metaclient: Too Many Requests
Duration: 200.622809ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.....X............................X......X.............X....] duration:
885.79064ms
FAIL (2025-08-16 18:53:13 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 18:50:06.795231389 (193h23m47.52649904s) [upload=201259]: Starting upload
Aug 16 18:50:06.795294448 (193h23m47.526562098s) [upload=201259]: Done starting upload
Aug 16 18:50:06.795449339 (193h23m47.526716989s) [upload=201259]: Uploading segments...
Aug 16 18:50:06.795693649 (193h23m47.5269613s) [upload=201259]: Got next segment. Inline: false
Aug 16 18:50:06.795759203 (193h23m47.527026853s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 18:50:06.795765165 (193h23m47.527032824s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 18:50:06.841060252 (193h23m47.572327901s) [seg_pos={0 0}, upload=201259]: Begin upload segment...
Aug 16 18:50:06.841119362 (193h23m47.572387012s) [seg_pos={0 0}, upload=201259]: Done begin upload segment.
Aug 16 18:50:06.841151233 (193h23m47.572418883s) [noise=true , address=104.36.82.35:4587 , piece_id=5JFLAGKDPOYPDZFSKF2DJT6EHCPJHQBHGMV3T4RAPKFOXP5YDVYQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841184625 (193h23m47.572452276s) [noise=true , address=104.36.82.34:4565 , piece_id=NPK7GSWSZWGHSUSETZCCOLVYUK6QE7RCZ5COSLSQ5UJ543W67MGQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841723480 (193h23m47.57299114s) [noise=true , address=104.36.82.20:4446 , piece_id=ZVIY47XJPM2KPHF6QWJYMGVR25PMANDTI3IGB5TTMW3QAT6NDPVQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841804182 (193h23m47.573071831s) [noise=true , address=104.36.82.39:4737 , piece_id=DC7GL4U6VY3SO6KZAXQNAK54AT2WFZBJUZM2WEFWLQKS5ULQJ3UQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.842218111 (193h23m47.573485761s) [noise=true , address=77.90.31.19:4870 , piece_id=76KXS2TZPI5OH3TESKHQNCKO34UP5YPFAQ5EPKB4LKST3PSWNY7Q, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.842347224 (193h23m47.573614874s) [noise=true , address=77.90.31.13:4657 , piece_id=3T2AY52BCUCXPSJHCPFDT4MNDY3RJVULG6X52HT4PKY7SJQ464SA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.843304817 (193h23m47.574572467s) [noise=true , address=104.36.82.37:4657 , piece_id=DOCMOQXG2TIS3MHSMBHQNEKZFUSXLKENOQXGWLQRYEYFD2OBJ2LA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.843418962 (193h23m47.574686612s) [noise=true , address=104.36.82.21:4476 , piece_id=H52MJNGMGSKORKKOPNBMVFOSFCKMCJOBET5NIQFAWZ5JDLTLY4ZQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844011178 (193h23m47.575278828s) [noise=true , address=45.91.116.5:4321 , piece_id=R4V5GAA7COM6Z2FAH7REIIDOMB7EJ2HUJHAWRWVNJRJV5WREPUSQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844142576 (193h23m47.575410225s) [noise=true , address=104.36.82.7:4933 , piece_id=GERLHPHJEVE5AVHI5VM4TCEDJC7PAAFHYAHPTETVC5NBMWTSFAFQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844882007 (193h23m47.576149657s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2F5PRGNYWIKKROX5EVNMCDUPJZPIOFJBN35YXEH4H5BKINRJKPQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.845386287 (193h23m47.576653947s) [noise=true , address=77.90.31.14:4681 , piece_id=F2C4U4NYLA5TGZSPC35WB2XH3YVQZNAYYPCGH66IIDLVSX7WZXKQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.845864367 (193h23m47.577132018s) [noise=true , address=45.91.116.10:4100 , piece_id=JMZXTBLEKC5X6I3T2P4XX32GGIXSH6IW4QCKFZFLTM5JQEBMLECQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.846491107 (193h23m47.577758757s) [noise=true , address=104.36.82.23:4447 , piece_id=H2XVFVY64HORCHUCFXZUQM7H4EWXQPV6YENXX7EEOOMCZTW4N6CA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.846703747 (193h23m47.577971408s) [noise=true , address=104.36.82.14:4230 , piece_id=WTOJ6THOEIOMF72YGNYOKRGYJQJF4FQP4VGDW2QQ2326DGTUSHCQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.847183361 (193h23m47.578451012s) [noise=true , address=77.90.31.10:4521 , piece_id=DJ2ZHTVZZ7SPBYTO2WH2BMDPS37K7MSYBPA3SHWXB3TM5FLTOZYQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.847384710 (193h23m47.57865236s) [noise=true , address=104.36.82.3:4793 , piece_id=47HFN7SSBLKV4Q2MTDVFC4GBNIPATKO6LRUOC4G2AW7A4MFAI6GA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.848437041 (193h23m47.579704692s) [noise=true , address=104.36.82.59:4313 , piece_id=J47ZWGLHUN7ECNRGXZZ42Q375WKFHUJN3XLYEGX2CMHC2RUWZJCA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.984012580 (193h23m47.71528023s) [upload=201259]: Next returned nil segment
Aug 16 18:50:06.984029241 (193h23m47.715296871s) [upload=201259]: Waiting for error group managing segments...
Aug 16 18:50:06.996112904 (193h23m47.727380564s) [noise=true , address=104.36.82.14:4230 , piece_id=WTOJ6THOEIOMF72YGNYOKRGYJQJF4FQP4VGDW2QQ2326DGTUSHCQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:06.999695960 (193h23m47.73096362s) [noise=true , address=104.36.82.39:4737 , piece_id=DC7GL4U6VY3SO6KZAXQNAK54AT2WFZBJUZM2WEFWLQKS5ULQJ3UQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.025463880 (193h23m47.756731529s) [noise=true , address=77.90.31.13:4657 , piece_id=3T2AY52BCUCXPSJHCPFDT4MNDY3RJVULG6X52HT4PKY7SJQ464SA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.027404303 (193h23m47.758671953s) [noise=true , address=104.36.82.21:4476 , piece_id=H52MJNGMGSKORKKOPNBMVFOSFCKMCJOBET5NIQFAWZ5JDLTLY4ZQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.031728906 (193h23m47.762996565s) [noise=true , address=77.90.31.14:4681 , piece_id=F2C4U4NYLA5TGZSPC35WB2XH3YVQZNAYYPCGH66IIDLVSX7WZXKQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.032687090 (193h23m47.76395474s) [noise=true , address=104.36.82.59:4313 , piece_id=J47ZWGLHUN7ECNRGXZZ42Q375WKFHUJN3XLYEGX2CMHC2RUWZJCA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.037670705 (193h23m47.768938354s) [noise=true , address=77.90.31.19:4870 , piece_id=76KXS2TZPI5OH3TESKHQNCKO34UP5YPFAQ5EPKB4LKST3PSWNY7Q, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.039026547 (193h23m47.770294198s) [noise=true , address=104.36.82.35:4587 , piece_id=5JFLAGKDPOYPDZFSKF2DJT6EHCPJHQBHGMV3T4RAPKFOXP5YDVYQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.039608773 (193h23m47.770876424s) [noise=true , address=104.36.82.20:4446 , piece_id=ZVIY47XJPM2KPHF6QWJYMGVR25PMANDTI3IGB5TTMW3QAT6NDPVQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.052389308 (193h23m47.783656959s) [noise=true , address=104.36.82.7:4933 , piece_id=GERLHPHJEVE5AVHI5VM4TCEDJC7PAAFHYAHPTETVC5NBMWTSFAFQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.052813196 (193h23m47.784080856s) [noise=true , address=104.36.82.37:4657 , piece_id=DOCMOQXG2TIS3MHSMBHQNEKZFUSXLKENOQXGWLQRYEYFD2OBJ2LA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.067727990 (193h23m47.79899564s) [noise=true , address=45.91.116.10:4100 , piece_id=JMZXTBLEKC5X6I3T2P4XX32GGIXSH6IW4QCKFZFLTM5JQEBMLECQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.077757915 (193h23m47.809025565s) [noise=true , address=104.36.82.34:4565 , piece_id=NPK7GSWSZWGHSUSETZCCOLVYUK6QE7RCZ5COSLSQ5UJ543W67MGQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.088885418 (193h23m47.820153067s) [noise=true , address=104.36.82.3:4793 , piece_id=47HFN7SSBLKV4Q2MTDVFC4GBNIPATKO6LRUOC4G2AW7A4MFAI6GA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.088946764 (193h23m47.820214414s) [seg_pos={0 0}, upload=201259]: Segment reached optimal threshold of 14 pieces.
Aug 16 18:50:07.089255815 (193h23m47.820523475s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2F5PRGNYWIKKROX5EVNMCDUPJZPIOFJBN35YXEH4H5BKINRJKPQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sJfMr1nMTpizd5PZ2bZ6M8tZWhFL2ukdJ3cNSRQtdUHNJhg81): protocol: expected piece hash; context canceled; EOF
Aug 16 18:50:07.089271314 (193h23m47.820538974s) [noise=true , address=104.36.82.23:4447 , piece_id=H2XVFVY64HORCHUCFXZUQM7H4EWXQPV6YENXX7EEOOMCZTW4N6CA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fqT9xA7kXTG8K9XwTUxL6FXibV35AkPHDK6grKGHg17fk91fP): protocol: write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection; write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection
Aug 16 18:50:07.089329323 (193h23m47.820596973s) [noise=true , address=77.90.31.10:4521 , piece_id=DJ2ZHTVZZ7SPBYTO2WH2BMDPS37K7MSYBPA3SHWXB3TM5FLTOZYQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WpVJa7SXkANKParDWYrC1cN8aLHTkUSPrRJGKQ6fvA5oDEkoa): protocol: write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection; write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection
Aug 16 18:50:07.089440162 (193h23m47.820707812s) [noise=true , address=45.91.116.5:4321 , piece_id=R4V5GAA7COM6Z2FAH7REIIDOMB7EJ2HUJHAWRWVNJRJV5WREPUSQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12m3Lw8yL9wVq38nW514iaLooMVgikbQBGA9vrFsr66jx5w1xXj): protocol: write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection; write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection
Aug 16 18:50:07.089461401 (193h23m47.820729052s) [seg_pos={0 0}, upload=201259]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 18:50:07.089583131 (193h23m47.820850791s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 18:50:07.089622546 (193h23m47.820890196s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 18:50:07.183064911 (193h23m47.914332561s) [upload=201259]: Done uploading segments...
Aug 16 18:50:07.183080390 (193h23m47.91434804s) [upload=201259]: Upload finished. err: <nil>
Duration: 885.81168ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....................X...........X...........................] duration:
441.409993ms
FAIL (2025-08-16 18:52:26 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 18:30:20.656629884 (193h4m1.387897535s) [upload=200914]: Starting upload Aug 16 18:30:20.656698023 (193h4m1.387965672s) [upload=200914]: Done starting upload Aug 16 18:30:20.656779016 (193h4m1.388046665s) [upload=200914]: Uploading segments... Aug 16 18:30:20.656835431 (193h4m1.388103081s) [upload=200914]: Got next segment. Inline: true Aug 16 18:30:20.656842083 (193h4m1.388109744s) [upload=200914]: Waiting for error group managing segments... Aug 16 18:30:20.656913488 (193h4m1.388181139s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 18:30:20.656919560 (193h4m1.38818721s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 18:30:20.656923327 (193h4m1.388190977s) [upload=200914]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 18:30:20.659031257 (193h4m1.390298906s) [upload=200914]: Done uploading segments... Aug 16 18:30:20.659043129 (193h4m1.390310778s) [upload=200914]: Upload finished. err: metaclient: Too Many Requests
Duration: 441.432415ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [......X............................X......X.............X...] duration:
724.265076ms
FAIL (2025-08-16 18:52:08 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 18:50:06.795231389 (193h23m47.52649904s) [upload=201259]: Starting upload
Aug 16 18:50:06.795294448 (193h23m47.526562098s) [upload=201259]: Done starting upload
Aug 16 18:50:06.795449339 (193h23m47.526716989s) [upload=201259]: Uploading segments...
Aug 16 18:50:06.795693649 (193h23m47.5269613s) [upload=201259]: Got next segment. Inline: false
Aug 16 18:50:06.795759203 (193h23m47.527026853s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 18:50:06.795765165 (193h23m47.527032824s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 18:50:06.841060252 (193h23m47.572327901s) [seg_pos={0 0}, upload=201259]: Begin upload segment...
Aug 16 18:50:06.841119362 (193h23m47.572387012s) [seg_pos={0 0}, upload=201259]: Done begin upload segment.
Aug 16 18:50:06.841151233 (193h23m47.572418883s) [noise=true , address=104.36.82.35:4587 , piece_id=5JFLAGKDPOYPDZFSKF2DJT6EHCPJHQBHGMV3T4RAPKFOXP5YDVYQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841184625 (193h23m47.572452276s) [noise=true , address=104.36.82.34:4565 , piece_id=NPK7GSWSZWGHSUSETZCCOLVYUK6QE7RCZ5COSLSQ5UJ543W67MGQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841723480 (193h23m47.57299114s) [noise=true , address=104.36.82.20:4446 , piece_id=ZVIY47XJPM2KPHF6QWJYMGVR25PMANDTI3IGB5TTMW3QAT6NDPVQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.841804182 (193h23m47.573071831s) [noise=true , address=104.36.82.39:4737 , piece_id=DC7GL4U6VY3SO6KZAXQNAK54AT2WFZBJUZM2WEFWLQKS5ULQJ3UQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.842218111 (193h23m47.573485761s) [noise=true , address=77.90.31.19:4870 , piece_id=76KXS2TZPI5OH3TESKHQNCKO34UP5YPFAQ5EPKB4LKST3PSWNY7Q, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.842347224 (193h23m47.573614874s) [noise=true , address=77.90.31.13:4657 , piece_id=3T2AY52BCUCXPSJHCPFDT4MNDY3RJVULG6X52HT4PKY7SJQ464SA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.843304817 (193h23m47.574572467s) [noise=true , address=104.36.82.37:4657 , piece_id=DOCMOQXG2TIS3MHSMBHQNEKZFUSXLKENOQXGWLQRYEYFD2OBJ2LA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.843418962 (193h23m47.574686612s) [noise=true , address=104.36.82.21:4476 , piece_id=H52MJNGMGSKORKKOPNBMVFOSFCKMCJOBET5NIQFAWZ5JDLTLY4ZQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844011178 (193h23m47.575278828s) [noise=true , address=45.91.116.5:4321 , piece_id=R4V5GAA7COM6Z2FAH7REIIDOMB7EJ2HUJHAWRWVNJRJV5WREPUSQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844142576 (193h23m47.575410225s) [noise=true , address=104.36.82.7:4933 , piece_id=GERLHPHJEVE5AVHI5VM4TCEDJC7PAAFHYAHPTETVC5NBMWTSFAFQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.844882007 (193h23m47.576149657s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2F5PRGNYWIKKROX5EVNMCDUPJZPIOFJBN35YXEH4H5BKINRJKPQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.845386287 (193h23m47.576653947s) [noise=true , address=77.90.31.14:4681 , piece_id=F2C4U4NYLA5TGZSPC35WB2XH3YVQZNAYYPCGH66IIDLVSX7WZXKQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.845864367 (193h23m47.577132018s) [noise=true , address=45.91.116.10:4100 , piece_id=JMZXTBLEKC5X6I3T2P4XX32GGIXSH6IW4QCKFZFLTM5JQEBMLECQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.846491107 (193h23m47.577758757s) [noise=true , address=104.36.82.23:4447 , piece_id=H2XVFVY64HORCHUCFXZUQM7H4EWXQPV6YENXX7EEOOMCZTW4N6CA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.846703747 (193h23m47.577971408s) [noise=true , address=104.36.82.14:4230 , piece_id=WTOJ6THOEIOMF72YGNYOKRGYJQJF4FQP4VGDW2QQ2326DGTUSHCQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.847183361 (193h23m47.578451012s) [noise=true , address=77.90.31.10:4521 , piece_id=DJ2ZHTVZZ7SPBYTO2WH2BMDPS37K7MSYBPA3SHWXB3TM5FLTOZYQ, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.847384710 (193h23m47.57865236s) [noise=true , address=104.36.82.3:4793 , piece_id=47HFN7SSBLKV4Q2MTDVFC4GBNIPATKO6LRUOC4G2AW7A4MFAI6GA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.848437041 (193h23m47.579704692s) [noise=true , address=104.36.82.59:4313 , piece_id=J47ZWGLHUN7ECNRGXZZ42Q375WKFHUJN3XLYEGX2CMHC2RUWZJCA, seg_pos={0 0}, upload=201259]: Uploading piece...
Aug 16 18:50:06.984012580 (193h23m47.71528023s) [upload=201259]: Next returned nil segment
Aug 16 18:50:06.984029241 (193h23m47.715296871s) [upload=201259]: Waiting for error group managing segments...
Aug 16 18:50:06.996112904 (193h23m47.727380564s) [noise=true , address=104.36.82.14:4230 , piece_id=WTOJ6THOEIOMF72YGNYOKRGYJQJF4FQP4VGDW2QQ2326DGTUSHCQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:06.999695960 (193h23m47.73096362s) [noise=true , address=104.36.82.39:4737 , piece_id=DC7GL4U6VY3SO6KZAXQNAK54AT2WFZBJUZM2WEFWLQKS5ULQJ3UQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.025463880 (193h23m47.756731529s) [noise=true , address=77.90.31.13:4657 , piece_id=3T2AY52BCUCXPSJHCPFDT4MNDY3RJVULG6X52HT4PKY7SJQ464SA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.027404303 (193h23m47.758671953s) [noise=true , address=104.36.82.21:4476 , piece_id=H52MJNGMGSKORKKOPNBMVFOSFCKMCJOBET5NIQFAWZ5JDLTLY4ZQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.031728906 (193h23m47.762996565s) [noise=true , address=77.90.31.14:4681 , piece_id=F2C4U4NYLA5TGZSPC35WB2XH3YVQZNAYYPCGH66IIDLVSX7WZXKQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.032687090 (193h23m47.76395474s) [noise=true , address=104.36.82.59:4313 , piece_id=J47ZWGLHUN7ECNRGXZZ42Q375WKFHUJN3XLYEGX2CMHC2RUWZJCA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.037670705 (193h23m47.768938354s) [noise=true , address=77.90.31.19:4870 , piece_id=76KXS2TZPI5OH3TESKHQNCKO34UP5YPFAQ5EPKB4LKST3PSWNY7Q, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.039026547 (193h23m47.770294198s) [noise=true , address=104.36.82.35:4587 , piece_id=5JFLAGKDPOYPDZFSKF2DJT6EHCPJHQBHGMV3T4RAPKFOXP5YDVYQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.039608773 (193h23m47.770876424s) [noise=true , address=104.36.82.20:4446 , piece_id=ZVIY47XJPM2KPHF6QWJYMGVR25PMANDTI3IGB5TTMW3QAT6NDPVQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.052389308 (193h23m47.783656959s) [noise=true , address=104.36.82.7:4933 , piece_id=GERLHPHJEVE5AVHI5VM4TCEDJC7PAAFHYAHPTETVC5NBMWTSFAFQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.052813196 (193h23m47.784080856s) [noise=true , address=104.36.82.37:4657 , piece_id=DOCMOQXG2TIS3MHSMBHQNEKZFUSXLKENOQXGWLQRYEYFD2OBJ2LA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.067727990 (193h23m47.79899564s) [noise=true , address=45.91.116.10:4100 , piece_id=JMZXTBLEKC5X6I3T2P4XX32GGIXSH6IW4QCKFZFLTM5JQEBMLECQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.077757915 (193h23m47.809025565s) [noise=true , address=104.36.82.34:4565 , piece_id=NPK7GSWSZWGHSUSETZCCOLVYUK6QE7RCZ5COSLSQ5UJ543W67MGQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.088885418 (193h23m47.820153067s) [noise=true , address=104.36.82.3:4793 , piece_id=47HFN7SSBLKV4Q2MTDVFC4GBNIPATKO6LRUOC4G2AW7A4MFAI6GA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: <nil>
Aug 16 18:50:07.088946764 (193h23m47.820214414s) [seg_pos={0 0}, upload=201259]: Segment reached optimal threshold of 14 pieces.
Aug 16 18:50:07.089255815 (193h23m47.820523475s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2F5PRGNYWIKKROX5EVNMCDUPJZPIOFJBN35YXEH4H5BKINRJKPQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sJfMr1nMTpizd5PZ2bZ6M8tZWhFL2ukdJ3cNSRQtdUHNJhg81): protocol: expected piece hash; context canceled; EOF
Aug 16 18:50:07.089271314 (193h23m47.820538974s) [noise=true , address=104.36.82.23:4447 , piece_id=H2XVFVY64HORCHUCFXZUQM7H4EWXQPV6YENXX7EEOOMCZTW4N6CA, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fqT9xA7kXTG8K9XwTUxL6FXibV35AkPHDK6grKGHg17fk91fP): protocol: write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection; write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27942->104.36.82.23:4447: use of closed network connection
Aug 16 18:50:07.089329323 (193h23m47.820596973s) [noise=true , address=77.90.31.10:4521 , piece_id=DJ2ZHTVZZ7SPBYTO2WH2BMDPS37K7MSYBPA3SHWXB3TM5FLTOZYQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WpVJa7SXkANKParDWYrC1cN8aLHTkUSPrRJGKQ6fvA5oDEkoa): protocol: write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection; write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:20060->77.90.31.10:4521: use of closed network connection
Aug 16 18:50:07.089440162 (193h23m47.820707812s) [noise=true , address=45.91.116.5:4321 , piece_id=R4V5GAA7COM6Z2FAH7REIIDOMB7EJ2HUJHAWRWVNJRJV5WREPUSQ, seg_pos={0 0}, upload=201259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12m3Lw8yL9wVq38nW514iaLooMVgikbQBGA9vrFsr66jx5w1xXj): protocol: write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection; write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:64218->45.91.116.5:4321: use of closed network connection
Aug 16 18:50:07.089461401 (193h23m47.820729052s) [seg_pos={0 0}, upload=201259]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 18:50:07.089583131 (193h23m47.820850791s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 18:50:07.089622546 (193h23m47.820890196s) [upload=201259]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 18:50:07.183064911 (193h23m47.914332561s) [upload=201259]: Done uploading segments...
Aug 16 18:50:07.183080390 (193h23m47.91434804s) [upload=201259]: Upload finished. err: <nil>
Duration: 724.284553ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|