Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 225.263157ms FAIL (2025-08-18 16:50:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 16:50:22.455201622 (239h24m3.186469242s) [upload=249033]: Starting upload Aug 18 16:50:22.455242599 (239h24m3.18651022s) [upload=249033]: Done starting upload Aug 18 16:50:22.455297081 (239h24m3.186564711s) [upload=249033]: Uploading segments... Aug 18 16:50:22.455322059 (239h24m3.186589678s) [upload=249033]: Got next segment. Inline: true Aug 18 16:50:22.455325595 (239h24m3.186593225s) [upload=249033]: Waiting for error group managing segments... Aug 18 16:50:22.455355953 (239h24m3.186623583s) [upload=249033]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 18 16:50:22.455359670 (239h24m3.18662729s) [upload=249033]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 18 16:50:22.455362105 (239h24m3.186629725s) [upload=249033]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 18 16:50:22.457793706 (239h24m3.189061346s) [upload=249033]: Done uploading segments... Aug 18 16:50:22.457802943 (239h24m3.189070583s) [upload=249033]: Upload finished. err: metaclient: Too Many Requests Duration:* 225.281351ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 18.387409ms FAIL (2025-08-18 16:50:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 16:50:22.455201622 (239h24m3.186469242s) [upload=249033]: Starting upload Aug 18 16:50:22.455242599 (239h24m3.18651022s) [upload=249033]: Done starting upload Aug 18 16:50:22.455297081 (239h24m3.186564711s) [upload=249033]: Uploading segments... Aug 18 16:50:22.455322059 (239h24m3.186589678s) [upload=249033]: Got next segment. Inline: true Aug 18 16:50:22.455325595 (239h24m3.186593225s) [upload=249033]: Waiting for error group managing segments... Aug 18 16:50:22.455355953 (239h24m3.186623583s) [upload=249033]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 18 16:50:22.455359670 (239h24m3.18662729s) [upload=249033]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 18 16:50:22.455362105 (239h24m3.186629725s) [upload=249033]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 18 16:50:22.457793706 (239h24m3.189061346s) [upload=249033]: Done uploading segments... Aug 18 16:50:22.457802943 (239h24m3.189070583s) [upload=249033]: Upload finished. err: metaclient: Too Many Requests Duration:* 18.455156ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [................................X.....X.....................] duration: 545.855917ms FAIL (2025-08-18 16:49:59 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 64d462567c51af6d9b624cb5865bdffa7555db7b90aeb23b7ae4479d50eac861 != before 6eecad395d421d06136f3311231a1e2d3e8557f8f901305f1593d024374e727a ======LOGS====== Aug 18 16:34:22.214255888 (239h8m2.945523538s) [upload=248756]: Starting upload Aug 18 16:34:22.214353812 (239h8m2.945621442s) [upload=248756]: Done starting upload Aug 18 16:34:22.214418823 (239h8m2.945686444s) [upload=248756]: Uploading segments... Aug 18 16:34:22.214783459 (239h8m2.94605108s) [upload=248756]: Got next segment. Inline: false Aug 18 16:34:22.214826430 (239h8m2.94609405s) [upload=248756]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 18 16:34:22.214831279 (239h8m2.946098899s) [upload=248756]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 18 16:34:22.655597428 (239h8m3.386865058s) [seg_pos={0 0}, upload=248756]: Begin upload segment... Aug 18 16:34:22.655630331 (239h8m3.386897961s) [seg_pos={0 0}, upload=248756]: Done begin upload segment. Aug 18 16:34:22.655648695 (239h8m3.386916325s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.655780432 (239h8m3.387048082s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.655951924 (239h8m3.387219554s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656245847 (239h8m3.387513477s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656483063 (239h8m3.387750683s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656499674 (239h8m3.387767334s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656750867 (239h8m3.388018487s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657064396 (239h8m3.388332016s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657243713 (239h8m3.388511373s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657298286 (239h8m3.388565906s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657514422 (239h8m3.388782052s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657712585 (239h8m3.388980235s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657749464 (239h8m3.389017084s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.658276746 (239h8m3.389544406s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.658837279 (239h8m3.390104939s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.659238013 (239h8m3.390505673s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.659679072 (239h8m3.390946722s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.660362657 (239h8m3.391630307s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.762984030 (239h8m3.494251649s) [upload=248756]: Next returned nil segment Aug 18 16:34:22.762996874 (239h8m3.494264494s) [upload=248756]: Waiting for error group managing segments... Aug 18 16:34:22.775602041 (239h8m3.506869731s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.791843445 (239h8m3.523111094s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.794626666 (239h8m3.525894317s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.809984199 (239h8m3.541251848s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.815346168 (239h8m3.546613818s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.818382807 (239h8m3.549650467s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.819568395 (239h8m3.550836046s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.823155579 (239h8m3.55442323s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.825292287 (239h8m3.556559947s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.826512009 (239h8m3.55777966s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.831395270 (239h8m3.56266292s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.840636022 (239h8m3.571903672s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.876979697 (239h8m3.608247347s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.886970178 (239h8m3.618237828s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.887033958 (239h8m3.618301607s) [seg_pos={0 0}, upload=248756]: Segment reached optimal threshold of 14 pieces. Aug 18 16:34:22.887338350 (239h8m3.618606001s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rFuJ2JyBGWtaASJNnTdHoeKUY1mCfDYfJ74BkxK64U9it8FKF): protocol: expected piece hash; context canceled; EOF Aug 18 16:34:22.887452555 (239h8m3.618720204s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y3X8z9oBzPFDeM4psz1KBtFTcJQS4STc4xiL2N2V8sCEcDDKX): protocol: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection Aug 18 16:34:22.887488632 (239h8m3.618756283s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WKWWwa3svATpoNY1z7LNvYmA8gA6ZFpJsk17G4c37tDJVJ2wj): protocol: expected piece hash; context canceled; EOF Aug 18 16:34:22.887608057 (239h8m3.618875708s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rNaUSswWJWd1zWAbTyLWe8XJYKwfsCm1afjXMeCfWyaF85h96): protocol: read tcp 5.161.89.252:15398->79.127.205.235:4681: use of closed network connection; conn closed: op Aug 18 16:34:22.887639025 (239h8m3.618906675s) [seg_pos={0 0}, upload=248756]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 18 16:34:22.887721931 (239h8m3.618989571s) [upload=248756]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 18 16:34:22.887727010 (239h8m3.618994651s) [upload=248756]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 18 16:34:23.404302198 (239h8m4.135569848s) [upload=248756]: Done uploading segments... Aug 18 16:34:23.404321905 (239h8m4.135589555s) [upload=248756]: Upload finished. err: <nil> Duration: 545.882838ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.................................X.....X....................] duration: 442.636729ms FAIL (2025-08-18 16:48:58 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 64d462567c51af6d9b624cb5865bdffa7555db7b90aeb23b7ae4479d50eac861 != before 6eecad395d421d06136f3311231a1e2d3e8557f8f901305f1593d024374e727a ======LOGS====== Aug 18 16:34:22.214255888 (239h8m2.945523538s) [upload=248756]: Starting upload Aug 18 16:34:22.214353812 (239h8m2.945621442s) [upload=248756]: Done starting upload Aug 18 16:34:22.214418823 (239h8m2.945686444s) [upload=248756]: Uploading segments... Aug 18 16:34:22.214783459 (239h8m2.94605108s) [upload=248756]: Got next segment. Inline: false Aug 18 16:34:22.214826430 (239h8m2.94609405s) [upload=248756]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 18 16:34:22.214831279 (239h8m2.946098899s) [upload=248756]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 18 16:34:22.655597428 (239h8m3.386865058s) [seg_pos={0 0}, upload=248756]: Begin upload segment... Aug 18 16:34:22.655630331 (239h8m3.386897961s) [seg_pos={0 0}, upload=248756]: Done begin upload segment. Aug 18 16:34:22.655648695 (239h8m3.386916325s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.655780432 (239h8m3.387048082s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.655951924 (239h8m3.387219554s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656245847 (239h8m3.387513477s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656483063 (239h8m3.387750683s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656499674 (239h8m3.387767334s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656750867 (239h8m3.388018487s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657064396 (239h8m3.388332016s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657243713 (239h8m3.388511373s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657298286 (239h8m3.388565906s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657514422 (239h8m3.388782052s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657712585 (239h8m3.388980235s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657749464 (239h8m3.389017084s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.658276746 (239h8m3.389544406s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.658837279 (239h8m3.390104939s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.659238013 (239h8m3.390505673s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.659679072 (239h8m3.390946722s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.660362657 (239h8m3.391630307s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.762984030 (239h8m3.494251649s) [upload=248756]: Next returned nil segment Aug 18 16:34:22.762996874 (239h8m3.494264494s) [upload=248756]: Waiting for error group managing segments... Aug 18 16:34:22.775602041 (239h8m3.506869731s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.791843445 (239h8m3.523111094s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.794626666 (239h8m3.525894317s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.809984199 (239h8m3.541251848s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.815346168 (239h8m3.546613818s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.818382807 (239h8m3.549650467s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.819568395 (239h8m3.550836046s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.823155579 (239h8m3.55442323s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.825292287 (239h8m3.556559947s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.826512009 (239h8m3.55777966s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.831395270 (239h8m3.56266292s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.840636022 (239h8m3.571903672s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.876979697 (239h8m3.608247347s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.886970178 (239h8m3.618237828s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.887033958 (239h8m3.618301607s) [seg_pos={0 0}, upload=248756]: Segment reached optimal threshold of 14 pieces. Aug 18 16:34:22.887338350 (239h8m3.618606001s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rFuJ2JyBGWtaASJNnTdHoeKUY1mCfDYfJ74BkxK64U9it8FKF): protocol: expected piece hash; context canceled; EOF Aug 18 16:34:22.887452555 (239h8m3.618720204s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y3X8z9oBzPFDeM4psz1KBtFTcJQS4STc4xiL2N2V8sCEcDDKX): protocol: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection Aug 18 16:34:22.887488632 (239h8m3.618756283s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WKWWwa3svATpoNY1z7LNvYmA8gA6ZFpJsk17G4c37tDJVJ2wj): protocol: expected piece hash; context canceled; EOF Aug 18 16:34:22.887608057 (239h8m3.618875708s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rNaUSswWJWd1zWAbTyLWe8XJYKwfsCm1afjXMeCfWyaF85h96): protocol: read tcp 5.161.89.252:15398->79.127.205.235:4681: use of closed network connection; conn closed: op Aug 18 16:34:22.887639025 (239h8m3.618906675s) [seg_pos={0 0}, upload=248756]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 18 16:34:22.887721931 (239h8m3.618989571s) [upload=248756]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 18 16:34:22.887727010 (239h8m3.618994651s) [upload=248756]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 18 16:34:23.404302198 (239h8m4.135569848s) [upload=248756]: Done uploading segments... Aug 18 16:34:23.404321905 (239h8m4.135589555s) [upload=248756]: Upload finished. err: <nil> Duration: 442.660704ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 158.866456ms FAIL (2025-08-18 16:48:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 16:06:50.203260394 (238h40m30.934528045s) [upload=248286]: Starting upload Aug 18 16:06:50.203323703 (238h40m30.934591354s) [upload=248286]: Done starting upload Aug 18 16:06:50.203388015 (238h40m30.934655665s) [upload=248286]: Uploading segments... Aug 18 16:06:50.203469207 (238h40m30.934736857s) [upload=248286]: Got next segment. Inline: true Aug 18 16:06:50.203476631 (238h40m30.934744281s) [upload=248286]: Waiting for error group managing segments... Aug 18 16:06:50.203524050 (238h40m30.9347917s) [upload=248286]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 18 16:06:50.203530112 (238h40m30.934797761s) [upload=248286]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 18 16:06:50.203534039 (238h40m30.934801689s) [upload=248286]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 18 16:06:50.219212762 (238h40m30.950480423s) [upload=248286]: Done uploading segments... Aug 18 16:06:50.219227430 (238h40m30.95049509s) [upload=248286]: Upload finished. err: metaclient: Too Many Requests Duration:* 158.888558ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................................X.....X...................] duration: 608.647819ms FAIL (2025-08-18 16:48:15 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 64d462567c51af6d9b624cb5865bdffa7555db7b90aeb23b7ae4479d50eac861 != before 6eecad395d421d06136f3311231a1e2d3e8557f8f901305f1593d024374e727a ======LOGS====== Aug 18 16:34:22.214255888 (239h8m2.945523538s) [upload=248756]: Starting upload Aug 18 16:34:22.214353812 (239h8m2.945621442s) [upload=248756]: Done starting upload Aug 18 16:34:22.214418823 (239h8m2.945686444s) [upload=248756]: Uploading segments... Aug 18 16:34:22.214783459 (239h8m2.94605108s) [upload=248756]: Got next segment. Inline: false Aug 18 16:34:22.214826430 (239h8m2.94609405s) [upload=248756]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 18 16:34:22.214831279 (239h8m2.946098899s) [upload=248756]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 18 16:34:22.655597428 (239h8m3.386865058s) [seg_pos={0 0}, upload=248756]: Begin upload segment... Aug 18 16:34:22.655630331 (239h8m3.386897961s) [seg_pos={0 0}, upload=248756]: Done begin upload segment. Aug 18 16:34:22.655648695 (239h8m3.386916325s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.655780432 (239h8m3.387048082s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.655951924 (239h8m3.387219554s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656245847 (239h8m3.387513477s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656483063 (239h8m3.387750683s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656499674 (239h8m3.387767334s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656750867 (239h8m3.388018487s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657064396 (239h8m3.388332016s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657243713 (239h8m3.388511373s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657298286 (239h8m3.388565906s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657514422 (239h8m3.388782052s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657712585 (239h8m3.388980235s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657749464 (239h8m3.389017084s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.658276746 (239h8m3.389544406s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.658837279 (239h8m3.390104939s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.659238013 (239h8m3.390505673s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.659679072 (239h8m3.390946722s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.660362657 (239h8m3.391630307s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.762984030 (239h8m3.494251649s) [upload=248756]: Next returned nil segment Aug 18 16:34:22.762996874 (239h8m3.494264494s) [upload=248756]: Waiting for error group managing segments... Aug 18 16:34:22.775602041 (239h8m3.506869731s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.791843445 (239h8m3.523111094s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.794626666 (239h8m3.525894317s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.809984199 (239h8m3.541251848s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.815346168 (239h8m3.546613818s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.818382807 (239h8m3.549650467s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.819568395 (239h8m3.550836046s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.823155579 (239h8m3.55442323s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.825292287 (239h8m3.556559947s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.826512009 (239h8m3.55777966s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.831395270 (239h8m3.56266292s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.840636022 (239h8m3.571903672s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.876979697 (239h8m3.608247347s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.886970178 (239h8m3.618237828s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.887033958 (239h8m3.618301607s) [seg_pos={0 0}, upload=248756]: Segment reached optimal threshold of 14 pieces. Aug 18 16:34:22.887338350 (239h8m3.618606001s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rFuJ2JyBGWtaASJNnTdHoeKUY1mCfDYfJ74BkxK64U9it8FKF): protocol: expected piece hash; context canceled; EOF Aug 18 16:34:22.887452555 (239h8m3.618720204s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y3X8z9oBzPFDeM4psz1KBtFTcJQS4STc4xiL2N2V8sCEcDDKX): protocol: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection Aug 18 16:34:22.887488632 (239h8m3.618756283s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WKWWwa3svATpoNY1z7LNvYmA8gA6ZFpJsk17G4c37tDJVJ2wj): protocol: expected piece hash; context canceled; EOF Aug 18 16:34:22.887608057 (239h8m3.618875708s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rNaUSswWJWd1zWAbTyLWe8XJYKwfsCm1afjXMeCfWyaF85h96): protocol: read tcp 5.161.89.252:15398->79.127.205.235:4681: use of closed network connection; conn closed: op Aug 18 16:34:22.887639025 (239h8m3.618906675s) [seg_pos={0 0}, upload=248756]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 18 16:34:22.887721931 (239h8m3.618989571s) [upload=248756]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 18 16:34:22.887727010 (239h8m3.618994651s) [upload=248756]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 18 16:34:23.404302198 (239h8m4.135569848s) [upload=248756]: Done uploading segments... Aug 18 16:34:23.404321905 (239h8m4.135589555s) [upload=248756]: Upload finished. err: <nil> Duration: 608.670882ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...................................X.....X..................] duration: 853.999142ms FAIL (2025-08-18 16:47:48 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 64d462567c51af6d9b624cb5865bdffa7555db7b90aeb23b7ae4479d50eac861 != before 6eecad395d421d06136f3311231a1e2d3e8557f8f901305f1593d024374e727a ======LOGS====== Aug 18 16:34:22.214255888 (239h8m2.945523538s) [upload=248756]: Starting upload Aug 18 16:34:22.214353812 (239h8m2.945621442s) [upload=248756]: Done starting upload Aug 18 16:34:22.214418823 (239h8m2.945686444s) [upload=248756]: Uploading segments... Aug 18 16:34:22.214783459 (239h8m2.94605108s) [upload=248756]: Got next segment. Inline: false Aug 18 16:34:22.214826430 (239h8m2.94609405s) [upload=248756]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 18 16:34:22.214831279 (239h8m2.946098899s) [upload=248756]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 18 16:34:22.655597428 (239h8m3.386865058s) [seg_pos={0 0}, upload=248756]: Begin upload segment... Aug 18 16:34:22.655630331 (239h8m3.386897961s) [seg_pos={0 0}, upload=248756]: Done begin upload segment. Aug 18 16:34:22.655648695 (239h8m3.386916325s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.655780432 (239h8m3.387048082s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.655951924 (239h8m3.387219554s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656245847 (239h8m3.387513477s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656483063 (239h8m3.387750683s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656499674 (239h8m3.387767334s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656750867 (239h8m3.388018487s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657064396 (239h8m3.388332016s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657243713 (239h8m3.388511373s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657298286 (239h8m3.388565906s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657514422 (239h8m3.388782052s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657712585 (239h8m3.388980235s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657749464 (239h8m3.389017084s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.658276746 (239h8m3.389544406s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.658837279 (239h8m3.390104939s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.659238013 (239h8m3.390505673s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.659679072 (239h8m3.390946722s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.660362657 (239h8m3.391630307s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.762984030 (239h8m3.494251649s) [upload=248756]: Next returned nil segment Aug 18 16:34:22.762996874 (239h8m3.494264494s) [upload=248756]: Waiting for error group managing segments... Aug 18 16:34:22.775602041 (239h8m3.506869731s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.791843445 (239h8m3.523111094s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.794626666 (239h8m3.525894317s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.809984199 (239h8m3.541251848s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.815346168 (239h8m3.546613818s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.818382807 (239h8m3.549650467s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.819568395 (239h8m3.550836046s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.823155579 (239h8m3.55442323s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.825292287 (239h8m3.556559947s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.826512009 (239h8m3.55777966s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.831395270 (239h8m3.56266292s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.840636022 (239h8m3.571903672s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.876979697 (239h8m3.608247347s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.886970178 (239h8m3.618237828s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.887033958 (239h8m3.618301607s) [seg_pos={0 0}, upload=248756]: Segment reached optimal threshold of 14 pieces. Aug 18 16:34:22.887338350 (239h8m3.618606001s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rFuJ2JyBGWtaASJNnTdHoeKUY1mCfDYfJ74BkxK64U9it8FKF): protocol: expected piece hash; context canceled; EOF Aug 18 16:34:22.887452555 (239h8m3.618720204s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y3X8z9oBzPFDeM4psz1KBtFTcJQS4STc4xiL2N2V8sCEcDDKX): protocol: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection Aug 18 16:34:22.887488632 (239h8m3.618756283s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WKWWwa3svATpoNY1z7LNvYmA8gA6ZFpJsk17G4c37tDJVJ2wj): protocol: expected piece hash; context canceled; EOF Aug 18 16:34:22.887608057 (239h8m3.618875708s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rNaUSswWJWd1zWAbTyLWe8XJYKwfsCm1afjXMeCfWyaF85h96): protocol: read tcp 5.161.89.252:15398->79.127.205.235:4681: use of closed network connection; conn closed: op Aug 18 16:34:22.887639025 (239h8m3.618906675s) [seg_pos={0 0}, upload=248756]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 18 16:34:22.887721931 (239h8m3.618989571s) [upload=248756]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 18 16:34:22.887727010 (239h8m3.618994651s) [upload=248756]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 18 16:34:23.404302198 (239h8m4.135569848s) [upload=248756]: Done uploading segments... Aug 18 16:34:23.404321905 (239h8m4.135589555s) [upload=248756]: Upload finished. err: <nil> Duration: 854.021965ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 393.276367ms FAIL (2025-08-18 16:47:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 16:06:50.203260394 (238h40m30.934528045s) [upload=248286]: Starting upload Aug 18 16:06:50.203323703 (238h40m30.934591354s) [upload=248286]: Done starting upload Aug 18 16:06:50.203388015 (238h40m30.934655665s) [upload=248286]: Uploading segments... Aug 18 16:06:50.203469207 (238h40m30.934736857s) [upload=248286]: Got next segment. Inline: true Aug 18 16:06:50.203476631 (238h40m30.934744281s) [upload=248286]: Waiting for error group managing segments... Aug 18 16:06:50.203524050 (238h40m30.9347917s) [upload=248286]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 18 16:06:50.203530112 (238h40m30.934797761s) [upload=248286]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 18 16:06:50.203534039 (238h40m30.934801689s) [upload=248286]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 18 16:06:50.219212762 (238h40m30.950480423s) [upload=248286]: Done uploading segments... Aug 18 16:06:50.219227430 (238h40m30.95049509s) [upload=248286]: Upload finished. err: metaclient: Too Many Requests Duration:* 393.308688ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 280.298424ms FAIL (2025-08-18 16:47:21 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 16:06:50.203260394 (238h40m30.934528045s) [upload=248286]: Starting upload Aug 18 16:06:50.203323703 (238h40m30.934591354s) [upload=248286]: Done starting upload Aug 18 16:06:50.203388015 (238h40m30.934655665s) [upload=248286]: Uploading segments... Aug 18 16:06:50.203469207 (238h40m30.934736857s) [upload=248286]: Got next segment. Inline: true Aug 18 16:06:50.203476631 (238h40m30.934744281s) [upload=248286]: Waiting for error group managing segments... Aug 18 16:06:50.203524050 (238h40m30.9347917s) [upload=248286]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 18 16:06:50.203530112 (238h40m30.934797761s) [upload=248286]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 18 16:06:50.203534039 (238h40m30.934801689s) [upload=248286]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 18 16:06:50.219212762 (238h40m30.950480423s) [upload=248286]: Done uploading segments... Aug 18 16:06:50.219227430 (238h40m30.95049509s) [upload=248286]: Upload finished. err: metaclient: Too Many Requests Duration:* 280.325956ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [....................................X.....X.................] duration: 491.503801ms FAIL (2025-08-18 16:47:11 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 64d462567c51af6d9b624cb5865bdffa7555db7b90aeb23b7ae4479d50eac861 != before 6eecad395d421d06136f3311231a1e2d3e8557f8f901305f1593d024374e727a ======LOGS====== Aug 18 16:34:22.214255888 (239h8m2.945523538s) [upload=248756]: Starting upload Aug 18 16:34:22.214353812 (239h8m2.945621442s) [upload=248756]: Done starting upload Aug 18 16:34:22.214418823 (239h8m2.945686444s) [upload=248756]: Uploading segments... Aug 18 16:34:22.214783459 (239h8m2.94605108s) [upload=248756]: Got next segment. Inline: false Aug 18 16:34:22.214826430 (239h8m2.94609405s) [upload=248756]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 18 16:34:22.214831279 (239h8m2.946098899s) [upload=248756]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 18 16:34:22.655597428 (239h8m3.386865058s) [seg_pos={0 0}, upload=248756]: Begin upload segment... Aug 18 16:34:22.655630331 (239h8m3.386897961s) [seg_pos={0 0}, upload=248756]: Done begin upload segment. Aug 18 16:34:22.655648695 (239h8m3.386916325s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.655780432 (239h8m3.387048082s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.655951924 (239h8m3.387219554s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656245847 (239h8m3.387513477s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656483063 (239h8m3.387750683s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656499674 (239h8m3.387767334s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656750867 (239h8m3.388018487s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657064396 (239h8m3.388332016s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657243713 (239h8m3.388511373s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657298286 (239h8m3.388565906s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657514422 (239h8m3.388782052s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657712585 (239h8m3.388980235s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657749464 (239h8m3.389017084s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.658276746 (239h8m3.389544406s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.658837279 (239h8m3.390104939s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.659238013 (239h8m3.390505673s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.659679072 (239h8m3.390946722s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.660362657 (239h8m3.391630307s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.762984030 (239h8m3.494251649s) [upload=248756]: Next returned nil segment Aug 18 16:34:22.762996874 (239h8m3.494264494s) [upload=248756]: Waiting for error group managing segments... Aug 18 16:34:22.775602041 (239h8m3.506869731s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.791843445 (239h8m3.523111094s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.794626666 (239h8m3.525894317s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.809984199 (239h8m3.541251848s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.815346168 (239h8m3.546613818s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.818382807 (239h8m3.549650467s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.819568395 (239h8m3.550836046s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.823155579 (239h8m3.55442323s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.825292287 (239h8m3.556559947s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.826512009 (239h8m3.55777966s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.831395270 (239h8m3.56266292s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.840636022 (239h8m3.571903672s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.876979697 (239h8m3.608247347s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.886970178 (239h8m3.618237828s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.887033958 (239h8m3.618301607s) [seg_pos={0 0}, upload=248756]: Segment reached optimal threshold of 14 pieces. Aug 18 16:34:22.887338350 (239h8m3.618606001s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rFuJ2JyBGWtaASJNnTdHoeKUY1mCfDYfJ74BkxK64U9it8FKF): protocol: expected piece hash; context canceled; EOF Aug 18 16:34:22.887452555 (239h8m3.618720204s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y3X8z9oBzPFDeM4psz1KBtFTcJQS4STc4xiL2N2V8sCEcDDKX): protocol: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection Aug 18 16:34:22.887488632 (239h8m3.618756283s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WKWWwa3svATpoNY1z7LNvYmA8gA6ZFpJsk17G4c37tDJVJ2wj): protocol: expected piece hash; context canceled; EOF Aug 18 16:34:22.887608057 (239h8m3.618875708s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rNaUSswWJWd1zWAbTyLWe8XJYKwfsCm1afjXMeCfWyaF85h96): protocol: read tcp 5.161.89.252:15398->79.127.205.235:4681: use of closed network connection; conn closed: op Aug 18 16:34:22.887639025 (239h8m3.618906675s) [seg_pos={0 0}, upload=248756]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 18 16:34:22.887721931 (239h8m3.618989571s) [upload=248756]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 18 16:34:22.887727010 (239h8m3.618994651s) [upload=248756]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 18 16:34:23.404302198 (239h8m4.135569848s) [upload=248756]: Done uploading segments... Aug 18 16:34:23.404321905 (239h8m4.135589555s) [upload=248756]: Upload finished. err: <nil> Duration: 491.52434ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 170.239498ms FAIL (2025-08-18 16:46:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 16:06:50.203260394 (238h40m30.934528045s) [upload=248286]: Starting upload Aug 18 16:06:50.203323703 (238h40m30.934591354s) [upload=248286]: Done starting upload Aug 18 16:06:50.203388015 (238h40m30.934655665s) [upload=248286]: Uploading segments... Aug 18 16:06:50.203469207 (238h40m30.934736857s) [upload=248286]: Got next segment. Inline: true Aug 18 16:06:50.203476631 (238h40m30.934744281s) [upload=248286]: Waiting for error group managing segments... Aug 18 16:06:50.203524050 (238h40m30.9347917s) [upload=248286]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 18 16:06:50.203530112 (238h40m30.934797761s) [upload=248286]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 18 16:06:50.203534039 (238h40m30.934801689s) [upload=248286]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 18 16:06:50.219212762 (238h40m30.950480423s) [upload=248286]: Done uploading segments... Aug 18 16:06:50.219227430 (238h40m30.95049509s) [upload=248286]: Upload finished. err: metaclient: Too Many Requests Duration:* 170.259425ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 214.540337ms FAIL (2025-08-18 16:46:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 16:06:50.203260394 (238h40m30.934528045s) [upload=248286]: Starting upload Aug 18 16:06:50.203323703 (238h40m30.934591354s) [upload=248286]: Done starting upload Aug 18 16:06:50.203388015 (238h40m30.934655665s) [upload=248286]: Uploading segments... Aug 18 16:06:50.203469207 (238h40m30.934736857s) [upload=248286]: Got next segment. Inline: true Aug 18 16:06:50.203476631 (238h40m30.934744281s) [upload=248286]: Waiting for error group managing segments... Aug 18 16:06:50.203524050 (238h40m30.9347917s) [upload=248286]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 18 16:06:50.203530112 (238h40m30.934797761s) [upload=248286]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 18 16:06:50.203534039 (238h40m30.934801689s) [upload=248286]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 18 16:06:50.219212762 (238h40m30.950480423s) [upload=248286]: Done uploading segments... Aug 18 16:06:50.219227430 (238h40m30.95049509s) [upload=248286]: Upload finished. err: metaclient: Too Many Requests Duration:* 214.565685ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....................................X.....X................] duration: 688.987001ms FAIL (2025-08-18 16:46:12 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 64d462567c51af6d9b624cb5865bdffa7555db7b90aeb23b7ae4479d50eac861 != before 6eecad395d421d06136f3311231a1e2d3e8557f8f901305f1593d024374e727a ======LOGS====== Aug 18 16:34:22.214255888 (239h8m2.945523538s) [upload=248756]: Starting upload Aug 18 16:34:22.214353812 (239h8m2.945621442s) [upload=248756]: Done starting upload Aug 18 16:34:22.214418823 (239h8m2.945686444s) [upload=248756]: Uploading segments... Aug 18 16:34:22.214783459 (239h8m2.94605108s) [upload=248756]: Got next segment. Inline: false Aug 18 16:34:22.214826430 (239h8m2.94609405s) [upload=248756]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 18 16:34:22.214831279 (239h8m2.946098899s) [upload=248756]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 18 16:34:22.655597428 (239h8m3.386865058s) [seg_pos={0 0}, upload=248756]: Begin upload segment... Aug 18 16:34:22.655630331 (239h8m3.386897961s) [seg_pos={0 0}, upload=248756]: Done begin upload segment. Aug 18 16:34:22.655648695 (239h8m3.386916325s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.655780432 (239h8m3.387048082s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.655951924 (239h8m3.387219554s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656245847 (239h8m3.387513477s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656483063 (239h8m3.387750683s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656499674 (239h8m3.387767334s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656750867 (239h8m3.388018487s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657064396 (239h8m3.388332016s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657243713 (239h8m3.388511373s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657298286 (239h8m3.388565906s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657514422 (239h8m3.388782052s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657712585 (239h8m3.388980235s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657749464 (239h8m3.389017084s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.658276746 (239h8m3.389544406s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.658837279 (239h8m3.390104939s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.659238013 (239h8m3.390505673s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.659679072 (239h8m3.390946722s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.660362657 (239h8m3.391630307s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.762984030 (239h8m3.494251649s) [upload=248756]: Next returned nil segment Aug 18 16:34:22.762996874 (239h8m3.494264494s) [upload=248756]: Waiting for error group managing segments... Aug 18 16:34:22.775602041 (239h8m3.506869731s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.791843445 (239h8m3.523111094s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.794626666 (239h8m3.525894317s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.809984199 (239h8m3.541251848s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.815346168 (239h8m3.546613818s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.818382807 (239h8m3.549650467s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.819568395 (239h8m3.550836046s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.823155579 (239h8m3.55442323s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.825292287 (239h8m3.556559947s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.826512009 (239h8m3.55777966s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.831395270 (239h8m3.56266292s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.840636022 (239h8m3.571903672s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.876979697 (239h8m3.608247347s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.886970178 (239h8m3.618237828s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.887033958 (239h8m3.618301607s) [seg_pos={0 0}, upload=248756]: Segment reached optimal threshold of 14 pieces. Aug 18 16:34:22.887338350 (239h8m3.618606001s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rFuJ2JyBGWtaASJNnTdHoeKUY1mCfDYfJ74BkxK64U9it8FKF): protocol: expected piece hash; context canceled; EOF Aug 18 16:34:22.887452555 (239h8m3.618720204s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y3X8z9oBzPFDeM4psz1KBtFTcJQS4STc4xiL2N2V8sCEcDDKX): protocol: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection Aug 18 16:34:22.887488632 (239h8m3.618756283s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WKWWwa3svATpoNY1z7LNvYmA8gA6ZFpJsk17G4c37tDJVJ2wj): protocol: expected piece hash; context canceled; EOF Aug 18 16:34:22.887608057 (239h8m3.618875708s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rNaUSswWJWd1zWAbTyLWe8XJYKwfsCm1afjXMeCfWyaF85h96): protocol: read tcp 5.161.89.252:15398->79.127.205.235:4681: use of closed network connection; conn closed: op Aug 18 16:34:22.887639025 (239h8m3.618906675s) [seg_pos={0 0}, upload=248756]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 18 16:34:22.887721931 (239h8m3.618989571s) [upload=248756]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 18 16:34:22.887727010 (239h8m3.618994651s) [upload=248756]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 18 16:34:23.404302198 (239h8m4.135569848s) [upload=248756]: Done uploading segments... Aug 18 16:34:23.404321905 (239h8m4.135589555s) [upload=248756]: Upload finished. err: <nil> Duration: 689.036424ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [......................................X.....X...............] duration: 438.544794ms FAIL (2025-08-18 16:45:38 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 64d462567c51af6d9b624cb5865bdffa7555db7b90aeb23b7ae4479d50eac861 != before 6eecad395d421d06136f3311231a1e2d3e8557f8f901305f1593d024374e727a ======LOGS====== Aug 18 16:34:22.214255888 (239h8m2.945523538s) [upload=248756]: Starting upload Aug 18 16:34:22.214353812 (239h8m2.945621442s) [upload=248756]: Done starting upload Aug 18 16:34:22.214418823 (239h8m2.945686444s) [upload=248756]: Uploading segments... Aug 18 16:34:22.214783459 (239h8m2.94605108s) [upload=248756]: Got next segment. Inline: false Aug 18 16:34:22.214826430 (239h8m2.94609405s) [upload=248756]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 18 16:34:22.214831279 (239h8m2.946098899s) [upload=248756]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 18 16:34:22.655597428 (239h8m3.386865058s) [seg_pos={0 0}, upload=248756]: Begin upload segment... Aug 18 16:34:22.655630331 (239h8m3.386897961s) [seg_pos={0 0}, upload=248756]: Done begin upload segment. Aug 18 16:34:22.655648695 (239h8m3.386916325s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.655780432 (239h8m3.387048082s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.655951924 (239h8m3.387219554s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656245847 (239h8m3.387513477s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656483063 (239h8m3.387750683s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656499674 (239h8m3.387767334s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656750867 (239h8m3.388018487s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657064396 (239h8m3.388332016s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657243713 (239h8m3.388511373s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657298286 (239h8m3.388565906s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657514422 (239h8m3.388782052s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657712585 (239h8m3.388980235s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657749464 (239h8m3.389017084s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.658276746 (239h8m3.389544406s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.658837279 (239h8m3.390104939s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.659238013 (239h8m3.390505673s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.659679072 (239h8m3.390946722s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.660362657 (239h8m3.391630307s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.762984030 (239h8m3.494251649s) [upload=248756]: Next returned nil segment Aug 18 16:34:22.762996874 (239h8m3.494264494s) [upload=248756]: Waiting for error group managing segments... Aug 18 16:34:22.775602041 (239h8m3.506869731s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.791843445 (239h8m3.523111094s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.794626666 (239h8m3.525894317s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.809984199 (239h8m3.541251848s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.815346168 (239h8m3.546613818s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.818382807 (239h8m3.549650467s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.819568395 (239h8m3.550836046s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.823155579 (239h8m3.55442323s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.825292287 (239h8m3.556559947s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.826512009 (239h8m3.55777966s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.831395270 (239h8m3.56266292s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.840636022 (239h8m3.571903672s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.876979697 (239h8m3.608247347s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.886970178 (239h8m3.618237828s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.887033958 (239h8m3.618301607s) [seg_pos={0 0}, upload=248756]: Segment reached optimal threshold of 14 pieces. Aug 18 16:34:22.887338350 (239h8m3.618606001s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rFuJ2JyBGWtaASJNnTdHoeKUY1mCfDYfJ74BkxK64U9it8FKF): protocol: expected piece hash; context canceled; EOF Aug 18 16:34:22.887452555 (239h8m3.618720204s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y3X8z9oBzPFDeM4psz1KBtFTcJQS4STc4xiL2N2V8sCEcDDKX): protocol: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection Aug 18 16:34:22.887488632 (239h8m3.618756283s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WKWWwa3svATpoNY1z7LNvYmA8gA6ZFpJsk17G4c37tDJVJ2wj): protocol: expected piece hash; context canceled; EOF Aug 18 16:34:22.887608057 (239h8m3.618875708s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rNaUSswWJWd1zWAbTyLWe8XJYKwfsCm1afjXMeCfWyaF85h96): protocol: read tcp 5.161.89.252:15398->79.127.205.235:4681: use of closed network connection; conn closed: op Aug 18 16:34:22.887639025 (239h8m3.618906675s) [seg_pos={0 0}, upload=248756]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 18 16:34:22.887721931 (239h8m3.618989571s) [upload=248756]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 18 16:34:22.887727010 (239h8m3.618994651s) [upload=248756]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 18 16:34:23.404302198 (239h8m4.135569848s) [upload=248756]: Done uploading segments... Aug 18 16:34:23.404321905 (239h8m4.135589555s) [upload=248756]: Upload finished. err: <nil> Duration: 438.5642ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 198.3147ms FAIL (2025-08-18 16:45:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 16:06:50.203260394 (238h40m30.934528045s) [upload=248286]: Starting upload Aug 18 16:06:50.203323703 (238h40m30.934591354s) [upload=248286]: Done starting upload Aug 18 16:06:50.203388015 (238h40m30.934655665s) [upload=248286]: Uploading segments... Aug 18 16:06:50.203469207 (238h40m30.934736857s) [upload=248286]: Got next segment. Inline: true Aug 18 16:06:50.203476631 (238h40m30.934744281s) [upload=248286]: Waiting for error group managing segments... Aug 18 16:06:50.203524050 (238h40m30.9347917s) [upload=248286]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 18 16:06:50.203530112 (238h40m30.934797761s) [upload=248286]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 18 16:06:50.203534039 (238h40m30.934801689s) [upload=248286]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 18 16:06:50.219212762 (238h40m30.950480423s) [upload=248286]: Done uploading segments... Aug 18 16:06:50.219227430 (238h40m30.95049509s) [upload=248286]: Upload finished. err: metaclient: Too Many Requests Duration:* 198.334477ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......................................X.....X..............] duration: 709.295071ms FAIL (2025-08-18 16:45:09 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 64d462567c51af6d9b624cb5865bdffa7555db7b90aeb23b7ae4479d50eac861 != before 6eecad395d421d06136f3311231a1e2d3e8557f8f901305f1593d024374e727a ======LOGS====== Aug 18 16:34:22.214255888 (239h8m2.945523538s) [upload=248756]: Starting upload Aug 18 16:34:22.214353812 (239h8m2.945621442s) [upload=248756]: Done starting upload Aug 18 16:34:22.214418823 (239h8m2.945686444s) [upload=248756]: Uploading segments... Aug 18 16:34:22.214783459 (239h8m2.94605108s) [upload=248756]: Got next segment. Inline: false Aug 18 16:34:22.214826430 (239h8m2.94609405s) [upload=248756]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 18 16:34:22.214831279 (239h8m2.946098899s) [upload=248756]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 18 16:34:22.655597428 (239h8m3.386865058s) [seg_pos={0 0}, upload=248756]: Begin upload segment... Aug 18 16:34:22.655630331 (239h8m3.386897961s) [seg_pos={0 0}, upload=248756]: Done begin upload segment. Aug 18 16:34:22.655648695 (239h8m3.386916325s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.655780432 (239h8m3.387048082s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.655951924 (239h8m3.387219554s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656245847 (239h8m3.387513477s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656483063 (239h8m3.387750683s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656499674 (239h8m3.387767334s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656750867 (239h8m3.388018487s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657064396 (239h8m3.388332016s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657243713 (239h8m3.388511373s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657298286 (239h8m3.388565906s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657514422 (239h8m3.388782052s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657712585 (239h8m3.388980235s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657749464 (239h8m3.389017084s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.658276746 (239h8m3.389544406s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.658837279 (239h8m3.390104939s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.659238013 (239h8m3.390505673s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.659679072 (239h8m3.390946722s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.660362657 (239h8m3.391630307s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.762984030 (239h8m3.494251649s) [upload=248756]: Next returned nil segment Aug 18 16:34:22.762996874 (239h8m3.494264494s) [upload=248756]: Waiting for error group managing segments... Aug 18 16:34:22.775602041 (239h8m3.506869731s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.791843445 (239h8m3.523111094s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.794626666 (239h8m3.525894317s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.809984199 (239h8m3.541251848s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.815346168 (239h8m3.546613818s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.818382807 (239h8m3.549650467s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.819568395 (239h8m3.550836046s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.823155579 (239h8m3.55442323s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.825292287 (239h8m3.556559947s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.826512009 (239h8m3.55777966s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.831395270 (239h8m3.56266292s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.840636022 (239h8m3.571903672s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.876979697 (239h8m3.608247347s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.886970178 (239h8m3.618237828s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.887033958 (239h8m3.618301607s) [seg_pos={0 0}, upload=248756]: Segment reached optimal threshold of 14 pieces. Aug 18 16:34:22.887338350 (239h8m3.618606001s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rFuJ2JyBGWtaASJNnTdHoeKUY1mCfDYfJ74BkxK64U9it8FKF): protocol: expected piece hash; context canceled; EOF Aug 18 16:34:22.887452555 (239h8m3.618720204s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y3X8z9oBzPFDeM4psz1KBtFTcJQS4STc4xiL2N2V8sCEcDDKX): protocol: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection Aug 18 16:34:22.887488632 (239h8m3.618756283s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WKWWwa3svATpoNY1z7LNvYmA8gA6ZFpJsk17G4c37tDJVJ2wj): protocol: expected piece hash; context canceled; EOF Aug 18 16:34:22.887608057 (239h8m3.618875708s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rNaUSswWJWd1zWAbTyLWe8XJYKwfsCm1afjXMeCfWyaF85h96): protocol: read tcp 5.161.89.252:15398->79.127.205.235:4681: use of closed network connection; conn closed: op Aug 18 16:34:22.887639025 (239h8m3.618906675s) [seg_pos={0 0}, upload=248756]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 18 16:34:22.887721931 (239h8m3.618989571s) [upload=248756]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 18 16:34:22.887727010 (239h8m3.618994651s) [upload=248756]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 18 16:34:23.404302198 (239h8m4.135569848s) [upload=248756]: Done uploading segments... Aug 18 16:34:23.404321905 (239h8m4.135589555s) [upload=248756]: Upload finished. err: <nil> Duration: 709.315479ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [........................................X.....X.............] duration: 778.139222ms FAIL (2025-08-18 16:44:38 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 64d462567c51af6d9b624cb5865bdffa7555db7b90aeb23b7ae4479d50eac861 != before 6eecad395d421d06136f3311231a1e2d3e8557f8f901305f1593d024374e727a ======LOGS====== Aug 18 16:34:22.214255888 (239h8m2.945523538s) [upload=248756]: Starting upload Aug 18 16:34:22.214353812 (239h8m2.945621442s) [upload=248756]: Done starting upload Aug 18 16:34:22.214418823 (239h8m2.945686444s) [upload=248756]: Uploading segments... Aug 18 16:34:22.214783459 (239h8m2.94605108s) [upload=248756]: Got next segment. Inline: false Aug 18 16:34:22.214826430 (239h8m2.94609405s) [upload=248756]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 18 16:34:22.214831279 (239h8m2.946098899s) [upload=248756]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 18 16:34:22.655597428 (239h8m3.386865058s) [seg_pos={0 0}, upload=248756]: Begin upload segment... Aug 18 16:34:22.655630331 (239h8m3.386897961s) [seg_pos={0 0}, upload=248756]: Done begin upload segment. Aug 18 16:34:22.655648695 (239h8m3.386916325s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.655780432 (239h8m3.387048082s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.655951924 (239h8m3.387219554s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656245847 (239h8m3.387513477s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656483063 (239h8m3.387750683s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656499674 (239h8m3.387767334s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656750867 (239h8m3.388018487s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657064396 (239h8m3.388332016s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657243713 (239h8m3.388511373s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657298286 (239h8m3.388565906s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657514422 (239h8m3.388782052s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657712585 (239h8m3.388980235s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657749464 (239h8m3.389017084s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.658276746 (239h8m3.389544406s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.658837279 (239h8m3.390104939s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.659238013 (239h8m3.390505673s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.659679072 (239h8m3.390946722s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.660362657 (239h8m3.391630307s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.762984030 (239h8m3.494251649s) [upload=248756]: Next returned nil segment Aug 18 16:34:22.762996874 (239h8m3.494264494s) [upload=248756]: Waiting for error group managing segments... Aug 18 16:34:22.775602041 (239h8m3.506869731s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.791843445 (239h8m3.523111094s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.794626666 (239h8m3.525894317s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.809984199 (239h8m3.541251848s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.815346168 (239h8m3.546613818s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.818382807 (239h8m3.549650467s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.819568395 (239h8m3.550836046s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.823155579 (239h8m3.55442323s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.825292287 (239h8m3.556559947s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.826512009 (239h8m3.55777966s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.831395270 (239h8m3.56266292s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.840636022 (239h8m3.571903672s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.876979697 (239h8m3.608247347s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.886970178 (239h8m3.618237828s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.887033958 (239h8m3.618301607s) [seg_pos={0 0}, upload=248756]: Segment reached optimal threshold of 14 pieces. Aug 18 16:34:22.887338350 (239h8m3.618606001s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rFuJ2JyBGWtaASJNnTdHoeKUY1mCfDYfJ74BkxK64U9it8FKF): protocol: expected piece hash; context canceled; EOF Aug 18 16:34:22.887452555 (239h8m3.618720204s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y3X8z9oBzPFDeM4psz1KBtFTcJQS4STc4xiL2N2V8sCEcDDKX): protocol: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection Aug 18 16:34:22.887488632 (239h8m3.618756283s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WKWWwa3svATpoNY1z7LNvYmA8gA6ZFpJsk17G4c37tDJVJ2wj): protocol: expected piece hash; context canceled; EOF Aug 18 16:34:22.887608057 (239h8m3.618875708s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rNaUSswWJWd1zWAbTyLWe8XJYKwfsCm1afjXMeCfWyaF85h96): protocol: read tcp 5.161.89.252:15398->79.127.205.235:4681: use of closed network connection; conn closed: op Aug 18 16:34:22.887639025 (239h8m3.618906675s) [seg_pos={0 0}, upload=248756]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 18 16:34:22.887721931 (239h8m3.618989571s) [upload=248756]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 18 16:34:22.887727010 (239h8m3.618994651s) [upload=248756]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 18 16:34:23.404302198 (239h8m4.135569848s) [upload=248756]: Done uploading segments... Aug 18 16:34:23.404321905 (239h8m4.135589555s) [upload=248756]: Upload finished. err: <nil> Duration: 778.154661ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 582.806014ms FAIL (2025-08-18 16:44:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 16:06:50.203260394 (238h40m30.934528045s) [upload=248286]: Starting upload Aug 18 16:06:50.203323703 (238h40m30.934591354s) [upload=248286]: Done starting upload Aug 18 16:06:50.203388015 (238h40m30.934655665s) [upload=248286]: Uploading segments... Aug 18 16:06:50.203469207 (238h40m30.934736857s) [upload=248286]: Got next segment. Inline: true Aug 18 16:06:50.203476631 (238h40m30.934744281s) [upload=248286]: Waiting for error group managing segments... Aug 18 16:06:50.203524050 (238h40m30.9347917s) [upload=248286]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 18 16:06:50.203530112 (238h40m30.934797761s) [upload=248286]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 18 16:06:50.203534039 (238h40m30.934801689s) [upload=248286]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 18 16:06:50.219212762 (238h40m30.950480423s) [upload=248286]: Done uploading segments... Aug 18 16:06:50.219227430 (238h40m30.95049509s) [upload=248286]: Upload finished. err: metaclient: Too Many Requests Duration:* 582.865726ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........................................X.....X............] duration: 402.503195ms FAIL (2025-08-18 16:43:48 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 64d462567c51af6d9b624cb5865bdffa7555db7b90aeb23b7ae4479d50eac861 != before 6eecad395d421d06136f3311231a1e2d3e8557f8f901305f1593d024374e727a ======LOGS====== Aug 18 16:34:22.214255888 (239h8m2.945523538s) [upload=248756]: Starting upload Aug 18 16:34:22.214353812 (239h8m2.945621442s) [upload=248756]: Done starting upload Aug 18 16:34:22.214418823 (239h8m2.945686444s) [upload=248756]: Uploading segments... Aug 18 16:34:22.214783459 (239h8m2.94605108s) [upload=248756]: Got next segment. Inline: false Aug 18 16:34:22.214826430 (239h8m2.94609405s) [upload=248756]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 18 16:34:22.214831279 (239h8m2.946098899s) [upload=248756]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 18 16:34:22.655597428 (239h8m3.386865058s) [seg_pos={0 0}, upload=248756]: Begin upload segment... Aug 18 16:34:22.655630331 (239h8m3.386897961s) [seg_pos={0 0}, upload=248756]: Done begin upload segment. Aug 18 16:34:22.655648695 (239h8m3.386916325s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.655780432 (239h8m3.387048082s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.655951924 (239h8m3.387219554s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656245847 (239h8m3.387513477s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656483063 (239h8m3.387750683s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656499674 (239h8m3.387767334s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656750867 (239h8m3.388018487s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657064396 (239h8m3.388332016s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657243713 (239h8m3.388511373s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657298286 (239h8m3.388565906s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657514422 (239h8m3.388782052s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657712585 (239h8m3.388980235s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657749464 (239h8m3.389017084s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.658276746 (239h8m3.389544406s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.658837279 (239h8m3.390104939s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.659238013 (239h8m3.390505673s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.659679072 (239h8m3.390946722s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.660362657 (239h8m3.391630307s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.762984030 (239h8m3.494251649s) [upload=248756]: Next returned nil segment Aug 18 16:34:22.762996874 (239h8m3.494264494s) [upload=248756]: Waiting for error group managing segments... Aug 18 16:34:22.775602041 (239h8m3.506869731s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.791843445 (239h8m3.523111094s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.794626666 (239h8m3.525894317s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.809984199 (239h8m3.541251848s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.815346168 (239h8m3.546613818s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.818382807 (239h8m3.549650467s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.819568395 (239h8m3.550836046s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.823155579 (239h8m3.55442323s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.825292287 (239h8m3.556559947s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.826512009 (239h8m3.55777966s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.831395270 (239h8m3.56266292s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.840636022 (239h8m3.571903672s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.876979697 (239h8m3.608247347s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.886970178 (239h8m3.618237828s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.887033958 (239h8m3.618301607s) [seg_pos={0 0}, upload=248756]: Segment reached optimal threshold of 14 pieces. Aug 18 16:34:22.887338350 (239h8m3.618606001s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rFuJ2JyBGWtaASJNnTdHoeKUY1mCfDYfJ74BkxK64U9it8FKF): protocol: expected piece hash; context canceled; EOF Aug 18 16:34:22.887452555 (239h8m3.618720204s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y3X8z9oBzPFDeM4psz1KBtFTcJQS4STc4xiL2N2V8sCEcDDKX): protocol: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection Aug 18 16:34:22.887488632 (239h8m3.618756283s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WKWWwa3svATpoNY1z7LNvYmA8gA6ZFpJsk17G4c37tDJVJ2wj): protocol: expected piece hash; context canceled; EOF Aug 18 16:34:22.887608057 (239h8m3.618875708s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rNaUSswWJWd1zWAbTyLWe8XJYKwfsCm1afjXMeCfWyaF85h96): protocol: read tcp 5.161.89.252:15398->79.127.205.235:4681: use of closed network connection; conn closed: op Aug 18 16:34:22.887639025 (239h8m3.618906675s) [seg_pos={0 0}, upload=248756]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 18 16:34:22.887721931 (239h8m3.618989571s) [upload=248756]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 18 16:34:22.887727010 (239h8m3.618994651s) [upload=248756]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 18 16:34:23.404302198 (239h8m4.135569848s) [upload=248756]: Done uploading segments... Aug 18 16:34:23.404321905 (239h8m4.135589555s) [upload=248756]: Upload finished. err: <nil> Duration: 402.52192ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 244.800538ms FAIL (2025-08-18 16:43:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 16:06:50.203260394 (238h40m30.934528045s) [upload=248286]: Starting upload Aug 18 16:06:50.203323703 (238h40m30.934591354s) [upload=248286]: Done starting upload Aug 18 16:06:50.203388015 (238h40m30.934655665s) [upload=248286]: Uploading segments... Aug 18 16:06:50.203469207 (238h40m30.934736857s) [upload=248286]: Got next segment. Inline: true Aug 18 16:06:50.203476631 (238h40m30.934744281s) [upload=248286]: Waiting for error group managing segments... Aug 18 16:06:50.203524050 (238h40m30.9347917s) [upload=248286]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 18 16:06:50.203530112 (238h40m30.934797761s) [upload=248286]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 18 16:06:50.203534039 (238h40m30.934801689s) [upload=248286]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 18 16:06:50.219212762 (238h40m30.950480423s) [upload=248286]: Done uploading segments... Aug 18 16:06:50.219227430 (238h40m30.95049509s) [upload=248286]: Upload finished. err: metaclient: Too Many Requests Duration:* 244.817931ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 1.558810821s FAIL (2025-08-18 16:43:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 16:06:50.203260394 (238h40m30.934528045s) [upload=248286]: Starting upload Aug 18 16:06:50.203323703 (238h40m30.934591354s) [upload=248286]: Done starting upload Aug 18 16:06:50.203388015 (238h40m30.934655665s) [upload=248286]: Uploading segments... Aug 18 16:06:50.203469207 (238h40m30.934736857s) [upload=248286]: Got next segment. Inline: true Aug 18 16:06:50.203476631 (238h40m30.934744281s) [upload=248286]: Waiting for error group managing segments... Aug 18 16:06:50.203524050 (238h40m30.9347917s) [upload=248286]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 18 16:06:50.203530112 (238h40m30.934797761s) [upload=248286]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 18 16:06:50.203534039 (238h40m30.934801689s) [upload=248286]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 18 16:06:50.219212762 (238h40m30.950480423s) [upload=248286]: Done uploading segments... Aug 18 16:06:50.219227430 (238h40m30.95049509s) [upload=248286]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.558839395s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........................................X.....X...........] duration: 647.305433ms FAIL (2025-08-18 16:43:00 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 64d462567c51af6d9b624cb5865bdffa7555db7b90aeb23b7ae4479d50eac861 != before 6eecad395d421d06136f3311231a1e2d3e8557f8f901305f1593d024374e727a ======LOGS====== Aug 18 16:34:22.214255888 (239h8m2.945523538s) [upload=248756]: Starting upload Aug 18 16:34:22.214353812 (239h8m2.945621442s) [upload=248756]: Done starting upload Aug 18 16:34:22.214418823 (239h8m2.945686444s) [upload=248756]: Uploading segments... Aug 18 16:34:22.214783459 (239h8m2.94605108s) [upload=248756]: Got next segment. Inline: false Aug 18 16:34:22.214826430 (239h8m2.94609405s) [upload=248756]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 18 16:34:22.214831279 (239h8m2.946098899s) [upload=248756]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 18 16:34:22.655597428 (239h8m3.386865058s) [seg_pos={0 0}, upload=248756]: Begin upload segment... Aug 18 16:34:22.655630331 (239h8m3.386897961s) [seg_pos={0 0}, upload=248756]: Done begin upload segment. Aug 18 16:34:22.655648695 (239h8m3.386916325s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.655780432 (239h8m3.387048082s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.655951924 (239h8m3.387219554s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656245847 (239h8m3.387513477s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656483063 (239h8m3.387750683s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656499674 (239h8m3.387767334s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656750867 (239h8m3.388018487s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657064396 (239h8m3.388332016s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657243713 (239h8m3.388511373s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657298286 (239h8m3.388565906s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657514422 (239h8m3.388782052s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657712585 (239h8m3.388980235s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657749464 (239h8m3.389017084s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.658276746 (239h8m3.389544406s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.658837279 (239h8m3.390104939s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.659238013 (239h8m3.390505673s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.659679072 (239h8m3.390946722s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.660362657 (239h8m3.391630307s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.762984030 (239h8m3.494251649s) [upload=248756]: Next returned nil segment Aug 18 16:34:22.762996874 (239h8m3.494264494s) [upload=248756]: Waiting for error group managing segments... Aug 18 16:34:22.775602041 (239h8m3.506869731s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.791843445 (239h8m3.523111094s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.794626666 (239h8m3.525894317s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.809984199 (239h8m3.541251848s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.815346168 (239h8m3.546613818s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.818382807 (239h8m3.549650467s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.819568395 (239h8m3.550836046s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.823155579 (239h8m3.55442323s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.825292287 (239h8m3.556559947s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.826512009 (239h8m3.55777966s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.831395270 (239h8m3.56266292s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.840636022 (239h8m3.571903672s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.876979697 (239h8m3.608247347s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.886970178 (239h8m3.618237828s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.887033958 (239h8m3.618301607s) [seg_pos={0 0}, upload=248756]: Segment reached optimal threshold of 14 pieces. Aug 18 16:34:22.887338350 (239h8m3.618606001s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rFuJ2JyBGWtaASJNnTdHoeKUY1mCfDYfJ74BkxK64U9it8FKF): protocol: expected piece hash; context canceled; EOF Aug 18 16:34:22.887452555 (239h8m3.618720204s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y3X8z9oBzPFDeM4psz1KBtFTcJQS4STc4xiL2N2V8sCEcDDKX): protocol: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection Aug 18 16:34:22.887488632 (239h8m3.618756283s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WKWWwa3svATpoNY1z7LNvYmA8gA6ZFpJsk17G4c37tDJVJ2wj): protocol: expected piece hash; context canceled; EOF Aug 18 16:34:22.887608057 (239h8m3.618875708s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rNaUSswWJWd1zWAbTyLWe8XJYKwfsCm1afjXMeCfWyaF85h96): protocol: read tcp 5.161.89.252:15398->79.127.205.235:4681: use of closed network connection; conn closed: op Aug 18 16:34:22.887639025 (239h8m3.618906675s) [seg_pos={0 0}, upload=248756]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 18 16:34:22.887721931 (239h8m3.618989571s) [upload=248756]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 18 16:34:22.887727010 (239h8m3.618994651s) [upload=248756]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 18 16:34:23.404302198 (239h8m4.135569848s) [upload=248756]: Done uploading segments... Aug 18 16:34:23.404321905 (239h8m4.135589555s) [upload=248756]: Upload finished. err: <nil> Duration: 647.329188ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...........................................X.....X..........] duration: 497.786304ms FAIL (2025-08-18 16:42:14 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 64d462567c51af6d9b624cb5865bdffa7555db7b90aeb23b7ae4479d50eac861 != before 6eecad395d421d06136f3311231a1e2d3e8557f8f901305f1593d024374e727a ======LOGS====== Aug 18 16:34:22.214255888 (239h8m2.945523538s) [upload=248756]: Starting upload Aug 18 16:34:22.214353812 (239h8m2.945621442s) [upload=248756]: Done starting upload Aug 18 16:34:22.214418823 (239h8m2.945686444s) [upload=248756]: Uploading segments... Aug 18 16:34:22.214783459 (239h8m2.94605108s) [upload=248756]: Got next segment. Inline: false Aug 18 16:34:22.214826430 (239h8m2.94609405s) [upload=248756]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 18 16:34:22.214831279 (239h8m2.946098899s) [upload=248756]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 18 16:34:22.655597428 (239h8m3.386865058s) [seg_pos={0 0}, upload=248756]: Begin upload segment... Aug 18 16:34:22.655630331 (239h8m3.386897961s) [seg_pos={0 0}, upload=248756]: Done begin upload segment. Aug 18 16:34:22.655648695 (239h8m3.386916325s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.655780432 (239h8m3.387048082s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.655951924 (239h8m3.387219554s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656245847 (239h8m3.387513477s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656483063 (239h8m3.387750683s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656499674 (239h8m3.387767334s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656750867 (239h8m3.388018487s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657064396 (239h8m3.388332016s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657243713 (239h8m3.388511373s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657298286 (239h8m3.388565906s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657514422 (239h8m3.388782052s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657712585 (239h8m3.388980235s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657749464 (239h8m3.389017084s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.658276746 (239h8m3.389544406s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.658837279 (239h8m3.390104939s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.659238013 (239h8m3.390505673s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.659679072 (239h8m3.390946722s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.660362657 (239h8m3.391630307s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.762984030 (239h8m3.494251649s) [upload=248756]: Next returned nil segment Aug 18 16:34:22.762996874 (239h8m3.494264494s) [upload=248756]: Waiting for error group managing segments... Aug 18 16:34:22.775602041 (239h8m3.506869731s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.791843445 (239h8m3.523111094s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.794626666 (239h8m3.525894317s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.809984199 (239h8m3.541251848s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.815346168 (239h8m3.546613818s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.818382807 (239h8m3.549650467s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.819568395 (239h8m3.550836046s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.823155579 (239h8m3.55442323s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.825292287 (239h8m3.556559947s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.826512009 (239h8m3.55777966s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.831395270 (239h8m3.56266292s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.840636022 (239h8m3.571903672s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.876979697 (239h8m3.608247347s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.886970178 (239h8m3.618237828s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.887033958 (239h8m3.618301607s) [seg_pos={0 0}, upload=248756]: Segment reached optimal threshold of 14 pieces. Aug 18 16:34:22.887338350 (239h8m3.618606001s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rFuJ2JyBGWtaASJNnTdHoeKUY1mCfDYfJ74BkxK64U9it8FKF): protocol: expected piece hash; context canceled; EOF Aug 18 16:34:22.887452555 (239h8m3.618720204s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y3X8z9oBzPFDeM4psz1KBtFTcJQS4STc4xiL2N2V8sCEcDDKX): protocol: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection Aug 18 16:34:22.887488632 (239h8m3.618756283s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WKWWwa3svATpoNY1z7LNvYmA8gA6ZFpJsk17G4c37tDJVJ2wj): protocol: expected piece hash; context canceled; EOF Aug 18 16:34:22.887608057 (239h8m3.618875708s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rNaUSswWJWd1zWAbTyLWe8XJYKwfsCm1afjXMeCfWyaF85h96): protocol: read tcp 5.161.89.252:15398->79.127.205.235:4681: use of closed network connection; conn closed: op Aug 18 16:34:22.887639025 (239h8m3.618906675s) [seg_pos={0 0}, upload=248756]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 18 16:34:22.887721931 (239h8m3.618989571s) [upload=248756]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 18 16:34:22.887727010 (239h8m3.618994651s) [upload=248756]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 18 16:34:23.404302198 (239h8m4.135569848s) [upload=248756]: Done uploading segments... Aug 18 16:34:23.404321905 (239h8m4.135589555s) [upload=248756]: Upload finished. err: <nil> Duration: 497.810259ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 1.063614263s FAIL (2025-08-18 16:41:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 16:06:50.203260394 (238h40m30.934528045s) [upload=248286]: Starting upload Aug 18 16:06:50.203323703 (238h40m30.934591354s) [upload=248286]: Done starting upload Aug 18 16:06:50.203388015 (238h40m30.934655665s) [upload=248286]: Uploading segments... Aug 18 16:06:50.203469207 (238h40m30.934736857s) [upload=248286]: Got next segment. Inline: true Aug 18 16:06:50.203476631 (238h40m30.934744281s) [upload=248286]: Waiting for error group managing segments... Aug 18 16:06:50.203524050 (238h40m30.9347917s) [upload=248286]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 18 16:06:50.203530112 (238h40m30.934797761s) [upload=248286]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 18 16:06:50.203534039 (238h40m30.934801689s) [upload=248286]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 18 16:06:50.219212762 (238h40m30.950480423s) [upload=248286]: Done uploading segments... Aug 18 16:06:50.219227430 (238h40m30.95049509s) [upload=248286]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.063632728s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [............................................X.....X.........] duration: 633.233919ms FAIL (2025-08-18 16:41:13 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 64d462567c51af6d9b624cb5865bdffa7555db7b90aeb23b7ae4479d50eac861 != before 6eecad395d421d06136f3311231a1e2d3e8557f8f901305f1593d024374e727a ======LOGS====== Aug 18 16:34:22.214255888 (239h8m2.945523538s) [upload=248756]: Starting upload Aug 18 16:34:22.214353812 (239h8m2.945621442s) [upload=248756]: Done starting upload Aug 18 16:34:22.214418823 (239h8m2.945686444s) [upload=248756]: Uploading segments... Aug 18 16:34:22.214783459 (239h8m2.94605108s) [upload=248756]: Got next segment. Inline: false Aug 18 16:34:22.214826430 (239h8m2.94609405s) [upload=248756]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 18 16:34:22.214831279 (239h8m2.946098899s) [upload=248756]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 18 16:34:22.655597428 (239h8m3.386865058s) [seg_pos={0 0}, upload=248756]: Begin upload segment... Aug 18 16:34:22.655630331 (239h8m3.386897961s) [seg_pos={0 0}, upload=248756]: Done begin upload segment. Aug 18 16:34:22.655648695 (239h8m3.386916325s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.655780432 (239h8m3.387048082s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.655951924 (239h8m3.387219554s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656245847 (239h8m3.387513477s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656483063 (239h8m3.387750683s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656499674 (239h8m3.387767334s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656750867 (239h8m3.388018487s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657064396 (239h8m3.388332016s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657243713 (239h8m3.388511373s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657298286 (239h8m3.388565906s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657514422 (239h8m3.388782052s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657712585 (239h8m3.388980235s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657749464 (239h8m3.389017084s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.658276746 (239h8m3.389544406s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.658837279 (239h8m3.390104939s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.659238013 (239h8m3.390505673s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.659679072 (239h8m3.390946722s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.660362657 (239h8m3.391630307s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.762984030 (239h8m3.494251649s) [upload=248756]: Next returned nil segment Aug 18 16:34:22.762996874 (239h8m3.494264494s) [upload=248756]: Waiting for error group managing segments... Aug 18 16:34:22.775602041 (239h8m3.506869731s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.791843445 (239h8m3.523111094s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.794626666 (239h8m3.525894317s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.809984199 (239h8m3.541251848s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.815346168 (239h8m3.546613818s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.818382807 (239h8m3.549650467s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.819568395 (239h8m3.550836046s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.823155579 (239h8m3.55442323s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.825292287 (239h8m3.556559947s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.826512009 (239h8m3.55777966s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.831395270 (239h8m3.56266292s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.840636022 (239h8m3.571903672s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.876979697 (239h8m3.608247347s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.886970178 (239h8m3.618237828s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.887033958 (239h8m3.618301607s) [seg_pos={0 0}, upload=248756]: Segment reached optimal threshold of 14 pieces. Aug 18 16:34:22.887338350 (239h8m3.618606001s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rFuJ2JyBGWtaASJNnTdHoeKUY1mCfDYfJ74BkxK64U9it8FKF): protocol: expected piece hash; context canceled; EOF Aug 18 16:34:22.887452555 (239h8m3.618720204s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y3X8z9oBzPFDeM4psz1KBtFTcJQS4STc4xiL2N2V8sCEcDDKX): protocol: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection Aug 18 16:34:22.887488632 (239h8m3.618756283s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WKWWwa3svATpoNY1z7LNvYmA8gA6ZFpJsk17G4c37tDJVJ2wj): protocol: expected piece hash; context canceled; EOF Aug 18 16:34:22.887608057 (239h8m3.618875708s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rNaUSswWJWd1zWAbTyLWe8XJYKwfsCm1afjXMeCfWyaF85h96): protocol: read tcp 5.161.89.252:15398->79.127.205.235:4681: use of closed network connection; conn closed: op Aug 18 16:34:22.887639025 (239h8m3.618906675s) [seg_pos={0 0}, upload=248756]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 18 16:34:22.887721931 (239h8m3.618989571s) [upload=248756]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 18 16:34:22.887727010 (239h8m3.618994651s) [upload=248756]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 18 16:34:23.404302198 (239h8m4.135569848s) [upload=248756]: Done uploading segments... Aug 18 16:34:23.404321905 (239h8m4.135589555s) [upload=248756]: Upload finished. err: <nil> Duration: 633.262943ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.............................................X.....X........] duration: 571.870437ms FAIL (2025-08-18 16:40:48 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 64d462567c51af6d9b624cb5865bdffa7555db7b90aeb23b7ae4479d50eac861 != before 6eecad395d421d06136f3311231a1e2d3e8557f8f901305f1593d024374e727a ======LOGS====== Aug 18 16:34:22.214255888 (239h8m2.945523538s) [upload=248756]: Starting upload Aug 18 16:34:22.214353812 (239h8m2.945621442s) [upload=248756]: Done starting upload Aug 18 16:34:22.214418823 (239h8m2.945686444s) [upload=248756]: Uploading segments... Aug 18 16:34:22.214783459 (239h8m2.94605108s) [upload=248756]: Got next segment. Inline: false Aug 18 16:34:22.214826430 (239h8m2.94609405s) [upload=248756]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 18 16:34:22.214831279 (239h8m2.946098899s) [upload=248756]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 18 16:34:22.655597428 (239h8m3.386865058s) [seg_pos={0 0}, upload=248756]: Begin upload segment... Aug 18 16:34:22.655630331 (239h8m3.386897961s) [seg_pos={0 0}, upload=248756]: Done begin upload segment. Aug 18 16:34:22.655648695 (239h8m3.386916325s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.655780432 (239h8m3.387048082s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.655951924 (239h8m3.387219554s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656245847 (239h8m3.387513477s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656483063 (239h8m3.387750683s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656499674 (239h8m3.387767334s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656750867 (239h8m3.388018487s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657064396 (239h8m3.388332016s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657243713 (239h8m3.388511373s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657298286 (239h8m3.388565906s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657514422 (239h8m3.388782052s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657712585 (239h8m3.388980235s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657749464 (239h8m3.389017084s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.658276746 (239h8m3.389544406s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.658837279 (239h8m3.390104939s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.659238013 (239h8m3.390505673s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.659679072 (239h8m3.390946722s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.660362657 (239h8m3.391630307s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.762984030 (239h8m3.494251649s) [upload=248756]: Next returned nil segment Aug 18 16:34:22.762996874 (239h8m3.494264494s) [upload=248756]: Waiting for error group managing segments... Aug 18 16:34:22.775602041 (239h8m3.506869731s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.791843445 (239h8m3.523111094s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.794626666 (239h8m3.525894317s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.809984199 (239h8m3.541251848s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.815346168 (239h8m3.546613818s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.818382807 (239h8m3.549650467s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.819568395 (239h8m3.550836046s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.823155579 (239h8m3.55442323s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.825292287 (239h8m3.556559947s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.826512009 (239h8m3.55777966s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.831395270 (239h8m3.56266292s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.840636022 (239h8m3.571903672s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.876979697 (239h8m3.608247347s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.886970178 (239h8m3.618237828s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.887033958 (239h8m3.618301607s) [seg_pos={0 0}, upload=248756]: Segment reached optimal threshold of 14 pieces. Aug 18 16:34:22.887338350 (239h8m3.618606001s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rFuJ2JyBGWtaASJNnTdHoeKUY1mCfDYfJ74BkxK64U9it8FKF): protocol: expected piece hash; context canceled; EOF Aug 18 16:34:22.887452555 (239h8m3.618720204s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y3X8z9oBzPFDeM4psz1KBtFTcJQS4STc4xiL2N2V8sCEcDDKX): protocol: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection Aug 18 16:34:22.887488632 (239h8m3.618756283s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WKWWwa3svATpoNY1z7LNvYmA8gA6ZFpJsk17G4c37tDJVJ2wj): protocol: expected piece hash; context canceled; EOF Aug 18 16:34:22.887608057 (239h8m3.618875708s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rNaUSswWJWd1zWAbTyLWe8XJYKwfsCm1afjXMeCfWyaF85h96): protocol: read tcp 5.161.89.252:15398->79.127.205.235:4681: use of closed network connection; conn closed: op Aug 18 16:34:22.887639025 (239h8m3.618906675s) [seg_pos={0 0}, upload=248756]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 18 16:34:22.887721931 (239h8m3.618989571s) [upload=248756]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 18 16:34:22.887727010 (239h8m3.618994651s) [upload=248756]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 18 16:34:23.404302198 (239h8m4.135569848s) [upload=248756]: Done uploading segments... Aug 18 16:34:23.404321905 (239h8m4.135589555s) [upload=248756]: Upload finished. err: <nil> Duration: 571.892469ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 304.168002ms FAIL (2025-08-18 16:40:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 16:06:50.203260394 (238h40m30.934528045s) [upload=248286]: Starting upload Aug 18 16:06:50.203323703 (238h40m30.934591354s) [upload=248286]: Done starting upload Aug 18 16:06:50.203388015 (238h40m30.934655665s) [upload=248286]: Uploading segments... Aug 18 16:06:50.203469207 (238h40m30.934736857s) [upload=248286]: Got next segment. Inline: true Aug 18 16:06:50.203476631 (238h40m30.934744281s) [upload=248286]: Waiting for error group managing segments... Aug 18 16:06:50.203524050 (238h40m30.9347917s) [upload=248286]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 18 16:06:50.203530112 (238h40m30.934797761s) [upload=248286]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 18 16:06:50.203534039 (238h40m30.934801689s) [upload=248286]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 18 16:06:50.219212762 (238h40m30.950480423s) [upload=248286]: Done uploading segments... Aug 18 16:06:50.219227430 (238h40m30.95049509s) [upload=248286]: Upload finished. err: metaclient: Too Many Requests Duration:* 304.189462ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 192.267673ms FAIL (2025-08-18 16:40:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 16:06:50.203260394 (238h40m30.934528045s) [upload=248286]: Starting upload Aug 18 16:06:50.203323703 (238h40m30.934591354s) [upload=248286]: Done starting upload Aug 18 16:06:50.203388015 (238h40m30.934655665s) [upload=248286]: Uploading segments... Aug 18 16:06:50.203469207 (238h40m30.934736857s) [upload=248286]: Got next segment. Inline: true Aug 18 16:06:50.203476631 (238h40m30.934744281s) [upload=248286]: Waiting for error group managing segments... Aug 18 16:06:50.203524050 (238h40m30.9347917s) [upload=248286]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 18 16:06:50.203530112 (238h40m30.934797761s) [upload=248286]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 18 16:06:50.203534039 (238h40m30.934801689s) [upload=248286]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 18 16:06:50.219212762 (238h40m30.950480423s) [upload=248286]: Done uploading segments... Aug 18 16:06:50.219227430 (238h40m30.95049509s) [upload=248286]: Upload finished. err: metaclient: Too Many Requests Duration:* 192.294875ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..............................................X.....X.......] duration: 487.05586ms FAIL (2025-08-18 16:39:38 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 64d462567c51af6d9b624cb5865bdffa7555db7b90aeb23b7ae4479d50eac861 != before 6eecad395d421d06136f3311231a1e2d3e8557f8f901305f1593d024374e727a ======LOGS====== Aug 18 16:34:22.214255888 (239h8m2.945523538s) [upload=248756]: Starting upload Aug 18 16:34:22.214353812 (239h8m2.945621442s) [upload=248756]: Done starting upload Aug 18 16:34:22.214418823 (239h8m2.945686444s) [upload=248756]: Uploading segments... Aug 18 16:34:22.214783459 (239h8m2.94605108s) [upload=248756]: Got next segment. Inline: false Aug 18 16:34:22.214826430 (239h8m2.94609405s) [upload=248756]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 18 16:34:22.214831279 (239h8m2.946098899s) [upload=248756]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 18 16:34:22.655597428 (239h8m3.386865058s) [seg_pos={0 0}, upload=248756]: Begin upload segment... Aug 18 16:34:22.655630331 (239h8m3.386897961s) [seg_pos={0 0}, upload=248756]: Done begin upload segment. Aug 18 16:34:22.655648695 (239h8m3.386916325s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.655780432 (239h8m3.387048082s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.655951924 (239h8m3.387219554s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656245847 (239h8m3.387513477s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656483063 (239h8m3.387750683s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656499674 (239h8m3.387767334s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656750867 (239h8m3.388018487s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657064396 (239h8m3.388332016s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657243713 (239h8m3.388511373s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657298286 (239h8m3.388565906s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657514422 (239h8m3.388782052s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657712585 (239h8m3.388980235s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657749464 (239h8m3.389017084s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.658276746 (239h8m3.389544406s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.658837279 (239h8m3.390104939s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.659238013 (239h8m3.390505673s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.659679072 (239h8m3.390946722s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.660362657 (239h8m3.391630307s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.762984030 (239h8m3.494251649s) [upload=248756]: Next returned nil segment Aug 18 16:34:22.762996874 (239h8m3.494264494s) [upload=248756]: Waiting for error group managing segments... Aug 18 16:34:22.775602041 (239h8m3.506869731s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.791843445 (239h8m3.523111094s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.794626666 (239h8m3.525894317s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.809984199 (239h8m3.541251848s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.815346168 (239h8m3.546613818s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.818382807 (239h8m3.549650467s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.819568395 (239h8m3.550836046s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.823155579 (239h8m3.55442323s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.825292287 (239h8m3.556559947s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.826512009 (239h8m3.55777966s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.831395270 (239h8m3.56266292s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.840636022 (239h8m3.571903672s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.876979697 (239h8m3.608247347s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.886970178 (239h8m3.618237828s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.887033958 (239h8m3.618301607s) [seg_pos={0 0}, upload=248756]: Segment reached optimal threshold of 14 pieces. Aug 18 16:34:22.887338350 (239h8m3.618606001s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rFuJ2JyBGWtaASJNnTdHoeKUY1mCfDYfJ74BkxK64U9it8FKF): protocol: expected piece hash; context canceled; EOF Aug 18 16:34:22.887452555 (239h8m3.618720204s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y3X8z9oBzPFDeM4psz1KBtFTcJQS4STc4xiL2N2V8sCEcDDKX): protocol: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection Aug 18 16:34:22.887488632 (239h8m3.618756283s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WKWWwa3svATpoNY1z7LNvYmA8gA6ZFpJsk17G4c37tDJVJ2wj): protocol: expected piece hash; context canceled; EOF Aug 18 16:34:22.887608057 (239h8m3.618875708s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rNaUSswWJWd1zWAbTyLWe8XJYKwfsCm1afjXMeCfWyaF85h96): protocol: read tcp 5.161.89.252:15398->79.127.205.235:4681: use of closed network connection; conn closed: op Aug 18 16:34:22.887639025 (239h8m3.618906675s) [seg_pos={0 0}, upload=248756]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 18 16:34:22.887721931 (239h8m3.618989571s) [upload=248756]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 18 16:34:22.887727010 (239h8m3.618994651s) [upload=248756]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 18 16:34:23.404302198 (239h8m4.135569848s) [upload=248756]: Done uploading segments... Aug 18 16:34:23.404321905 (239h8m4.135589555s) [upload=248756]: Upload finished. err: <nil> Duration: 487.078743ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 176.804284ms FAIL (2025-08-18 16:39:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 16:06:50.203260394 (238h40m30.934528045s) [upload=248286]: Starting upload Aug 18 16:06:50.203323703 (238h40m30.934591354s) [upload=248286]: Done starting upload Aug 18 16:06:50.203388015 (238h40m30.934655665s) [upload=248286]: Uploading segments... Aug 18 16:06:50.203469207 (238h40m30.934736857s) [upload=248286]: Got next segment. Inline: true Aug 18 16:06:50.203476631 (238h40m30.934744281s) [upload=248286]: Waiting for error group managing segments... Aug 18 16:06:50.203524050 (238h40m30.9347917s) [upload=248286]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 18 16:06:50.203530112 (238h40m30.934797761s) [upload=248286]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 18 16:06:50.203534039 (238h40m30.934801689s) [upload=248286]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 18 16:06:50.219212762 (238h40m30.950480423s) [upload=248286]: Done uploading segments... Aug 18 16:06:50.219227430 (238h40m30.95049509s) [upload=248286]: Upload finished. err: metaclient: Too Many Requests Duration:* 176.832236ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............................................X.....X......] duration: 845.152608ms FAIL (2025-08-18 16:38:40 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 64d462567c51af6d9b624cb5865bdffa7555db7b90aeb23b7ae4479d50eac861 != before 6eecad395d421d06136f3311231a1e2d3e8557f8f901305f1593d024374e727a ======LOGS====== Aug 18 16:34:22.214255888 (239h8m2.945523538s) [upload=248756]: Starting upload Aug 18 16:34:22.214353812 (239h8m2.945621442s) [upload=248756]: Done starting upload Aug 18 16:34:22.214418823 (239h8m2.945686444s) [upload=248756]: Uploading segments... Aug 18 16:34:22.214783459 (239h8m2.94605108s) [upload=248756]: Got next segment. Inline: false Aug 18 16:34:22.214826430 (239h8m2.94609405s) [upload=248756]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 18 16:34:22.214831279 (239h8m2.946098899s) [upload=248756]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 18 16:34:22.655597428 (239h8m3.386865058s) [seg_pos={0 0}, upload=248756]: Begin upload segment... Aug 18 16:34:22.655630331 (239h8m3.386897961s) [seg_pos={0 0}, upload=248756]: Done begin upload segment. Aug 18 16:34:22.655648695 (239h8m3.386916325s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.655780432 (239h8m3.387048082s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.655951924 (239h8m3.387219554s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656245847 (239h8m3.387513477s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656483063 (239h8m3.387750683s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656499674 (239h8m3.387767334s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656750867 (239h8m3.388018487s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657064396 (239h8m3.388332016s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657243713 (239h8m3.388511373s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657298286 (239h8m3.388565906s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657514422 (239h8m3.388782052s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657712585 (239h8m3.388980235s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657749464 (239h8m3.389017084s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.658276746 (239h8m3.389544406s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.658837279 (239h8m3.390104939s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.659238013 (239h8m3.390505673s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.659679072 (239h8m3.390946722s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.660362657 (239h8m3.391630307s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.762984030 (239h8m3.494251649s) [upload=248756]: Next returned nil segment Aug 18 16:34:22.762996874 (239h8m3.494264494s) [upload=248756]: Waiting for error group managing segments... Aug 18 16:34:22.775602041 (239h8m3.506869731s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.791843445 (239h8m3.523111094s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.794626666 (239h8m3.525894317s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.809984199 (239h8m3.541251848s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.815346168 (239h8m3.546613818s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.818382807 (239h8m3.549650467s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.819568395 (239h8m3.550836046s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.823155579 (239h8m3.55442323s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.825292287 (239h8m3.556559947s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.826512009 (239h8m3.55777966s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.831395270 (239h8m3.56266292s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.840636022 (239h8m3.571903672s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.876979697 (239h8m3.608247347s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.886970178 (239h8m3.618237828s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.887033958 (239h8m3.618301607s) [seg_pos={0 0}, upload=248756]: Segment reached optimal threshold of 14 pieces. Aug 18 16:34:22.887338350 (239h8m3.618606001s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rFuJ2JyBGWtaASJNnTdHoeKUY1mCfDYfJ74BkxK64U9it8FKF): protocol: expected piece hash; context canceled; EOF Aug 18 16:34:22.887452555 (239h8m3.618720204s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y3X8z9oBzPFDeM4psz1KBtFTcJQS4STc4xiL2N2V8sCEcDDKX): protocol: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection Aug 18 16:34:22.887488632 (239h8m3.618756283s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WKWWwa3svATpoNY1z7LNvYmA8gA6ZFpJsk17G4c37tDJVJ2wj): protocol: expected piece hash; context canceled; EOF Aug 18 16:34:22.887608057 (239h8m3.618875708s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rNaUSswWJWd1zWAbTyLWe8XJYKwfsCm1afjXMeCfWyaF85h96): protocol: read tcp 5.161.89.252:15398->79.127.205.235:4681: use of closed network connection; conn closed: op Aug 18 16:34:22.887639025 (239h8m3.618906675s) [seg_pos={0 0}, upload=248756]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 18 16:34:22.887721931 (239h8m3.618989571s) [upload=248756]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 18 16:34:22.887727010 (239h8m3.618994651s) [upload=248756]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 18 16:34:23.404302198 (239h8m4.135569848s) [upload=248756]: Done uploading segments... Aug 18 16:34:23.404321905 (239h8m4.135589555s) [upload=248756]: Upload finished. err: <nil> Duration: 845.176053ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 221.520757ms FAIL (2025-08-18 16:38:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 16:06:50.203260394 (238h40m30.934528045s) [upload=248286]: Starting upload Aug 18 16:06:50.203323703 (238h40m30.934591354s) [upload=248286]: Done starting upload Aug 18 16:06:50.203388015 (238h40m30.934655665s) [upload=248286]: Uploading segments... Aug 18 16:06:50.203469207 (238h40m30.934736857s) [upload=248286]: Got next segment. Inline: true Aug 18 16:06:50.203476631 (238h40m30.934744281s) [upload=248286]: Waiting for error group managing segments... Aug 18 16:06:50.203524050 (238h40m30.9347917s) [upload=248286]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 18 16:06:50.203530112 (238h40m30.934797761s) [upload=248286]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 18 16:06:50.203534039 (238h40m30.934801689s) [upload=248286]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 18 16:06:50.219212762 (238h40m30.950480423s) [upload=248286]: Done uploading segments... Aug 18 16:06:50.219227430 (238h40m30.95049509s) [upload=248286]: Upload finished. err: metaclient: Too Many Requests Duration:* 221.551063ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 700.168622ms FAIL (2025-08-18 16:37:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 16:06:50.203260394 (238h40m30.934528045s) [upload=248286]: Starting upload Aug 18 16:06:50.203323703 (238h40m30.934591354s) [upload=248286]: Done starting upload Aug 18 16:06:50.203388015 (238h40m30.934655665s) [upload=248286]: Uploading segments... Aug 18 16:06:50.203469207 (238h40m30.934736857s) [upload=248286]: Got next segment. Inline: true Aug 18 16:06:50.203476631 (238h40m30.934744281s) [upload=248286]: Waiting for error group managing segments... Aug 18 16:06:50.203524050 (238h40m30.9347917s) [upload=248286]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 18 16:06:50.203530112 (238h40m30.934797761s) [upload=248286]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 18 16:06:50.203534039 (238h40m30.934801689s) [upload=248286]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 18 16:06:50.219212762 (238h40m30.950480423s) [upload=248286]: Done uploading segments... Aug 18 16:06:50.219227430 (238h40m30.95049509s) [upload=248286]: Upload finished. err: metaclient: Too Many Requests Duration:* 700.191565ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [................................................X.....X.....] duration: 502.738113ms FAIL (2025-08-18 16:37:49 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 64d462567c51af6d9b624cb5865bdffa7555db7b90aeb23b7ae4479d50eac861 != before 6eecad395d421d06136f3311231a1e2d3e8557f8f901305f1593d024374e727a ======LOGS====== Aug 18 16:34:22.214255888 (239h8m2.945523538s) [upload=248756]: Starting upload Aug 18 16:34:22.214353812 (239h8m2.945621442s) [upload=248756]: Done starting upload Aug 18 16:34:22.214418823 (239h8m2.945686444s) [upload=248756]: Uploading segments... Aug 18 16:34:22.214783459 (239h8m2.94605108s) [upload=248756]: Got next segment. Inline: false Aug 18 16:34:22.214826430 (239h8m2.94609405s) [upload=248756]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 18 16:34:22.214831279 (239h8m2.946098899s) [upload=248756]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 18 16:34:22.655597428 (239h8m3.386865058s) [seg_pos={0 0}, upload=248756]: Begin upload segment... Aug 18 16:34:22.655630331 (239h8m3.386897961s) [seg_pos={0 0}, upload=248756]: Done begin upload segment. Aug 18 16:34:22.655648695 (239h8m3.386916325s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.655780432 (239h8m3.387048082s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.655951924 (239h8m3.387219554s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656245847 (239h8m3.387513477s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656483063 (239h8m3.387750683s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656499674 (239h8m3.387767334s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656750867 (239h8m3.388018487s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657064396 (239h8m3.388332016s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657243713 (239h8m3.388511373s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657298286 (239h8m3.388565906s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657514422 (239h8m3.388782052s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657712585 (239h8m3.388980235s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657749464 (239h8m3.389017084s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.658276746 (239h8m3.389544406s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.658837279 (239h8m3.390104939s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.659238013 (239h8m3.390505673s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.659679072 (239h8m3.390946722s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.660362657 (239h8m3.391630307s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.762984030 (239h8m3.494251649s) [upload=248756]: Next returned nil segment Aug 18 16:34:22.762996874 (239h8m3.494264494s) [upload=248756]: Waiting for error group managing segments... Aug 18 16:34:22.775602041 (239h8m3.506869731s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.791843445 (239h8m3.523111094s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.794626666 (239h8m3.525894317s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.809984199 (239h8m3.541251848s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.815346168 (239h8m3.546613818s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.818382807 (239h8m3.549650467s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.819568395 (239h8m3.550836046s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.823155579 (239h8m3.55442323s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.825292287 (239h8m3.556559947s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.826512009 (239h8m3.55777966s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.831395270 (239h8m3.56266292s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.840636022 (239h8m3.571903672s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.876979697 (239h8m3.608247347s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.886970178 (239h8m3.618237828s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.887033958 (239h8m3.618301607s) [seg_pos={0 0}, upload=248756]: Segment reached optimal threshold of 14 pieces. Aug 18 16:34:22.887338350 (239h8m3.618606001s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rFuJ2JyBGWtaASJNnTdHoeKUY1mCfDYfJ74BkxK64U9it8FKF): protocol: expected piece hash; context canceled; EOF Aug 18 16:34:22.887452555 (239h8m3.618720204s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y3X8z9oBzPFDeM4psz1KBtFTcJQS4STc4xiL2N2V8sCEcDDKX): protocol: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection Aug 18 16:34:22.887488632 (239h8m3.618756283s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WKWWwa3svATpoNY1z7LNvYmA8gA6ZFpJsk17G4c37tDJVJ2wj): protocol: expected piece hash; context canceled; EOF Aug 18 16:34:22.887608057 (239h8m3.618875708s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rNaUSswWJWd1zWAbTyLWe8XJYKwfsCm1afjXMeCfWyaF85h96): protocol: read tcp 5.161.89.252:15398->79.127.205.235:4681: use of closed network connection; conn closed: op Aug 18 16:34:22.887639025 (239h8m3.618906675s) [seg_pos={0 0}, upload=248756]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 18 16:34:22.887721931 (239h8m3.618989571s) [upload=248756]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 18 16:34:22.887727010 (239h8m3.618994651s) [upload=248756]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 18 16:34:23.404302198 (239h8m4.135569848s) [upload=248756]: Done uploading segments... Aug 18 16:34:23.404321905 (239h8m4.135589555s) [upload=248756]: Upload finished. err: <nil> Duration: 502.760756ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 210.093768ms FAIL (2025-08-18 16:36:53 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 16:06:50.203260394 (238h40m30.934528045s) [upload=248286]: Starting upload Aug 18 16:06:50.203323703 (238h40m30.934591354s) [upload=248286]: Done starting upload Aug 18 16:06:50.203388015 (238h40m30.934655665s) [upload=248286]: Uploading segments... Aug 18 16:06:50.203469207 (238h40m30.934736857s) [upload=248286]: Got next segment. Inline: true Aug 18 16:06:50.203476631 (238h40m30.934744281s) [upload=248286]: Waiting for error group managing segments... Aug 18 16:06:50.203524050 (238h40m30.9347917s) [upload=248286]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 18 16:06:50.203530112 (238h40m30.934797761s) [upload=248286]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 18 16:06:50.203534039 (238h40m30.934801689s) [upload=248286]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 18 16:06:50.219212762 (238h40m30.950480423s) [upload=248286]: Done uploading segments... Aug 18 16:06:50.219227430 (238h40m30.95049509s) [upload=248286]: Upload finished. err: metaclient: Too Many Requests Duration:* 210.183247ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.................................................X.....X....] duration: 779.093428ms FAIL (2025-08-18 16:36:50 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 64d462567c51af6d9b624cb5865bdffa7555db7b90aeb23b7ae4479d50eac861 != before 6eecad395d421d06136f3311231a1e2d3e8557f8f901305f1593d024374e727a ======LOGS====== Aug 18 16:34:22.214255888 (239h8m2.945523538s) [upload=248756]: Starting upload Aug 18 16:34:22.214353812 (239h8m2.945621442s) [upload=248756]: Done starting upload Aug 18 16:34:22.214418823 (239h8m2.945686444s) [upload=248756]: Uploading segments... Aug 18 16:34:22.214783459 (239h8m2.94605108s) [upload=248756]: Got next segment. Inline: false Aug 18 16:34:22.214826430 (239h8m2.94609405s) [upload=248756]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 18 16:34:22.214831279 (239h8m2.946098899s) [upload=248756]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 18 16:34:22.655597428 (239h8m3.386865058s) [seg_pos={0 0}, upload=248756]: Begin upload segment... Aug 18 16:34:22.655630331 (239h8m3.386897961s) [seg_pos={0 0}, upload=248756]: Done begin upload segment. Aug 18 16:34:22.655648695 (239h8m3.386916325s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.655780432 (239h8m3.387048082s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.655951924 (239h8m3.387219554s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656245847 (239h8m3.387513477s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656483063 (239h8m3.387750683s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656499674 (239h8m3.387767334s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656750867 (239h8m3.388018487s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657064396 (239h8m3.388332016s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657243713 (239h8m3.388511373s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657298286 (239h8m3.388565906s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657514422 (239h8m3.388782052s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657712585 (239h8m3.388980235s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657749464 (239h8m3.389017084s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.658276746 (239h8m3.389544406s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.658837279 (239h8m3.390104939s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.659238013 (239h8m3.390505673s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.659679072 (239h8m3.390946722s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.660362657 (239h8m3.391630307s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.762984030 (239h8m3.494251649s) [upload=248756]: Next returned nil segment Aug 18 16:34:22.762996874 (239h8m3.494264494s) [upload=248756]: Waiting for error group managing segments... Aug 18 16:34:22.775602041 (239h8m3.506869731s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.791843445 (239h8m3.523111094s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.794626666 (239h8m3.525894317s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.809984199 (239h8m3.541251848s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.815346168 (239h8m3.546613818s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.818382807 (239h8m3.549650467s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.819568395 (239h8m3.550836046s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.823155579 (239h8m3.55442323s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.825292287 (239h8m3.556559947s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.826512009 (239h8m3.55777966s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.831395270 (239h8m3.56266292s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.840636022 (239h8m3.571903672s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.876979697 (239h8m3.608247347s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.886970178 (239h8m3.618237828s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.887033958 (239h8m3.618301607s) [seg_pos={0 0}, upload=248756]: Segment reached optimal threshold of 14 pieces. Aug 18 16:34:22.887338350 (239h8m3.618606001s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rFuJ2JyBGWtaASJNnTdHoeKUY1mCfDYfJ74BkxK64U9it8FKF): protocol: expected piece hash; context canceled; EOF Aug 18 16:34:22.887452555 (239h8m3.618720204s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y3X8z9oBzPFDeM4psz1KBtFTcJQS4STc4xiL2N2V8sCEcDDKX): protocol: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection Aug 18 16:34:22.887488632 (239h8m3.618756283s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WKWWwa3svATpoNY1z7LNvYmA8gA6ZFpJsk17G4c37tDJVJ2wj): protocol: expected piece hash; context canceled; EOF Aug 18 16:34:22.887608057 (239h8m3.618875708s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rNaUSswWJWd1zWAbTyLWe8XJYKwfsCm1afjXMeCfWyaF85h96): protocol: read tcp 5.161.89.252:15398->79.127.205.235:4681: use of closed network connection; conn closed: op Aug 18 16:34:22.887639025 (239h8m3.618906675s) [seg_pos={0 0}, upload=248756]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 18 16:34:22.887721931 (239h8m3.618989571s) [upload=248756]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 18 16:34:22.887727010 (239h8m3.618994651s) [upload=248756]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 18 16:34:23.404302198 (239h8m4.135569848s) [upload=248756]: Done uploading segments... Aug 18 16:34:23.404321905 (239h8m4.135589555s) [upload=248756]: Upload finished. err: <nil> Duration: 779.118625ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 397.734009ms FAIL (2025-08-18 16:36:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 16:06:50.203260394 (238h40m30.934528045s) [upload=248286]: Starting upload Aug 18 16:06:50.203323703 (238h40m30.934591354s) [upload=248286]: Done starting upload Aug 18 16:06:50.203388015 (238h40m30.934655665s) [upload=248286]: Uploading segments... Aug 18 16:06:50.203469207 (238h40m30.934736857s) [upload=248286]: Got next segment. Inline: true Aug 18 16:06:50.203476631 (238h40m30.934744281s) [upload=248286]: Waiting for error group managing segments... Aug 18 16:06:50.203524050 (238h40m30.9347917s) [upload=248286]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 18 16:06:50.203530112 (238h40m30.934797761s) [upload=248286]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 18 16:06:50.203534039 (238h40m30.934801689s) [upload=248286]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 18 16:06:50.219212762 (238h40m30.950480423s) [upload=248286]: Done uploading segments... Aug 18 16:06:50.219227430 (238h40m30.95049509s) [upload=248286]: Upload finished. err: metaclient: Too Many Requests Duration:* 397.760028ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 745.952775ms FAIL (2025-08-18 16:36:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 16:06:50.203260394 (238h40m30.934528045s) [upload=248286]: Starting upload Aug 18 16:06:50.203323703 (238h40m30.934591354s) [upload=248286]: Done starting upload Aug 18 16:06:50.203388015 (238h40m30.934655665s) [upload=248286]: Uploading segments... Aug 18 16:06:50.203469207 (238h40m30.934736857s) [upload=248286]: Got next segment. Inline: true Aug 18 16:06:50.203476631 (238h40m30.934744281s) [upload=248286]: Waiting for error group managing segments... Aug 18 16:06:50.203524050 (238h40m30.9347917s) [upload=248286]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 18 16:06:50.203530112 (238h40m30.934797761s) [upload=248286]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 18 16:06:50.203534039 (238h40m30.934801689s) [upload=248286]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 18 16:06:50.219212762 (238h40m30.950480423s) [upload=248286]: Done uploading segments... Aug 18 16:06:50.219227430 (238h40m30.95049509s) [upload=248286]: Upload finished. err: metaclient: Too Many Requests Duration:* 745.972812ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................................................X.....X...] duration: 1.267603666s FAIL (2025-08-18 16:35:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 64d462567c51af6d9b624cb5865bdffa7555db7b90aeb23b7ae4479d50eac861 != before 6eecad395d421d06136f3311231a1e2d3e8557f8f901305f1593d024374e727a ======LOGS====== Aug 18 16:34:22.214255888 (239h8m2.945523538s) [upload=248756]: Starting upload Aug 18 16:34:22.214353812 (239h8m2.945621442s) [upload=248756]: Done starting upload Aug 18 16:34:22.214418823 (239h8m2.945686444s) [upload=248756]: Uploading segments... Aug 18 16:34:22.214783459 (239h8m2.94605108s) [upload=248756]: Got next segment. Inline: false Aug 18 16:34:22.214826430 (239h8m2.94609405s) [upload=248756]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 18 16:34:22.214831279 (239h8m2.946098899s) [upload=248756]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 18 16:34:22.655597428 (239h8m3.386865058s) [seg_pos={0 0}, upload=248756]: Begin upload segment... Aug 18 16:34:22.655630331 (239h8m3.386897961s) [seg_pos={0 0}, upload=248756]: Done begin upload segment. Aug 18 16:34:22.655648695 (239h8m3.386916325s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.655780432 (239h8m3.387048082s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.655951924 (239h8m3.387219554s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656245847 (239h8m3.387513477s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656483063 (239h8m3.387750683s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656499674 (239h8m3.387767334s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656750867 (239h8m3.388018487s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657064396 (239h8m3.388332016s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657243713 (239h8m3.388511373s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657298286 (239h8m3.388565906s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657514422 (239h8m3.388782052s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657712585 (239h8m3.388980235s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657749464 (239h8m3.389017084s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.658276746 (239h8m3.389544406s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.658837279 (239h8m3.390104939s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.659238013 (239h8m3.390505673s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.659679072 (239h8m3.390946722s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.660362657 (239h8m3.391630307s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.762984030 (239h8m3.494251649s) [upload=248756]: Next returned nil segment Aug 18 16:34:22.762996874 (239h8m3.494264494s) [upload=248756]: Waiting for error group managing segments... Aug 18 16:34:22.775602041 (239h8m3.506869731s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.791843445 (239h8m3.523111094s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.794626666 (239h8m3.525894317s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.809984199 (239h8m3.541251848s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.815346168 (239h8m3.546613818s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.818382807 (239h8m3.549650467s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.819568395 (239h8m3.550836046s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.823155579 (239h8m3.55442323s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.825292287 (239h8m3.556559947s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.826512009 (239h8m3.55777966s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.831395270 (239h8m3.56266292s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.840636022 (239h8m3.571903672s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.876979697 (239h8m3.608247347s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.886970178 (239h8m3.618237828s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.887033958 (239h8m3.618301607s) [seg_pos={0 0}, upload=248756]: Segment reached optimal threshold of 14 pieces. Aug 18 16:34:22.887338350 (239h8m3.618606001s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rFuJ2JyBGWtaASJNnTdHoeKUY1mCfDYfJ74BkxK64U9it8FKF): protocol: expected piece hash; context canceled; EOF Aug 18 16:34:22.887452555 (239h8m3.618720204s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y3X8z9oBzPFDeM4psz1KBtFTcJQS4STc4xiL2N2V8sCEcDDKX): protocol: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection Aug 18 16:34:22.887488632 (239h8m3.618756283s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WKWWwa3svATpoNY1z7LNvYmA8gA6ZFpJsk17G4c37tDJVJ2wj): protocol: expected piece hash; context canceled; EOF Aug 18 16:34:22.887608057 (239h8m3.618875708s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rNaUSswWJWd1zWAbTyLWe8XJYKwfsCm1afjXMeCfWyaF85h96): protocol: read tcp 5.161.89.252:15398->79.127.205.235:4681: use of closed network connection; conn closed: op Aug 18 16:34:22.887639025 (239h8m3.618906675s) [seg_pos={0 0}, upload=248756]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 18 16:34:22.887721931 (239h8m3.618989571s) [upload=248756]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 18 16:34:22.887727010 (239h8m3.618994651s) [upload=248756]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 18 16:34:23.404302198 (239h8m4.135569848s) [upload=248756]: Done uploading segments... Aug 18 16:34:23.404321905 (239h8m4.135589555s) [upload=248756]: Upload finished. err: <nil> Duration: 1.267627852s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 964.805149ms FAIL (2025-08-18 16:35:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 16:06:50.203260394 (238h40m30.934528045s) [upload=248286]: Starting upload Aug 18 16:06:50.203323703 (238h40m30.934591354s) [upload=248286]: Done starting upload Aug 18 16:06:50.203388015 (238h40m30.934655665s) [upload=248286]: Uploading segments... Aug 18 16:06:50.203469207 (238h40m30.934736857s) [upload=248286]: Got next segment. Inline: true Aug 18 16:06:50.203476631 (238h40m30.934744281s) [upload=248286]: Waiting for error group managing segments... Aug 18 16:06:50.203524050 (238h40m30.9347917s) [upload=248286]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 18 16:06:50.203530112 (238h40m30.934797761s) [upload=248286]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 18 16:06:50.203534039 (238h40m30.934801689s) [upload=248286]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 18 16:06:50.219212762 (238h40m30.950480423s) [upload=248286]: Done uploading segments... Aug 18 16:06:50.219227430 (238h40m30.95049509s) [upload=248286]: Upload finished. err: metaclient: Too Many Requests Duration:* 964.835315ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [X..................................................X.....X..] duration: 430.666652ms FAIL (2025-08-18 16:35:18 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 64d462567c51af6d9b624cb5865bdffa7555db7b90aeb23b7ae4479d50eac861 != before 6eecad395d421d06136f3311231a1e2d3e8557f8f901305f1593d024374e727a ======LOGS====== Aug 18 16:34:22.214255888 (239h8m2.945523538s) [upload=248756]: Starting upload Aug 18 16:34:22.214353812 (239h8m2.945621442s) [upload=248756]: Done starting upload Aug 18 16:34:22.214418823 (239h8m2.945686444s) [upload=248756]: Uploading segments... Aug 18 16:34:22.214783459 (239h8m2.94605108s) [upload=248756]: Got next segment. Inline: false Aug 18 16:34:22.214826430 (239h8m2.94609405s) [upload=248756]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 18 16:34:22.214831279 (239h8m2.946098899s) [upload=248756]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 18 16:34:22.655597428 (239h8m3.386865058s) [seg_pos={0 0}, upload=248756]: Begin upload segment... Aug 18 16:34:22.655630331 (239h8m3.386897961s) [seg_pos={0 0}, upload=248756]: Done begin upload segment. Aug 18 16:34:22.655648695 (239h8m3.386916325s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.655780432 (239h8m3.387048082s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.655951924 (239h8m3.387219554s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656245847 (239h8m3.387513477s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656483063 (239h8m3.387750683s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656499674 (239h8m3.387767334s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656750867 (239h8m3.388018487s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657064396 (239h8m3.388332016s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657243713 (239h8m3.388511373s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657298286 (239h8m3.388565906s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657514422 (239h8m3.388782052s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657712585 (239h8m3.388980235s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657749464 (239h8m3.389017084s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.658276746 (239h8m3.389544406s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.658837279 (239h8m3.390104939s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.659238013 (239h8m3.390505673s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.659679072 (239h8m3.390946722s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.660362657 (239h8m3.391630307s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.762984030 (239h8m3.494251649s) [upload=248756]: Next returned nil segment Aug 18 16:34:22.762996874 (239h8m3.494264494s) [upload=248756]: Waiting for error group managing segments... Aug 18 16:34:22.775602041 (239h8m3.506869731s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.791843445 (239h8m3.523111094s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.794626666 (239h8m3.525894317s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.809984199 (239h8m3.541251848s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.815346168 (239h8m3.546613818s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.818382807 (239h8m3.549650467s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.819568395 (239h8m3.550836046s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.823155579 (239h8m3.55442323s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.825292287 (239h8m3.556559947s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.826512009 (239h8m3.55777966s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.831395270 (239h8m3.56266292s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.840636022 (239h8m3.571903672s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.876979697 (239h8m3.608247347s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.886970178 (239h8m3.618237828s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.887033958 (239h8m3.618301607s) [seg_pos={0 0}, upload=248756]: Segment reached optimal threshold of 14 pieces. Aug 18 16:34:22.887338350 (239h8m3.618606001s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rFuJ2JyBGWtaASJNnTdHoeKUY1mCfDYfJ74BkxK64U9it8FKF): protocol: expected piece hash; context canceled; EOF Aug 18 16:34:22.887452555 (239h8m3.618720204s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y3X8z9oBzPFDeM4psz1KBtFTcJQS4STc4xiL2N2V8sCEcDDKX): protocol: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection Aug 18 16:34:22.887488632 (239h8m3.618756283s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WKWWwa3svATpoNY1z7LNvYmA8gA6ZFpJsk17G4c37tDJVJ2wj): protocol: expected piece hash; context canceled; EOF Aug 18 16:34:22.887608057 (239h8m3.618875708s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rNaUSswWJWd1zWAbTyLWe8XJYKwfsCm1afjXMeCfWyaF85h96): protocol: read tcp 5.161.89.252:15398->79.127.205.235:4681: use of closed network connection; conn closed: op Aug 18 16:34:22.887639025 (239h8m3.618906675s) [seg_pos={0 0}, upload=248756]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 18 16:34:22.887721931 (239h8m3.618989571s) [upload=248756]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 18 16:34:22.887727010 (239h8m3.618994651s) [upload=248756]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 18 16:34:23.404302198 (239h8m4.135569848s) [upload=248756]: Done uploading segments... Aug 18 16:34:23.404321905 (239h8m4.135589555s) [upload=248756]: Upload finished. err: <nil> Duration: 430.687761ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.X..................................................X.....X.] duration: 567.118515ms FAIL (2025-08-18 16:34:47 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 64d462567c51af6d9b624cb5865bdffa7555db7b90aeb23b7ae4479d50eac861 != before 6eecad395d421d06136f3311231a1e2d3e8557f8f901305f1593d024374e727a ======LOGS====== Aug 18 16:34:22.214255888 (239h8m2.945523538s) [upload=248756]: Starting upload Aug 18 16:34:22.214353812 (239h8m2.945621442s) [upload=248756]: Done starting upload Aug 18 16:34:22.214418823 (239h8m2.945686444s) [upload=248756]: Uploading segments... Aug 18 16:34:22.214783459 (239h8m2.94605108s) [upload=248756]: Got next segment. Inline: false Aug 18 16:34:22.214826430 (239h8m2.94609405s) [upload=248756]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 18 16:34:22.214831279 (239h8m2.946098899s) [upload=248756]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 18 16:34:22.655597428 (239h8m3.386865058s) [seg_pos={0 0}, upload=248756]: Begin upload segment... Aug 18 16:34:22.655630331 (239h8m3.386897961s) [seg_pos={0 0}, upload=248756]: Done begin upload segment. Aug 18 16:34:22.655648695 (239h8m3.386916325s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.655780432 (239h8m3.387048082s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.655951924 (239h8m3.387219554s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656245847 (239h8m3.387513477s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656483063 (239h8m3.387750683s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656499674 (239h8m3.387767334s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656750867 (239h8m3.388018487s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657064396 (239h8m3.388332016s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657243713 (239h8m3.388511373s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657298286 (239h8m3.388565906s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657514422 (239h8m3.388782052s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657712585 (239h8m3.388980235s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657749464 (239h8m3.389017084s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.658276746 (239h8m3.389544406s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.658837279 (239h8m3.390104939s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.659238013 (239h8m3.390505673s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.659679072 (239h8m3.390946722s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.660362657 (239h8m3.391630307s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.762984030 (239h8m3.494251649s) [upload=248756]: Next returned nil segment Aug 18 16:34:22.762996874 (239h8m3.494264494s) [upload=248756]: Waiting for error group managing segments... Aug 18 16:34:22.775602041 (239h8m3.506869731s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.791843445 (239h8m3.523111094s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.794626666 (239h8m3.525894317s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.809984199 (239h8m3.541251848s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.815346168 (239h8m3.546613818s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.818382807 (239h8m3.549650467s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.819568395 (239h8m3.550836046s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.823155579 (239h8m3.55442323s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.825292287 (239h8m3.556559947s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.826512009 (239h8m3.55777966s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.831395270 (239h8m3.56266292s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.840636022 (239h8m3.571903672s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.876979697 (239h8m3.608247347s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.886970178 (239h8m3.618237828s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.887033958 (239h8m3.618301607s) [seg_pos={0 0}, upload=248756]: Segment reached optimal threshold of 14 pieces. Aug 18 16:34:22.887338350 (239h8m3.618606001s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rFuJ2JyBGWtaASJNnTdHoeKUY1mCfDYfJ74BkxK64U9it8FKF): protocol: expected piece hash; context canceled; EOF Aug 18 16:34:22.887452555 (239h8m3.618720204s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y3X8z9oBzPFDeM4psz1KBtFTcJQS4STc4xiL2N2V8sCEcDDKX): protocol: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection Aug 18 16:34:22.887488632 (239h8m3.618756283s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WKWWwa3svATpoNY1z7LNvYmA8gA6ZFpJsk17G4c37tDJVJ2wj): protocol: expected piece hash; context canceled; EOF Aug 18 16:34:22.887608057 (239h8m3.618875708s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rNaUSswWJWd1zWAbTyLWe8XJYKwfsCm1afjXMeCfWyaF85h96): protocol: read tcp 5.161.89.252:15398->79.127.205.235:4681: use of closed network connection; conn closed: op Aug 18 16:34:22.887639025 (239h8m3.618906675s) [seg_pos={0 0}, upload=248756]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 18 16:34:22.887721931 (239h8m3.618989571s) [upload=248756]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 18 16:34:22.887727010 (239h8m3.618994651s) [upload=248756]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 18 16:34:23.404302198 (239h8m4.135569848s) [upload=248756]: Done uploading segments... Aug 18 16:34:23.404321905 (239h8m4.135589555s) [upload=248756]: Upload finished. err: <nil> Duration: 567.140275ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 167.502787ms FAIL (2025-08-18 16:34:36 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 16:06:50.203260394 (238h40m30.934528045s) [upload=248286]: Starting upload Aug 18 16:06:50.203323703 (238h40m30.934591354s) [upload=248286]: Done starting upload Aug 18 16:06:50.203388015 (238h40m30.934655665s) [upload=248286]: Uploading segments... Aug 18 16:06:50.203469207 (238h40m30.934736857s) [upload=248286]: Got next segment. Inline: true Aug 18 16:06:50.203476631 (238h40m30.934744281s) [upload=248286]: Waiting for error group managing segments... Aug 18 16:06:50.203524050 (238h40m30.9347917s) [upload=248286]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 18 16:06:50.203530112 (238h40m30.934797761s) [upload=248286]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 18 16:06:50.203534039 (238h40m30.934801689s) [upload=248286]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 18 16:06:50.219212762 (238h40m30.950480423s) [upload=248286]: Done uploading segments... Aug 18 16:06:50.219227430 (238h40m30.95049509s) [upload=248286]: Upload finished. err: metaclient: Too Many Requests Duration:* 167.518065ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..X..................................................X.....X] duration: 2.208174631s FAIL (2025-08-18 16:34:24 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 64d462567c51af6d9b624cb5865bdffa7555db7b90aeb23b7ae4479d50eac861 != before 6eecad395d421d06136f3311231a1e2d3e8557f8f901305f1593d024374e727a ======LOGS====== Aug 18 16:34:22.214255888 (239h8m2.945523538s) [upload=248756]: Starting upload Aug 18 16:34:22.214353812 (239h8m2.945621442s) [upload=248756]: Done starting upload Aug 18 16:34:22.214418823 (239h8m2.945686444s) [upload=248756]: Uploading segments... Aug 18 16:34:22.214783459 (239h8m2.94605108s) [upload=248756]: Got next segment. Inline: false Aug 18 16:34:22.214826430 (239h8m2.94609405s) [upload=248756]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 18 16:34:22.214831279 (239h8m2.946098899s) [upload=248756]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 18 16:34:22.655597428 (239h8m3.386865058s) [seg_pos={0 0}, upload=248756]: Begin upload segment... Aug 18 16:34:22.655630331 (239h8m3.386897961s) [seg_pos={0 0}, upload=248756]: Done begin upload segment. Aug 18 16:34:22.655648695 (239h8m3.386916325s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.655780432 (239h8m3.387048082s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.655951924 (239h8m3.387219554s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656245847 (239h8m3.387513477s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656483063 (239h8m3.387750683s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656499674 (239h8m3.387767334s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.656750867 (239h8m3.388018487s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657064396 (239h8m3.388332016s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657243713 (239h8m3.388511373s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657298286 (239h8m3.388565906s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657514422 (239h8m3.388782052s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657712585 (239h8m3.388980235s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.657749464 (239h8m3.389017084s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.658276746 (239h8m3.389544406s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.658837279 (239h8m3.390104939s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.659238013 (239h8m3.390505673s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.659679072 (239h8m3.390946722s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.660362657 (239h8m3.391630307s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Uploading piece... Aug 18 16:34:22.762984030 (239h8m3.494251649s) [upload=248756]: Next returned nil segment Aug 18 16:34:22.762996874 (239h8m3.494264494s) [upload=248756]: Waiting for error group managing segments... Aug 18 16:34:22.775602041 (239h8m3.506869731s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.791843445 (239h8m3.523111094s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.794626666 (239h8m3.525894317s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.809984199 (239h8m3.541251848s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.815346168 (239h8m3.546613818s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.818382807 (239h8m3.549650467s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.819568395 (239h8m3.550836046s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.823155579 (239h8m3.55442323s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.825292287 (239h8m3.556559947s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.826512009 (239h8m3.55777966s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.831395270 (239h8m3.56266292s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.840636022 (239h8m3.571903672s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.876979697 (239h8m3.608247347s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.886970178 (239h8m3.618237828s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil> Aug 18 16:34:22.887033958 (239h8m3.618301607s) [seg_pos={0 0}, upload=248756]: Segment reached optimal threshold of 14 pieces. Aug 18 16:34:22.887338350 (239h8m3.618606001s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rFuJ2JyBGWtaASJNnTdHoeKUY1mCfDYfJ74BkxK64U9it8FKF): protocol: expected piece hash; context canceled; EOF Aug 18 16:34:22.887452555 (239h8m3.618720204s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y3X8z9oBzPFDeM4psz1KBtFTcJQS4STc4xiL2N2V8sCEcDDKX): protocol: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection Aug 18 16:34:22.887488632 (239h8m3.618756283s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WKWWwa3svATpoNY1z7LNvYmA8gA6ZFpJsk17G4c37tDJVJ2wj): protocol: expected piece hash; context canceled; EOF Aug 18 16:34:22.887608057 (239h8m3.618875708s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rNaUSswWJWd1zWAbTyLWe8XJYKwfsCm1afjXMeCfWyaF85h96): protocol: read tcp 5.161.89.252:15398->79.127.205.235:4681: use of closed network connection; conn closed: op Aug 18 16:34:22.887639025 (239h8m3.618906675s) [seg_pos={0 0}, upload=248756]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 18 16:34:22.887721931 (239h8m3.618989571s) [upload=248756]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 18 16:34:22.887727010 (239h8m3.618994651s) [upload=248756]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 18 16:34:23.404302198 (239h8m4.135569848s) [upload=248756]: Done uploading segments... Aug 18 16:34:23.404321905 (239h8m4.135589555s) [upload=248756]: Upload finished. err: <nil> Duration: 2.208193728s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 1.290121957s FAIL (2025-08-18 16:34:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 16:06:50.203260394 (238h40m30.934528045s) [upload=248286]: Starting upload Aug 18 16:06:50.203323703 (238h40m30.934591354s) [upload=248286]: Done starting upload Aug 18 16:06:50.203388015 (238h40m30.934655665s) [upload=248286]: Uploading segments... Aug 18 16:06:50.203469207 (238h40m30.934736857s) [upload=248286]: Got next segment. Inline: true Aug 18 16:06:50.203476631 (238h40m30.934744281s) [upload=248286]: Waiting for error group managing segments... Aug 18 16:06:50.203524050 (238h40m30.9347917s) [upload=248286]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 18 16:06:50.203530112 (238h40m30.934797761s) [upload=248286]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 18 16:06:50.203534039 (238h40m30.934801689s) [upload=248286]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 18 16:06:50.219212762 (238h40m30.950480423s) [upload=248286]: Done uploading segments... Aug 18 16:06:50.219227430 (238h40m30.95049509s) [upload=248286]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.290148397s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 720.268309ms FAIL (2025-08-18 16:33:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 16:06:50.203260394 (238h40m30.934528045s) [upload=248286]: Starting upload Aug 18 16:06:50.203323703 (238h40m30.934591354s) [upload=248286]: Done starting upload Aug 18 16:06:50.203388015 (238h40m30.934655665s) [upload=248286]: Uploading segments... Aug 18 16:06:50.203469207 (238h40m30.934736857s) [upload=248286]: Got next segment. Inline: true Aug 18 16:06:50.203476631 (238h40m30.934744281s) [upload=248286]: Waiting for error group managing segments... Aug 18 16:06:50.203524050 (238h40m30.9347917s) [upload=248286]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 18 16:06:50.203530112 (238h40m30.934797761s) [upload=248286]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 18 16:06:50.203534039 (238h40m30.934801689s) [upload=248286]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 18 16:06:50.219212762 (238h40m30.950480423s) [upload=248286]: Done uploading segments... Aug 18 16:06:50.219227430 (238h40m30.95049509s) [upload=248286]: Upload finished. err: metaclient: Too Many Requests Duration:* 720.294688ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...X..................................................X.....] duration: 662.436648ms FAIL (2025-08-18 16:33:19 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 16:28:52.940468512 (239h2m33.671736142s) [upload=248663]: Starting upload Aug 18 16:28:52.940515881 (239h2m33.671783511s) [upload=248663]: Done starting upload Aug 18 16:28:52.940622973 (239h2m33.671890623s) [upload=248663]: Uploading segments... Aug 18 16:28:52.940754099 (239h2m33.672021719s) [upload=248663]: Got next segment. Inline: false Aug 18 16:28:52.940814272 (239h2m33.672081902s) [upload=248663]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 18 16:28:52.940820343 (239h2m33.672088013s) [upload=248663]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 18 16:28:52.943273926 (239h2m33.674541576s) [upload=248663]: Next segment err: metaclient: Too Many Requests Aug 18 16:28:52.943289425 (239h2m33.674557075s) [upload=248663]: Done uploading segments... Aug 18 16:28:52.943304894 (239h2m33.674572544s) [upload=248663]: Upload finished. err: metaclient: Too Many Requests Duration: 662.464151ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 457.262281ms FAIL (2025-08-18 16:32:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 16:06:50.203260394 (238h40m30.934528045s) [upload=248286]: Starting upload Aug 18 16:06:50.203323703 (238h40m30.934591354s) [upload=248286]: Done starting upload Aug 18 16:06:50.203388015 (238h40m30.934655665s) [upload=248286]: Uploading segments... Aug 18 16:06:50.203469207 (238h40m30.934736857s) [upload=248286]: Got next segment. Inline: true Aug 18 16:06:50.203476631 (238h40m30.934744281s) [upload=248286]: Waiting for error group managing segments... Aug 18 16:06:50.203524050 (238h40m30.9347917s) [upload=248286]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 18 16:06:50.203530112 (238h40m30.934797761s) [upload=248286]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 18 16:06:50.203534039 (238h40m30.934801689s) [upload=248286]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 18 16:06:50.219212762 (238h40m30.950480423s) [upload=248286]: Done uploading segments... Aug 18 16:06:50.219227430 (238h40m30.95049509s) [upload=248286]: Upload finished. err: metaclient: Too Many Requests Duration:* 457.284705ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [....X..................................................X....] duration: 697.612629ms FAIL (2025-08-18 16:32:22 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 16:28:52.940468512 (239h2m33.671736142s) [upload=248663]: Starting upload Aug 18 16:28:52.940515881 (239h2m33.671783511s) [upload=248663]: Done starting upload Aug 18 16:28:52.940622973 (239h2m33.671890623s) [upload=248663]: Uploading segments... Aug 18 16:28:52.940754099 (239h2m33.672021719s) [upload=248663]: Got next segment. Inline: false Aug 18 16:28:52.940814272 (239h2m33.672081902s) [upload=248663]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 18 16:28:52.940820343 (239h2m33.672088013s) [upload=248663]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 18 16:28:52.943273926 (239h2m33.674541576s) [upload=248663]: Next segment err: metaclient: Too Many Requests Aug 18 16:28:52.943289425 (239h2m33.674557075s) [upload=248663]: Done uploading segments... Aug 18 16:28:52.943304894 (239h2m33.674572544s) [upload=248663]: Upload finished. err: metaclient: Too Many Requests Duration: 697.635442ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [X....X..................................................X...] duration: 510.639147ms FAIL (2025-08-18 16:31:47 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 16:28:52.940468512 (239h2m33.671736142s) [upload=248663]: Starting upload Aug 18 16:28:52.940515881 (239h2m33.671783511s) [upload=248663]: Done starting upload Aug 18 16:28:52.940622973 (239h2m33.671890623s) [upload=248663]: Uploading segments... Aug 18 16:28:52.940754099 (239h2m33.672021719s) [upload=248663]: Got next segment. Inline: false Aug 18 16:28:52.940814272 (239h2m33.672081902s) [upload=248663]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 18 16:28:52.940820343 (239h2m33.672088013s) [upload=248663]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 18 16:28:52.943273926 (239h2m33.674541576s) [upload=248663]: Next segment err: metaclient: Too Many Requests Aug 18 16:28:52.943289425 (239h2m33.674557075s) [upload=248663]: Done uploading segments... Aug 18 16:28:52.943304894 (239h2m33.674572544s) [upload=248663]: Upload finished. err: metaclient: Too Many Requests Duration: 510.670756ms core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)