Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......................X.......X.............................] duration:
923.662832ms
FAIL (2025-08-13 19:29:36 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 13 19:08:20.572767219 (121h42m1.304034869s) [upload=126718]: Starting upload
Aug 13 19:08:20.572840447 (121h42m1.304108097s) [upload=126718]: Done starting upload
Aug 13 19:08:20.572952778 (121h42m1.304220427s) [upload=126718]: Uploading segments...
Aug 13 19:08:20.573276887 (121h42m1.304544547s) [upload=126718]: Got next segment. Inline: false
Aug 13 19:08:20.573342571 (121h42m1.304610222s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 19:08:20.573351448 (121h42m1.304619119s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 19:08:20.613293228 (121h42m1.344560888s) [seg_pos={0 0}, upload=126718]: Begin upload segment...
Aug 13 19:08:20.613362899 (121h42m1.344630549s) [seg_pos={0 0}, upload=126718]: Done begin upload segment.
Aug 13 19:08:20.613395610 (121h42m1.34466326s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613479168 (121h42m1.344746828s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613933462 (121h42m1.345201122s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613966173 (121h42m1.345233824s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614473598 (121h42m1.345741248s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614513222 (121h42m1.345780882s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614845417 (121h42m1.346113078s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615068767 (121h42m1.346336418s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615223789 (121h42m1.346491439s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615618681 (121h42m1.346886332s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615644741 (121h42m1.346912401s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616154590 (121h42m1.34742224s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616169798 (121h42m1.347437449s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616718090 (121h42m1.347985739s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616748518 (121h42m1.348016167s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.617120096 (121h42m1.348387746s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.622023970 (121h42m1.353291681s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.622840135 (121h42m1.354107785s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.727179166 (121h42m1.458446786s) [upload=126718]: Next returned nil segment
Aug 13 19:08:20.727279234 (121h42m1.458546864s) [upload=126718]: Waiting for error group managing segments...
Aug 13 19:08:20.740817168 (121h42m1.472084789s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.741709907 (121h42m1.472977537s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.741976870 (121h42m1.4732445s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.748823638 (121h42m1.480091268s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.750729704 (121h42m1.481997324s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.751278897 (121h42m1.482546527s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.763551371 (121h42m1.494819001s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.768221566 (121h42m1.499489196s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.769131177 (121h42m1.500398808s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.769654381 (121h42m1.500922002s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.770436272 (121h42m1.501703892s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.126424712 (121h42m1.857692362s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.134590111 (121h42m1.865857762s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.150885924 (121h42m1.882153574s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.150912293 (121h42m1.882179944s) [seg_pos={0 0}, upload=126718]: Segment reached optimal threshold of 14 pieces.
Aug 13 19:08:21.151075060 (121h42m1.88234271s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hdE48UnygY1dCRASR39FkumY2V8f5Xb68Pd1WJ4AMLUnnGAfT): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151110567 (121h42m1.882378216s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151167683 (121h42m1.882435334s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tnTEYvqJ6PB2DsuXA28sEuEiGj11StA4qdhcYH1kuoaMkTVdY): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151282079 (121h42m1.882549729s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151301135 (121h42m1.882568775s) [seg_pos={0 0}, upload=126718]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 19:08:21.151371136 (121h42m1.882638776s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 19:08:21.151376356 (121h42m1.882644006s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 19:08:21.328511696 (121h42m2.059779306s) [upload=126718]: Done uploading segments...
Aug 13 19:08:21.328527987 (121h42m2.059795618s) [upload=126718]: Upload finished. err: <nil>
Duration: 923.678271ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
283.404531ms
FAIL (2025-08-13 19:29:02 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 18:55:21.849790646 (121h29m2.581058266s) [upload=126500]: Starting upload Aug 13 18:55:21.849866529 (121h29m2.581134149s) [upload=126500]: Done starting upload Aug 13 18:55:21.849939096 (121h29m2.581206726s) [upload=126500]: Uploading segments... Aug 13 18:55:21.849977618 (121h29m2.581245248s) [upload=126500]: Got next segment. Inline: true Aug 13 18:55:21.849983399 (121h29m2.581251049s) [upload=126500]: Waiting for error group managing segments... Aug 13 18:55:21.850034435 (121h29m2.581302065s) [upload=126500]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 18:55:21.850040105 (121h29m2.581307765s) [upload=126500]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 18:55:21.850044223 (121h29m2.581311853s) [upload=126500]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 18:55:21.852506835 (121h29m2.583774465s) [upload=126500]: Done uploading segments... Aug 13 18:55:21.852521132 (121h29m2.583788762s) [upload=126500]: Upload finished. err: metaclient: Too Many Requests
Duration: 283.436301ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......................X.......X............................] duration:
522.530744ms
FAIL (2025-08-13 19:28:39 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 13 19:08:20.572767219 (121h42m1.304034869s) [upload=126718]: Starting upload
Aug 13 19:08:20.572840447 (121h42m1.304108097s) [upload=126718]: Done starting upload
Aug 13 19:08:20.572952778 (121h42m1.304220427s) [upload=126718]: Uploading segments...
Aug 13 19:08:20.573276887 (121h42m1.304544547s) [upload=126718]: Got next segment. Inline: false
Aug 13 19:08:20.573342571 (121h42m1.304610222s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 19:08:20.573351448 (121h42m1.304619119s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 19:08:20.613293228 (121h42m1.344560888s) [seg_pos={0 0}, upload=126718]: Begin upload segment...
Aug 13 19:08:20.613362899 (121h42m1.344630549s) [seg_pos={0 0}, upload=126718]: Done begin upload segment.
Aug 13 19:08:20.613395610 (121h42m1.34466326s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613479168 (121h42m1.344746828s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613933462 (121h42m1.345201122s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613966173 (121h42m1.345233824s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614473598 (121h42m1.345741248s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614513222 (121h42m1.345780882s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614845417 (121h42m1.346113078s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615068767 (121h42m1.346336418s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615223789 (121h42m1.346491439s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615618681 (121h42m1.346886332s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615644741 (121h42m1.346912401s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616154590 (121h42m1.34742224s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616169798 (121h42m1.347437449s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616718090 (121h42m1.347985739s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616748518 (121h42m1.348016167s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.617120096 (121h42m1.348387746s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.622023970 (121h42m1.353291681s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.622840135 (121h42m1.354107785s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.727179166 (121h42m1.458446786s) [upload=126718]: Next returned nil segment
Aug 13 19:08:20.727279234 (121h42m1.458546864s) [upload=126718]: Waiting for error group managing segments...
Aug 13 19:08:20.740817168 (121h42m1.472084789s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.741709907 (121h42m1.472977537s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.741976870 (121h42m1.4732445s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.748823638 (121h42m1.480091268s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.750729704 (121h42m1.481997324s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.751278897 (121h42m1.482546527s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.763551371 (121h42m1.494819001s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.768221566 (121h42m1.499489196s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.769131177 (121h42m1.500398808s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.769654381 (121h42m1.500922002s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.770436272 (121h42m1.501703892s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.126424712 (121h42m1.857692362s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.134590111 (121h42m1.865857762s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.150885924 (121h42m1.882153574s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.150912293 (121h42m1.882179944s) [seg_pos={0 0}, upload=126718]: Segment reached optimal threshold of 14 pieces.
Aug 13 19:08:21.151075060 (121h42m1.88234271s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hdE48UnygY1dCRASR39FkumY2V8f5Xb68Pd1WJ4AMLUnnGAfT): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151110567 (121h42m1.882378216s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151167683 (121h42m1.882435334s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tnTEYvqJ6PB2DsuXA28sEuEiGj11StA4qdhcYH1kuoaMkTVdY): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151282079 (121h42m1.882549729s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151301135 (121h42m1.882568775s) [seg_pos={0 0}, upload=126718]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 19:08:21.151371136 (121h42m1.882638776s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 19:08:21.151376356 (121h42m1.882644006s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 19:08:21.328511696 (121h42m2.059779306s) [upload=126718]: Done uploading segments...
Aug 13 19:08:21.328527987 (121h42m2.059795618s) [upload=126718]: Upload finished. err: <nil>
Duration: 522.558766ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
241.955254ms
FAIL (2025-08-13 19:28:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 18:55:21.849790646 (121h29m2.581058266s) [upload=126500]: Starting upload Aug 13 18:55:21.849866529 (121h29m2.581134149s) [upload=126500]: Done starting upload Aug 13 18:55:21.849939096 (121h29m2.581206726s) [upload=126500]: Uploading segments... Aug 13 18:55:21.849977618 (121h29m2.581245248s) [upload=126500]: Got next segment. Inline: true Aug 13 18:55:21.849983399 (121h29m2.581251049s) [upload=126500]: Waiting for error group managing segments... Aug 13 18:55:21.850034435 (121h29m2.581302065s) [upload=126500]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 18:55:21.850040105 (121h29m2.581307765s) [upload=126500]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 18:55:21.850044223 (121h29m2.581311853s) [upload=126500]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 18:55:21.852506835 (121h29m2.583774465s) [upload=126500]: Done uploading segments... Aug 13 18:55:21.852521132 (121h29m2.583788762s) [upload=126500]: Upload finished. err: metaclient: Too Many Requests
Duration: 241.977295ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
148.797501ms
FAIL (2025-08-13 19:27:42 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 18:55:21.849790646 (121h29m2.581058266s) [upload=126500]: Starting upload Aug 13 18:55:21.849866529 (121h29m2.581134149s) [upload=126500]: Done starting upload Aug 13 18:55:21.849939096 (121h29m2.581206726s) [upload=126500]: Uploading segments... Aug 13 18:55:21.849977618 (121h29m2.581245248s) [upload=126500]: Got next segment. Inline: true Aug 13 18:55:21.849983399 (121h29m2.581251049s) [upload=126500]: Waiting for error group managing segments... Aug 13 18:55:21.850034435 (121h29m2.581302065s) [upload=126500]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 18:55:21.850040105 (121h29m2.581307765s) [upload=126500]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 18:55:21.850044223 (121h29m2.581311853s) [upload=126500]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 18:55:21.852506835 (121h29m2.583774465s) [upload=126500]: Done uploading segments... Aug 13 18:55:21.852521132 (121h29m2.583788762s) [upload=126500]: Upload finished. err: metaclient: Too Many Requests
Duration: 148.81817ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........................X.......X...........................] duration:
423.029689ms
FAIL (2025-08-13 19:27:37 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 13 19:08:20.572767219 (121h42m1.304034869s) [upload=126718]: Starting upload
Aug 13 19:08:20.572840447 (121h42m1.304108097s) [upload=126718]: Done starting upload
Aug 13 19:08:20.572952778 (121h42m1.304220427s) [upload=126718]: Uploading segments...
Aug 13 19:08:20.573276887 (121h42m1.304544547s) [upload=126718]: Got next segment. Inline: false
Aug 13 19:08:20.573342571 (121h42m1.304610222s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 19:08:20.573351448 (121h42m1.304619119s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 19:08:20.613293228 (121h42m1.344560888s) [seg_pos={0 0}, upload=126718]: Begin upload segment...
Aug 13 19:08:20.613362899 (121h42m1.344630549s) [seg_pos={0 0}, upload=126718]: Done begin upload segment.
Aug 13 19:08:20.613395610 (121h42m1.34466326s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613479168 (121h42m1.344746828s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613933462 (121h42m1.345201122s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613966173 (121h42m1.345233824s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614473598 (121h42m1.345741248s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614513222 (121h42m1.345780882s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614845417 (121h42m1.346113078s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615068767 (121h42m1.346336418s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615223789 (121h42m1.346491439s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615618681 (121h42m1.346886332s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615644741 (121h42m1.346912401s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616154590 (121h42m1.34742224s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616169798 (121h42m1.347437449s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616718090 (121h42m1.347985739s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616748518 (121h42m1.348016167s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.617120096 (121h42m1.348387746s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.622023970 (121h42m1.353291681s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.622840135 (121h42m1.354107785s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.727179166 (121h42m1.458446786s) [upload=126718]: Next returned nil segment
Aug 13 19:08:20.727279234 (121h42m1.458546864s) [upload=126718]: Waiting for error group managing segments...
Aug 13 19:08:20.740817168 (121h42m1.472084789s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.741709907 (121h42m1.472977537s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.741976870 (121h42m1.4732445s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.748823638 (121h42m1.480091268s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.750729704 (121h42m1.481997324s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.751278897 (121h42m1.482546527s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.763551371 (121h42m1.494819001s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.768221566 (121h42m1.499489196s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.769131177 (121h42m1.500398808s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.769654381 (121h42m1.500922002s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.770436272 (121h42m1.501703892s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.126424712 (121h42m1.857692362s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.134590111 (121h42m1.865857762s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.150885924 (121h42m1.882153574s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.150912293 (121h42m1.882179944s) [seg_pos={0 0}, upload=126718]: Segment reached optimal threshold of 14 pieces.
Aug 13 19:08:21.151075060 (121h42m1.88234271s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hdE48UnygY1dCRASR39FkumY2V8f5Xb68Pd1WJ4AMLUnnGAfT): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151110567 (121h42m1.882378216s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151167683 (121h42m1.882435334s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tnTEYvqJ6PB2DsuXA28sEuEiGj11StA4qdhcYH1kuoaMkTVdY): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151282079 (121h42m1.882549729s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151301135 (121h42m1.882568775s) [seg_pos={0 0}, upload=126718]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 19:08:21.151371136 (121h42m1.882638776s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 19:08:21.151376356 (121h42m1.882644006s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 19:08:21.328511696 (121h42m2.059779306s) [upload=126718]: Done uploading segments...
Aug 13 19:08:21.328527987 (121h42m2.059795618s) [upload=126718]: Upload finished. err: <nil>
Duration: 423.061499ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........................X.......X..........................] duration:
623.928347ms
FAIL (2025-08-13 19:26:46 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 13 19:08:20.572767219 (121h42m1.304034869s) [upload=126718]: Starting upload
Aug 13 19:08:20.572840447 (121h42m1.304108097s) [upload=126718]: Done starting upload
Aug 13 19:08:20.572952778 (121h42m1.304220427s) [upload=126718]: Uploading segments...
Aug 13 19:08:20.573276887 (121h42m1.304544547s) [upload=126718]: Got next segment. Inline: false
Aug 13 19:08:20.573342571 (121h42m1.304610222s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 19:08:20.573351448 (121h42m1.304619119s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 19:08:20.613293228 (121h42m1.344560888s) [seg_pos={0 0}, upload=126718]: Begin upload segment...
Aug 13 19:08:20.613362899 (121h42m1.344630549s) [seg_pos={0 0}, upload=126718]: Done begin upload segment.
Aug 13 19:08:20.613395610 (121h42m1.34466326s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613479168 (121h42m1.344746828s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613933462 (121h42m1.345201122s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613966173 (121h42m1.345233824s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614473598 (121h42m1.345741248s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614513222 (121h42m1.345780882s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614845417 (121h42m1.346113078s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615068767 (121h42m1.346336418s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615223789 (121h42m1.346491439s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615618681 (121h42m1.346886332s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615644741 (121h42m1.346912401s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616154590 (121h42m1.34742224s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616169798 (121h42m1.347437449s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616718090 (121h42m1.347985739s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616748518 (121h42m1.348016167s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.617120096 (121h42m1.348387746s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.622023970 (121h42m1.353291681s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.622840135 (121h42m1.354107785s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.727179166 (121h42m1.458446786s) [upload=126718]: Next returned nil segment
Aug 13 19:08:20.727279234 (121h42m1.458546864s) [upload=126718]: Waiting for error group managing segments...
Aug 13 19:08:20.740817168 (121h42m1.472084789s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.741709907 (121h42m1.472977537s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.741976870 (121h42m1.4732445s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.748823638 (121h42m1.480091268s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.750729704 (121h42m1.481997324s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.751278897 (121h42m1.482546527s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.763551371 (121h42m1.494819001s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.768221566 (121h42m1.499489196s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.769131177 (121h42m1.500398808s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.769654381 (121h42m1.500922002s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.770436272 (121h42m1.501703892s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.126424712 (121h42m1.857692362s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.134590111 (121h42m1.865857762s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.150885924 (121h42m1.882153574s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.150912293 (121h42m1.882179944s) [seg_pos={0 0}, upload=126718]: Segment reached optimal threshold of 14 pieces.
Aug 13 19:08:21.151075060 (121h42m1.88234271s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hdE48UnygY1dCRASR39FkumY2V8f5Xb68Pd1WJ4AMLUnnGAfT): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151110567 (121h42m1.882378216s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151167683 (121h42m1.882435334s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tnTEYvqJ6PB2DsuXA28sEuEiGj11StA4qdhcYH1kuoaMkTVdY): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151282079 (121h42m1.882549729s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151301135 (121h42m1.882568775s) [seg_pos={0 0}, upload=126718]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 19:08:21.151371136 (121h42m1.882638776s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 19:08:21.151376356 (121h42m1.882644006s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 19:08:21.328511696 (121h42m2.059779306s) [upload=126718]: Done uploading segments...
Aug 13 19:08:21.328527987 (121h42m2.059795618s) [upload=126718]: Upload finished. err: <nil>
Duration: 623.953373ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
192.998258ms
FAIL (2025-08-13 19:26:33 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 18:55:21.849790646 (121h29m2.581058266s) [upload=126500]: Starting upload Aug 13 18:55:21.849866529 (121h29m2.581134149s) [upload=126500]: Done starting upload Aug 13 18:55:21.849939096 (121h29m2.581206726s) [upload=126500]: Uploading segments... Aug 13 18:55:21.849977618 (121h29m2.581245248s) [upload=126500]: Got next segment. Inline: true Aug 13 18:55:21.849983399 (121h29m2.581251049s) [upload=126500]: Waiting for error group managing segments... Aug 13 18:55:21.850034435 (121h29m2.581302065s) [upload=126500]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 18:55:21.850040105 (121h29m2.581307765s) [upload=126500]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 18:55:21.850044223 (121h29m2.581311853s) [upload=126500]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 18:55:21.852506835 (121h29m2.583774465s) [upload=126500]: Done uploading segments... Aug 13 18:55:21.852521132 (121h29m2.583788762s) [upload=126500]: Upload finished. err: metaclient: Too Many Requests
Duration: 193.027974ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
166.980864ms
FAIL (2025-08-13 19:26:09 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 18:55:21.849790646 (121h29m2.581058266s) [upload=126500]: Starting upload Aug 13 18:55:21.849866529 (121h29m2.581134149s) [upload=126500]: Done starting upload Aug 13 18:55:21.849939096 (121h29m2.581206726s) [upload=126500]: Uploading segments... Aug 13 18:55:21.849977618 (121h29m2.581245248s) [upload=126500]: Got next segment. Inline: true Aug 13 18:55:21.849983399 (121h29m2.581251049s) [upload=126500]: Waiting for error group managing segments... Aug 13 18:55:21.850034435 (121h29m2.581302065s) [upload=126500]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 18:55:21.850040105 (121h29m2.581307765s) [upload=126500]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 18:55:21.850044223 (121h29m2.581311853s) [upload=126500]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 18:55:21.852506835 (121h29m2.583774465s) [upload=126500]: Done uploading segments... Aug 13 18:55:21.852521132 (121h29m2.583788762s) [upload=126500]: Upload finished. err: metaclient: Too Many Requests
Duration: 167.002405ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [X.........................X.......X.........................] duration:
1.506227838s
FAIL (2025-08-13 19:26:02 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 13 19:08:20.572767219 (121h42m1.304034869s) [upload=126718]: Starting upload
Aug 13 19:08:20.572840447 (121h42m1.304108097s) [upload=126718]: Done starting upload
Aug 13 19:08:20.572952778 (121h42m1.304220427s) [upload=126718]: Uploading segments...
Aug 13 19:08:20.573276887 (121h42m1.304544547s) [upload=126718]: Got next segment. Inline: false
Aug 13 19:08:20.573342571 (121h42m1.304610222s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 19:08:20.573351448 (121h42m1.304619119s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 19:08:20.613293228 (121h42m1.344560888s) [seg_pos={0 0}, upload=126718]: Begin upload segment...
Aug 13 19:08:20.613362899 (121h42m1.344630549s) [seg_pos={0 0}, upload=126718]: Done begin upload segment.
Aug 13 19:08:20.613395610 (121h42m1.34466326s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613479168 (121h42m1.344746828s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613933462 (121h42m1.345201122s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613966173 (121h42m1.345233824s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614473598 (121h42m1.345741248s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614513222 (121h42m1.345780882s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614845417 (121h42m1.346113078s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615068767 (121h42m1.346336418s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615223789 (121h42m1.346491439s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615618681 (121h42m1.346886332s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615644741 (121h42m1.346912401s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616154590 (121h42m1.34742224s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616169798 (121h42m1.347437449s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616718090 (121h42m1.347985739s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616748518 (121h42m1.348016167s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.617120096 (121h42m1.348387746s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.622023970 (121h42m1.353291681s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.622840135 (121h42m1.354107785s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.727179166 (121h42m1.458446786s) [upload=126718]: Next returned nil segment
Aug 13 19:08:20.727279234 (121h42m1.458546864s) [upload=126718]: Waiting for error group managing segments...
Aug 13 19:08:20.740817168 (121h42m1.472084789s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.741709907 (121h42m1.472977537s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.741976870 (121h42m1.4732445s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.748823638 (121h42m1.480091268s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.750729704 (121h42m1.481997324s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.751278897 (121h42m1.482546527s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.763551371 (121h42m1.494819001s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.768221566 (121h42m1.499489196s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.769131177 (121h42m1.500398808s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.769654381 (121h42m1.500922002s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.770436272 (121h42m1.501703892s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.126424712 (121h42m1.857692362s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.134590111 (121h42m1.865857762s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.150885924 (121h42m1.882153574s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.150912293 (121h42m1.882179944s) [seg_pos={0 0}, upload=126718]: Segment reached optimal threshold of 14 pieces.
Aug 13 19:08:21.151075060 (121h42m1.88234271s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hdE48UnygY1dCRASR39FkumY2V8f5Xb68Pd1WJ4AMLUnnGAfT): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151110567 (121h42m1.882378216s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151167683 (121h42m1.882435334s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tnTEYvqJ6PB2DsuXA28sEuEiGj11StA4qdhcYH1kuoaMkTVdY): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151282079 (121h42m1.882549729s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151301135 (121h42m1.882568775s) [seg_pos={0 0}, upload=126718]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 19:08:21.151371136 (121h42m1.882638776s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 19:08:21.151376356 (121h42m1.882644006s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 19:08:21.328511696 (121h42m2.059779306s) [upload=126718]: Done uploading segments...
Aug 13 19:08:21.328527987 (121h42m2.059795618s) [upload=126718]: Upload finished. err: <nil>
Duration: 1.506279293s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.X.........................X.......X........................] duration:
423.0363ms
FAIL (2025-08-13 19:25:10 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 13 19:08:20.572767219 (121h42m1.304034869s) [upload=126718]: Starting upload
Aug 13 19:08:20.572840447 (121h42m1.304108097s) [upload=126718]: Done starting upload
Aug 13 19:08:20.572952778 (121h42m1.304220427s) [upload=126718]: Uploading segments...
Aug 13 19:08:20.573276887 (121h42m1.304544547s) [upload=126718]: Got next segment. Inline: false
Aug 13 19:08:20.573342571 (121h42m1.304610222s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 19:08:20.573351448 (121h42m1.304619119s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 19:08:20.613293228 (121h42m1.344560888s) [seg_pos={0 0}, upload=126718]: Begin upload segment...
Aug 13 19:08:20.613362899 (121h42m1.344630549s) [seg_pos={0 0}, upload=126718]: Done begin upload segment.
Aug 13 19:08:20.613395610 (121h42m1.34466326s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613479168 (121h42m1.344746828s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613933462 (121h42m1.345201122s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613966173 (121h42m1.345233824s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614473598 (121h42m1.345741248s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614513222 (121h42m1.345780882s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614845417 (121h42m1.346113078s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615068767 (121h42m1.346336418s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615223789 (121h42m1.346491439s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615618681 (121h42m1.346886332s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615644741 (121h42m1.346912401s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616154590 (121h42m1.34742224s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616169798 (121h42m1.347437449s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616718090 (121h42m1.347985739s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616748518 (121h42m1.348016167s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.617120096 (121h42m1.348387746s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.622023970 (121h42m1.353291681s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.622840135 (121h42m1.354107785s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.727179166 (121h42m1.458446786s) [upload=126718]: Next returned nil segment
Aug 13 19:08:20.727279234 (121h42m1.458546864s) [upload=126718]: Waiting for error group managing segments...
Aug 13 19:08:20.740817168 (121h42m1.472084789s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.741709907 (121h42m1.472977537s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.741976870 (121h42m1.4732445s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.748823638 (121h42m1.480091268s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.750729704 (121h42m1.481997324s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.751278897 (121h42m1.482546527s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.763551371 (121h42m1.494819001s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.768221566 (121h42m1.499489196s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.769131177 (121h42m1.500398808s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.769654381 (121h42m1.500922002s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.770436272 (121h42m1.501703892s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.126424712 (121h42m1.857692362s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.134590111 (121h42m1.865857762s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.150885924 (121h42m1.882153574s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.150912293 (121h42m1.882179944s) [seg_pos={0 0}, upload=126718]: Segment reached optimal threshold of 14 pieces.
Aug 13 19:08:21.151075060 (121h42m1.88234271s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hdE48UnygY1dCRASR39FkumY2V8f5Xb68Pd1WJ4AMLUnnGAfT): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151110567 (121h42m1.882378216s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151167683 (121h42m1.882435334s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tnTEYvqJ6PB2DsuXA28sEuEiGj11StA4qdhcYH1kuoaMkTVdY): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151282079 (121h42m1.882549729s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151301135 (121h42m1.882568775s) [seg_pos={0 0}, upload=126718]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 19:08:21.151371136 (121h42m1.882638776s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 19:08:21.151376356 (121h42m1.882644006s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 19:08:21.328511696 (121h42m2.059779306s) [upload=126718]: Done uploading segments...
Aug 13 19:08:21.328527987 (121h42m2.059795618s) [upload=126718]: Upload finished. err: <nil>
Duration: 423.062899ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
214.79563ms
FAIL (2025-08-13 19:24:58 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 18:55:21.849790646 (121h29m2.581058266s) [upload=126500]: Starting upload Aug 13 18:55:21.849866529 (121h29m2.581134149s) [upload=126500]: Done starting upload Aug 13 18:55:21.849939096 (121h29m2.581206726s) [upload=126500]: Uploading segments... Aug 13 18:55:21.849977618 (121h29m2.581245248s) [upload=126500]: Got next segment. Inline: true Aug 13 18:55:21.849983399 (121h29m2.581251049s) [upload=126500]: Waiting for error group managing segments... Aug 13 18:55:21.850034435 (121h29m2.581302065s) [upload=126500]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 18:55:21.850040105 (121h29m2.581307765s) [upload=126500]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 18:55:21.850044223 (121h29m2.581311853s) [upload=126500]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 18:55:21.852506835 (121h29m2.583774465s) [upload=126500]: Done uploading segments... Aug 13 18:55:21.852521132 (121h29m2.583788762s) [upload=126500]: Upload finished. err: metaclient: Too Many Requests
Duration: 214.817792ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..X.........................X.......X.......................] duration:
553.339539ms
FAIL (2025-08-13 19:24:50 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 13 19:08:20.572767219 (121h42m1.304034869s) [upload=126718]: Starting upload
Aug 13 19:08:20.572840447 (121h42m1.304108097s) [upload=126718]: Done starting upload
Aug 13 19:08:20.572952778 (121h42m1.304220427s) [upload=126718]: Uploading segments...
Aug 13 19:08:20.573276887 (121h42m1.304544547s) [upload=126718]: Got next segment. Inline: false
Aug 13 19:08:20.573342571 (121h42m1.304610222s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 19:08:20.573351448 (121h42m1.304619119s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 19:08:20.613293228 (121h42m1.344560888s) [seg_pos={0 0}, upload=126718]: Begin upload segment...
Aug 13 19:08:20.613362899 (121h42m1.344630549s) [seg_pos={0 0}, upload=126718]: Done begin upload segment.
Aug 13 19:08:20.613395610 (121h42m1.34466326s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613479168 (121h42m1.344746828s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613933462 (121h42m1.345201122s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613966173 (121h42m1.345233824s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614473598 (121h42m1.345741248s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614513222 (121h42m1.345780882s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614845417 (121h42m1.346113078s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615068767 (121h42m1.346336418s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615223789 (121h42m1.346491439s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615618681 (121h42m1.346886332s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615644741 (121h42m1.346912401s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616154590 (121h42m1.34742224s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616169798 (121h42m1.347437449s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616718090 (121h42m1.347985739s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616748518 (121h42m1.348016167s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.617120096 (121h42m1.348387746s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.622023970 (121h42m1.353291681s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.622840135 (121h42m1.354107785s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.727179166 (121h42m1.458446786s) [upload=126718]: Next returned nil segment
Aug 13 19:08:20.727279234 (121h42m1.458546864s) [upload=126718]: Waiting for error group managing segments...
Aug 13 19:08:20.740817168 (121h42m1.472084789s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.741709907 (121h42m1.472977537s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.741976870 (121h42m1.4732445s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.748823638 (121h42m1.480091268s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.750729704 (121h42m1.481997324s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.751278897 (121h42m1.482546527s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.763551371 (121h42m1.494819001s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.768221566 (121h42m1.499489196s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.769131177 (121h42m1.500398808s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.769654381 (121h42m1.500922002s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.770436272 (121h42m1.501703892s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.126424712 (121h42m1.857692362s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.134590111 (121h42m1.865857762s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.150885924 (121h42m1.882153574s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.150912293 (121h42m1.882179944s) [seg_pos={0 0}, upload=126718]: Segment reached optimal threshold of 14 pieces.
Aug 13 19:08:21.151075060 (121h42m1.88234271s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hdE48UnygY1dCRASR39FkumY2V8f5Xb68Pd1WJ4AMLUnnGAfT): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151110567 (121h42m1.882378216s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151167683 (121h42m1.882435334s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tnTEYvqJ6PB2DsuXA28sEuEiGj11StA4qdhcYH1kuoaMkTVdY): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151282079 (121h42m1.882549729s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151301135 (121h42m1.882568775s) [seg_pos={0 0}, upload=126718]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 19:08:21.151371136 (121h42m1.882638776s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 19:08:21.151376356 (121h42m1.882644006s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 19:08:21.328511696 (121h42m2.059779306s) [upload=126718]: Done uploading segments...
Aug 13 19:08:21.328527987 (121h42m2.059795618s) [upload=126718]: Upload finished. err: <nil>
Duration: 553.363233ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...X.........................X.......X......................] duration:
904.070182ms
FAIL (2025-08-13 19:24:02 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 13 19:08:20.572767219 (121h42m1.304034869s) [upload=126718]: Starting upload
Aug 13 19:08:20.572840447 (121h42m1.304108097s) [upload=126718]: Done starting upload
Aug 13 19:08:20.572952778 (121h42m1.304220427s) [upload=126718]: Uploading segments...
Aug 13 19:08:20.573276887 (121h42m1.304544547s) [upload=126718]: Got next segment. Inline: false
Aug 13 19:08:20.573342571 (121h42m1.304610222s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 19:08:20.573351448 (121h42m1.304619119s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 19:08:20.613293228 (121h42m1.344560888s) [seg_pos={0 0}, upload=126718]: Begin upload segment...
Aug 13 19:08:20.613362899 (121h42m1.344630549s) [seg_pos={0 0}, upload=126718]: Done begin upload segment.
Aug 13 19:08:20.613395610 (121h42m1.34466326s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613479168 (121h42m1.344746828s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613933462 (121h42m1.345201122s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613966173 (121h42m1.345233824s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614473598 (121h42m1.345741248s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614513222 (121h42m1.345780882s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614845417 (121h42m1.346113078s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615068767 (121h42m1.346336418s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615223789 (121h42m1.346491439s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615618681 (121h42m1.346886332s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615644741 (121h42m1.346912401s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616154590 (121h42m1.34742224s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616169798 (121h42m1.347437449s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616718090 (121h42m1.347985739s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616748518 (121h42m1.348016167s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.617120096 (121h42m1.348387746s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.622023970 (121h42m1.353291681s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.622840135 (121h42m1.354107785s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.727179166 (121h42m1.458446786s) [upload=126718]: Next returned nil segment
Aug 13 19:08:20.727279234 (121h42m1.458546864s) [upload=126718]: Waiting for error group managing segments...
Aug 13 19:08:20.740817168 (121h42m1.472084789s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.741709907 (121h42m1.472977537s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.741976870 (121h42m1.4732445s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.748823638 (121h42m1.480091268s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.750729704 (121h42m1.481997324s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.751278897 (121h42m1.482546527s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.763551371 (121h42m1.494819001s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.768221566 (121h42m1.499489196s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.769131177 (121h42m1.500398808s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.769654381 (121h42m1.500922002s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.770436272 (121h42m1.501703892s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.126424712 (121h42m1.857692362s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.134590111 (121h42m1.865857762s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.150885924 (121h42m1.882153574s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.150912293 (121h42m1.882179944s) [seg_pos={0 0}, upload=126718]: Segment reached optimal threshold of 14 pieces.
Aug 13 19:08:21.151075060 (121h42m1.88234271s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hdE48UnygY1dCRASR39FkumY2V8f5Xb68Pd1WJ4AMLUnnGAfT): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151110567 (121h42m1.882378216s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151167683 (121h42m1.882435334s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tnTEYvqJ6PB2DsuXA28sEuEiGj11StA4qdhcYH1kuoaMkTVdY): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151282079 (121h42m1.882549729s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151301135 (121h42m1.882568775s) [seg_pos={0 0}, upload=126718]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 19:08:21.151371136 (121h42m1.882638776s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 19:08:21.151376356 (121h42m1.882644006s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 19:08:21.328511696 (121h42m2.059779306s) [upload=126718]: Done uploading segments...
Aug 13 19:08:21.328527987 (121h42m2.059795618s) [upload=126718]: Upload finished. err: <nil>
Duration: 904.095751ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
276.308039ms
FAIL (2025-08-13 19:24:02 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 18:55:21.849790646 (121h29m2.581058266s) [upload=126500]: Starting upload Aug 13 18:55:21.849866529 (121h29m2.581134149s) [upload=126500]: Done starting upload Aug 13 18:55:21.849939096 (121h29m2.581206726s) [upload=126500]: Uploading segments... Aug 13 18:55:21.849977618 (121h29m2.581245248s) [upload=126500]: Got next segment. Inline: true Aug 13 18:55:21.849983399 (121h29m2.581251049s) [upload=126500]: Waiting for error group managing segments... Aug 13 18:55:21.850034435 (121h29m2.581302065s) [upload=126500]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 18:55:21.850040105 (121h29m2.581307765s) [upload=126500]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 18:55:21.850044223 (121h29m2.581311853s) [upload=126500]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 18:55:21.852506835 (121h29m2.583774465s) [upload=126500]: Done uploading segments... Aug 13 18:55:21.852521132 (121h29m2.583788762s) [upload=126500]: Upload finished. err: metaclient: Too Many Requests
Duration: 276.335091ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
239.507704ms
FAIL (2025-08-13 19:23:25 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 18:55:21.849790646 (121h29m2.581058266s) [upload=126500]: Starting upload Aug 13 18:55:21.849866529 (121h29m2.581134149s) [upload=126500]: Done starting upload Aug 13 18:55:21.849939096 (121h29m2.581206726s) [upload=126500]: Uploading segments... Aug 13 18:55:21.849977618 (121h29m2.581245248s) [upload=126500]: Got next segment. Inline: true Aug 13 18:55:21.849983399 (121h29m2.581251049s) [upload=126500]: Waiting for error group managing segments... Aug 13 18:55:21.850034435 (121h29m2.581302065s) [upload=126500]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 18:55:21.850040105 (121h29m2.581307765s) [upload=126500]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 18:55:21.850044223 (121h29m2.581311853s) [upload=126500]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 18:55:21.852506835 (121h29m2.583774465s) [upload=126500]: Done uploading segments... Aug 13 18:55:21.852521132 (121h29m2.583788762s) [upload=126500]: Upload finished. err: metaclient: Too Many Requests
Duration: 239.527682ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
436.755911ms
FAIL (2025-08-13 19:23:00 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 18:55:21.849790646 (121h29m2.581058266s) [upload=126500]: Starting upload Aug 13 18:55:21.849866529 (121h29m2.581134149s) [upload=126500]: Done starting upload Aug 13 18:55:21.849939096 (121h29m2.581206726s) [upload=126500]: Uploading segments... Aug 13 18:55:21.849977618 (121h29m2.581245248s) [upload=126500]: Got next segment. Inline: true Aug 13 18:55:21.849983399 (121h29m2.581251049s) [upload=126500]: Waiting for error group managing segments... Aug 13 18:55:21.850034435 (121h29m2.581302065s) [upload=126500]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 18:55:21.850040105 (121h29m2.581307765s) [upload=126500]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 18:55:21.850044223 (121h29m2.581311853s) [upload=126500]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 18:55:21.852506835 (121h29m2.583774465s) [upload=126500]: Done uploading segments... Aug 13 18:55:21.852521132 (121h29m2.583788762s) [upload=126500]: Upload finished. err: metaclient: Too Many Requests
Duration: 436.785778ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [....X.........................X.......X.....................] duration:
712.560051ms
FAIL (2025-08-13 19:22:56 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 13 19:08:20.572767219 (121h42m1.304034869s) [upload=126718]: Starting upload
Aug 13 19:08:20.572840447 (121h42m1.304108097s) [upload=126718]: Done starting upload
Aug 13 19:08:20.572952778 (121h42m1.304220427s) [upload=126718]: Uploading segments...
Aug 13 19:08:20.573276887 (121h42m1.304544547s) [upload=126718]: Got next segment. Inline: false
Aug 13 19:08:20.573342571 (121h42m1.304610222s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 19:08:20.573351448 (121h42m1.304619119s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 19:08:20.613293228 (121h42m1.344560888s) [seg_pos={0 0}, upload=126718]: Begin upload segment...
Aug 13 19:08:20.613362899 (121h42m1.344630549s) [seg_pos={0 0}, upload=126718]: Done begin upload segment.
Aug 13 19:08:20.613395610 (121h42m1.34466326s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613479168 (121h42m1.344746828s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613933462 (121h42m1.345201122s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613966173 (121h42m1.345233824s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614473598 (121h42m1.345741248s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614513222 (121h42m1.345780882s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614845417 (121h42m1.346113078s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615068767 (121h42m1.346336418s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615223789 (121h42m1.346491439s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615618681 (121h42m1.346886332s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615644741 (121h42m1.346912401s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616154590 (121h42m1.34742224s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616169798 (121h42m1.347437449s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616718090 (121h42m1.347985739s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616748518 (121h42m1.348016167s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.617120096 (121h42m1.348387746s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.622023970 (121h42m1.353291681s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.622840135 (121h42m1.354107785s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.727179166 (121h42m1.458446786s) [upload=126718]: Next returned nil segment
Aug 13 19:08:20.727279234 (121h42m1.458546864s) [upload=126718]: Waiting for error group managing segments...
Aug 13 19:08:20.740817168 (121h42m1.472084789s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.741709907 (121h42m1.472977537s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.741976870 (121h42m1.4732445s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.748823638 (121h42m1.480091268s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.750729704 (121h42m1.481997324s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.751278897 (121h42m1.482546527s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.763551371 (121h42m1.494819001s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.768221566 (121h42m1.499489196s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.769131177 (121h42m1.500398808s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.769654381 (121h42m1.500922002s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.770436272 (121h42m1.501703892s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.126424712 (121h42m1.857692362s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.134590111 (121h42m1.865857762s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.150885924 (121h42m1.882153574s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.150912293 (121h42m1.882179944s) [seg_pos={0 0}, upload=126718]: Segment reached optimal threshold of 14 pieces.
Aug 13 19:08:21.151075060 (121h42m1.88234271s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hdE48UnygY1dCRASR39FkumY2V8f5Xb68Pd1WJ4AMLUnnGAfT): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151110567 (121h42m1.882378216s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151167683 (121h42m1.882435334s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tnTEYvqJ6PB2DsuXA28sEuEiGj11StA4qdhcYH1kuoaMkTVdY): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151282079 (121h42m1.882549729s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151301135 (121h42m1.882568775s) [seg_pos={0 0}, upload=126718]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 19:08:21.151371136 (121h42m1.882638776s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 19:08:21.151376356 (121h42m1.882644006s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 19:08:21.328511696 (121h42m2.059779306s) [upload=126718]: Done uploading segments...
Aug 13 19:08:21.328527987 (121h42m2.059795618s) [upload=126718]: Upload finished. err: <nil>
Duration: 712.584177ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....X.........................X.......X....................] duration:
736.019217ms
FAIL (2025-08-13 19:21:58 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 13 19:08:20.572767219 (121h42m1.304034869s) [upload=126718]: Starting upload
Aug 13 19:08:20.572840447 (121h42m1.304108097s) [upload=126718]: Done starting upload
Aug 13 19:08:20.572952778 (121h42m1.304220427s) [upload=126718]: Uploading segments...
Aug 13 19:08:20.573276887 (121h42m1.304544547s) [upload=126718]: Got next segment. Inline: false
Aug 13 19:08:20.573342571 (121h42m1.304610222s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 19:08:20.573351448 (121h42m1.304619119s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 19:08:20.613293228 (121h42m1.344560888s) [seg_pos={0 0}, upload=126718]: Begin upload segment...
Aug 13 19:08:20.613362899 (121h42m1.344630549s) [seg_pos={0 0}, upload=126718]: Done begin upload segment.
Aug 13 19:08:20.613395610 (121h42m1.34466326s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613479168 (121h42m1.344746828s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613933462 (121h42m1.345201122s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613966173 (121h42m1.345233824s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614473598 (121h42m1.345741248s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614513222 (121h42m1.345780882s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614845417 (121h42m1.346113078s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615068767 (121h42m1.346336418s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615223789 (121h42m1.346491439s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615618681 (121h42m1.346886332s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615644741 (121h42m1.346912401s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616154590 (121h42m1.34742224s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616169798 (121h42m1.347437449s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616718090 (121h42m1.347985739s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616748518 (121h42m1.348016167s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.617120096 (121h42m1.348387746s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.622023970 (121h42m1.353291681s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.622840135 (121h42m1.354107785s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.727179166 (121h42m1.458446786s) [upload=126718]: Next returned nil segment
Aug 13 19:08:20.727279234 (121h42m1.458546864s) [upload=126718]: Waiting for error group managing segments...
Aug 13 19:08:20.740817168 (121h42m1.472084789s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.741709907 (121h42m1.472977537s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.741976870 (121h42m1.4732445s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.748823638 (121h42m1.480091268s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.750729704 (121h42m1.481997324s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.751278897 (121h42m1.482546527s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.763551371 (121h42m1.494819001s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.768221566 (121h42m1.499489196s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.769131177 (121h42m1.500398808s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.769654381 (121h42m1.500922002s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.770436272 (121h42m1.501703892s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.126424712 (121h42m1.857692362s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.134590111 (121h42m1.865857762s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.150885924 (121h42m1.882153574s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.150912293 (121h42m1.882179944s) [seg_pos={0 0}, upload=126718]: Segment reached optimal threshold of 14 pieces.
Aug 13 19:08:21.151075060 (121h42m1.88234271s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hdE48UnygY1dCRASR39FkumY2V8f5Xb68Pd1WJ4AMLUnnGAfT): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151110567 (121h42m1.882378216s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151167683 (121h42m1.882435334s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tnTEYvqJ6PB2DsuXA28sEuEiGj11StA4qdhcYH1kuoaMkTVdY): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151282079 (121h42m1.882549729s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151301135 (121h42m1.882568775s) [seg_pos={0 0}, upload=126718]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 19:08:21.151371136 (121h42m1.882638776s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 19:08:21.151376356 (121h42m1.882644006s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 19:08:21.328511696 (121h42m2.059779306s) [upload=126718]: Done uploading segments...
Aug 13 19:08:21.328527987 (121h42m2.059795618s) [upload=126718]: Upload finished. err: <nil>
Duration: 736.046399ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [X........................X..................................] duration:
183.625219ms
FAIL (2025-08-13 19:21:53 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 18:55:21.849790646 (121h29m2.581058266s) [upload=126500]: Starting upload Aug 13 18:55:21.849866529 (121h29m2.581134149s) [upload=126500]: Done starting upload Aug 13 18:55:21.849939096 (121h29m2.581206726s) [upload=126500]: Uploading segments... Aug 13 18:55:21.849977618 (121h29m2.581245248s) [upload=126500]: Got next segment. Inline: true Aug 13 18:55:21.849983399 (121h29m2.581251049s) [upload=126500]: Waiting for error group managing segments... Aug 13 18:55:21.850034435 (121h29m2.581302065s) [upload=126500]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 18:55:21.850040105 (121h29m2.581307765s) [upload=126500]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 18:55:21.850044223 (121h29m2.581311853s) [upload=126500]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 18:55:21.852506835 (121h29m2.583774465s) [upload=126500]: Done uploading segments... Aug 13 18:55:21.852521132 (121h29m2.583788762s) [upload=126500]: Upload finished. err: metaclient: Too Many Requests
Duration: 183.660906ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.X........................X.................................] duration:
320.49461ms
FAIL (2025-08-13 19:21:31 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 18:55:21.849790646 (121h29m2.581058266s) [upload=126500]: Starting upload Aug 13 18:55:21.849866529 (121h29m2.581134149s) [upload=126500]: Done starting upload Aug 13 18:55:21.849939096 (121h29m2.581206726s) [upload=126500]: Uploading segments... Aug 13 18:55:21.849977618 (121h29m2.581245248s) [upload=126500]: Got next segment. Inline: true Aug 13 18:55:21.849983399 (121h29m2.581251049s) [upload=126500]: Waiting for error group managing segments... Aug 13 18:55:21.850034435 (121h29m2.581302065s) [upload=126500]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 18:55:21.850040105 (121h29m2.581307765s) [upload=126500]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 18:55:21.850044223 (121h29m2.581311853s) [upload=126500]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 18:55:21.852506835 (121h29m2.583774465s) [upload=126500]: Done uploading segments... Aug 13 18:55:21.852521132 (121h29m2.583788762s) [upload=126500]: Upload finished. err: metaclient: Too Many Requests
Duration: 320.521249ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......X.........................X.......X...................] duration:
771.031834ms
FAIL (2025-08-13 19:20:46 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 13 19:08:20.572767219 (121h42m1.304034869s) [upload=126718]: Starting upload
Aug 13 19:08:20.572840447 (121h42m1.304108097s) [upload=126718]: Done starting upload
Aug 13 19:08:20.572952778 (121h42m1.304220427s) [upload=126718]: Uploading segments...
Aug 13 19:08:20.573276887 (121h42m1.304544547s) [upload=126718]: Got next segment. Inline: false
Aug 13 19:08:20.573342571 (121h42m1.304610222s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 19:08:20.573351448 (121h42m1.304619119s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 19:08:20.613293228 (121h42m1.344560888s) [seg_pos={0 0}, upload=126718]: Begin upload segment...
Aug 13 19:08:20.613362899 (121h42m1.344630549s) [seg_pos={0 0}, upload=126718]: Done begin upload segment.
Aug 13 19:08:20.613395610 (121h42m1.34466326s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613479168 (121h42m1.344746828s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613933462 (121h42m1.345201122s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613966173 (121h42m1.345233824s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614473598 (121h42m1.345741248s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614513222 (121h42m1.345780882s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614845417 (121h42m1.346113078s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615068767 (121h42m1.346336418s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615223789 (121h42m1.346491439s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615618681 (121h42m1.346886332s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615644741 (121h42m1.346912401s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616154590 (121h42m1.34742224s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616169798 (121h42m1.347437449s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616718090 (121h42m1.347985739s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616748518 (121h42m1.348016167s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.617120096 (121h42m1.348387746s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.622023970 (121h42m1.353291681s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.622840135 (121h42m1.354107785s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.727179166 (121h42m1.458446786s) [upload=126718]: Next returned nil segment
Aug 13 19:08:20.727279234 (121h42m1.458546864s) [upload=126718]: Waiting for error group managing segments...
Aug 13 19:08:20.740817168 (121h42m1.472084789s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.741709907 (121h42m1.472977537s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.741976870 (121h42m1.4732445s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.748823638 (121h42m1.480091268s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.750729704 (121h42m1.481997324s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.751278897 (121h42m1.482546527s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.763551371 (121h42m1.494819001s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.768221566 (121h42m1.499489196s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.769131177 (121h42m1.500398808s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.769654381 (121h42m1.500922002s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.770436272 (121h42m1.501703892s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.126424712 (121h42m1.857692362s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.134590111 (121h42m1.865857762s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.150885924 (121h42m1.882153574s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.150912293 (121h42m1.882179944s) [seg_pos={0 0}, upload=126718]: Segment reached optimal threshold of 14 pieces.
Aug 13 19:08:21.151075060 (121h42m1.88234271s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hdE48UnygY1dCRASR39FkumY2V8f5Xb68Pd1WJ4AMLUnnGAfT): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151110567 (121h42m1.882378216s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151167683 (121h42m1.882435334s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tnTEYvqJ6PB2DsuXA28sEuEiGj11StA4qdhcYH1kuoaMkTVdY): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151282079 (121h42m1.882549729s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151301135 (121h42m1.882568775s) [seg_pos={0 0}, upload=126718]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 19:08:21.151371136 (121h42m1.882638776s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 19:08:21.151376356 (121h42m1.882644006s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 19:08:21.328511696 (121h42m2.059779306s) [upload=126718]: Done uploading segments...
Aug 13 19:08:21.328527987 (121h42m2.059795618s) [upload=126718]: Upload finished. err: <nil>
Duration: 771.057842ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..X........................X................................] duration:
201.17576ms
FAIL (2025-08-13 19:20:29 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 18:55:21.849790646 (121h29m2.581058266s) [upload=126500]: Starting upload Aug 13 18:55:21.849866529 (121h29m2.581134149s) [upload=126500]: Done starting upload Aug 13 18:55:21.849939096 (121h29m2.581206726s) [upload=126500]: Uploading segments... Aug 13 18:55:21.849977618 (121h29m2.581245248s) [upload=126500]: Got next segment. Inline: true Aug 13 18:55:21.849983399 (121h29m2.581251049s) [upload=126500]: Waiting for error group managing segments... Aug 13 18:55:21.850034435 (121h29m2.581302065s) [upload=126500]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 18:55:21.850040105 (121h29m2.581307765s) [upload=126500]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 18:55:21.850044223 (121h29m2.581311853s) [upload=126500]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 18:55:21.852506835 (121h29m2.583774465s) [upload=126500]: Done uploading segments... Aug 13 18:55:21.852521132 (121h29m2.583788762s) [upload=126500]: Upload finished. err: metaclient: Too Many Requests
Duration: 201.200035ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......X.........................X.......X..................] duration:
642.334415ms
FAIL (2025-08-13 19:20:25 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 13 19:08:20.572767219 (121h42m1.304034869s) [upload=126718]: Starting upload
Aug 13 19:08:20.572840447 (121h42m1.304108097s) [upload=126718]: Done starting upload
Aug 13 19:08:20.572952778 (121h42m1.304220427s) [upload=126718]: Uploading segments...
Aug 13 19:08:20.573276887 (121h42m1.304544547s) [upload=126718]: Got next segment. Inline: false
Aug 13 19:08:20.573342571 (121h42m1.304610222s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 19:08:20.573351448 (121h42m1.304619119s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 19:08:20.613293228 (121h42m1.344560888s) [seg_pos={0 0}, upload=126718]: Begin upload segment...
Aug 13 19:08:20.613362899 (121h42m1.344630549s) [seg_pos={0 0}, upload=126718]: Done begin upload segment.
Aug 13 19:08:20.613395610 (121h42m1.34466326s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613479168 (121h42m1.344746828s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613933462 (121h42m1.345201122s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613966173 (121h42m1.345233824s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614473598 (121h42m1.345741248s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614513222 (121h42m1.345780882s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614845417 (121h42m1.346113078s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615068767 (121h42m1.346336418s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615223789 (121h42m1.346491439s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615618681 (121h42m1.346886332s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615644741 (121h42m1.346912401s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616154590 (121h42m1.34742224s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616169798 (121h42m1.347437449s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616718090 (121h42m1.347985739s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616748518 (121h42m1.348016167s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.617120096 (121h42m1.348387746s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.622023970 (121h42m1.353291681s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.622840135 (121h42m1.354107785s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.727179166 (121h42m1.458446786s) [upload=126718]: Next returned nil segment
Aug 13 19:08:20.727279234 (121h42m1.458546864s) [upload=126718]: Waiting for error group managing segments...
Aug 13 19:08:20.740817168 (121h42m1.472084789s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.741709907 (121h42m1.472977537s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.741976870 (121h42m1.4732445s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.748823638 (121h42m1.480091268s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.750729704 (121h42m1.481997324s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.751278897 (121h42m1.482546527s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.763551371 (121h42m1.494819001s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.768221566 (121h42m1.499489196s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.769131177 (121h42m1.500398808s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.769654381 (121h42m1.500922002s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.770436272 (121h42m1.501703892s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.126424712 (121h42m1.857692362s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.134590111 (121h42m1.865857762s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.150885924 (121h42m1.882153574s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.150912293 (121h42m1.882179944s) [seg_pos={0 0}, upload=126718]: Segment reached optimal threshold of 14 pieces.
Aug 13 19:08:21.151075060 (121h42m1.88234271s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hdE48UnygY1dCRASR39FkumY2V8f5Xb68Pd1WJ4AMLUnnGAfT): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151110567 (121h42m1.882378216s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151167683 (121h42m1.882435334s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tnTEYvqJ6PB2DsuXA28sEuEiGj11StA4qdhcYH1kuoaMkTVdY): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151282079 (121h42m1.882549729s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151301135 (121h42m1.882568775s) [seg_pos={0 0}, upload=126718]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 19:08:21.151371136 (121h42m1.882638776s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 19:08:21.151376356 (121h42m1.882644006s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 19:08:21.328511696 (121h42m2.059779306s) [upload=126718]: Done uploading segments...
Aug 13 19:08:21.328527987 (121h42m2.059795618s) [upload=126718]: Upload finished. err: <nil>
Duration: 642.36376ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [........X.........................X.......X.................] duration:
1.683365462s
FAIL (2025-08-13 19:20:06 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 13 19:08:20.572767219 (121h42m1.304034869s) [upload=126718]: Starting upload
Aug 13 19:08:20.572840447 (121h42m1.304108097s) [upload=126718]: Done starting upload
Aug 13 19:08:20.572952778 (121h42m1.304220427s) [upload=126718]: Uploading segments...
Aug 13 19:08:20.573276887 (121h42m1.304544547s) [upload=126718]: Got next segment. Inline: false
Aug 13 19:08:20.573342571 (121h42m1.304610222s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 19:08:20.573351448 (121h42m1.304619119s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 19:08:20.613293228 (121h42m1.344560888s) [seg_pos={0 0}, upload=126718]: Begin upload segment...
Aug 13 19:08:20.613362899 (121h42m1.344630549s) [seg_pos={0 0}, upload=126718]: Done begin upload segment.
Aug 13 19:08:20.613395610 (121h42m1.34466326s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613479168 (121h42m1.344746828s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613933462 (121h42m1.345201122s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613966173 (121h42m1.345233824s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614473598 (121h42m1.345741248s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614513222 (121h42m1.345780882s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614845417 (121h42m1.346113078s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615068767 (121h42m1.346336418s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615223789 (121h42m1.346491439s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615618681 (121h42m1.346886332s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615644741 (121h42m1.346912401s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616154590 (121h42m1.34742224s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616169798 (121h42m1.347437449s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616718090 (121h42m1.347985739s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616748518 (121h42m1.348016167s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.617120096 (121h42m1.348387746s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.622023970 (121h42m1.353291681s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.622840135 (121h42m1.354107785s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.727179166 (121h42m1.458446786s) [upload=126718]: Next returned nil segment
Aug 13 19:08:20.727279234 (121h42m1.458546864s) [upload=126718]: Waiting for error group managing segments...
Aug 13 19:08:20.740817168 (121h42m1.472084789s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.741709907 (121h42m1.472977537s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.741976870 (121h42m1.4732445s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.748823638 (121h42m1.480091268s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.750729704 (121h42m1.481997324s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.751278897 (121h42m1.482546527s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.763551371 (121h42m1.494819001s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.768221566 (121h42m1.499489196s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.769131177 (121h42m1.500398808s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.769654381 (121h42m1.500922002s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.770436272 (121h42m1.501703892s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.126424712 (121h42m1.857692362s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.134590111 (121h42m1.865857762s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.150885924 (121h42m1.882153574s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.150912293 (121h42m1.882179944s) [seg_pos={0 0}, upload=126718]: Segment reached optimal threshold of 14 pieces.
Aug 13 19:08:21.151075060 (121h42m1.88234271s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hdE48UnygY1dCRASR39FkumY2V8f5Xb68Pd1WJ4AMLUnnGAfT): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151110567 (121h42m1.882378216s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151167683 (121h42m1.882435334s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tnTEYvqJ6PB2DsuXA28sEuEiGj11StA4qdhcYH1kuoaMkTVdY): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151282079 (121h42m1.882549729s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151301135 (121h42m1.882568775s) [seg_pos={0 0}, upload=126718]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 19:08:21.151371136 (121h42m1.882638776s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 19:08:21.151376356 (121h42m1.882644006s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 19:08:21.328511696 (121h42m2.059779306s) [upload=126718]: Done uploading segments...
Aug 13 19:08:21.328527987 (121h42m2.059795618s) [upload=126718]: Upload finished. err: <nil>
Duration: 1.683455941s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.........X.........................X.......X................] duration:
432.509468ms
FAIL (2025-08-13 19:19:46 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 13 19:08:20.572767219 (121h42m1.304034869s) [upload=126718]: Starting upload
Aug 13 19:08:20.572840447 (121h42m1.304108097s) [upload=126718]: Done starting upload
Aug 13 19:08:20.572952778 (121h42m1.304220427s) [upload=126718]: Uploading segments...
Aug 13 19:08:20.573276887 (121h42m1.304544547s) [upload=126718]: Got next segment. Inline: false
Aug 13 19:08:20.573342571 (121h42m1.304610222s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 19:08:20.573351448 (121h42m1.304619119s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 19:08:20.613293228 (121h42m1.344560888s) [seg_pos={0 0}, upload=126718]: Begin upload segment...
Aug 13 19:08:20.613362899 (121h42m1.344630549s) [seg_pos={0 0}, upload=126718]: Done begin upload segment.
Aug 13 19:08:20.613395610 (121h42m1.34466326s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613479168 (121h42m1.344746828s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613933462 (121h42m1.345201122s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613966173 (121h42m1.345233824s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614473598 (121h42m1.345741248s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614513222 (121h42m1.345780882s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614845417 (121h42m1.346113078s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615068767 (121h42m1.346336418s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615223789 (121h42m1.346491439s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615618681 (121h42m1.346886332s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615644741 (121h42m1.346912401s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616154590 (121h42m1.34742224s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616169798 (121h42m1.347437449s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616718090 (121h42m1.347985739s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616748518 (121h42m1.348016167s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.617120096 (121h42m1.348387746s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.622023970 (121h42m1.353291681s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.622840135 (121h42m1.354107785s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.727179166 (121h42m1.458446786s) [upload=126718]: Next returned nil segment
Aug 13 19:08:20.727279234 (121h42m1.458546864s) [upload=126718]: Waiting for error group managing segments...
Aug 13 19:08:20.740817168 (121h42m1.472084789s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.741709907 (121h42m1.472977537s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.741976870 (121h42m1.4732445s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.748823638 (121h42m1.480091268s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.750729704 (121h42m1.481997324s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.751278897 (121h42m1.482546527s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.763551371 (121h42m1.494819001s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.768221566 (121h42m1.499489196s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.769131177 (121h42m1.500398808s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.769654381 (121h42m1.500922002s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.770436272 (121h42m1.501703892s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.126424712 (121h42m1.857692362s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.134590111 (121h42m1.865857762s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.150885924 (121h42m1.882153574s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.150912293 (121h42m1.882179944s) [seg_pos={0 0}, upload=126718]: Segment reached optimal threshold of 14 pieces.
Aug 13 19:08:21.151075060 (121h42m1.88234271s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hdE48UnygY1dCRASR39FkumY2V8f5Xb68Pd1WJ4AMLUnnGAfT): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151110567 (121h42m1.882378216s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151167683 (121h42m1.882435334s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tnTEYvqJ6PB2DsuXA28sEuEiGj11StA4qdhcYH1kuoaMkTVdY): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151282079 (121h42m1.882549729s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151301135 (121h42m1.882568775s) [seg_pos={0 0}, upload=126718]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 19:08:21.151371136 (121h42m1.882638776s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 19:08:21.151376356 (121h42m1.882644006s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 19:08:21.328511696 (121h42m2.059779306s) [upload=126718]: Done uploading segments...
Aug 13 19:08:21.328527987 (121h42m2.059795618s) [upload=126718]: Upload finished. err: <nil>
Duration: 432.527472ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...X........................X...............................] duration:
245.390802ms
FAIL (2025-08-13 19:19:44 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 18:55:21.849790646 (121h29m2.581058266s) [upload=126500]: Starting upload Aug 13 18:55:21.849866529 (121h29m2.581134149s) [upload=126500]: Done starting upload Aug 13 18:55:21.849939096 (121h29m2.581206726s) [upload=126500]: Uploading segments... Aug 13 18:55:21.849977618 (121h29m2.581245248s) [upload=126500]: Got next segment. Inline: true Aug 13 18:55:21.849983399 (121h29m2.581251049s) [upload=126500]: Waiting for error group managing segments... Aug 13 18:55:21.850034435 (121h29m2.581302065s) [upload=126500]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 18:55:21.850040105 (121h29m2.581307765s) [upload=126500]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 18:55:21.850044223 (121h29m2.581311853s) [upload=126500]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 18:55:21.852506835 (121h29m2.583774465s) [upload=126500]: Done uploading segments... Aug 13 18:55:21.852521132 (121h29m2.583788762s) [upload=126500]: Upload finished. err: metaclient: Too Many Requests
Duration: 245.417891ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..........X.........................X.......X...............] duration:
607.296753ms
FAIL (2025-08-13 19:19:15 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 13 19:08:20.572767219 (121h42m1.304034869s) [upload=126718]: Starting upload
Aug 13 19:08:20.572840447 (121h42m1.304108097s) [upload=126718]: Done starting upload
Aug 13 19:08:20.572952778 (121h42m1.304220427s) [upload=126718]: Uploading segments...
Aug 13 19:08:20.573276887 (121h42m1.304544547s) [upload=126718]: Got next segment. Inline: false
Aug 13 19:08:20.573342571 (121h42m1.304610222s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 19:08:20.573351448 (121h42m1.304619119s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 19:08:20.613293228 (121h42m1.344560888s) [seg_pos={0 0}, upload=126718]: Begin upload segment...
Aug 13 19:08:20.613362899 (121h42m1.344630549s) [seg_pos={0 0}, upload=126718]: Done begin upload segment.
Aug 13 19:08:20.613395610 (121h42m1.34466326s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613479168 (121h42m1.344746828s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613933462 (121h42m1.345201122s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613966173 (121h42m1.345233824s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614473598 (121h42m1.345741248s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614513222 (121h42m1.345780882s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614845417 (121h42m1.346113078s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615068767 (121h42m1.346336418s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615223789 (121h42m1.346491439s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615618681 (121h42m1.346886332s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615644741 (121h42m1.346912401s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616154590 (121h42m1.34742224s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616169798 (121h42m1.347437449s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616718090 (121h42m1.347985739s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616748518 (121h42m1.348016167s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.617120096 (121h42m1.348387746s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.622023970 (121h42m1.353291681s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.622840135 (121h42m1.354107785s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.727179166 (121h42m1.458446786s) [upload=126718]: Next returned nil segment
Aug 13 19:08:20.727279234 (121h42m1.458546864s) [upload=126718]: Waiting for error group managing segments...
Aug 13 19:08:20.740817168 (121h42m1.472084789s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.741709907 (121h42m1.472977537s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.741976870 (121h42m1.4732445s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.748823638 (121h42m1.480091268s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.750729704 (121h42m1.481997324s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.751278897 (121h42m1.482546527s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.763551371 (121h42m1.494819001s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.768221566 (121h42m1.499489196s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.769131177 (121h42m1.500398808s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.769654381 (121h42m1.500922002s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.770436272 (121h42m1.501703892s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.126424712 (121h42m1.857692362s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.134590111 (121h42m1.865857762s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.150885924 (121h42m1.882153574s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.150912293 (121h42m1.882179944s) [seg_pos={0 0}, upload=126718]: Segment reached optimal threshold of 14 pieces.
Aug 13 19:08:21.151075060 (121h42m1.88234271s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hdE48UnygY1dCRASR39FkumY2V8f5Xb68Pd1WJ4AMLUnnGAfT): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151110567 (121h42m1.882378216s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151167683 (121h42m1.882435334s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tnTEYvqJ6PB2DsuXA28sEuEiGj11StA4qdhcYH1kuoaMkTVdY): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151282079 (121h42m1.882549729s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151301135 (121h42m1.882568775s) [seg_pos={0 0}, upload=126718]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 19:08:21.151371136 (121h42m1.882638776s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 19:08:21.151376356 (121h42m1.882644006s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 19:08:21.328511696 (121h42m2.059779306s) [upload=126718]: Done uploading segments...
Aug 13 19:08:21.328527987 (121h42m2.059795618s) [upload=126718]: Upload finished. err: <nil>
Duration: 607.318994ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....X........................X..............................] duration:
149.834081ms
FAIL (2025-08-13 19:18:59 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 18:55:21.849790646 (121h29m2.581058266s) [upload=126500]: Starting upload Aug 13 18:55:21.849866529 (121h29m2.581134149s) [upload=126500]: Done starting upload Aug 13 18:55:21.849939096 (121h29m2.581206726s) [upload=126500]: Uploading segments... Aug 13 18:55:21.849977618 (121h29m2.581245248s) [upload=126500]: Got next segment. Inline: true Aug 13 18:55:21.849983399 (121h29m2.581251049s) [upload=126500]: Waiting for error group managing segments... Aug 13 18:55:21.850034435 (121h29m2.581302065s) [upload=126500]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 18:55:21.850040105 (121h29m2.581307765s) [upload=126500]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 18:55:21.850044223 (121h29m2.581311853s) [upload=126500]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 18:55:21.852506835 (121h29m2.583774465s) [upload=126500]: Done uploading segments... Aug 13 18:55:21.852521132 (121h29m2.583788762s) [upload=126500]: Upload finished. err: metaclient: Too Many Requests
Duration: 149.857674ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...........X.........................X.......X..............] duration:
429.335852ms
FAIL (2025-08-13 19:18:29 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 13 19:08:20.572767219 (121h42m1.304034869s) [upload=126718]: Starting upload
Aug 13 19:08:20.572840447 (121h42m1.304108097s) [upload=126718]: Done starting upload
Aug 13 19:08:20.572952778 (121h42m1.304220427s) [upload=126718]: Uploading segments...
Aug 13 19:08:20.573276887 (121h42m1.304544547s) [upload=126718]: Got next segment. Inline: false
Aug 13 19:08:20.573342571 (121h42m1.304610222s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 19:08:20.573351448 (121h42m1.304619119s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 19:08:20.613293228 (121h42m1.344560888s) [seg_pos={0 0}, upload=126718]: Begin upload segment...
Aug 13 19:08:20.613362899 (121h42m1.344630549s) [seg_pos={0 0}, upload=126718]: Done begin upload segment.
Aug 13 19:08:20.613395610 (121h42m1.34466326s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613479168 (121h42m1.344746828s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613933462 (121h42m1.345201122s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613966173 (121h42m1.345233824s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614473598 (121h42m1.345741248s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614513222 (121h42m1.345780882s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614845417 (121h42m1.346113078s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615068767 (121h42m1.346336418s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615223789 (121h42m1.346491439s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615618681 (121h42m1.346886332s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615644741 (121h42m1.346912401s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616154590 (121h42m1.34742224s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616169798 (121h42m1.347437449s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616718090 (121h42m1.347985739s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616748518 (121h42m1.348016167s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.617120096 (121h42m1.348387746s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.622023970 (121h42m1.353291681s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.622840135 (121h42m1.354107785s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.727179166 (121h42m1.458446786s) [upload=126718]: Next returned nil segment
Aug 13 19:08:20.727279234 (121h42m1.458546864s) [upload=126718]: Waiting for error group managing segments...
Aug 13 19:08:20.740817168 (121h42m1.472084789s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.741709907 (121h42m1.472977537s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.741976870 (121h42m1.4732445s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.748823638 (121h42m1.480091268s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.750729704 (121h42m1.481997324s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.751278897 (121h42m1.482546527s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.763551371 (121h42m1.494819001s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.768221566 (121h42m1.499489196s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.769131177 (121h42m1.500398808s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.769654381 (121h42m1.500922002s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.770436272 (121h42m1.501703892s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.126424712 (121h42m1.857692362s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.134590111 (121h42m1.865857762s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.150885924 (121h42m1.882153574s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.150912293 (121h42m1.882179944s) [seg_pos={0 0}, upload=126718]: Segment reached optimal threshold of 14 pieces.
Aug 13 19:08:21.151075060 (121h42m1.88234271s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hdE48UnygY1dCRASR39FkumY2V8f5Xb68Pd1WJ4AMLUnnGAfT): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151110567 (121h42m1.882378216s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151167683 (121h42m1.882435334s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tnTEYvqJ6PB2DsuXA28sEuEiGj11StA4qdhcYH1kuoaMkTVdY): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151282079 (121h42m1.882549729s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151301135 (121h42m1.882568775s) [seg_pos={0 0}, upload=126718]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 19:08:21.151371136 (121h42m1.882638776s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 19:08:21.151376356 (121h42m1.882644006s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 19:08:21.328511696 (121h42m2.059779306s) [upload=126718]: Done uploading segments...
Aug 13 19:08:21.328527987 (121h42m2.059795618s) [upload=126718]: Upload finished. err: <nil>
Duration: 429.359878ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....X........................X.............................] duration:
263.609289ms
FAIL (2025-08-13 19:18:09 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 18:55:21.849790646 (121h29m2.581058266s) [upload=126500]: Starting upload Aug 13 18:55:21.849866529 (121h29m2.581134149s) [upload=126500]: Done starting upload Aug 13 18:55:21.849939096 (121h29m2.581206726s) [upload=126500]: Uploading segments... Aug 13 18:55:21.849977618 (121h29m2.581245248s) [upload=126500]: Got next segment. Inline: true Aug 13 18:55:21.849983399 (121h29m2.581251049s) [upload=126500]: Waiting for error group managing segments... Aug 13 18:55:21.850034435 (121h29m2.581302065s) [upload=126500]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 18:55:21.850040105 (121h29m2.581307765s) [upload=126500]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 18:55:21.850044223 (121h29m2.581311853s) [upload=126500]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 18:55:21.852506835 (121h29m2.583774465s) [upload=126500]: Done uploading segments... Aug 13 18:55:21.852521132 (121h29m2.583788762s) [upload=126500]: Upload finished. err: metaclient: Too Many Requests
Duration: 263.638244ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [............X.........................X.......X.............] duration:
490.613761ms
FAIL (2025-08-13 19:18:02 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 13 19:08:20.572767219 (121h42m1.304034869s) [upload=126718]: Starting upload
Aug 13 19:08:20.572840447 (121h42m1.304108097s) [upload=126718]: Done starting upload
Aug 13 19:08:20.572952778 (121h42m1.304220427s) [upload=126718]: Uploading segments...
Aug 13 19:08:20.573276887 (121h42m1.304544547s) [upload=126718]: Got next segment. Inline: false
Aug 13 19:08:20.573342571 (121h42m1.304610222s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 19:08:20.573351448 (121h42m1.304619119s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 19:08:20.613293228 (121h42m1.344560888s) [seg_pos={0 0}, upload=126718]: Begin upload segment...
Aug 13 19:08:20.613362899 (121h42m1.344630549s) [seg_pos={0 0}, upload=126718]: Done begin upload segment.
Aug 13 19:08:20.613395610 (121h42m1.34466326s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613479168 (121h42m1.344746828s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613933462 (121h42m1.345201122s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613966173 (121h42m1.345233824s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614473598 (121h42m1.345741248s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614513222 (121h42m1.345780882s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614845417 (121h42m1.346113078s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615068767 (121h42m1.346336418s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615223789 (121h42m1.346491439s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615618681 (121h42m1.346886332s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615644741 (121h42m1.346912401s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616154590 (121h42m1.34742224s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616169798 (121h42m1.347437449s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616718090 (121h42m1.347985739s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616748518 (121h42m1.348016167s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.617120096 (121h42m1.348387746s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.622023970 (121h42m1.353291681s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.622840135 (121h42m1.354107785s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.727179166 (121h42m1.458446786s) [upload=126718]: Next returned nil segment
Aug 13 19:08:20.727279234 (121h42m1.458546864s) [upload=126718]: Waiting for error group managing segments...
Aug 13 19:08:20.740817168 (121h42m1.472084789s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.741709907 (121h42m1.472977537s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.741976870 (121h42m1.4732445s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.748823638 (121h42m1.480091268s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.750729704 (121h42m1.481997324s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.751278897 (121h42m1.482546527s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.763551371 (121h42m1.494819001s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.768221566 (121h42m1.499489196s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.769131177 (121h42m1.500398808s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.769654381 (121h42m1.500922002s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.770436272 (121h42m1.501703892s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.126424712 (121h42m1.857692362s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.134590111 (121h42m1.865857762s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.150885924 (121h42m1.882153574s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.150912293 (121h42m1.882179944s) [seg_pos={0 0}, upload=126718]: Segment reached optimal threshold of 14 pieces.
Aug 13 19:08:21.151075060 (121h42m1.88234271s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hdE48UnygY1dCRASR39FkumY2V8f5Xb68Pd1WJ4AMLUnnGAfT): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151110567 (121h42m1.882378216s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151167683 (121h42m1.882435334s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tnTEYvqJ6PB2DsuXA28sEuEiGj11StA4qdhcYH1kuoaMkTVdY): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151282079 (121h42m1.882549729s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151301135 (121h42m1.882568775s) [seg_pos={0 0}, upload=126718]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 19:08:21.151371136 (121h42m1.882638776s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 19:08:21.151376356 (121h42m1.882644006s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 19:08:21.328511696 (121h42m2.059779306s) [upload=126718]: Done uploading segments...
Aug 13 19:08:21.328527987 (121h42m2.059795618s) [upload=126718]: Upload finished. err: <nil>
Duration: 490.636844ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.............X.........................X.......X............] duration:
460.079602ms
FAIL (2025-08-13 19:17:23 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 13 19:08:20.572767219 (121h42m1.304034869s) [upload=126718]: Starting upload
Aug 13 19:08:20.572840447 (121h42m1.304108097s) [upload=126718]: Done starting upload
Aug 13 19:08:20.572952778 (121h42m1.304220427s) [upload=126718]: Uploading segments...
Aug 13 19:08:20.573276887 (121h42m1.304544547s) [upload=126718]: Got next segment. Inline: false
Aug 13 19:08:20.573342571 (121h42m1.304610222s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 19:08:20.573351448 (121h42m1.304619119s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 19:08:20.613293228 (121h42m1.344560888s) [seg_pos={0 0}, upload=126718]: Begin upload segment...
Aug 13 19:08:20.613362899 (121h42m1.344630549s) [seg_pos={0 0}, upload=126718]: Done begin upload segment.
Aug 13 19:08:20.613395610 (121h42m1.34466326s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613479168 (121h42m1.344746828s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613933462 (121h42m1.345201122s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613966173 (121h42m1.345233824s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614473598 (121h42m1.345741248s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614513222 (121h42m1.345780882s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614845417 (121h42m1.346113078s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615068767 (121h42m1.346336418s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615223789 (121h42m1.346491439s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615618681 (121h42m1.346886332s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615644741 (121h42m1.346912401s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616154590 (121h42m1.34742224s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616169798 (121h42m1.347437449s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616718090 (121h42m1.347985739s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616748518 (121h42m1.348016167s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.617120096 (121h42m1.348387746s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.622023970 (121h42m1.353291681s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.622840135 (121h42m1.354107785s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.727179166 (121h42m1.458446786s) [upload=126718]: Next returned nil segment
Aug 13 19:08:20.727279234 (121h42m1.458546864s) [upload=126718]: Waiting for error group managing segments...
Aug 13 19:08:20.740817168 (121h42m1.472084789s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.741709907 (121h42m1.472977537s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.741976870 (121h42m1.4732445s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.748823638 (121h42m1.480091268s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.750729704 (121h42m1.481997324s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.751278897 (121h42m1.482546527s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.763551371 (121h42m1.494819001s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.768221566 (121h42m1.499489196s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.769131177 (121h42m1.500398808s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.769654381 (121h42m1.500922002s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.770436272 (121h42m1.501703892s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.126424712 (121h42m1.857692362s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.134590111 (121h42m1.865857762s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.150885924 (121h42m1.882153574s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.150912293 (121h42m1.882179944s) [seg_pos={0 0}, upload=126718]: Segment reached optimal threshold of 14 pieces.
Aug 13 19:08:21.151075060 (121h42m1.88234271s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hdE48UnygY1dCRASR39FkumY2V8f5Xb68Pd1WJ4AMLUnnGAfT): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151110567 (121h42m1.882378216s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151167683 (121h42m1.882435334s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tnTEYvqJ6PB2DsuXA28sEuEiGj11StA4qdhcYH1kuoaMkTVdY): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151282079 (121h42m1.882549729s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151301135 (121h42m1.882568775s) [seg_pos={0 0}, upload=126718]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 19:08:21.151371136 (121h42m1.882638776s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 19:08:21.151376356 (121h42m1.882644006s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 19:08:21.328511696 (121h42m2.059779306s) [upload=126718]: Done uploading segments...
Aug 13 19:08:21.328527987 (121h42m2.059795618s) [upload=126718]: Upload finished. err: <nil>
Duration: 460.103057ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......X........................X............................] duration:
286.956445ms
FAIL (2025-08-13 19:17:15 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 18:55:21.849790646 (121h29m2.581058266s) [upload=126500]: Starting upload Aug 13 18:55:21.849866529 (121h29m2.581134149s) [upload=126500]: Done starting upload Aug 13 18:55:21.849939096 (121h29m2.581206726s) [upload=126500]: Uploading segments... Aug 13 18:55:21.849977618 (121h29m2.581245248s) [upload=126500]: Got next segment. Inline: true Aug 13 18:55:21.849983399 (121h29m2.581251049s) [upload=126500]: Waiting for error group managing segments... Aug 13 18:55:21.850034435 (121h29m2.581302065s) [upload=126500]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 18:55:21.850040105 (121h29m2.581307765s) [upload=126500]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 18:55:21.850044223 (121h29m2.581311853s) [upload=126500]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 18:55:21.852506835 (121h29m2.583774465s) [upload=126500]: Done uploading segments... Aug 13 18:55:21.852521132 (121h29m2.583788762s) [upload=126500]: Upload finished. err: metaclient: Too Many Requests
Duration: 286.982604ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [X......X........................X...........................] duration:
191.878772ms
FAIL (2025-08-13 19:16:38 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 18:55:21.849790646 (121h29m2.581058266s) [upload=126500]: Starting upload Aug 13 18:55:21.849866529 (121h29m2.581134149s) [upload=126500]: Done starting upload Aug 13 18:55:21.849939096 (121h29m2.581206726s) [upload=126500]: Uploading segments... Aug 13 18:55:21.849977618 (121h29m2.581245248s) [upload=126500]: Got next segment. Inline: true Aug 13 18:55:21.849983399 (121h29m2.581251049s) [upload=126500]: Waiting for error group managing segments... Aug 13 18:55:21.850034435 (121h29m2.581302065s) [upload=126500]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 18:55:21.850040105 (121h29m2.581307765s) [upload=126500]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 18:55:21.850044223 (121h29m2.581311853s) [upload=126500]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 18:55:21.852506835 (121h29m2.583774465s) [upload=126500]: Done uploading segments... Aug 13 18:55:21.852521132 (121h29m2.583788762s) [upload=126500]: Upload finished. err: metaclient: Too Many Requests
Duration: 191.907887ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..............X.........................X.......X...........] duration:
418.459759ms
FAIL (2025-08-13 19:16:19 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 13 19:08:20.572767219 (121h42m1.304034869s) [upload=126718]: Starting upload
Aug 13 19:08:20.572840447 (121h42m1.304108097s) [upload=126718]: Done starting upload
Aug 13 19:08:20.572952778 (121h42m1.304220427s) [upload=126718]: Uploading segments...
Aug 13 19:08:20.573276887 (121h42m1.304544547s) [upload=126718]: Got next segment. Inline: false
Aug 13 19:08:20.573342571 (121h42m1.304610222s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 19:08:20.573351448 (121h42m1.304619119s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 19:08:20.613293228 (121h42m1.344560888s) [seg_pos={0 0}, upload=126718]: Begin upload segment...
Aug 13 19:08:20.613362899 (121h42m1.344630549s) [seg_pos={0 0}, upload=126718]: Done begin upload segment.
Aug 13 19:08:20.613395610 (121h42m1.34466326s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613479168 (121h42m1.344746828s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613933462 (121h42m1.345201122s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613966173 (121h42m1.345233824s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614473598 (121h42m1.345741248s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614513222 (121h42m1.345780882s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614845417 (121h42m1.346113078s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615068767 (121h42m1.346336418s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615223789 (121h42m1.346491439s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615618681 (121h42m1.346886332s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615644741 (121h42m1.346912401s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616154590 (121h42m1.34742224s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616169798 (121h42m1.347437449s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616718090 (121h42m1.347985739s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616748518 (121h42m1.348016167s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.617120096 (121h42m1.348387746s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.622023970 (121h42m1.353291681s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.622840135 (121h42m1.354107785s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.727179166 (121h42m1.458446786s) [upload=126718]: Next returned nil segment
Aug 13 19:08:20.727279234 (121h42m1.458546864s) [upload=126718]: Waiting for error group managing segments...
Aug 13 19:08:20.740817168 (121h42m1.472084789s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.741709907 (121h42m1.472977537s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.741976870 (121h42m1.4732445s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.748823638 (121h42m1.480091268s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.750729704 (121h42m1.481997324s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.751278897 (121h42m1.482546527s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.763551371 (121h42m1.494819001s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.768221566 (121h42m1.499489196s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.769131177 (121h42m1.500398808s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.769654381 (121h42m1.500922002s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.770436272 (121h42m1.501703892s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.126424712 (121h42m1.857692362s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.134590111 (121h42m1.865857762s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.150885924 (121h42m1.882153574s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.150912293 (121h42m1.882179944s) [seg_pos={0 0}, upload=126718]: Segment reached optimal threshold of 14 pieces.
Aug 13 19:08:21.151075060 (121h42m1.88234271s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hdE48UnygY1dCRASR39FkumY2V8f5Xb68Pd1WJ4AMLUnnGAfT): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151110567 (121h42m1.882378216s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151167683 (121h42m1.882435334s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tnTEYvqJ6PB2DsuXA28sEuEiGj11StA4qdhcYH1kuoaMkTVdY): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151282079 (121h42m1.882549729s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151301135 (121h42m1.882568775s) [seg_pos={0 0}, upload=126718]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 19:08:21.151371136 (121h42m1.882638776s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 19:08:21.151376356 (121h42m1.882644006s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 19:08:21.328511696 (121h42m2.059779306s) [upload=126718]: Done uploading segments...
Aug 13 19:08:21.328527987 (121h42m2.059795618s) [upload=126718]: Upload finished. err: <nil>
Duration: 418.479386ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.X......X........................X..........................] duration:
404.564732ms
FAIL (2025-08-13 19:15:55 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 18:55:21.849790646 (121h29m2.581058266s) [upload=126500]: Starting upload Aug 13 18:55:21.849866529 (121h29m2.581134149s) [upload=126500]: Done starting upload Aug 13 18:55:21.849939096 (121h29m2.581206726s) [upload=126500]: Uploading segments... Aug 13 18:55:21.849977618 (121h29m2.581245248s) [upload=126500]: Got next segment. Inline: true Aug 13 18:55:21.849983399 (121h29m2.581251049s) [upload=126500]: Waiting for error group managing segments... Aug 13 18:55:21.850034435 (121h29m2.581302065s) [upload=126500]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 18:55:21.850040105 (121h29m2.581307765s) [upload=126500]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 18:55:21.850044223 (121h29m2.581311853s) [upload=126500]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 18:55:21.852506835 (121h29m2.583774465s) [upload=126500]: Done uploading segments... Aug 13 18:55:21.852521132 (121h29m2.583788762s) [upload=126500]: Upload finished. err: metaclient: Too Many Requests
Duration: 404.585852ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...............X.........................X.......X..........] duration:
427.336314ms
FAIL (2025-08-13 19:15:49 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 13 19:08:20.572767219 (121h42m1.304034869s) [upload=126718]: Starting upload
Aug 13 19:08:20.572840447 (121h42m1.304108097s) [upload=126718]: Done starting upload
Aug 13 19:08:20.572952778 (121h42m1.304220427s) [upload=126718]: Uploading segments...
Aug 13 19:08:20.573276887 (121h42m1.304544547s) [upload=126718]: Got next segment. Inline: false
Aug 13 19:08:20.573342571 (121h42m1.304610222s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 19:08:20.573351448 (121h42m1.304619119s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 19:08:20.613293228 (121h42m1.344560888s) [seg_pos={0 0}, upload=126718]: Begin upload segment...
Aug 13 19:08:20.613362899 (121h42m1.344630549s) [seg_pos={0 0}, upload=126718]: Done begin upload segment.
Aug 13 19:08:20.613395610 (121h42m1.34466326s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613479168 (121h42m1.344746828s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613933462 (121h42m1.345201122s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613966173 (121h42m1.345233824s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614473598 (121h42m1.345741248s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614513222 (121h42m1.345780882s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614845417 (121h42m1.346113078s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615068767 (121h42m1.346336418s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615223789 (121h42m1.346491439s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615618681 (121h42m1.346886332s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615644741 (121h42m1.346912401s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616154590 (121h42m1.34742224s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616169798 (121h42m1.347437449s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616718090 (121h42m1.347985739s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616748518 (121h42m1.348016167s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.617120096 (121h42m1.348387746s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.622023970 (121h42m1.353291681s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.622840135 (121h42m1.354107785s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.727179166 (121h42m1.458446786s) [upload=126718]: Next returned nil segment
Aug 13 19:08:20.727279234 (121h42m1.458546864s) [upload=126718]: Waiting for error group managing segments...
Aug 13 19:08:20.740817168 (121h42m1.472084789s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.741709907 (121h42m1.472977537s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.741976870 (121h42m1.4732445s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.748823638 (121h42m1.480091268s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.750729704 (121h42m1.481997324s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.751278897 (121h42m1.482546527s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.763551371 (121h42m1.494819001s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.768221566 (121h42m1.499489196s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.769131177 (121h42m1.500398808s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.769654381 (121h42m1.500922002s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.770436272 (121h42m1.501703892s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.126424712 (121h42m1.857692362s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.134590111 (121h42m1.865857762s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.150885924 (121h42m1.882153574s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.150912293 (121h42m1.882179944s) [seg_pos={0 0}, upload=126718]: Segment reached optimal threshold of 14 pieces.
Aug 13 19:08:21.151075060 (121h42m1.88234271s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hdE48UnygY1dCRASR39FkumY2V8f5Xb68Pd1WJ4AMLUnnGAfT): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151110567 (121h42m1.882378216s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151167683 (121h42m1.882435334s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tnTEYvqJ6PB2DsuXA28sEuEiGj11StA4qdhcYH1kuoaMkTVdY): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151282079 (121h42m1.882549729s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151301135 (121h42m1.882568775s) [seg_pos={0 0}, upload=126718]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 19:08:21.151371136 (121h42m1.882638776s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 19:08:21.151376356 (121h42m1.882644006s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 19:08:21.328511696 (121h42m2.059779306s) [upload=126718]: Done uploading segments...
Aug 13 19:08:21.328527987 (121h42m2.059795618s) [upload=126718]: Upload finished. err: <nil>
Duration: 427.360891ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [................X.........................X.......X.........] duration:
489.307662ms
FAIL (2025-08-13 19:15:14 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 13 19:08:20.572767219 (121h42m1.304034869s) [upload=126718]: Starting upload
Aug 13 19:08:20.572840447 (121h42m1.304108097s) [upload=126718]: Done starting upload
Aug 13 19:08:20.572952778 (121h42m1.304220427s) [upload=126718]: Uploading segments...
Aug 13 19:08:20.573276887 (121h42m1.304544547s) [upload=126718]: Got next segment. Inline: false
Aug 13 19:08:20.573342571 (121h42m1.304610222s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 19:08:20.573351448 (121h42m1.304619119s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 19:08:20.613293228 (121h42m1.344560888s) [seg_pos={0 0}, upload=126718]: Begin upload segment...
Aug 13 19:08:20.613362899 (121h42m1.344630549s) [seg_pos={0 0}, upload=126718]: Done begin upload segment.
Aug 13 19:08:20.613395610 (121h42m1.34466326s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613479168 (121h42m1.344746828s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613933462 (121h42m1.345201122s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613966173 (121h42m1.345233824s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614473598 (121h42m1.345741248s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614513222 (121h42m1.345780882s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614845417 (121h42m1.346113078s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615068767 (121h42m1.346336418s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615223789 (121h42m1.346491439s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615618681 (121h42m1.346886332s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615644741 (121h42m1.346912401s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616154590 (121h42m1.34742224s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616169798 (121h42m1.347437449s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616718090 (121h42m1.347985739s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616748518 (121h42m1.348016167s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.617120096 (121h42m1.348387746s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.622023970 (121h42m1.353291681s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.622840135 (121h42m1.354107785s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.727179166 (121h42m1.458446786s) [upload=126718]: Next returned nil segment
Aug 13 19:08:20.727279234 (121h42m1.458546864s) [upload=126718]: Waiting for error group managing segments...
Aug 13 19:08:20.740817168 (121h42m1.472084789s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.741709907 (121h42m1.472977537s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.741976870 (121h42m1.4732445s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.748823638 (121h42m1.480091268s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.750729704 (121h42m1.481997324s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.751278897 (121h42m1.482546527s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.763551371 (121h42m1.494819001s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.768221566 (121h42m1.499489196s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.769131177 (121h42m1.500398808s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.769654381 (121h42m1.500922002s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.770436272 (121h42m1.501703892s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.126424712 (121h42m1.857692362s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.134590111 (121h42m1.865857762s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.150885924 (121h42m1.882153574s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.150912293 (121h42m1.882179944s) [seg_pos={0 0}, upload=126718]: Segment reached optimal threshold of 14 pieces.
Aug 13 19:08:21.151075060 (121h42m1.88234271s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hdE48UnygY1dCRASR39FkumY2V8f5Xb68Pd1WJ4AMLUnnGAfT): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151110567 (121h42m1.882378216s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151167683 (121h42m1.882435334s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tnTEYvqJ6PB2DsuXA28sEuEiGj11StA4qdhcYH1kuoaMkTVdY): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151282079 (121h42m1.882549729s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151301135 (121h42m1.882568775s) [seg_pos={0 0}, upload=126718]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 19:08:21.151371136 (121h42m1.882638776s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 19:08:21.151376356 (121h42m1.882644006s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 19:08:21.328511696 (121h42m2.059779306s) [upload=126718]: Done uploading segments...
Aug 13 19:08:21.328527987 (121h42m2.059795618s) [upload=126718]: Upload finished. err: <nil>
Duration: 489.3327ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..X......X........................X.........................] duration:
172.192303ms
FAIL (2025-08-13 19:15:02 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 18:55:21.849790646 (121h29m2.581058266s) [upload=126500]: Starting upload Aug 13 18:55:21.849866529 (121h29m2.581134149s) [upload=126500]: Done starting upload Aug 13 18:55:21.849939096 (121h29m2.581206726s) [upload=126500]: Uploading segments... Aug 13 18:55:21.849977618 (121h29m2.581245248s) [upload=126500]: Got next segment. Inline: true Aug 13 18:55:21.849983399 (121h29m2.581251049s) [upload=126500]: Waiting for error group managing segments... Aug 13 18:55:21.850034435 (121h29m2.581302065s) [upload=126500]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 18:55:21.850040105 (121h29m2.581307765s) [upload=126500]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 18:55:21.850044223 (121h29m2.581311853s) [upload=126500]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 18:55:21.852506835 (121h29m2.583774465s) [upload=126500]: Done uploading segments... Aug 13 18:55:21.852521132 (121h29m2.583788762s) [upload=126500]: Upload finished. err: metaclient: Too Many Requests
Duration: 172.219163ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.................X.........................X.......X........] duration:
365.556205ms
FAIL (2025-08-13 19:14:32 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 13 19:08:20.572767219 (121h42m1.304034869s) [upload=126718]: Starting upload
Aug 13 19:08:20.572840447 (121h42m1.304108097s) [upload=126718]: Done starting upload
Aug 13 19:08:20.572952778 (121h42m1.304220427s) [upload=126718]: Uploading segments...
Aug 13 19:08:20.573276887 (121h42m1.304544547s) [upload=126718]: Got next segment. Inline: false
Aug 13 19:08:20.573342571 (121h42m1.304610222s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 19:08:20.573351448 (121h42m1.304619119s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 19:08:20.613293228 (121h42m1.344560888s) [seg_pos={0 0}, upload=126718]: Begin upload segment...
Aug 13 19:08:20.613362899 (121h42m1.344630549s) [seg_pos={0 0}, upload=126718]: Done begin upload segment.
Aug 13 19:08:20.613395610 (121h42m1.34466326s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613479168 (121h42m1.344746828s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613933462 (121h42m1.345201122s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613966173 (121h42m1.345233824s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614473598 (121h42m1.345741248s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614513222 (121h42m1.345780882s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614845417 (121h42m1.346113078s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615068767 (121h42m1.346336418s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615223789 (121h42m1.346491439s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615618681 (121h42m1.346886332s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615644741 (121h42m1.346912401s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616154590 (121h42m1.34742224s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616169798 (121h42m1.347437449s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616718090 (121h42m1.347985739s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616748518 (121h42m1.348016167s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.617120096 (121h42m1.348387746s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.622023970 (121h42m1.353291681s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.622840135 (121h42m1.354107785s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.727179166 (121h42m1.458446786s) [upload=126718]: Next returned nil segment
Aug 13 19:08:20.727279234 (121h42m1.458546864s) [upload=126718]: Waiting for error group managing segments...
Aug 13 19:08:20.740817168 (121h42m1.472084789s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.741709907 (121h42m1.472977537s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.741976870 (121h42m1.4732445s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.748823638 (121h42m1.480091268s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.750729704 (121h42m1.481997324s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.751278897 (121h42m1.482546527s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.763551371 (121h42m1.494819001s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.768221566 (121h42m1.499489196s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.769131177 (121h42m1.500398808s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.769654381 (121h42m1.500922002s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.770436272 (121h42m1.501703892s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.126424712 (121h42m1.857692362s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.134590111 (121h42m1.865857762s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.150885924 (121h42m1.882153574s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.150912293 (121h42m1.882179944s) [seg_pos={0 0}, upload=126718]: Segment reached optimal threshold of 14 pieces.
Aug 13 19:08:21.151075060 (121h42m1.88234271s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hdE48UnygY1dCRASR39FkumY2V8f5Xb68Pd1WJ4AMLUnnGAfT): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151110567 (121h42m1.882378216s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151167683 (121h42m1.882435334s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tnTEYvqJ6PB2DsuXA28sEuEiGj11StA4qdhcYH1kuoaMkTVdY): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151282079 (121h42m1.882549729s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151301135 (121h42m1.882568775s) [seg_pos={0 0}, upload=126718]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 19:08:21.151371136 (121h42m1.882638776s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 19:08:21.151376356 (121h42m1.882644006s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 19:08:21.328511696 (121h42m2.059779306s) [upload=126718]: Done uploading segments...
Aug 13 19:08:21.328527987 (121h42m2.059795618s) [upload=126718]: Upload finished. err: <nil>
Duration: 365.588475ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...X......X........................X........................] duration:
181.535046ms
FAIL (2025-08-13 19:13:56 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 18:55:21.849790646 (121h29m2.581058266s) [upload=126500]: Starting upload Aug 13 18:55:21.849866529 (121h29m2.581134149s) [upload=126500]: Done starting upload Aug 13 18:55:21.849939096 (121h29m2.581206726s) [upload=126500]: Uploading segments... Aug 13 18:55:21.849977618 (121h29m2.581245248s) [upload=126500]: Got next segment. Inline: true Aug 13 18:55:21.849983399 (121h29m2.581251049s) [upload=126500]: Waiting for error group managing segments... Aug 13 18:55:21.850034435 (121h29m2.581302065s) [upload=126500]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 18:55:21.850040105 (121h29m2.581307765s) [upload=126500]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 18:55:21.850044223 (121h29m2.581311853s) [upload=126500]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 18:55:21.852506835 (121h29m2.583774465s) [upload=126500]: Done uploading segments... Aug 13 18:55:21.852521132 (121h29m2.583788762s) [upload=126500]: Upload finished. err: metaclient: Too Many Requests
Duration: 181.549684ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..................X.........................X.......X.......] duration:
834.631132ms
FAIL (2025-08-13 19:13:46 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 13 19:08:20.572767219 (121h42m1.304034869s) [upload=126718]: Starting upload
Aug 13 19:08:20.572840447 (121h42m1.304108097s) [upload=126718]: Done starting upload
Aug 13 19:08:20.572952778 (121h42m1.304220427s) [upload=126718]: Uploading segments...
Aug 13 19:08:20.573276887 (121h42m1.304544547s) [upload=126718]: Got next segment. Inline: false
Aug 13 19:08:20.573342571 (121h42m1.304610222s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 19:08:20.573351448 (121h42m1.304619119s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 19:08:20.613293228 (121h42m1.344560888s) [seg_pos={0 0}, upload=126718]: Begin upload segment...
Aug 13 19:08:20.613362899 (121h42m1.344630549s) [seg_pos={0 0}, upload=126718]: Done begin upload segment.
Aug 13 19:08:20.613395610 (121h42m1.34466326s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613479168 (121h42m1.344746828s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613933462 (121h42m1.345201122s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613966173 (121h42m1.345233824s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614473598 (121h42m1.345741248s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614513222 (121h42m1.345780882s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614845417 (121h42m1.346113078s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615068767 (121h42m1.346336418s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615223789 (121h42m1.346491439s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615618681 (121h42m1.346886332s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615644741 (121h42m1.346912401s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616154590 (121h42m1.34742224s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616169798 (121h42m1.347437449s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616718090 (121h42m1.347985739s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616748518 (121h42m1.348016167s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.617120096 (121h42m1.348387746s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.622023970 (121h42m1.353291681s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.622840135 (121h42m1.354107785s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.727179166 (121h42m1.458446786s) [upload=126718]: Next returned nil segment
Aug 13 19:08:20.727279234 (121h42m1.458546864s) [upload=126718]: Waiting for error group managing segments...
Aug 13 19:08:20.740817168 (121h42m1.472084789s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.741709907 (121h42m1.472977537s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.741976870 (121h42m1.4732445s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.748823638 (121h42m1.480091268s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.750729704 (121h42m1.481997324s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.751278897 (121h42m1.482546527s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.763551371 (121h42m1.494819001s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.768221566 (121h42m1.499489196s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.769131177 (121h42m1.500398808s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.769654381 (121h42m1.500922002s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.770436272 (121h42m1.501703892s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.126424712 (121h42m1.857692362s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.134590111 (121h42m1.865857762s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.150885924 (121h42m1.882153574s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.150912293 (121h42m1.882179944s) [seg_pos={0 0}, upload=126718]: Segment reached optimal threshold of 14 pieces.
Aug 13 19:08:21.151075060 (121h42m1.88234271s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hdE48UnygY1dCRASR39FkumY2V8f5Xb68Pd1WJ4AMLUnnGAfT): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151110567 (121h42m1.882378216s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151167683 (121h42m1.882435334s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tnTEYvqJ6PB2DsuXA28sEuEiGj11StA4qdhcYH1kuoaMkTVdY): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151282079 (121h42m1.882549729s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151301135 (121h42m1.882568775s) [seg_pos={0 0}, upload=126718]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 19:08:21.151371136 (121h42m1.882638776s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 19:08:21.151376356 (121h42m1.882644006s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 19:08:21.328511696 (121h42m2.059779306s) [upload=126718]: Done uploading segments...
Aug 13 19:08:21.328527987 (121h42m2.059795618s) [upload=126718]: Upload finished. err: <nil>
Duration: 834.651911ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....X......X........................X.......................] duration:
447.690691ms
FAIL (2025-08-13 19:13:30 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 18:55:21.849790646 (121h29m2.581058266s) [upload=126500]: Starting upload Aug 13 18:55:21.849866529 (121h29m2.581134149s) [upload=126500]: Done starting upload Aug 13 18:55:21.849939096 (121h29m2.581206726s) [upload=126500]: Uploading segments... Aug 13 18:55:21.849977618 (121h29m2.581245248s) [upload=126500]: Got next segment. Inline: true Aug 13 18:55:21.849983399 (121h29m2.581251049s) [upload=126500]: Waiting for error group managing segments... Aug 13 18:55:21.850034435 (121h29m2.581302065s) [upload=126500]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 18:55:21.850040105 (121h29m2.581307765s) [upload=126500]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 18:55:21.850044223 (121h29m2.581311853s) [upload=126500]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 18:55:21.852506835 (121h29m2.583774465s) [upload=126500]: Done uploading segments... Aug 13 18:55:21.852521132 (121h29m2.583788762s) [upload=126500]: Upload finished. err: metaclient: Too Many Requests
Duration: 447.718965ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...................X.........................X.......X......] duration:
539.746507ms
FAIL (2025-08-13 19:13:13 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 13 19:08:20.572767219 (121h42m1.304034869s) [upload=126718]: Starting upload
Aug 13 19:08:20.572840447 (121h42m1.304108097s) [upload=126718]: Done starting upload
Aug 13 19:08:20.572952778 (121h42m1.304220427s) [upload=126718]: Uploading segments...
Aug 13 19:08:20.573276887 (121h42m1.304544547s) [upload=126718]: Got next segment. Inline: false
Aug 13 19:08:20.573342571 (121h42m1.304610222s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 19:08:20.573351448 (121h42m1.304619119s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 19:08:20.613293228 (121h42m1.344560888s) [seg_pos={0 0}, upload=126718]: Begin upload segment...
Aug 13 19:08:20.613362899 (121h42m1.344630549s) [seg_pos={0 0}, upload=126718]: Done begin upload segment.
Aug 13 19:08:20.613395610 (121h42m1.34466326s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613479168 (121h42m1.344746828s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613933462 (121h42m1.345201122s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613966173 (121h42m1.345233824s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614473598 (121h42m1.345741248s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614513222 (121h42m1.345780882s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614845417 (121h42m1.346113078s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615068767 (121h42m1.346336418s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615223789 (121h42m1.346491439s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615618681 (121h42m1.346886332s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615644741 (121h42m1.346912401s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616154590 (121h42m1.34742224s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616169798 (121h42m1.347437449s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616718090 (121h42m1.347985739s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616748518 (121h42m1.348016167s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.617120096 (121h42m1.348387746s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.622023970 (121h42m1.353291681s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.622840135 (121h42m1.354107785s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.727179166 (121h42m1.458446786s) [upload=126718]: Next returned nil segment
Aug 13 19:08:20.727279234 (121h42m1.458546864s) [upload=126718]: Waiting for error group managing segments...
Aug 13 19:08:20.740817168 (121h42m1.472084789s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.741709907 (121h42m1.472977537s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.741976870 (121h42m1.4732445s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.748823638 (121h42m1.480091268s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.750729704 (121h42m1.481997324s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.751278897 (121h42m1.482546527s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.763551371 (121h42m1.494819001s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.768221566 (121h42m1.499489196s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.769131177 (121h42m1.500398808s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.769654381 (121h42m1.500922002s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.770436272 (121h42m1.501703892s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.126424712 (121h42m1.857692362s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.134590111 (121h42m1.865857762s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.150885924 (121h42m1.882153574s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.150912293 (121h42m1.882179944s) [seg_pos={0 0}, upload=126718]: Segment reached optimal threshold of 14 pieces.
Aug 13 19:08:21.151075060 (121h42m1.88234271s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hdE48UnygY1dCRASR39FkumY2V8f5Xb68Pd1WJ4AMLUnnGAfT): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151110567 (121h42m1.882378216s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151167683 (121h42m1.882435334s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tnTEYvqJ6PB2DsuXA28sEuEiGj11StA4qdhcYH1kuoaMkTVdY): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151282079 (121h42m1.882549729s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151301135 (121h42m1.882568775s) [seg_pos={0 0}, upload=126718]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 19:08:21.151371136 (121h42m1.882638776s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 19:08:21.151376356 (121h42m1.882644006s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 19:08:21.328511696 (121h42m2.059779306s) [upload=126718]: Done uploading segments...
Aug 13 19:08:21.328527987 (121h42m2.059795618s) [upload=126718]: Upload finished. err: <nil>
Duration: 539.837249ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [....................X.........................X.......X.....] duration:
518.292163ms
FAIL (2025-08-13 19:12:34 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 13 19:08:20.572767219 (121h42m1.304034869s) [upload=126718]: Starting upload
Aug 13 19:08:20.572840447 (121h42m1.304108097s) [upload=126718]: Done starting upload
Aug 13 19:08:20.572952778 (121h42m1.304220427s) [upload=126718]: Uploading segments...
Aug 13 19:08:20.573276887 (121h42m1.304544547s) [upload=126718]: Got next segment. Inline: false
Aug 13 19:08:20.573342571 (121h42m1.304610222s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 19:08:20.573351448 (121h42m1.304619119s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 19:08:20.613293228 (121h42m1.344560888s) [seg_pos={0 0}, upload=126718]: Begin upload segment...
Aug 13 19:08:20.613362899 (121h42m1.344630549s) [seg_pos={0 0}, upload=126718]: Done begin upload segment.
Aug 13 19:08:20.613395610 (121h42m1.34466326s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613479168 (121h42m1.344746828s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613933462 (121h42m1.345201122s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613966173 (121h42m1.345233824s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614473598 (121h42m1.345741248s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614513222 (121h42m1.345780882s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614845417 (121h42m1.346113078s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615068767 (121h42m1.346336418s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615223789 (121h42m1.346491439s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615618681 (121h42m1.346886332s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615644741 (121h42m1.346912401s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616154590 (121h42m1.34742224s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616169798 (121h42m1.347437449s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616718090 (121h42m1.347985739s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616748518 (121h42m1.348016167s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.617120096 (121h42m1.348387746s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.622023970 (121h42m1.353291681s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.622840135 (121h42m1.354107785s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.727179166 (121h42m1.458446786s) [upload=126718]: Next returned nil segment
Aug 13 19:08:20.727279234 (121h42m1.458546864s) [upload=126718]: Waiting for error group managing segments...
Aug 13 19:08:20.740817168 (121h42m1.472084789s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.741709907 (121h42m1.472977537s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.741976870 (121h42m1.4732445s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.748823638 (121h42m1.480091268s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.750729704 (121h42m1.481997324s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.751278897 (121h42m1.482546527s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.763551371 (121h42m1.494819001s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.768221566 (121h42m1.499489196s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.769131177 (121h42m1.500398808s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.769654381 (121h42m1.500922002s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.770436272 (121h42m1.501703892s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.126424712 (121h42m1.857692362s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.134590111 (121h42m1.865857762s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.150885924 (121h42m1.882153574s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.150912293 (121h42m1.882179944s) [seg_pos={0 0}, upload=126718]: Segment reached optimal threshold of 14 pieces.
Aug 13 19:08:21.151075060 (121h42m1.88234271s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hdE48UnygY1dCRASR39FkumY2V8f5Xb68Pd1WJ4AMLUnnGAfT): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151110567 (121h42m1.882378216s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151167683 (121h42m1.882435334s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tnTEYvqJ6PB2DsuXA28sEuEiGj11StA4qdhcYH1kuoaMkTVdY): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151282079 (121h42m1.882549729s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151301135 (121h42m1.882568775s) [seg_pos={0 0}, upload=126718]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 19:08:21.151371136 (121h42m1.882638776s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 19:08:21.151376356 (121h42m1.882644006s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 19:08:21.328511696 (121h42m2.059779306s) [upload=126718]: Done uploading segments...
Aug 13 19:08:21.328527987 (121h42m2.059795618s) [upload=126718]: Upload finished. err: <nil>
Duration: 518.32844ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....X......X........................X......................] duration:
372.941229ms
FAIL (2025-08-13 19:12:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 18:55:21.849790646 (121h29m2.581058266s) [upload=126500]: Starting upload Aug 13 18:55:21.849866529 (121h29m2.581134149s) [upload=126500]: Done starting upload Aug 13 18:55:21.849939096 (121h29m2.581206726s) [upload=126500]: Uploading segments... Aug 13 18:55:21.849977618 (121h29m2.581245248s) [upload=126500]: Got next segment. Inline: true Aug 13 18:55:21.849983399 (121h29m2.581251049s) [upload=126500]: Waiting for error group managing segments... Aug 13 18:55:21.850034435 (121h29m2.581302065s) [upload=126500]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 18:55:21.850040105 (121h29m2.581307765s) [upload=126500]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 18:55:21.850044223 (121h29m2.581311853s) [upload=126500]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 18:55:21.852506835 (121h29m2.583774465s) [upload=126500]: Done uploading segments... Aug 13 18:55:21.852521132 (121h29m2.583788762s) [upload=126500]: Upload finished. err: metaclient: Too Many Requests
Duration: 372.964252ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....................X.........................X.......X....] duration:
521.003274ms
FAIL (2025-08-13 19:11:32 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 13 19:08:20.572767219 (121h42m1.304034869s) [upload=126718]: Starting upload
Aug 13 19:08:20.572840447 (121h42m1.304108097s) [upload=126718]: Done starting upload
Aug 13 19:08:20.572952778 (121h42m1.304220427s) [upload=126718]: Uploading segments...
Aug 13 19:08:20.573276887 (121h42m1.304544547s) [upload=126718]: Got next segment. Inline: false
Aug 13 19:08:20.573342571 (121h42m1.304610222s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 19:08:20.573351448 (121h42m1.304619119s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 19:08:20.613293228 (121h42m1.344560888s) [seg_pos={0 0}, upload=126718]: Begin upload segment...
Aug 13 19:08:20.613362899 (121h42m1.344630549s) [seg_pos={0 0}, upload=126718]: Done begin upload segment.
Aug 13 19:08:20.613395610 (121h42m1.34466326s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613479168 (121h42m1.344746828s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613933462 (121h42m1.345201122s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613966173 (121h42m1.345233824s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614473598 (121h42m1.345741248s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614513222 (121h42m1.345780882s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614845417 (121h42m1.346113078s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615068767 (121h42m1.346336418s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615223789 (121h42m1.346491439s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615618681 (121h42m1.346886332s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615644741 (121h42m1.346912401s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616154590 (121h42m1.34742224s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616169798 (121h42m1.347437449s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616718090 (121h42m1.347985739s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616748518 (121h42m1.348016167s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.617120096 (121h42m1.348387746s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.622023970 (121h42m1.353291681s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.622840135 (121h42m1.354107785s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.727179166 (121h42m1.458446786s) [upload=126718]: Next returned nil segment
Aug 13 19:08:20.727279234 (121h42m1.458546864s) [upload=126718]: Waiting for error group managing segments...
Aug 13 19:08:20.740817168 (121h42m1.472084789s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.741709907 (121h42m1.472977537s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.741976870 (121h42m1.4732445s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.748823638 (121h42m1.480091268s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.750729704 (121h42m1.481997324s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.751278897 (121h42m1.482546527s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.763551371 (121h42m1.494819001s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.768221566 (121h42m1.499489196s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.769131177 (121h42m1.500398808s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.769654381 (121h42m1.500922002s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.770436272 (121h42m1.501703892s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.126424712 (121h42m1.857692362s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.134590111 (121h42m1.865857762s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.150885924 (121h42m1.882153574s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.150912293 (121h42m1.882179944s) [seg_pos={0 0}, upload=126718]: Segment reached optimal threshold of 14 pieces.
Aug 13 19:08:21.151075060 (121h42m1.88234271s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hdE48UnygY1dCRASR39FkumY2V8f5Xb68Pd1WJ4AMLUnnGAfT): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151110567 (121h42m1.882378216s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151167683 (121h42m1.882435334s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tnTEYvqJ6PB2DsuXA28sEuEiGj11StA4qdhcYH1kuoaMkTVdY): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151282079 (121h42m1.882549729s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151301135 (121h42m1.882568775s) [seg_pos={0 0}, upload=126718]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 19:08:21.151371136 (121h42m1.882638776s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 19:08:21.151376356 (121h42m1.882644006s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 19:08:21.328511696 (121h42m2.059779306s) [upload=126718]: Done uploading segments...
Aug 13 19:08:21.328527987 (121h42m2.059795618s) [upload=126718]: Upload finished. err: <nil>
Duration: 521.030446ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......................X.........................X.......X...] duration:
430.653034ms
FAIL (2025-08-13 19:11:14 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 13 19:08:20.572767219 (121h42m1.304034869s) [upload=126718]: Starting upload
Aug 13 19:08:20.572840447 (121h42m1.304108097s) [upload=126718]: Done starting upload
Aug 13 19:08:20.572952778 (121h42m1.304220427s) [upload=126718]: Uploading segments...
Aug 13 19:08:20.573276887 (121h42m1.304544547s) [upload=126718]: Got next segment. Inline: false
Aug 13 19:08:20.573342571 (121h42m1.304610222s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 19:08:20.573351448 (121h42m1.304619119s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 19:08:20.613293228 (121h42m1.344560888s) [seg_pos={0 0}, upload=126718]: Begin upload segment...
Aug 13 19:08:20.613362899 (121h42m1.344630549s) [seg_pos={0 0}, upload=126718]: Done begin upload segment.
Aug 13 19:08:20.613395610 (121h42m1.34466326s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613479168 (121h42m1.344746828s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613933462 (121h42m1.345201122s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.613966173 (121h42m1.345233824s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614473598 (121h42m1.345741248s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614513222 (121h42m1.345780882s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.614845417 (121h42m1.346113078s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615068767 (121h42m1.346336418s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615223789 (121h42m1.346491439s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615618681 (121h42m1.346886332s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.615644741 (121h42m1.346912401s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616154590 (121h42m1.34742224s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616169798 (121h42m1.347437449s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616718090 (121h42m1.347985739s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.616748518 (121h42m1.348016167s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.617120096 (121h42m1.348387746s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.622023970 (121h42m1.353291681s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.622840135 (121h42m1.354107785s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Uploading piece...
Aug 13 19:08:20.727179166 (121h42m1.458446786s) [upload=126718]: Next returned nil segment
Aug 13 19:08:20.727279234 (121h42m1.458546864s) [upload=126718]: Waiting for error group managing segments...
Aug 13 19:08:20.740817168 (121h42m1.472084789s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.741709907 (121h42m1.472977537s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.741976870 (121h42m1.4732445s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.748823638 (121h42m1.480091268s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.750729704 (121h42m1.481997324s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.751278897 (121h42m1.482546527s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.763551371 (121h42m1.494819001s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.768221566 (121h42m1.499489196s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.769131177 (121h42m1.500398808s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.769654381 (121h42m1.500922002s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:20.770436272 (121h42m1.501703892s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.126424712 (121h42m1.857692362s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.134590111 (121h42m1.865857762s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.150885924 (121h42m1.882153574s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil>
Aug 13 19:08:21.150912293 (121h42m1.882179944s) [seg_pos={0 0}, upload=126718]: Segment reached optimal threshold of 14 pieces.
Aug 13 19:08:21.151075060 (121h42m1.88234271s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hdE48UnygY1dCRASR39FkumY2V8f5Xb68Pd1WJ4AMLUnnGAfT): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151110567 (121h42m1.882378216s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151167683 (121h42m1.882435334s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tnTEYvqJ6PB2DsuXA28sEuEiGj11StA4qdhcYH1kuoaMkTVdY): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151282079 (121h42m1.882549729s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: expected piece hash; context canceled; EOF
Aug 13 19:08:21.151301135 (121h42m1.882568775s) [seg_pos={0 0}, upload=126718]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 19:08:21.151371136 (121h42m1.882638776s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 19:08:21.151376356 (121h42m1.882644006s) [upload=126718]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 19:08:21.328511696 (121h42m2.059779306s) [upload=126718]: Done uploading segments...
Aug 13 19:08:21.328527987 (121h42m2.059795618s) [upload=126718]: Upload finished. err: <nil>
Duration: 430.677319ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [......X......X........................X.....................] duration:
166.216514ms
FAIL (2025-08-13 19:11:07 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 18:55:21.849790646 (121h29m2.581058266s) [upload=126500]: Starting upload Aug 13 18:55:21.849866529 (121h29m2.581134149s) [upload=126500]: Done starting upload Aug 13 18:55:21.849939096 (121h29m2.581206726s) [upload=126500]: Uploading segments... Aug 13 18:55:21.849977618 (121h29m2.581245248s) [upload=126500]: Got next segment. Inline: true Aug 13 18:55:21.849983399 (121h29m2.581251049s) [upload=126500]: Waiting for error group managing segments... Aug 13 18:55:21.850034435 (121h29m2.581302065s) [upload=126500]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 18:55:21.850040105 (121h29m2.581307765s) [upload=126500]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 18:55:21.850044223 (121h29m2.581311853s) [upload=126500]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 18:55:21.852506835 (121h29m2.583774465s) [upload=126500]: Done uploading segments... Aug 13 18:55:21.852521132 (121h29m2.583788762s) [upload=126500]: Upload finished. err: metaclient: Too Many Requests
Duration: 166.278821ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|