Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.X....X.....................X.......X.......................] duration: 507.754161ms FAIL (2025-08-22 16:02:51 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a332dec0f9830710718513902cda341fc779204e956c9b76c091b9655ff15791 != before fead3175f949e8f7847321a6a0be058f5ba8f9601d139b79b5db601e719df2b2 ======LOGS====== Aug 22 15:45:25.052387297 (334h19m5.783654927s) [upload=347532]: Starting upload Aug 22 15:45:25.052448271 (334h19m5.783715891s) [upload=347532]: Done starting upload Aug 22 15:45:25.052562306 (334h19m5.783829936s) [upload=347532]: Uploading segments... Aug 22 15:45:25.052661752 (334h19m5.783929383s) [upload=347532]: Got next segment. Inline: false Aug 22 15:45:25.052697329 (334h19m5.783964959s) [upload=347532]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 15:45:25.052702730 (334h19m5.783970379s) [upload=347532]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 15:45:25.108388744 (334h19m5.839656374s) [seg_pos={0 0}, upload=347532]: Begin upload segment... Aug 22 15:45:25.108436563 (334h19m5.839704193s) [seg_pos={0 0}, upload=347532]: Done begin upload segment. Aug 22 15:45:25.108458765 (334h19m5.839726395s) [noise=true , address=77.90.31.19:4868 , piece_id=PXGGATWZGDBGPRFNITEFZAYPMSEAJCASMWELNBSKCQAGCD54CVIQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108478472 (334h19m5.839746092s) [noise=true , address=45.91.116.8:4070 , piece_id=2YPJJIPDFIV5SS57USBXJHJFKW4M5TQDVUMJNCERKIX5ZD452Z4A, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108550818 (334h19m5.839818439s) [noise=true , address=45.91.116.11:4121 , piece_id=ZMXYNELKX2KHD5RWH2OU5ZZ7LOCPDAGX4GXB6UBW6J2US75UXWRA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108772846 (334h19m5.840040476s) [noise=true , address=104.36.82.6:4880 , piece_id=CAUY7U2VJB6MPAPWANT4KYCCP3RGBWH3MA5WF4E7YO3X2KIGUWZA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108781532 (334h19m5.840049162s) [noise=true , address=77.90.31.15:4702 , piece_id=W37OSPHPZPTQYCHD73KXSAVSUTASTCJAGG3LWMQAPTSPIUUCKUUA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108989513 (334h19m5.840257143s) [noise=true , address=77.90.31.12:4623 , piece_id=KMKYXHMWV2HUK53CPJF5USRWNF33FQBGMG5NPMRAMZAJTO3BU6AA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108994733 (334h19m5.840262353s) [noise=true , address=104.36.82.60:4339 , piece_id=DCXJLRGTJK2TMID2RUBDVKWDOV4SRHAGVELLZY7TERPIACKO6HQQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109200140 (334h19m5.840467759s) [noise=true , address=77.90.31.10:4536 , piece_id=TB3NK2FHULSSUGXBUUWS5JZUEGCXFK3LORPWHSW6546UAUET6RXQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109204497 (334h19m5.840472127s) [noise=true , address=104.36.82.44:4896 , piece_id=GCPBKLGUO337LW65K5PUCDZIMIM4SGKH2L2XYAJDR25KXPKS3QBQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109422278 (334h19m5.840689908s) [noise=true , address=79.127.219.47:4061 , piece_id=PQK2BYCQVCQUECDHHHAPCAEOKZFQCNIL7UXXC7FW4QU36VTM53JQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109435232 (334h19m5.840702853s) [noise=true , address=45.91.116.8:4066 , piece_id=42MWX3KB4OYNODSSONGQVRQHVQPNAYDN7BEQCLOWBFVISZKFV5UA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109635338 (334h19m5.840902959s) [noise=true , address=104.36.82.11:4120 , piece_id=ZVJDHQPPTGG7J4DCW23CUG3NVCEBSNDKSKUFBR6Q2XDIODKS2CRQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109646599 (334h19m5.84091423s) [noise=true , address=77.90.31.21:4902 , piece_id=XNNBMEIPPGRCIFPXHE4RDNBVMKYV777UVDTXYGBTFUXFPUUIL7HA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109856895 (334h19m5.841124525s) [noise=true , address=79.127.219.51:4206 , piece_id=DT27R7X4YZUNSZ2XDWKXLUMIXY6TD25FF473GE7V7Z6BXIJQB6WQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.110069735 (334h19m5.841337366s) [noise=true , address=79.127.201.215:4344 , piece_id=GLXLVWBVLX3WPDVC5G3CA2DAPPF3GZTTN4PKRSHV66H7KO2PGN7A, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.110276726 (334h19m5.841544345s) [noise=true , address=77.90.31.16:4738 , piece_id=XWJADL5V6LBSKWDI32TRV5NZNG2Y5KTWZRKP7HJQOIB3PD75IH4A, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.110529401 (334h19m5.841797031s) [noise=true , address=45.91.116.5:4326 , piece_id=TRF3G7F2SAC4KTRQ4TTMPP6H5GDH5C2ZGY5VOYT7Y6NCSRNLLZOA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.111701505 (334h19m5.842969136s) [noise=true , address=104.36.82.23:4466 , piece_id=OTU3SXJHJT23CBUEVT4NI7MPUBTWRW74FU7JATMGGEUC4FB6JDWA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.194907293 (334h19m5.926174913s) [upload=347532]: Next returned nil segment Aug 22 15:45:25.194933362 (334h19m5.926200992s) [upload=347532]: Waiting for error group managing segments... Aug 22 15:45:25.202079456 (334h19m5.933347077s) [noise=true , address=45.91.116.8:4066 , piece_id=42MWX3KB4OYNODSSONGQVRQHVQPNAYDN7BEQCLOWBFVISZKFV5UA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.202604625 (334h19m5.933872255s) [noise=true , address=79.127.219.51:4206 , piece_id=DT27R7X4YZUNSZ2XDWKXLUMIXY6TD25FF473GE7V7Z6BXIJQB6WQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.202778832 (334h19m5.934046452s) [noise=true , address=79.127.219.47:4061 , piece_id=PQK2BYCQVCQUECDHHHAPCAEOKZFQCNIL7UXXC7FW4QU36VTM53JQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.202957649 (334h19m5.934225279s) [noise=true , address=45.91.116.5:4326 , piece_id=TRF3G7F2SAC4KTRQ4TTMPP6H5GDH5C2ZGY5VOYT7Y6NCSRNLLZOA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.205554464 (334h19m5.936822084s) [noise=true , address=45.91.116.8:4070 , piece_id=2YPJJIPDFIV5SS57USBXJHJFKW4M5TQDVUMJNCERKIX5ZD452Z4A, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.207505926 (334h19m5.938773545s) [noise=true , address=104.36.82.60:4339 , piece_id=DCXJLRGTJK2TMID2RUBDVKWDOV4SRHAGVELLZY7TERPIACKO6HQQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.214577409 (334h19m5.945845039s) [noise=true , address=104.36.82.6:4880 , piece_id=CAUY7U2VJB6MPAPWANT4KYCCP3RGBWH3MA5WF4E7YO3X2KIGUWZA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.215183799 (334h19m5.946451429s) [noise=true , address=104.36.82.11:4120 , piece_id=ZVJDHQPPTGG7J4DCW23CUG3NVCEBSNDKSKUFBR6Q2XDIODKS2CRQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.227204945 (334h19m5.958472576s) [noise=true , address=77.90.31.16:4738 , piece_id=XWJADL5V6LBSKWDI32TRV5NZNG2Y5KTWZRKP7HJQOIB3PD75IH4A, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.231276064 (334h19m5.962543685s) [noise=true , address=77.90.31.15:4702 , piece_id=W37OSPHPZPTQYCHD73KXSAVSUTASTCJAGG3LWMQAPTSPIUUCKUUA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.232214379 (334h19m5.963482s) [noise=true , address=77.90.31.19:4868 , piece_id=PXGGATWZGDBGPRFNITEFZAYPMSEAJCASMWELNBSKCQAGCD54CVIQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.234490052 (334h19m5.965757682s) [noise=true , address=77.90.31.21:4902 , piece_id=XNNBMEIPPGRCIFPXHE4RDNBVMKYV777UVDTXYGBTFUXFPUUIL7HA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.242306687 (334h19m5.973574317s) [noise=true , address=77.90.31.10:4536 , piece_id=TB3NK2FHULSSUGXBUUWS5JZUEGCXFK3LORPWHSW6546UAUET6RXQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.251803884 (334h19m5.983071514s) [noise=true , address=104.36.82.23:4466 , piece_id=OTU3SXJHJT23CBUEVT4NI7MPUBTWRW74FU7JATMGGEUC4FB6JDWA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.251826296 (334h19m5.983093957s) [seg_pos={0 0}, upload=347532]: Segment reached optimal threshold of 14 pieces. Aug 22 15:45:25.251970888 (334h19m5.983238518s) [noise=true , address=45.91.116.11:4121 , piece_id=ZMXYNELKX2KHD5RWH2OU5ZZ7LOCPDAGX4GXB6UBW6J2US75UXWRA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wkujwGr7G6yGYFLiYcxfBnN1pmKY6mHXoAzZWAjGCCiWWZNdh): protocol: expected piece hash; context canceled; EOF Aug 22 15:45:25.252035119 (334h19m5.983302739s) [noise=true , address=77.90.31.12:4623 , piece_id=KMKYXHMWV2HUK53CPJF5USRWNF33FQBGMG5NPMRAMZAJTO3BU6AA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ANjFmZrb9SDcqEHW8CBzeMtwvmceoLH9MtPabAjBw8wXjBuaM): protocol: expected piece hash; context canceled; EOF Aug 22 15:45:25.252430574 (334h19m5.983698224s) [noise=true , address=104.36.82.44:4896 , piece_id=GCPBKLGUO337LW65K5PUCDZIMIM4SGKH2L2XYAJDR25KXPKS3QBQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ndSgjgfZMVQni5tw1ugdTrhJt4c4NagdvgYTbSbjatYYtfu1o): protocol: write tcp 5.161.89.252:59268->104.36.82.44:4896: use of closed network connection; write tcp 5.161.89.252:59268->104.36.82.44:4896: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:59268->104.36.82.44:4896: use of closed network connection Aug 22 15:45:25.252837219 (334h19m5.984104849s) [noise=true , address=79.127.201.215:4344 , piece_id=GLXLVWBVLX3WPDVC5G3CA2DAPPF3GZTTN4PKRSHV66H7KO2PGN7A, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: write tcp 5.161.89.252:10764->79.127.201.215:4344: use of closed network connection; write tcp 5.161.89.252:10764->79.127.201.215:4344: use of closed network connection Aug 22 15:45:25.252866453 (334h19m5.984134083s) [seg_pos={0 0}, upload=347532]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 15:45:25.253131663 (334h19m5.984399293s) [upload=347532]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 15:45:25.253146330 (334h19m5.984413981s) [upload=347532]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 15:45:25.422275527 (334h19m6.153543177s) [upload=347532]: Done uploading segments... Aug 22 15:45:25.422292930 (334h19m6.15356058s) [upload=347532]: Upload finished. err: <nil> Duration: 507.774909ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 3.038092824s FAIL (2025-08-22 16:02:38 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 3.038119244s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 3.476614792s FAIL (2025-08-22 16:01:47 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 3.47664037s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..X....X.....................X.......X......................] duration: 1.635987426s FAIL (2025-08-22 16:01:38 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a332dec0f9830710718513902cda341fc779204e956c9b76c091b9655ff15791 != before fead3175f949e8f7847321a6a0be058f5ba8f9601d139b79b5db601e719df2b2 ======LOGS====== Aug 22 15:45:25.052387297 (334h19m5.783654927s) [upload=347532]: Starting upload Aug 22 15:45:25.052448271 (334h19m5.783715891s) [upload=347532]: Done starting upload Aug 22 15:45:25.052562306 (334h19m5.783829936s) [upload=347532]: Uploading segments... Aug 22 15:45:25.052661752 (334h19m5.783929383s) [upload=347532]: Got next segment. Inline: false Aug 22 15:45:25.052697329 (334h19m5.783964959s) [upload=347532]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 15:45:25.052702730 (334h19m5.783970379s) [upload=347532]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 15:45:25.108388744 (334h19m5.839656374s) [seg_pos={0 0}, upload=347532]: Begin upload segment... Aug 22 15:45:25.108436563 (334h19m5.839704193s) [seg_pos={0 0}, upload=347532]: Done begin upload segment. Aug 22 15:45:25.108458765 (334h19m5.839726395s) [noise=true , address=77.90.31.19:4868 , piece_id=PXGGATWZGDBGPRFNITEFZAYPMSEAJCASMWELNBSKCQAGCD54CVIQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108478472 (334h19m5.839746092s) [noise=true , address=45.91.116.8:4070 , piece_id=2YPJJIPDFIV5SS57USBXJHJFKW4M5TQDVUMJNCERKIX5ZD452Z4A, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108550818 (334h19m5.839818439s) [noise=true , address=45.91.116.11:4121 , piece_id=ZMXYNELKX2KHD5RWH2OU5ZZ7LOCPDAGX4GXB6UBW6J2US75UXWRA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108772846 (334h19m5.840040476s) [noise=true , address=104.36.82.6:4880 , piece_id=CAUY7U2VJB6MPAPWANT4KYCCP3RGBWH3MA5WF4E7YO3X2KIGUWZA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108781532 (334h19m5.840049162s) [noise=true , address=77.90.31.15:4702 , piece_id=W37OSPHPZPTQYCHD73KXSAVSUTASTCJAGG3LWMQAPTSPIUUCKUUA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108989513 (334h19m5.840257143s) [noise=true , address=77.90.31.12:4623 , piece_id=KMKYXHMWV2HUK53CPJF5USRWNF33FQBGMG5NPMRAMZAJTO3BU6AA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108994733 (334h19m5.840262353s) [noise=true , address=104.36.82.60:4339 , piece_id=DCXJLRGTJK2TMID2RUBDVKWDOV4SRHAGVELLZY7TERPIACKO6HQQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109200140 (334h19m5.840467759s) [noise=true , address=77.90.31.10:4536 , piece_id=TB3NK2FHULSSUGXBUUWS5JZUEGCXFK3LORPWHSW6546UAUET6RXQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109204497 (334h19m5.840472127s) [noise=true , address=104.36.82.44:4896 , piece_id=GCPBKLGUO337LW65K5PUCDZIMIM4SGKH2L2XYAJDR25KXPKS3QBQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109422278 (334h19m5.840689908s) [noise=true , address=79.127.219.47:4061 , piece_id=PQK2BYCQVCQUECDHHHAPCAEOKZFQCNIL7UXXC7FW4QU36VTM53JQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109435232 (334h19m5.840702853s) [noise=true , address=45.91.116.8:4066 , piece_id=42MWX3KB4OYNODSSONGQVRQHVQPNAYDN7BEQCLOWBFVISZKFV5UA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109635338 (334h19m5.840902959s) [noise=true , address=104.36.82.11:4120 , piece_id=ZVJDHQPPTGG7J4DCW23CUG3NVCEBSNDKSKUFBR6Q2XDIODKS2CRQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109646599 (334h19m5.84091423s) [noise=true , address=77.90.31.21:4902 , piece_id=XNNBMEIPPGRCIFPXHE4RDNBVMKYV777UVDTXYGBTFUXFPUUIL7HA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109856895 (334h19m5.841124525s) [noise=true , address=79.127.219.51:4206 , piece_id=DT27R7X4YZUNSZ2XDWKXLUMIXY6TD25FF473GE7V7Z6BXIJQB6WQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.110069735 (334h19m5.841337366s) [noise=true , address=79.127.201.215:4344 , piece_id=GLXLVWBVLX3WPDVC5G3CA2DAPPF3GZTTN4PKRSHV66H7KO2PGN7A, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.110276726 (334h19m5.841544345s) [noise=true , address=77.90.31.16:4738 , piece_id=XWJADL5V6LBSKWDI32TRV5NZNG2Y5KTWZRKP7HJQOIB3PD75IH4A, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.110529401 (334h19m5.841797031s) [noise=true , address=45.91.116.5:4326 , piece_id=TRF3G7F2SAC4KTRQ4TTMPP6H5GDH5C2ZGY5VOYT7Y6NCSRNLLZOA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.111701505 (334h19m5.842969136s) [noise=true , address=104.36.82.23:4466 , piece_id=OTU3SXJHJT23CBUEVT4NI7MPUBTWRW74FU7JATMGGEUC4FB6JDWA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.194907293 (334h19m5.926174913s) [upload=347532]: Next returned nil segment Aug 22 15:45:25.194933362 (334h19m5.926200992s) [upload=347532]: Waiting for error group managing segments... Aug 22 15:45:25.202079456 (334h19m5.933347077s) [noise=true , address=45.91.116.8:4066 , piece_id=42MWX3KB4OYNODSSONGQVRQHVQPNAYDN7BEQCLOWBFVISZKFV5UA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.202604625 (334h19m5.933872255s) [noise=true , address=79.127.219.51:4206 , piece_id=DT27R7X4YZUNSZ2XDWKXLUMIXY6TD25FF473GE7V7Z6BXIJQB6WQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.202778832 (334h19m5.934046452s) [noise=true , address=79.127.219.47:4061 , piece_id=PQK2BYCQVCQUECDHHHAPCAEOKZFQCNIL7UXXC7FW4QU36VTM53JQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.202957649 (334h19m5.934225279s) [noise=true , address=45.91.116.5:4326 , piece_id=TRF3G7F2SAC4KTRQ4TTMPP6H5GDH5C2ZGY5VOYT7Y6NCSRNLLZOA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.205554464 (334h19m5.936822084s) [noise=true , address=45.91.116.8:4070 , piece_id=2YPJJIPDFIV5SS57USBXJHJFKW4M5TQDVUMJNCERKIX5ZD452Z4A, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.207505926 (334h19m5.938773545s) [noise=true , address=104.36.82.60:4339 , piece_id=DCXJLRGTJK2TMID2RUBDVKWDOV4SRHAGVELLZY7TERPIACKO6HQQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.214577409 (334h19m5.945845039s) [noise=true , address=104.36.82.6:4880 , piece_id=CAUY7U2VJB6MPAPWANT4KYCCP3RGBWH3MA5WF4E7YO3X2KIGUWZA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.215183799 (334h19m5.946451429s) [noise=true , address=104.36.82.11:4120 , piece_id=ZVJDHQPPTGG7J4DCW23CUG3NVCEBSNDKSKUFBR6Q2XDIODKS2CRQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.227204945 (334h19m5.958472576s) [noise=true , address=77.90.31.16:4738 , piece_id=XWJADL5V6LBSKWDI32TRV5NZNG2Y5KTWZRKP7HJQOIB3PD75IH4A, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.231276064 (334h19m5.962543685s) [noise=true , address=77.90.31.15:4702 , piece_id=W37OSPHPZPTQYCHD73KXSAVSUTASTCJAGG3LWMQAPTSPIUUCKUUA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.232214379 (334h19m5.963482s) [noise=true , address=77.90.31.19:4868 , piece_id=PXGGATWZGDBGPRFNITEFZAYPMSEAJCASMWELNBSKCQAGCD54CVIQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.234490052 (334h19m5.965757682s) [noise=true , address=77.90.31.21:4902 , piece_id=XNNBMEIPPGRCIFPXHE4RDNBVMKYV777UVDTXYGBTFUXFPUUIL7HA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.242306687 (334h19m5.973574317s) [noise=true , address=77.90.31.10:4536 , piece_id=TB3NK2FHULSSUGXBUUWS5JZUEGCXFK3LORPWHSW6546UAUET6RXQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.251803884 (334h19m5.983071514s) [noise=true , address=104.36.82.23:4466 , piece_id=OTU3SXJHJT23CBUEVT4NI7MPUBTWRW74FU7JATMGGEUC4FB6JDWA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.251826296 (334h19m5.983093957s) [seg_pos={0 0}, upload=347532]: Segment reached optimal threshold of 14 pieces. Aug 22 15:45:25.251970888 (334h19m5.983238518s) [noise=true , address=45.91.116.11:4121 , piece_id=ZMXYNELKX2KHD5RWH2OU5ZZ7LOCPDAGX4GXB6UBW6J2US75UXWRA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wkujwGr7G6yGYFLiYcxfBnN1pmKY6mHXoAzZWAjGCCiWWZNdh): protocol: expected piece hash; context canceled; EOF Aug 22 15:45:25.252035119 (334h19m5.983302739s) [noise=true , address=77.90.31.12:4623 , piece_id=KMKYXHMWV2HUK53CPJF5USRWNF33FQBGMG5NPMRAMZAJTO3BU6AA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ANjFmZrb9SDcqEHW8CBzeMtwvmceoLH9MtPabAjBw8wXjBuaM): protocol: expected piece hash; context canceled; EOF Aug 22 15:45:25.252430574 (334h19m5.983698224s) [noise=true , address=104.36.82.44:4896 , piece_id=GCPBKLGUO337LW65K5PUCDZIMIM4SGKH2L2XYAJDR25KXPKS3QBQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ndSgjgfZMVQni5tw1ugdTrhJt4c4NagdvgYTbSbjatYYtfu1o): protocol: write tcp 5.161.89.252:59268->104.36.82.44:4896: use of closed network connection; write tcp 5.161.89.252:59268->104.36.82.44:4896: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:59268->104.36.82.44:4896: use of closed network connection Aug 22 15:45:25.252837219 (334h19m5.984104849s) [noise=true , address=79.127.201.215:4344 , piece_id=GLXLVWBVLX3WPDVC5G3CA2DAPPF3GZTTN4PKRSHV66H7KO2PGN7A, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: write tcp 5.161.89.252:10764->79.127.201.215:4344: use of closed network connection; write tcp 5.161.89.252:10764->79.127.201.215:4344: use of closed network connection Aug 22 15:45:25.252866453 (334h19m5.984134083s) [seg_pos={0 0}, upload=347532]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 15:45:25.253131663 (334h19m5.984399293s) [upload=347532]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 15:45:25.253146330 (334h19m5.984413981s) [upload=347532]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 15:45:25.422275527 (334h19m6.153543177s) [upload=347532]: Done uploading segments... Aug 22 15:45:25.422292930 (334h19m6.15356058s) [upload=347532]: Upload finished. err: <nil> Duration: 1.636004917s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 2.911561893s FAIL (2025-08-22 16:00:40 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 2.911588062s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...X....X.....................X.......X.....................] duration: 1.661223752s FAIL (2025-08-22 16:00:25 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a332dec0f9830710718513902cda341fc779204e956c9b76c091b9655ff15791 != before fead3175f949e8f7847321a6a0be058f5ba8f9601d139b79b5db601e719df2b2 ======LOGS====== Aug 22 15:45:25.052387297 (334h19m5.783654927s) [upload=347532]: Starting upload Aug 22 15:45:25.052448271 (334h19m5.783715891s) [upload=347532]: Done starting upload Aug 22 15:45:25.052562306 (334h19m5.783829936s) [upload=347532]: Uploading segments... Aug 22 15:45:25.052661752 (334h19m5.783929383s) [upload=347532]: Got next segment. Inline: false Aug 22 15:45:25.052697329 (334h19m5.783964959s) [upload=347532]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 15:45:25.052702730 (334h19m5.783970379s) [upload=347532]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 15:45:25.108388744 (334h19m5.839656374s) [seg_pos={0 0}, upload=347532]: Begin upload segment... Aug 22 15:45:25.108436563 (334h19m5.839704193s) [seg_pos={0 0}, upload=347532]: Done begin upload segment. Aug 22 15:45:25.108458765 (334h19m5.839726395s) [noise=true , address=77.90.31.19:4868 , piece_id=PXGGATWZGDBGPRFNITEFZAYPMSEAJCASMWELNBSKCQAGCD54CVIQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108478472 (334h19m5.839746092s) [noise=true , address=45.91.116.8:4070 , piece_id=2YPJJIPDFIV5SS57USBXJHJFKW4M5TQDVUMJNCERKIX5ZD452Z4A, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108550818 (334h19m5.839818439s) [noise=true , address=45.91.116.11:4121 , piece_id=ZMXYNELKX2KHD5RWH2OU5ZZ7LOCPDAGX4GXB6UBW6J2US75UXWRA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108772846 (334h19m5.840040476s) [noise=true , address=104.36.82.6:4880 , piece_id=CAUY7U2VJB6MPAPWANT4KYCCP3RGBWH3MA5WF4E7YO3X2KIGUWZA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108781532 (334h19m5.840049162s) [noise=true , address=77.90.31.15:4702 , piece_id=W37OSPHPZPTQYCHD73KXSAVSUTASTCJAGG3LWMQAPTSPIUUCKUUA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108989513 (334h19m5.840257143s) [noise=true , address=77.90.31.12:4623 , piece_id=KMKYXHMWV2HUK53CPJF5USRWNF33FQBGMG5NPMRAMZAJTO3BU6AA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108994733 (334h19m5.840262353s) [noise=true , address=104.36.82.60:4339 , piece_id=DCXJLRGTJK2TMID2RUBDVKWDOV4SRHAGVELLZY7TERPIACKO6HQQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109200140 (334h19m5.840467759s) [noise=true , address=77.90.31.10:4536 , piece_id=TB3NK2FHULSSUGXBUUWS5JZUEGCXFK3LORPWHSW6546UAUET6RXQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109204497 (334h19m5.840472127s) [noise=true , address=104.36.82.44:4896 , piece_id=GCPBKLGUO337LW65K5PUCDZIMIM4SGKH2L2XYAJDR25KXPKS3QBQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109422278 (334h19m5.840689908s) [noise=true , address=79.127.219.47:4061 , piece_id=PQK2BYCQVCQUECDHHHAPCAEOKZFQCNIL7UXXC7FW4QU36VTM53JQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109435232 (334h19m5.840702853s) [noise=true , address=45.91.116.8:4066 , piece_id=42MWX3KB4OYNODSSONGQVRQHVQPNAYDN7BEQCLOWBFVISZKFV5UA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109635338 (334h19m5.840902959s) [noise=true , address=104.36.82.11:4120 , piece_id=ZVJDHQPPTGG7J4DCW23CUG3NVCEBSNDKSKUFBR6Q2XDIODKS2CRQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109646599 (334h19m5.84091423s) [noise=true , address=77.90.31.21:4902 , piece_id=XNNBMEIPPGRCIFPXHE4RDNBVMKYV777UVDTXYGBTFUXFPUUIL7HA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109856895 (334h19m5.841124525s) [noise=true , address=79.127.219.51:4206 , piece_id=DT27R7X4YZUNSZ2XDWKXLUMIXY6TD25FF473GE7V7Z6BXIJQB6WQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.110069735 (334h19m5.841337366s) [noise=true , address=79.127.201.215:4344 , piece_id=GLXLVWBVLX3WPDVC5G3CA2DAPPF3GZTTN4PKRSHV66H7KO2PGN7A, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.110276726 (334h19m5.841544345s) [noise=true , address=77.90.31.16:4738 , piece_id=XWJADL5V6LBSKWDI32TRV5NZNG2Y5KTWZRKP7HJQOIB3PD75IH4A, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.110529401 (334h19m5.841797031s) [noise=true , address=45.91.116.5:4326 , piece_id=TRF3G7F2SAC4KTRQ4TTMPP6H5GDH5C2ZGY5VOYT7Y6NCSRNLLZOA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.111701505 (334h19m5.842969136s) [noise=true , address=104.36.82.23:4466 , piece_id=OTU3SXJHJT23CBUEVT4NI7MPUBTWRW74FU7JATMGGEUC4FB6JDWA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.194907293 (334h19m5.926174913s) [upload=347532]: Next returned nil segment Aug 22 15:45:25.194933362 (334h19m5.926200992s) [upload=347532]: Waiting for error group managing segments... Aug 22 15:45:25.202079456 (334h19m5.933347077s) [noise=true , address=45.91.116.8:4066 , piece_id=42MWX3KB4OYNODSSONGQVRQHVQPNAYDN7BEQCLOWBFVISZKFV5UA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.202604625 (334h19m5.933872255s) [noise=true , address=79.127.219.51:4206 , piece_id=DT27R7X4YZUNSZ2XDWKXLUMIXY6TD25FF473GE7V7Z6BXIJQB6WQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.202778832 (334h19m5.934046452s) [noise=true , address=79.127.219.47:4061 , piece_id=PQK2BYCQVCQUECDHHHAPCAEOKZFQCNIL7UXXC7FW4QU36VTM53JQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.202957649 (334h19m5.934225279s) [noise=true , address=45.91.116.5:4326 , piece_id=TRF3G7F2SAC4KTRQ4TTMPP6H5GDH5C2ZGY5VOYT7Y6NCSRNLLZOA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.205554464 (334h19m5.936822084s) [noise=true , address=45.91.116.8:4070 , piece_id=2YPJJIPDFIV5SS57USBXJHJFKW4M5TQDVUMJNCERKIX5ZD452Z4A, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.207505926 (334h19m5.938773545s) [noise=true , address=104.36.82.60:4339 , piece_id=DCXJLRGTJK2TMID2RUBDVKWDOV4SRHAGVELLZY7TERPIACKO6HQQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.214577409 (334h19m5.945845039s) [noise=true , address=104.36.82.6:4880 , piece_id=CAUY7U2VJB6MPAPWANT4KYCCP3RGBWH3MA5WF4E7YO3X2KIGUWZA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.215183799 (334h19m5.946451429s) [noise=true , address=104.36.82.11:4120 , piece_id=ZVJDHQPPTGG7J4DCW23CUG3NVCEBSNDKSKUFBR6Q2XDIODKS2CRQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.227204945 (334h19m5.958472576s) [noise=true , address=77.90.31.16:4738 , piece_id=XWJADL5V6LBSKWDI32TRV5NZNG2Y5KTWZRKP7HJQOIB3PD75IH4A, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.231276064 (334h19m5.962543685s) [noise=true , address=77.90.31.15:4702 , piece_id=W37OSPHPZPTQYCHD73KXSAVSUTASTCJAGG3LWMQAPTSPIUUCKUUA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.232214379 (334h19m5.963482s) [noise=true , address=77.90.31.19:4868 , piece_id=PXGGATWZGDBGPRFNITEFZAYPMSEAJCASMWELNBSKCQAGCD54CVIQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.234490052 (334h19m5.965757682s) [noise=true , address=77.90.31.21:4902 , piece_id=XNNBMEIPPGRCIFPXHE4RDNBVMKYV777UVDTXYGBTFUXFPUUIL7HA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.242306687 (334h19m5.973574317s) [noise=true , address=77.90.31.10:4536 , piece_id=TB3NK2FHULSSUGXBUUWS5JZUEGCXFK3LORPWHSW6546UAUET6RXQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.251803884 (334h19m5.983071514s) [noise=true , address=104.36.82.23:4466 , piece_id=OTU3SXJHJT23CBUEVT4NI7MPUBTWRW74FU7JATMGGEUC4FB6JDWA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.251826296 (334h19m5.983093957s) [seg_pos={0 0}, upload=347532]: Segment reached optimal threshold of 14 pieces. Aug 22 15:45:25.251970888 (334h19m5.983238518s) [noise=true , address=45.91.116.11:4121 , piece_id=ZMXYNELKX2KHD5RWH2OU5ZZ7LOCPDAGX4GXB6UBW6J2US75UXWRA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wkujwGr7G6yGYFLiYcxfBnN1pmKY6mHXoAzZWAjGCCiWWZNdh): protocol: expected piece hash; context canceled; EOF Aug 22 15:45:25.252035119 (334h19m5.983302739s) [noise=true , address=77.90.31.12:4623 , piece_id=KMKYXHMWV2HUK53CPJF5USRWNF33FQBGMG5NPMRAMZAJTO3BU6AA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ANjFmZrb9SDcqEHW8CBzeMtwvmceoLH9MtPabAjBw8wXjBuaM): protocol: expected piece hash; context canceled; EOF Aug 22 15:45:25.252430574 (334h19m5.983698224s) [noise=true , address=104.36.82.44:4896 , piece_id=GCPBKLGUO337LW65K5PUCDZIMIM4SGKH2L2XYAJDR25KXPKS3QBQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ndSgjgfZMVQni5tw1ugdTrhJt4c4NagdvgYTbSbjatYYtfu1o): protocol: write tcp 5.161.89.252:59268->104.36.82.44:4896: use of closed network connection; write tcp 5.161.89.252:59268->104.36.82.44:4896: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:59268->104.36.82.44:4896: use of closed network connection Aug 22 15:45:25.252837219 (334h19m5.984104849s) [noise=true , address=79.127.201.215:4344 , piece_id=GLXLVWBVLX3WPDVC5G3CA2DAPPF3GZTTN4PKRSHV66H7KO2PGN7A, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: write tcp 5.161.89.252:10764->79.127.201.215:4344: use of closed network connection; write tcp 5.161.89.252:10764->79.127.201.215:4344: use of closed network connection Aug 22 15:45:25.252866453 (334h19m5.984134083s) [seg_pos={0 0}, upload=347532]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 15:45:25.253131663 (334h19m5.984399293s) [upload=347532]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 15:45:25.253146330 (334h19m5.984413981s) [upload=347532]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 15:45:25.422275527 (334h19m6.153543177s) [upload=347532]: Done uploading segments... Aug 22 15:45:25.422292930 (334h19m6.15356058s) [upload=347532]: Upload finished. err: <nil> Duration: 1.661242928s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [....X....X.....................X.......X....................] duration: 1.882884172s FAIL (2025-08-22 15:59:47 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a332dec0f9830710718513902cda341fc779204e956c9b76c091b9655ff15791 != before fead3175f949e8f7847321a6a0be058f5ba8f9601d139b79b5db601e719df2b2 ======LOGS====== Aug 22 15:45:25.052387297 (334h19m5.783654927s) [upload=347532]: Starting upload Aug 22 15:45:25.052448271 (334h19m5.783715891s) [upload=347532]: Done starting upload Aug 22 15:45:25.052562306 (334h19m5.783829936s) [upload=347532]: Uploading segments... Aug 22 15:45:25.052661752 (334h19m5.783929383s) [upload=347532]: Got next segment. Inline: false Aug 22 15:45:25.052697329 (334h19m5.783964959s) [upload=347532]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 15:45:25.052702730 (334h19m5.783970379s) [upload=347532]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 15:45:25.108388744 (334h19m5.839656374s) [seg_pos={0 0}, upload=347532]: Begin upload segment... Aug 22 15:45:25.108436563 (334h19m5.839704193s) [seg_pos={0 0}, upload=347532]: Done begin upload segment. Aug 22 15:45:25.108458765 (334h19m5.839726395s) [noise=true , address=77.90.31.19:4868 , piece_id=PXGGATWZGDBGPRFNITEFZAYPMSEAJCASMWELNBSKCQAGCD54CVIQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108478472 (334h19m5.839746092s) [noise=true , address=45.91.116.8:4070 , piece_id=2YPJJIPDFIV5SS57USBXJHJFKW4M5TQDVUMJNCERKIX5ZD452Z4A, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108550818 (334h19m5.839818439s) [noise=true , address=45.91.116.11:4121 , piece_id=ZMXYNELKX2KHD5RWH2OU5ZZ7LOCPDAGX4GXB6UBW6J2US75UXWRA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108772846 (334h19m5.840040476s) [noise=true , address=104.36.82.6:4880 , piece_id=CAUY7U2VJB6MPAPWANT4KYCCP3RGBWH3MA5WF4E7YO3X2KIGUWZA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108781532 (334h19m5.840049162s) [noise=true , address=77.90.31.15:4702 , piece_id=W37OSPHPZPTQYCHD73KXSAVSUTASTCJAGG3LWMQAPTSPIUUCKUUA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108989513 (334h19m5.840257143s) [noise=true , address=77.90.31.12:4623 , piece_id=KMKYXHMWV2HUK53CPJF5USRWNF33FQBGMG5NPMRAMZAJTO3BU6AA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108994733 (334h19m5.840262353s) [noise=true , address=104.36.82.60:4339 , piece_id=DCXJLRGTJK2TMID2RUBDVKWDOV4SRHAGVELLZY7TERPIACKO6HQQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109200140 (334h19m5.840467759s) [noise=true , address=77.90.31.10:4536 , piece_id=TB3NK2FHULSSUGXBUUWS5JZUEGCXFK3LORPWHSW6546UAUET6RXQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109204497 (334h19m5.840472127s) [noise=true , address=104.36.82.44:4896 , piece_id=GCPBKLGUO337LW65K5PUCDZIMIM4SGKH2L2XYAJDR25KXPKS3QBQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109422278 (334h19m5.840689908s) [noise=true , address=79.127.219.47:4061 , piece_id=PQK2BYCQVCQUECDHHHAPCAEOKZFQCNIL7UXXC7FW4QU36VTM53JQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109435232 (334h19m5.840702853s) [noise=true , address=45.91.116.8:4066 , piece_id=42MWX3KB4OYNODSSONGQVRQHVQPNAYDN7BEQCLOWBFVISZKFV5UA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109635338 (334h19m5.840902959s) [noise=true , address=104.36.82.11:4120 , piece_id=ZVJDHQPPTGG7J4DCW23CUG3NVCEBSNDKSKUFBR6Q2XDIODKS2CRQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109646599 (334h19m5.84091423s) [noise=true , address=77.90.31.21:4902 , piece_id=XNNBMEIPPGRCIFPXHE4RDNBVMKYV777UVDTXYGBTFUXFPUUIL7HA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109856895 (334h19m5.841124525s) [noise=true , address=79.127.219.51:4206 , piece_id=DT27R7X4YZUNSZ2XDWKXLUMIXY6TD25FF473GE7V7Z6BXIJQB6WQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.110069735 (334h19m5.841337366s) [noise=true , address=79.127.201.215:4344 , piece_id=GLXLVWBVLX3WPDVC5G3CA2DAPPF3GZTTN4PKRSHV66H7KO2PGN7A, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.110276726 (334h19m5.841544345s) [noise=true , address=77.90.31.16:4738 , piece_id=XWJADL5V6LBSKWDI32TRV5NZNG2Y5KTWZRKP7HJQOIB3PD75IH4A, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.110529401 (334h19m5.841797031s) [noise=true , address=45.91.116.5:4326 , piece_id=TRF3G7F2SAC4KTRQ4TTMPP6H5GDH5C2ZGY5VOYT7Y6NCSRNLLZOA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.111701505 (334h19m5.842969136s) [noise=true , address=104.36.82.23:4466 , piece_id=OTU3SXJHJT23CBUEVT4NI7MPUBTWRW74FU7JATMGGEUC4FB6JDWA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.194907293 (334h19m5.926174913s) [upload=347532]: Next returned nil segment Aug 22 15:45:25.194933362 (334h19m5.926200992s) [upload=347532]: Waiting for error group managing segments... Aug 22 15:45:25.202079456 (334h19m5.933347077s) [noise=true , address=45.91.116.8:4066 , piece_id=42MWX3KB4OYNODSSONGQVRQHVQPNAYDN7BEQCLOWBFVISZKFV5UA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.202604625 (334h19m5.933872255s) [noise=true , address=79.127.219.51:4206 , piece_id=DT27R7X4YZUNSZ2XDWKXLUMIXY6TD25FF473GE7V7Z6BXIJQB6WQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.202778832 (334h19m5.934046452s) [noise=true , address=79.127.219.47:4061 , piece_id=PQK2BYCQVCQUECDHHHAPCAEOKZFQCNIL7UXXC7FW4QU36VTM53JQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.202957649 (334h19m5.934225279s) [noise=true , address=45.91.116.5:4326 , piece_id=TRF3G7F2SAC4KTRQ4TTMPP6H5GDH5C2ZGY5VOYT7Y6NCSRNLLZOA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.205554464 (334h19m5.936822084s) [noise=true , address=45.91.116.8:4070 , piece_id=2YPJJIPDFIV5SS57USBXJHJFKW4M5TQDVUMJNCERKIX5ZD452Z4A, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.207505926 (334h19m5.938773545s) [noise=true , address=104.36.82.60:4339 , piece_id=DCXJLRGTJK2TMID2RUBDVKWDOV4SRHAGVELLZY7TERPIACKO6HQQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.214577409 (334h19m5.945845039s) [noise=true , address=104.36.82.6:4880 , piece_id=CAUY7U2VJB6MPAPWANT4KYCCP3RGBWH3MA5WF4E7YO3X2KIGUWZA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.215183799 (334h19m5.946451429s) [noise=true , address=104.36.82.11:4120 , piece_id=ZVJDHQPPTGG7J4DCW23CUG3NVCEBSNDKSKUFBR6Q2XDIODKS2CRQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.227204945 (334h19m5.958472576s) [noise=true , address=77.90.31.16:4738 , piece_id=XWJADL5V6LBSKWDI32TRV5NZNG2Y5KTWZRKP7HJQOIB3PD75IH4A, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.231276064 (334h19m5.962543685s) [noise=true , address=77.90.31.15:4702 , piece_id=W37OSPHPZPTQYCHD73KXSAVSUTASTCJAGG3LWMQAPTSPIUUCKUUA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.232214379 (334h19m5.963482s) [noise=true , address=77.90.31.19:4868 , piece_id=PXGGATWZGDBGPRFNITEFZAYPMSEAJCASMWELNBSKCQAGCD54CVIQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.234490052 (334h19m5.965757682s) [noise=true , address=77.90.31.21:4902 , piece_id=XNNBMEIPPGRCIFPXHE4RDNBVMKYV777UVDTXYGBTFUXFPUUIL7HA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.242306687 (334h19m5.973574317s) [noise=true , address=77.90.31.10:4536 , piece_id=TB3NK2FHULSSUGXBUUWS5JZUEGCXFK3LORPWHSW6546UAUET6RXQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.251803884 (334h19m5.983071514s) [noise=true , address=104.36.82.23:4466 , piece_id=OTU3SXJHJT23CBUEVT4NI7MPUBTWRW74FU7JATMGGEUC4FB6JDWA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.251826296 (334h19m5.983093957s) [seg_pos={0 0}, upload=347532]: Segment reached optimal threshold of 14 pieces. Aug 22 15:45:25.251970888 (334h19m5.983238518s) [noise=true , address=45.91.116.11:4121 , piece_id=ZMXYNELKX2KHD5RWH2OU5ZZ7LOCPDAGX4GXB6UBW6J2US75UXWRA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wkujwGr7G6yGYFLiYcxfBnN1pmKY6mHXoAzZWAjGCCiWWZNdh): protocol: expected piece hash; context canceled; EOF Aug 22 15:45:25.252035119 (334h19m5.983302739s) [noise=true , address=77.90.31.12:4623 , piece_id=KMKYXHMWV2HUK53CPJF5USRWNF33FQBGMG5NPMRAMZAJTO3BU6AA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ANjFmZrb9SDcqEHW8CBzeMtwvmceoLH9MtPabAjBw8wXjBuaM): protocol: expected piece hash; context canceled; EOF Aug 22 15:45:25.252430574 (334h19m5.983698224s) [noise=true , address=104.36.82.44:4896 , piece_id=GCPBKLGUO337LW65K5PUCDZIMIM4SGKH2L2XYAJDR25KXPKS3QBQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ndSgjgfZMVQni5tw1ugdTrhJt4c4NagdvgYTbSbjatYYtfu1o): protocol: write tcp 5.161.89.252:59268->104.36.82.44:4896: use of closed network connection; write tcp 5.161.89.252:59268->104.36.82.44:4896: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:59268->104.36.82.44:4896: use of closed network connection Aug 22 15:45:25.252837219 (334h19m5.984104849s) [noise=true , address=79.127.201.215:4344 , piece_id=GLXLVWBVLX3WPDVC5G3CA2DAPPF3GZTTN4PKRSHV66H7KO2PGN7A, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: write tcp 5.161.89.252:10764->79.127.201.215:4344: use of closed network connection; write tcp 5.161.89.252:10764->79.127.201.215:4344: use of closed network connection Aug 22 15:45:25.252866453 (334h19m5.984134083s) [seg_pos={0 0}, upload=347532]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 15:45:25.253131663 (334h19m5.984399293s) [upload=347532]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 15:45:25.253146330 (334h19m5.984413981s) [upload=347532]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 15:45:25.422275527 (334h19m6.153543177s) [upload=347532]: Done uploading segments... Aug 22 15:45:25.422292930 (334h19m6.15356058s) [upload=347532]: Upload finished. err: <nil> Duration: 1.882908337s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 3.123133484s FAIL (2025-08-22 15:59:41 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 3.123160025s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 2.887896701s FAIL (2025-08-22 15:59:04 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 2.887922149s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.....X....X.....................X.......X...................] duration: 1.464867393s FAIL (2025-08-22 15:58:50 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a332dec0f9830710718513902cda341fc779204e956c9b76c091b9655ff15791 != before fead3175f949e8f7847321a6a0be058f5ba8f9601d139b79b5db601e719df2b2 ======LOGS====== Aug 22 15:45:25.052387297 (334h19m5.783654927s) [upload=347532]: Starting upload Aug 22 15:45:25.052448271 (334h19m5.783715891s) [upload=347532]: Done starting upload Aug 22 15:45:25.052562306 (334h19m5.783829936s) [upload=347532]: Uploading segments... Aug 22 15:45:25.052661752 (334h19m5.783929383s) [upload=347532]: Got next segment. Inline: false Aug 22 15:45:25.052697329 (334h19m5.783964959s) [upload=347532]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 15:45:25.052702730 (334h19m5.783970379s) [upload=347532]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 15:45:25.108388744 (334h19m5.839656374s) [seg_pos={0 0}, upload=347532]: Begin upload segment... Aug 22 15:45:25.108436563 (334h19m5.839704193s) [seg_pos={0 0}, upload=347532]: Done begin upload segment. Aug 22 15:45:25.108458765 (334h19m5.839726395s) [noise=true , address=77.90.31.19:4868 , piece_id=PXGGATWZGDBGPRFNITEFZAYPMSEAJCASMWELNBSKCQAGCD54CVIQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108478472 (334h19m5.839746092s) [noise=true , address=45.91.116.8:4070 , piece_id=2YPJJIPDFIV5SS57USBXJHJFKW4M5TQDVUMJNCERKIX5ZD452Z4A, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108550818 (334h19m5.839818439s) [noise=true , address=45.91.116.11:4121 , piece_id=ZMXYNELKX2KHD5RWH2OU5ZZ7LOCPDAGX4GXB6UBW6J2US75UXWRA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108772846 (334h19m5.840040476s) [noise=true , address=104.36.82.6:4880 , piece_id=CAUY7U2VJB6MPAPWANT4KYCCP3RGBWH3MA5WF4E7YO3X2KIGUWZA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108781532 (334h19m5.840049162s) [noise=true , address=77.90.31.15:4702 , piece_id=W37OSPHPZPTQYCHD73KXSAVSUTASTCJAGG3LWMQAPTSPIUUCKUUA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108989513 (334h19m5.840257143s) [noise=true , address=77.90.31.12:4623 , piece_id=KMKYXHMWV2HUK53CPJF5USRWNF33FQBGMG5NPMRAMZAJTO3BU6AA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108994733 (334h19m5.840262353s) [noise=true , address=104.36.82.60:4339 , piece_id=DCXJLRGTJK2TMID2RUBDVKWDOV4SRHAGVELLZY7TERPIACKO6HQQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109200140 (334h19m5.840467759s) [noise=true , address=77.90.31.10:4536 , piece_id=TB3NK2FHULSSUGXBUUWS5JZUEGCXFK3LORPWHSW6546UAUET6RXQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109204497 (334h19m5.840472127s) [noise=true , address=104.36.82.44:4896 , piece_id=GCPBKLGUO337LW65K5PUCDZIMIM4SGKH2L2XYAJDR25KXPKS3QBQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109422278 (334h19m5.840689908s) [noise=true , address=79.127.219.47:4061 , piece_id=PQK2BYCQVCQUECDHHHAPCAEOKZFQCNIL7UXXC7FW4QU36VTM53JQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109435232 (334h19m5.840702853s) [noise=true , address=45.91.116.8:4066 , piece_id=42MWX3KB4OYNODSSONGQVRQHVQPNAYDN7BEQCLOWBFVISZKFV5UA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109635338 (334h19m5.840902959s) [noise=true , address=104.36.82.11:4120 , piece_id=ZVJDHQPPTGG7J4DCW23CUG3NVCEBSNDKSKUFBR6Q2XDIODKS2CRQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109646599 (334h19m5.84091423s) [noise=true , address=77.90.31.21:4902 , piece_id=XNNBMEIPPGRCIFPXHE4RDNBVMKYV777UVDTXYGBTFUXFPUUIL7HA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109856895 (334h19m5.841124525s) [noise=true , address=79.127.219.51:4206 , piece_id=DT27R7X4YZUNSZ2XDWKXLUMIXY6TD25FF473GE7V7Z6BXIJQB6WQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.110069735 (334h19m5.841337366s) [noise=true , address=79.127.201.215:4344 , piece_id=GLXLVWBVLX3WPDVC5G3CA2DAPPF3GZTTN4PKRSHV66H7KO2PGN7A, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.110276726 (334h19m5.841544345s) [noise=true , address=77.90.31.16:4738 , piece_id=XWJADL5V6LBSKWDI32TRV5NZNG2Y5KTWZRKP7HJQOIB3PD75IH4A, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.110529401 (334h19m5.841797031s) [noise=true , address=45.91.116.5:4326 , piece_id=TRF3G7F2SAC4KTRQ4TTMPP6H5GDH5C2ZGY5VOYT7Y6NCSRNLLZOA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.111701505 (334h19m5.842969136s) [noise=true , address=104.36.82.23:4466 , piece_id=OTU3SXJHJT23CBUEVT4NI7MPUBTWRW74FU7JATMGGEUC4FB6JDWA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.194907293 (334h19m5.926174913s) [upload=347532]: Next returned nil segment Aug 22 15:45:25.194933362 (334h19m5.926200992s) [upload=347532]: Waiting for error group managing segments... Aug 22 15:45:25.202079456 (334h19m5.933347077s) [noise=true , address=45.91.116.8:4066 , piece_id=42MWX3KB4OYNODSSONGQVRQHVQPNAYDN7BEQCLOWBFVISZKFV5UA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.202604625 (334h19m5.933872255s) [noise=true , address=79.127.219.51:4206 , piece_id=DT27R7X4YZUNSZ2XDWKXLUMIXY6TD25FF473GE7V7Z6BXIJQB6WQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.202778832 (334h19m5.934046452s) [noise=true , address=79.127.219.47:4061 , piece_id=PQK2BYCQVCQUECDHHHAPCAEOKZFQCNIL7UXXC7FW4QU36VTM53JQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.202957649 (334h19m5.934225279s) [noise=true , address=45.91.116.5:4326 , piece_id=TRF3G7F2SAC4KTRQ4TTMPP6H5GDH5C2ZGY5VOYT7Y6NCSRNLLZOA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.205554464 (334h19m5.936822084s) [noise=true , address=45.91.116.8:4070 , piece_id=2YPJJIPDFIV5SS57USBXJHJFKW4M5TQDVUMJNCERKIX5ZD452Z4A, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.207505926 (334h19m5.938773545s) [noise=true , address=104.36.82.60:4339 , piece_id=DCXJLRGTJK2TMID2RUBDVKWDOV4SRHAGVELLZY7TERPIACKO6HQQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.214577409 (334h19m5.945845039s) [noise=true , address=104.36.82.6:4880 , piece_id=CAUY7U2VJB6MPAPWANT4KYCCP3RGBWH3MA5WF4E7YO3X2KIGUWZA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.215183799 (334h19m5.946451429s) [noise=true , address=104.36.82.11:4120 , piece_id=ZVJDHQPPTGG7J4DCW23CUG3NVCEBSNDKSKUFBR6Q2XDIODKS2CRQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.227204945 (334h19m5.958472576s) [noise=true , address=77.90.31.16:4738 , piece_id=XWJADL5V6LBSKWDI32TRV5NZNG2Y5KTWZRKP7HJQOIB3PD75IH4A, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.231276064 (334h19m5.962543685s) [noise=true , address=77.90.31.15:4702 , piece_id=W37OSPHPZPTQYCHD73KXSAVSUTASTCJAGG3LWMQAPTSPIUUCKUUA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.232214379 (334h19m5.963482s) [noise=true , address=77.90.31.19:4868 , piece_id=PXGGATWZGDBGPRFNITEFZAYPMSEAJCASMWELNBSKCQAGCD54CVIQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.234490052 (334h19m5.965757682s) [noise=true , address=77.90.31.21:4902 , piece_id=XNNBMEIPPGRCIFPXHE4RDNBVMKYV777UVDTXYGBTFUXFPUUIL7HA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.242306687 (334h19m5.973574317s) [noise=true , address=77.90.31.10:4536 , piece_id=TB3NK2FHULSSUGXBUUWS5JZUEGCXFK3LORPWHSW6546UAUET6RXQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.251803884 (334h19m5.983071514s) [noise=true , address=104.36.82.23:4466 , piece_id=OTU3SXJHJT23CBUEVT4NI7MPUBTWRW74FU7JATMGGEUC4FB6JDWA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.251826296 (334h19m5.983093957s) [seg_pos={0 0}, upload=347532]: Segment reached optimal threshold of 14 pieces. Aug 22 15:45:25.251970888 (334h19m5.983238518s) [noise=true , address=45.91.116.11:4121 , piece_id=ZMXYNELKX2KHD5RWH2OU5ZZ7LOCPDAGX4GXB6UBW6J2US75UXWRA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wkujwGr7G6yGYFLiYcxfBnN1pmKY6mHXoAzZWAjGCCiWWZNdh): protocol: expected piece hash; context canceled; EOF Aug 22 15:45:25.252035119 (334h19m5.983302739s) [noise=true , address=77.90.31.12:4623 , piece_id=KMKYXHMWV2HUK53CPJF5USRWNF33FQBGMG5NPMRAMZAJTO3BU6AA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ANjFmZrb9SDcqEHW8CBzeMtwvmceoLH9MtPabAjBw8wXjBuaM): protocol: expected piece hash; context canceled; EOF Aug 22 15:45:25.252430574 (334h19m5.983698224s) [noise=true , address=104.36.82.44:4896 , piece_id=GCPBKLGUO337LW65K5PUCDZIMIM4SGKH2L2XYAJDR25KXPKS3QBQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ndSgjgfZMVQni5tw1ugdTrhJt4c4NagdvgYTbSbjatYYtfu1o): protocol: write tcp 5.161.89.252:59268->104.36.82.44:4896: use of closed network connection; write tcp 5.161.89.252:59268->104.36.82.44:4896: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:59268->104.36.82.44:4896: use of closed network connection Aug 22 15:45:25.252837219 (334h19m5.984104849s) [noise=true , address=79.127.201.215:4344 , piece_id=GLXLVWBVLX3WPDVC5G3CA2DAPPF3GZTTN4PKRSHV66H7KO2PGN7A, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: write tcp 5.161.89.252:10764->79.127.201.215:4344: use of closed network connection; write tcp 5.161.89.252:10764->79.127.201.215:4344: use of closed network connection Aug 22 15:45:25.252866453 (334h19m5.984134083s) [seg_pos={0 0}, upload=347532]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 15:45:25.253131663 (334h19m5.984399293s) [upload=347532]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 15:45:25.253146330 (334h19m5.984413981s) [upload=347532]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 15:45:25.422275527 (334h19m6.153543177s) [upload=347532]: Done uploading segments... Aug 22 15:45:25.422292930 (334h19m6.15356058s) [upload=347532]: Upload finished. err: <nil> Duration: 1.464893292s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [......X....X.....................X.......X..................] duration: 2.158779224s FAIL (2025-08-22 15:58:31 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a332dec0f9830710718513902cda341fc779204e956c9b76c091b9655ff15791 != before fead3175f949e8f7847321a6a0be058f5ba8f9601d139b79b5db601e719df2b2 ======LOGS====== Aug 22 15:45:25.052387297 (334h19m5.783654927s) [upload=347532]: Starting upload Aug 22 15:45:25.052448271 (334h19m5.783715891s) [upload=347532]: Done starting upload Aug 22 15:45:25.052562306 (334h19m5.783829936s) [upload=347532]: Uploading segments... Aug 22 15:45:25.052661752 (334h19m5.783929383s) [upload=347532]: Got next segment. Inline: false Aug 22 15:45:25.052697329 (334h19m5.783964959s) [upload=347532]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 15:45:25.052702730 (334h19m5.783970379s) [upload=347532]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 15:45:25.108388744 (334h19m5.839656374s) [seg_pos={0 0}, upload=347532]: Begin upload segment... Aug 22 15:45:25.108436563 (334h19m5.839704193s) [seg_pos={0 0}, upload=347532]: Done begin upload segment. Aug 22 15:45:25.108458765 (334h19m5.839726395s) [noise=true , address=77.90.31.19:4868 , piece_id=PXGGATWZGDBGPRFNITEFZAYPMSEAJCASMWELNBSKCQAGCD54CVIQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108478472 (334h19m5.839746092s) [noise=true , address=45.91.116.8:4070 , piece_id=2YPJJIPDFIV5SS57USBXJHJFKW4M5TQDVUMJNCERKIX5ZD452Z4A, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108550818 (334h19m5.839818439s) [noise=true , address=45.91.116.11:4121 , piece_id=ZMXYNELKX2KHD5RWH2OU5ZZ7LOCPDAGX4GXB6UBW6J2US75UXWRA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108772846 (334h19m5.840040476s) [noise=true , address=104.36.82.6:4880 , piece_id=CAUY7U2VJB6MPAPWANT4KYCCP3RGBWH3MA5WF4E7YO3X2KIGUWZA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108781532 (334h19m5.840049162s) [noise=true , address=77.90.31.15:4702 , piece_id=W37OSPHPZPTQYCHD73KXSAVSUTASTCJAGG3LWMQAPTSPIUUCKUUA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108989513 (334h19m5.840257143s) [noise=true , address=77.90.31.12:4623 , piece_id=KMKYXHMWV2HUK53CPJF5USRWNF33FQBGMG5NPMRAMZAJTO3BU6AA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108994733 (334h19m5.840262353s) [noise=true , address=104.36.82.60:4339 , piece_id=DCXJLRGTJK2TMID2RUBDVKWDOV4SRHAGVELLZY7TERPIACKO6HQQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109200140 (334h19m5.840467759s) [noise=true , address=77.90.31.10:4536 , piece_id=TB3NK2FHULSSUGXBUUWS5JZUEGCXFK3LORPWHSW6546UAUET6RXQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109204497 (334h19m5.840472127s) [noise=true , address=104.36.82.44:4896 , piece_id=GCPBKLGUO337LW65K5PUCDZIMIM4SGKH2L2XYAJDR25KXPKS3QBQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109422278 (334h19m5.840689908s) [noise=true , address=79.127.219.47:4061 , piece_id=PQK2BYCQVCQUECDHHHAPCAEOKZFQCNIL7UXXC7FW4QU36VTM53JQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109435232 (334h19m5.840702853s) [noise=true , address=45.91.116.8:4066 , piece_id=42MWX3KB4OYNODSSONGQVRQHVQPNAYDN7BEQCLOWBFVISZKFV5UA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109635338 (334h19m5.840902959s) [noise=true , address=104.36.82.11:4120 , piece_id=ZVJDHQPPTGG7J4DCW23CUG3NVCEBSNDKSKUFBR6Q2XDIODKS2CRQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109646599 (334h19m5.84091423s) [noise=true , address=77.90.31.21:4902 , piece_id=XNNBMEIPPGRCIFPXHE4RDNBVMKYV777UVDTXYGBTFUXFPUUIL7HA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109856895 (334h19m5.841124525s) [noise=true , address=79.127.219.51:4206 , piece_id=DT27R7X4YZUNSZ2XDWKXLUMIXY6TD25FF473GE7V7Z6BXIJQB6WQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.110069735 (334h19m5.841337366s) [noise=true , address=79.127.201.215:4344 , piece_id=GLXLVWBVLX3WPDVC5G3CA2DAPPF3GZTTN4PKRSHV66H7KO2PGN7A, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.110276726 (334h19m5.841544345s) [noise=true , address=77.90.31.16:4738 , piece_id=XWJADL5V6LBSKWDI32TRV5NZNG2Y5KTWZRKP7HJQOIB3PD75IH4A, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.110529401 (334h19m5.841797031s) [noise=true , address=45.91.116.5:4326 , piece_id=TRF3G7F2SAC4KTRQ4TTMPP6H5GDH5C2ZGY5VOYT7Y6NCSRNLLZOA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.111701505 (334h19m5.842969136s) [noise=true , address=104.36.82.23:4466 , piece_id=OTU3SXJHJT23CBUEVT4NI7MPUBTWRW74FU7JATMGGEUC4FB6JDWA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.194907293 (334h19m5.926174913s) [upload=347532]: Next returned nil segment Aug 22 15:45:25.194933362 (334h19m5.926200992s) [upload=347532]: Waiting for error group managing segments... Aug 22 15:45:25.202079456 (334h19m5.933347077s) [noise=true , address=45.91.116.8:4066 , piece_id=42MWX3KB4OYNODSSONGQVRQHVQPNAYDN7BEQCLOWBFVISZKFV5UA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.202604625 (334h19m5.933872255s) [noise=true , address=79.127.219.51:4206 , piece_id=DT27R7X4YZUNSZ2XDWKXLUMIXY6TD25FF473GE7V7Z6BXIJQB6WQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.202778832 (334h19m5.934046452s) [noise=true , address=79.127.219.47:4061 , piece_id=PQK2BYCQVCQUECDHHHAPCAEOKZFQCNIL7UXXC7FW4QU36VTM53JQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.202957649 (334h19m5.934225279s) [noise=true , address=45.91.116.5:4326 , piece_id=TRF3G7F2SAC4KTRQ4TTMPP6H5GDH5C2ZGY5VOYT7Y6NCSRNLLZOA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.205554464 (334h19m5.936822084s) [noise=true , address=45.91.116.8:4070 , piece_id=2YPJJIPDFIV5SS57USBXJHJFKW4M5TQDVUMJNCERKIX5ZD452Z4A, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.207505926 (334h19m5.938773545s) [noise=true , address=104.36.82.60:4339 , piece_id=DCXJLRGTJK2TMID2RUBDVKWDOV4SRHAGVELLZY7TERPIACKO6HQQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.214577409 (334h19m5.945845039s) [noise=true , address=104.36.82.6:4880 , piece_id=CAUY7U2VJB6MPAPWANT4KYCCP3RGBWH3MA5WF4E7YO3X2KIGUWZA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.215183799 (334h19m5.946451429s) [noise=true , address=104.36.82.11:4120 , piece_id=ZVJDHQPPTGG7J4DCW23CUG3NVCEBSNDKSKUFBR6Q2XDIODKS2CRQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.227204945 (334h19m5.958472576s) [noise=true , address=77.90.31.16:4738 , piece_id=XWJADL5V6LBSKWDI32TRV5NZNG2Y5KTWZRKP7HJQOIB3PD75IH4A, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.231276064 (334h19m5.962543685s) [noise=true , address=77.90.31.15:4702 , piece_id=W37OSPHPZPTQYCHD73KXSAVSUTASTCJAGG3LWMQAPTSPIUUCKUUA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.232214379 (334h19m5.963482s) [noise=true , address=77.90.31.19:4868 , piece_id=PXGGATWZGDBGPRFNITEFZAYPMSEAJCASMWELNBSKCQAGCD54CVIQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.234490052 (334h19m5.965757682s) [noise=true , address=77.90.31.21:4902 , piece_id=XNNBMEIPPGRCIFPXHE4RDNBVMKYV777UVDTXYGBTFUXFPUUIL7HA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.242306687 (334h19m5.973574317s) [noise=true , address=77.90.31.10:4536 , piece_id=TB3NK2FHULSSUGXBUUWS5JZUEGCXFK3LORPWHSW6546UAUET6RXQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.251803884 (334h19m5.983071514s) [noise=true , address=104.36.82.23:4466 , piece_id=OTU3SXJHJT23CBUEVT4NI7MPUBTWRW74FU7JATMGGEUC4FB6JDWA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.251826296 (334h19m5.983093957s) [seg_pos={0 0}, upload=347532]: Segment reached optimal threshold of 14 pieces. Aug 22 15:45:25.251970888 (334h19m5.983238518s) [noise=true , address=45.91.116.11:4121 , piece_id=ZMXYNELKX2KHD5RWH2OU5ZZ7LOCPDAGX4GXB6UBW6J2US75UXWRA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wkujwGr7G6yGYFLiYcxfBnN1pmKY6mHXoAzZWAjGCCiWWZNdh): protocol: expected piece hash; context canceled; EOF Aug 22 15:45:25.252035119 (334h19m5.983302739s) [noise=true , address=77.90.31.12:4623 , piece_id=KMKYXHMWV2HUK53CPJF5USRWNF33FQBGMG5NPMRAMZAJTO3BU6AA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ANjFmZrb9SDcqEHW8CBzeMtwvmceoLH9MtPabAjBw8wXjBuaM): protocol: expected piece hash; context canceled; EOF Aug 22 15:45:25.252430574 (334h19m5.983698224s) [noise=true , address=104.36.82.44:4896 , piece_id=GCPBKLGUO337LW65K5PUCDZIMIM4SGKH2L2XYAJDR25KXPKS3QBQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ndSgjgfZMVQni5tw1ugdTrhJt4c4NagdvgYTbSbjatYYtfu1o): protocol: write tcp 5.161.89.252:59268->104.36.82.44:4896: use of closed network connection; write tcp 5.161.89.252:59268->104.36.82.44:4896: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:59268->104.36.82.44:4896: use of closed network connection Aug 22 15:45:25.252837219 (334h19m5.984104849s) [noise=true , address=79.127.201.215:4344 , piece_id=GLXLVWBVLX3WPDVC5G3CA2DAPPF3GZTTN4PKRSHV66H7KO2PGN7A, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: write tcp 5.161.89.252:10764->79.127.201.215:4344: use of closed network connection; write tcp 5.161.89.252:10764->79.127.201.215:4344: use of closed network connection Aug 22 15:45:25.252866453 (334h19m5.984134083s) [seg_pos={0 0}, upload=347532]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 15:45:25.253131663 (334h19m5.984399293s) [upload=347532]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 15:45:25.253146330 (334h19m5.984413981s) [upload=347532]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 15:45:25.422275527 (334h19m6.153543177s) [upload=347532]: Done uploading segments... Aug 22 15:45:25.422292930 (334h19m6.15356058s) [upload=347532]: Upload finished. err: <nil> Duration: 2.158807989s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 3.764216961s FAIL (2025-08-22 15:58:16 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 3.764244623s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.......X....X.....................X.......X.................] duration: 677.658999ms FAIL (2025-08-22 15:58:01 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a332dec0f9830710718513902cda341fc779204e956c9b76c091b9655ff15791 != before fead3175f949e8f7847321a6a0be058f5ba8f9601d139b79b5db601e719df2b2 ======LOGS====== Aug 22 15:45:25.052387297 (334h19m5.783654927s) [upload=347532]: Starting upload Aug 22 15:45:25.052448271 (334h19m5.783715891s) [upload=347532]: Done starting upload Aug 22 15:45:25.052562306 (334h19m5.783829936s) [upload=347532]: Uploading segments... Aug 22 15:45:25.052661752 (334h19m5.783929383s) [upload=347532]: Got next segment. Inline: false Aug 22 15:45:25.052697329 (334h19m5.783964959s) [upload=347532]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 15:45:25.052702730 (334h19m5.783970379s) [upload=347532]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 15:45:25.108388744 (334h19m5.839656374s) [seg_pos={0 0}, upload=347532]: Begin upload segment... Aug 22 15:45:25.108436563 (334h19m5.839704193s) [seg_pos={0 0}, upload=347532]: Done begin upload segment. Aug 22 15:45:25.108458765 (334h19m5.839726395s) [noise=true , address=77.90.31.19:4868 , piece_id=PXGGATWZGDBGPRFNITEFZAYPMSEAJCASMWELNBSKCQAGCD54CVIQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108478472 (334h19m5.839746092s) [noise=true , address=45.91.116.8:4070 , piece_id=2YPJJIPDFIV5SS57USBXJHJFKW4M5TQDVUMJNCERKIX5ZD452Z4A, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108550818 (334h19m5.839818439s) [noise=true , address=45.91.116.11:4121 , piece_id=ZMXYNELKX2KHD5RWH2OU5ZZ7LOCPDAGX4GXB6UBW6J2US75UXWRA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108772846 (334h19m5.840040476s) [noise=true , address=104.36.82.6:4880 , piece_id=CAUY7U2VJB6MPAPWANT4KYCCP3RGBWH3MA5WF4E7YO3X2KIGUWZA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108781532 (334h19m5.840049162s) [noise=true , address=77.90.31.15:4702 , piece_id=W37OSPHPZPTQYCHD73KXSAVSUTASTCJAGG3LWMQAPTSPIUUCKUUA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108989513 (334h19m5.840257143s) [noise=true , address=77.90.31.12:4623 , piece_id=KMKYXHMWV2HUK53CPJF5USRWNF33FQBGMG5NPMRAMZAJTO3BU6AA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108994733 (334h19m5.840262353s) [noise=true , address=104.36.82.60:4339 , piece_id=DCXJLRGTJK2TMID2RUBDVKWDOV4SRHAGVELLZY7TERPIACKO6HQQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109200140 (334h19m5.840467759s) [noise=true , address=77.90.31.10:4536 , piece_id=TB3NK2FHULSSUGXBUUWS5JZUEGCXFK3LORPWHSW6546UAUET6RXQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109204497 (334h19m5.840472127s) [noise=true , address=104.36.82.44:4896 , piece_id=GCPBKLGUO337LW65K5PUCDZIMIM4SGKH2L2XYAJDR25KXPKS3QBQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109422278 (334h19m5.840689908s) [noise=true , address=79.127.219.47:4061 , piece_id=PQK2BYCQVCQUECDHHHAPCAEOKZFQCNIL7UXXC7FW4QU36VTM53JQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109435232 (334h19m5.840702853s) [noise=true , address=45.91.116.8:4066 , piece_id=42MWX3KB4OYNODSSONGQVRQHVQPNAYDN7BEQCLOWBFVISZKFV5UA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109635338 (334h19m5.840902959s) [noise=true , address=104.36.82.11:4120 , piece_id=ZVJDHQPPTGG7J4DCW23CUG3NVCEBSNDKSKUFBR6Q2XDIODKS2CRQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109646599 (334h19m5.84091423s) [noise=true , address=77.90.31.21:4902 , piece_id=XNNBMEIPPGRCIFPXHE4RDNBVMKYV777UVDTXYGBTFUXFPUUIL7HA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109856895 (334h19m5.841124525s) [noise=true , address=79.127.219.51:4206 , piece_id=DT27R7X4YZUNSZ2XDWKXLUMIXY6TD25FF473GE7V7Z6BXIJQB6WQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.110069735 (334h19m5.841337366s) [noise=true , address=79.127.201.215:4344 , piece_id=GLXLVWBVLX3WPDVC5G3CA2DAPPF3GZTTN4PKRSHV66H7KO2PGN7A, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.110276726 (334h19m5.841544345s) [noise=true , address=77.90.31.16:4738 , piece_id=XWJADL5V6LBSKWDI32TRV5NZNG2Y5KTWZRKP7HJQOIB3PD75IH4A, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.110529401 (334h19m5.841797031s) [noise=true , address=45.91.116.5:4326 , piece_id=TRF3G7F2SAC4KTRQ4TTMPP6H5GDH5C2ZGY5VOYT7Y6NCSRNLLZOA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.111701505 (334h19m5.842969136s) [noise=true , address=104.36.82.23:4466 , piece_id=OTU3SXJHJT23CBUEVT4NI7MPUBTWRW74FU7JATMGGEUC4FB6JDWA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.194907293 (334h19m5.926174913s) [upload=347532]: Next returned nil segment Aug 22 15:45:25.194933362 (334h19m5.926200992s) [upload=347532]: Waiting for error group managing segments... Aug 22 15:45:25.202079456 (334h19m5.933347077s) [noise=true , address=45.91.116.8:4066 , piece_id=42MWX3KB4OYNODSSONGQVRQHVQPNAYDN7BEQCLOWBFVISZKFV5UA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.202604625 (334h19m5.933872255s) [noise=true , address=79.127.219.51:4206 , piece_id=DT27R7X4YZUNSZ2XDWKXLUMIXY6TD25FF473GE7V7Z6BXIJQB6WQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.202778832 (334h19m5.934046452s) [noise=true , address=79.127.219.47:4061 , piece_id=PQK2BYCQVCQUECDHHHAPCAEOKZFQCNIL7UXXC7FW4QU36VTM53JQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.202957649 (334h19m5.934225279s) [noise=true , address=45.91.116.5:4326 , piece_id=TRF3G7F2SAC4KTRQ4TTMPP6H5GDH5C2ZGY5VOYT7Y6NCSRNLLZOA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.205554464 (334h19m5.936822084s) [noise=true , address=45.91.116.8:4070 , piece_id=2YPJJIPDFIV5SS57USBXJHJFKW4M5TQDVUMJNCERKIX5ZD452Z4A, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.207505926 (334h19m5.938773545s) [noise=true , address=104.36.82.60:4339 , piece_id=DCXJLRGTJK2TMID2RUBDVKWDOV4SRHAGVELLZY7TERPIACKO6HQQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.214577409 (334h19m5.945845039s) [noise=true , address=104.36.82.6:4880 , piece_id=CAUY7U2VJB6MPAPWANT4KYCCP3RGBWH3MA5WF4E7YO3X2KIGUWZA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.215183799 (334h19m5.946451429s) [noise=true , address=104.36.82.11:4120 , piece_id=ZVJDHQPPTGG7J4DCW23CUG3NVCEBSNDKSKUFBR6Q2XDIODKS2CRQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.227204945 (334h19m5.958472576s) [noise=true , address=77.90.31.16:4738 , piece_id=XWJADL5V6LBSKWDI32TRV5NZNG2Y5KTWZRKP7HJQOIB3PD75IH4A, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.231276064 (334h19m5.962543685s) [noise=true , address=77.90.31.15:4702 , piece_id=W37OSPHPZPTQYCHD73KXSAVSUTASTCJAGG3LWMQAPTSPIUUCKUUA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.232214379 (334h19m5.963482s) [noise=true , address=77.90.31.19:4868 , piece_id=PXGGATWZGDBGPRFNITEFZAYPMSEAJCASMWELNBSKCQAGCD54CVIQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.234490052 (334h19m5.965757682s) [noise=true , address=77.90.31.21:4902 , piece_id=XNNBMEIPPGRCIFPXHE4RDNBVMKYV777UVDTXYGBTFUXFPUUIL7HA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.242306687 (334h19m5.973574317s) [noise=true , address=77.90.31.10:4536 , piece_id=TB3NK2FHULSSUGXBUUWS5JZUEGCXFK3LORPWHSW6546UAUET6RXQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.251803884 (334h19m5.983071514s) [noise=true , address=104.36.82.23:4466 , piece_id=OTU3SXJHJT23CBUEVT4NI7MPUBTWRW74FU7JATMGGEUC4FB6JDWA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.251826296 (334h19m5.983093957s) [seg_pos={0 0}, upload=347532]: Segment reached optimal threshold of 14 pieces. Aug 22 15:45:25.251970888 (334h19m5.983238518s) [noise=true , address=45.91.116.11:4121 , piece_id=ZMXYNELKX2KHD5RWH2OU5ZZ7LOCPDAGX4GXB6UBW6J2US75UXWRA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wkujwGr7G6yGYFLiYcxfBnN1pmKY6mHXoAzZWAjGCCiWWZNdh): protocol: expected piece hash; context canceled; EOF Aug 22 15:45:25.252035119 (334h19m5.983302739s) [noise=true , address=77.90.31.12:4623 , piece_id=KMKYXHMWV2HUK53CPJF5USRWNF33FQBGMG5NPMRAMZAJTO3BU6AA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ANjFmZrb9SDcqEHW8CBzeMtwvmceoLH9MtPabAjBw8wXjBuaM): protocol: expected piece hash; context canceled; EOF Aug 22 15:45:25.252430574 (334h19m5.983698224s) [noise=true , address=104.36.82.44:4896 , piece_id=GCPBKLGUO337LW65K5PUCDZIMIM4SGKH2L2XYAJDR25KXPKS3QBQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ndSgjgfZMVQni5tw1ugdTrhJt4c4NagdvgYTbSbjatYYtfu1o): protocol: write tcp 5.161.89.252:59268->104.36.82.44:4896: use of closed network connection; write tcp 5.161.89.252:59268->104.36.82.44:4896: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:59268->104.36.82.44:4896: use of closed network connection Aug 22 15:45:25.252837219 (334h19m5.984104849s) [noise=true , address=79.127.201.215:4344 , piece_id=GLXLVWBVLX3WPDVC5G3CA2DAPPF3GZTTN4PKRSHV66H7KO2PGN7A, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: write tcp 5.161.89.252:10764->79.127.201.215:4344: use of closed network connection; write tcp 5.161.89.252:10764->79.127.201.215:4344: use of closed network connection Aug 22 15:45:25.252866453 (334h19m5.984134083s) [seg_pos={0 0}, upload=347532]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 15:45:25.253131663 (334h19m5.984399293s) [upload=347532]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 15:45:25.253146330 (334h19m5.984413981s) [upload=347532]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 15:45:25.422275527 (334h19m6.153543177s) [upload=347532]: Done uploading segments... Aug 22 15:45:25.422292930 (334h19m6.15356058s) [upload=347532]: Upload finished. err: <nil> Duration: 677.689817ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 3.250243341s FAIL (2025-08-22 15:57:34 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 3.250267367s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [........X....X.....................X.......X................] duration: 1.341497212s FAIL (2025-08-22 15:57:11 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a332dec0f9830710718513902cda341fc779204e956c9b76c091b9655ff15791 != before fead3175f949e8f7847321a6a0be058f5ba8f9601d139b79b5db601e719df2b2 ======LOGS====== Aug 22 15:45:25.052387297 (334h19m5.783654927s) [upload=347532]: Starting upload Aug 22 15:45:25.052448271 (334h19m5.783715891s) [upload=347532]: Done starting upload Aug 22 15:45:25.052562306 (334h19m5.783829936s) [upload=347532]: Uploading segments... Aug 22 15:45:25.052661752 (334h19m5.783929383s) [upload=347532]: Got next segment. Inline: false Aug 22 15:45:25.052697329 (334h19m5.783964959s) [upload=347532]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 15:45:25.052702730 (334h19m5.783970379s) [upload=347532]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 15:45:25.108388744 (334h19m5.839656374s) [seg_pos={0 0}, upload=347532]: Begin upload segment... Aug 22 15:45:25.108436563 (334h19m5.839704193s) [seg_pos={0 0}, upload=347532]: Done begin upload segment. Aug 22 15:45:25.108458765 (334h19m5.839726395s) [noise=true , address=77.90.31.19:4868 , piece_id=PXGGATWZGDBGPRFNITEFZAYPMSEAJCASMWELNBSKCQAGCD54CVIQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108478472 (334h19m5.839746092s) [noise=true , address=45.91.116.8:4070 , piece_id=2YPJJIPDFIV5SS57USBXJHJFKW4M5TQDVUMJNCERKIX5ZD452Z4A, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108550818 (334h19m5.839818439s) [noise=true , address=45.91.116.11:4121 , piece_id=ZMXYNELKX2KHD5RWH2OU5ZZ7LOCPDAGX4GXB6UBW6J2US75UXWRA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108772846 (334h19m5.840040476s) [noise=true , address=104.36.82.6:4880 , piece_id=CAUY7U2VJB6MPAPWANT4KYCCP3RGBWH3MA5WF4E7YO3X2KIGUWZA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108781532 (334h19m5.840049162s) [noise=true , address=77.90.31.15:4702 , piece_id=W37OSPHPZPTQYCHD73KXSAVSUTASTCJAGG3LWMQAPTSPIUUCKUUA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108989513 (334h19m5.840257143s) [noise=true , address=77.90.31.12:4623 , piece_id=KMKYXHMWV2HUK53CPJF5USRWNF33FQBGMG5NPMRAMZAJTO3BU6AA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108994733 (334h19m5.840262353s) [noise=true , address=104.36.82.60:4339 , piece_id=DCXJLRGTJK2TMID2RUBDVKWDOV4SRHAGVELLZY7TERPIACKO6HQQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109200140 (334h19m5.840467759s) [noise=true , address=77.90.31.10:4536 , piece_id=TB3NK2FHULSSUGXBUUWS5JZUEGCXFK3LORPWHSW6546UAUET6RXQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109204497 (334h19m5.840472127s) [noise=true , address=104.36.82.44:4896 , piece_id=GCPBKLGUO337LW65K5PUCDZIMIM4SGKH2L2XYAJDR25KXPKS3QBQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109422278 (334h19m5.840689908s) [noise=true , address=79.127.219.47:4061 , piece_id=PQK2BYCQVCQUECDHHHAPCAEOKZFQCNIL7UXXC7FW4QU36VTM53JQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109435232 (334h19m5.840702853s) [noise=true , address=45.91.116.8:4066 , piece_id=42MWX3KB4OYNODSSONGQVRQHVQPNAYDN7BEQCLOWBFVISZKFV5UA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109635338 (334h19m5.840902959s) [noise=true , address=104.36.82.11:4120 , piece_id=ZVJDHQPPTGG7J4DCW23CUG3NVCEBSNDKSKUFBR6Q2XDIODKS2CRQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109646599 (334h19m5.84091423s) [noise=true , address=77.90.31.21:4902 , piece_id=XNNBMEIPPGRCIFPXHE4RDNBVMKYV777UVDTXYGBTFUXFPUUIL7HA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109856895 (334h19m5.841124525s) [noise=true , address=79.127.219.51:4206 , piece_id=DT27R7X4YZUNSZ2XDWKXLUMIXY6TD25FF473GE7V7Z6BXIJQB6WQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.110069735 (334h19m5.841337366s) [noise=true , address=79.127.201.215:4344 , piece_id=GLXLVWBVLX3WPDVC5G3CA2DAPPF3GZTTN4PKRSHV66H7KO2PGN7A, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.110276726 (334h19m5.841544345s) [noise=true , address=77.90.31.16:4738 , piece_id=XWJADL5V6LBSKWDI32TRV5NZNG2Y5KTWZRKP7HJQOIB3PD75IH4A, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.110529401 (334h19m5.841797031s) [noise=true , address=45.91.116.5:4326 , piece_id=TRF3G7F2SAC4KTRQ4TTMPP6H5GDH5C2ZGY5VOYT7Y6NCSRNLLZOA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.111701505 (334h19m5.842969136s) [noise=true , address=104.36.82.23:4466 , piece_id=OTU3SXJHJT23CBUEVT4NI7MPUBTWRW74FU7JATMGGEUC4FB6JDWA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.194907293 (334h19m5.926174913s) [upload=347532]: Next returned nil segment Aug 22 15:45:25.194933362 (334h19m5.926200992s) [upload=347532]: Waiting for error group managing segments... Aug 22 15:45:25.202079456 (334h19m5.933347077s) [noise=true , address=45.91.116.8:4066 , piece_id=42MWX3KB4OYNODSSONGQVRQHVQPNAYDN7BEQCLOWBFVISZKFV5UA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.202604625 (334h19m5.933872255s) [noise=true , address=79.127.219.51:4206 , piece_id=DT27R7X4YZUNSZ2XDWKXLUMIXY6TD25FF473GE7V7Z6BXIJQB6WQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.202778832 (334h19m5.934046452s) [noise=true , address=79.127.219.47:4061 , piece_id=PQK2BYCQVCQUECDHHHAPCAEOKZFQCNIL7UXXC7FW4QU36VTM53JQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.202957649 (334h19m5.934225279s) [noise=true , address=45.91.116.5:4326 , piece_id=TRF3G7F2SAC4KTRQ4TTMPP6H5GDH5C2ZGY5VOYT7Y6NCSRNLLZOA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.205554464 (334h19m5.936822084s) [noise=true , address=45.91.116.8:4070 , piece_id=2YPJJIPDFIV5SS57USBXJHJFKW4M5TQDVUMJNCERKIX5ZD452Z4A, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.207505926 (334h19m5.938773545s) [noise=true , address=104.36.82.60:4339 , piece_id=DCXJLRGTJK2TMID2RUBDVKWDOV4SRHAGVELLZY7TERPIACKO6HQQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.214577409 (334h19m5.945845039s) [noise=true , address=104.36.82.6:4880 , piece_id=CAUY7U2VJB6MPAPWANT4KYCCP3RGBWH3MA5WF4E7YO3X2KIGUWZA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.215183799 (334h19m5.946451429s) [noise=true , address=104.36.82.11:4120 , piece_id=ZVJDHQPPTGG7J4DCW23CUG3NVCEBSNDKSKUFBR6Q2XDIODKS2CRQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.227204945 (334h19m5.958472576s) [noise=true , address=77.90.31.16:4738 , piece_id=XWJADL5V6LBSKWDI32TRV5NZNG2Y5KTWZRKP7HJQOIB3PD75IH4A, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.231276064 (334h19m5.962543685s) [noise=true , address=77.90.31.15:4702 , piece_id=W37OSPHPZPTQYCHD73KXSAVSUTASTCJAGG3LWMQAPTSPIUUCKUUA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.232214379 (334h19m5.963482s) [noise=true , address=77.90.31.19:4868 , piece_id=PXGGATWZGDBGPRFNITEFZAYPMSEAJCASMWELNBSKCQAGCD54CVIQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.234490052 (334h19m5.965757682s) [noise=true , address=77.90.31.21:4902 , piece_id=XNNBMEIPPGRCIFPXHE4RDNBVMKYV777UVDTXYGBTFUXFPUUIL7HA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.242306687 (334h19m5.973574317s) [noise=true , address=77.90.31.10:4536 , piece_id=TB3NK2FHULSSUGXBUUWS5JZUEGCXFK3LORPWHSW6546UAUET6RXQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.251803884 (334h19m5.983071514s) [noise=true , address=104.36.82.23:4466 , piece_id=OTU3SXJHJT23CBUEVT4NI7MPUBTWRW74FU7JATMGGEUC4FB6JDWA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.251826296 (334h19m5.983093957s) [seg_pos={0 0}, upload=347532]: Segment reached optimal threshold of 14 pieces. Aug 22 15:45:25.251970888 (334h19m5.983238518s) [noise=true , address=45.91.116.11:4121 , piece_id=ZMXYNELKX2KHD5RWH2OU5ZZ7LOCPDAGX4GXB6UBW6J2US75UXWRA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wkujwGr7G6yGYFLiYcxfBnN1pmKY6mHXoAzZWAjGCCiWWZNdh): protocol: expected piece hash; context canceled; EOF Aug 22 15:45:25.252035119 (334h19m5.983302739s) [noise=true , address=77.90.31.12:4623 , piece_id=KMKYXHMWV2HUK53CPJF5USRWNF33FQBGMG5NPMRAMZAJTO3BU6AA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ANjFmZrb9SDcqEHW8CBzeMtwvmceoLH9MtPabAjBw8wXjBuaM): protocol: expected piece hash; context canceled; EOF Aug 22 15:45:25.252430574 (334h19m5.983698224s) [noise=true , address=104.36.82.44:4896 , piece_id=GCPBKLGUO337LW65K5PUCDZIMIM4SGKH2L2XYAJDR25KXPKS3QBQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ndSgjgfZMVQni5tw1ugdTrhJt4c4NagdvgYTbSbjatYYtfu1o): protocol: write tcp 5.161.89.252:59268->104.36.82.44:4896: use of closed network connection; write tcp 5.161.89.252:59268->104.36.82.44:4896: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:59268->104.36.82.44:4896: use of closed network connection Aug 22 15:45:25.252837219 (334h19m5.984104849s) [noise=true , address=79.127.201.215:4344 , piece_id=GLXLVWBVLX3WPDVC5G3CA2DAPPF3GZTTN4PKRSHV66H7KO2PGN7A, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: write tcp 5.161.89.252:10764->79.127.201.215:4344: use of closed network connection; write tcp 5.161.89.252:10764->79.127.201.215:4344: use of closed network connection Aug 22 15:45:25.252866453 (334h19m5.984134083s) [seg_pos={0 0}, upload=347532]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 15:45:25.253131663 (334h19m5.984399293s) [upload=347532]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 15:45:25.253146330 (334h19m5.984413981s) [upload=347532]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 15:45:25.422275527 (334h19m6.153543177s) [upload=347532]: Done uploading segments... Aug 22 15:45:25.422292930 (334h19m6.15356058s) [upload=347532]: Upload finished. err: <nil> Duration: 1.34152195s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 3.668660911s FAIL (2025-08-22 15:56:45 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 3.668679427s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.........X....X.....................X.......X...............] duration: 2.420709119s FAIL (2025-08-22 15:56:24 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a332dec0f9830710718513902cda341fc779204e956c9b76c091b9655ff15791 != before fead3175f949e8f7847321a6a0be058f5ba8f9601d139b79b5db601e719df2b2 ======LOGS====== Aug 22 15:45:25.052387297 (334h19m5.783654927s) [upload=347532]: Starting upload Aug 22 15:45:25.052448271 (334h19m5.783715891s) [upload=347532]: Done starting upload Aug 22 15:45:25.052562306 (334h19m5.783829936s) [upload=347532]: Uploading segments... Aug 22 15:45:25.052661752 (334h19m5.783929383s) [upload=347532]: Got next segment. Inline: false Aug 22 15:45:25.052697329 (334h19m5.783964959s) [upload=347532]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 15:45:25.052702730 (334h19m5.783970379s) [upload=347532]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 15:45:25.108388744 (334h19m5.839656374s) [seg_pos={0 0}, upload=347532]: Begin upload segment... Aug 22 15:45:25.108436563 (334h19m5.839704193s) [seg_pos={0 0}, upload=347532]: Done begin upload segment. Aug 22 15:45:25.108458765 (334h19m5.839726395s) [noise=true , address=77.90.31.19:4868 , piece_id=PXGGATWZGDBGPRFNITEFZAYPMSEAJCASMWELNBSKCQAGCD54CVIQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108478472 (334h19m5.839746092s) [noise=true , address=45.91.116.8:4070 , piece_id=2YPJJIPDFIV5SS57USBXJHJFKW4M5TQDVUMJNCERKIX5ZD452Z4A, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108550818 (334h19m5.839818439s) [noise=true , address=45.91.116.11:4121 , piece_id=ZMXYNELKX2KHD5RWH2OU5ZZ7LOCPDAGX4GXB6UBW6J2US75UXWRA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108772846 (334h19m5.840040476s) [noise=true , address=104.36.82.6:4880 , piece_id=CAUY7U2VJB6MPAPWANT4KYCCP3RGBWH3MA5WF4E7YO3X2KIGUWZA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108781532 (334h19m5.840049162s) [noise=true , address=77.90.31.15:4702 , piece_id=W37OSPHPZPTQYCHD73KXSAVSUTASTCJAGG3LWMQAPTSPIUUCKUUA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108989513 (334h19m5.840257143s) [noise=true , address=77.90.31.12:4623 , piece_id=KMKYXHMWV2HUK53CPJF5USRWNF33FQBGMG5NPMRAMZAJTO3BU6AA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108994733 (334h19m5.840262353s) [noise=true , address=104.36.82.60:4339 , piece_id=DCXJLRGTJK2TMID2RUBDVKWDOV4SRHAGVELLZY7TERPIACKO6HQQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109200140 (334h19m5.840467759s) [noise=true , address=77.90.31.10:4536 , piece_id=TB3NK2FHULSSUGXBUUWS5JZUEGCXFK3LORPWHSW6546UAUET6RXQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109204497 (334h19m5.840472127s) [noise=true , address=104.36.82.44:4896 , piece_id=GCPBKLGUO337LW65K5PUCDZIMIM4SGKH2L2XYAJDR25KXPKS3QBQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109422278 (334h19m5.840689908s) [noise=true , address=79.127.219.47:4061 , piece_id=PQK2BYCQVCQUECDHHHAPCAEOKZFQCNIL7UXXC7FW4QU36VTM53JQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109435232 (334h19m5.840702853s) [noise=true , address=45.91.116.8:4066 , piece_id=42MWX3KB4OYNODSSONGQVRQHVQPNAYDN7BEQCLOWBFVISZKFV5UA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109635338 (334h19m5.840902959s) [noise=true , address=104.36.82.11:4120 , piece_id=ZVJDHQPPTGG7J4DCW23CUG3NVCEBSNDKSKUFBR6Q2XDIODKS2CRQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109646599 (334h19m5.84091423s) [noise=true , address=77.90.31.21:4902 , piece_id=XNNBMEIPPGRCIFPXHE4RDNBVMKYV777UVDTXYGBTFUXFPUUIL7HA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109856895 (334h19m5.841124525s) [noise=true , address=79.127.219.51:4206 , piece_id=DT27R7X4YZUNSZ2XDWKXLUMIXY6TD25FF473GE7V7Z6BXIJQB6WQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.110069735 (334h19m5.841337366s) [noise=true , address=79.127.201.215:4344 , piece_id=GLXLVWBVLX3WPDVC5G3CA2DAPPF3GZTTN4PKRSHV66H7KO2PGN7A, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.110276726 (334h19m5.841544345s) [noise=true , address=77.90.31.16:4738 , piece_id=XWJADL5V6LBSKWDI32TRV5NZNG2Y5KTWZRKP7HJQOIB3PD75IH4A, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.110529401 (334h19m5.841797031s) [noise=true , address=45.91.116.5:4326 , piece_id=TRF3G7F2SAC4KTRQ4TTMPP6H5GDH5C2ZGY5VOYT7Y6NCSRNLLZOA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.111701505 (334h19m5.842969136s) [noise=true , address=104.36.82.23:4466 , piece_id=OTU3SXJHJT23CBUEVT4NI7MPUBTWRW74FU7JATMGGEUC4FB6JDWA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.194907293 (334h19m5.926174913s) [upload=347532]: Next returned nil segment Aug 22 15:45:25.194933362 (334h19m5.926200992s) [upload=347532]: Waiting for error group managing segments... Aug 22 15:45:25.202079456 (334h19m5.933347077s) [noise=true , address=45.91.116.8:4066 , piece_id=42MWX3KB4OYNODSSONGQVRQHVQPNAYDN7BEQCLOWBFVISZKFV5UA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.202604625 (334h19m5.933872255s) [noise=true , address=79.127.219.51:4206 , piece_id=DT27R7X4YZUNSZ2XDWKXLUMIXY6TD25FF473GE7V7Z6BXIJQB6WQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.202778832 (334h19m5.934046452s) [noise=true , address=79.127.219.47:4061 , piece_id=PQK2BYCQVCQUECDHHHAPCAEOKZFQCNIL7UXXC7FW4QU36VTM53JQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.202957649 (334h19m5.934225279s) [noise=true , address=45.91.116.5:4326 , piece_id=TRF3G7F2SAC4KTRQ4TTMPP6H5GDH5C2ZGY5VOYT7Y6NCSRNLLZOA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.205554464 (334h19m5.936822084s) [noise=true , address=45.91.116.8:4070 , piece_id=2YPJJIPDFIV5SS57USBXJHJFKW4M5TQDVUMJNCERKIX5ZD452Z4A, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.207505926 (334h19m5.938773545s) [noise=true , address=104.36.82.60:4339 , piece_id=DCXJLRGTJK2TMID2RUBDVKWDOV4SRHAGVELLZY7TERPIACKO6HQQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.214577409 (334h19m5.945845039s) [noise=true , address=104.36.82.6:4880 , piece_id=CAUY7U2VJB6MPAPWANT4KYCCP3RGBWH3MA5WF4E7YO3X2KIGUWZA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.215183799 (334h19m5.946451429s) [noise=true , address=104.36.82.11:4120 , piece_id=ZVJDHQPPTGG7J4DCW23CUG3NVCEBSNDKSKUFBR6Q2XDIODKS2CRQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.227204945 (334h19m5.958472576s) [noise=true , address=77.90.31.16:4738 , piece_id=XWJADL5V6LBSKWDI32TRV5NZNG2Y5KTWZRKP7HJQOIB3PD75IH4A, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.231276064 (334h19m5.962543685s) [noise=true , address=77.90.31.15:4702 , piece_id=W37OSPHPZPTQYCHD73KXSAVSUTASTCJAGG3LWMQAPTSPIUUCKUUA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.232214379 (334h19m5.963482s) [noise=true , address=77.90.31.19:4868 , piece_id=PXGGATWZGDBGPRFNITEFZAYPMSEAJCASMWELNBSKCQAGCD54CVIQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.234490052 (334h19m5.965757682s) [noise=true , address=77.90.31.21:4902 , piece_id=XNNBMEIPPGRCIFPXHE4RDNBVMKYV777UVDTXYGBTFUXFPUUIL7HA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.242306687 (334h19m5.973574317s) [noise=true , address=77.90.31.10:4536 , piece_id=TB3NK2FHULSSUGXBUUWS5JZUEGCXFK3LORPWHSW6546UAUET6RXQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.251803884 (334h19m5.983071514s) [noise=true , address=104.36.82.23:4466 , piece_id=OTU3SXJHJT23CBUEVT4NI7MPUBTWRW74FU7JATMGGEUC4FB6JDWA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.251826296 (334h19m5.983093957s) [seg_pos={0 0}, upload=347532]: Segment reached optimal threshold of 14 pieces. Aug 22 15:45:25.251970888 (334h19m5.983238518s) [noise=true , address=45.91.116.11:4121 , piece_id=ZMXYNELKX2KHD5RWH2OU5ZZ7LOCPDAGX4GXB6UBW6J2US75UXWRA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wkujwGr7G6yGYFLiYcxfBnN1pmKY6mHXoAzZWAjGCCiWWZNdh): protocol: expected piece hash; context canceled; EOF Aug 22 15:45:25.252035119 (334h19m5.983302739s) [noise=true , address=77.90.31.12:4623 , piece_id=KMKYXHMWV2HUK53CPJF5USRWNF33FQBGMG5NPMRAMZAJTO3BU6AA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ANjFmZrb9SDcqEHW8CBzeMtwvmceoLH9MtPabAjBw8wXjBuaM): protocol: expected piece hash; context canceled; EOF Aug 22 15:45:25.252430574 (334h19m5.983698224s) [noise=true , address=104.36.82.44:4896 , piece_id=GCPBKLGUO337LW65K5PUCDZIMIM4SGKH2L2XYAJDR25KXPKS3QBQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ndSgjgfZMVQni5tw1ugdTrhJt4c4NagdvgYTbSbjatYYtfu1o): protocol: write tcp 5.161.89.252:59268->104.36.82.44:4896: use of closed network connection; write tcp 5.161.89.252:59268->104.36.82.44:4896: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:59268->104.36.82.44:4896: use of closed network connection Aug 22 15:45:25.252837219 (334h19m5.984104849s) [noise=true , address=79.127.201.215:4344 , piece_id=GLXLVWBVLX3WPDVC5G3CA2DAPPF3GZTTN4PKRSHV66H7KO2PGN7A, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: write tcp 5.161.89.252:10764->79.127.201.215:4344: use of closed network connection; write tcp 5.161.89.252:10764->79.127.201.215:4344: use of closed network connection Aug 22 15:45:25.252866453 (334h19m5.984134083s) [seg_pos={0 0}, upload=347532]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 15:45:25.253131663 (334h19m5.984399293s) [upload=347532]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 15:45:25.253146330 (334h19m5.984413981s) [upload=347532]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 15:45:25.422275527 (334h19m6.153543177s) [upload=347532]: Done uploading segments... Aug 22 15:45:25.422292930 (334h19m6.15356058s) [upload=347532]: Upload finished. err: <nil> Duration: 2.420729927s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 2.834743975s FAIL (2025-08-22 15:56:17 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 2.834820159s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 2.993376872s FAIL (2025-08-22 15:56:00 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 2.993406017s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..........X....X.....................X.......X..............] duration: 2.133287436s FAIL (2025-08-22 15:55:53 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a332dec0f9830710718513902cda341fc779204e956c9b76c091b9655ff15791 != before fead3175f949e8f7847321a6a0be058f5ba8f9601d139b79b5db601e719df2b2 ======LOGS====== Aug 22 15:45:25.052387297 (334h19m5.783654927s) [upload=347532]: Starting upload Aug 22 15:45:25.052448271 (334h19m5.783715891s) [upload=347532]: Done starting upload Aug 22 15:45:25.052562306 (334h19m5.783829936s) [upload=347532]: Uploading segments... Aug 22 15:45:25.052661752 (334h19m5.783929383s) [upload=347532]: Got next segment. Inline: false Aug 22 15:45:25.052697329 (334h19m5.783964959s) [upload=347532]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 15:45:25.052702730 (334h19m5.783970379s) [upload=347532]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 15:45:25.108388744 (334h19m5.839656374s) [seg_pos={0 0}, upload=347532]: Begin upload segment... Aug 22 15:45:25.108436563 (334h19m5.839704193s) [seg_pos={0 0}, upload=347532]: Done begin upload segment. Aug 22 15:45:25.108458765 (334h19m5.839726395s) [noise=true , address=77.90.31.19:4868 , piece_id=PXGGATWZGDBGPRFNITEFZAYPMSEAJCASMWELNBSKCQAGCD54CVIQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108478472 (334h19m5.839746092s) [noise=true , address=45.91.116.8:4070 , piece_id=2YPJJIPDFIV5SS57USBXJHJFKW4M5TQDVUMJNCERKIX5ZD452Z4A, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108550818 (334h19m5.839818439s) [noise=true , address=45.91.116.11:4121 , piece_id=ZMXYNELKX2KHD5RWH2OU5ZZ7LOCPDAGX4GXB6UBW6J2US75UXWRA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108772846 (334h19m5.840040476s) [noise=true , address=104.36.82.6:4880 , piece_id=CAUY7U2VJB6MPAPWANT4KYCCP3RGBWH3MA5WF4E7YO3X2KIGUWZA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108781532 (334h19m5.840049162s) [noise=true , address=77.90.31.15:4702 , piece_id=W37OSPHPZPTQYCHD73KXSAVSUTASTCJAGG3LWMQAPTSPIUUCKUUA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108989513 (334h19m5.840257143s) [noise=true , address=77.90.31.12:4623 , piece_id=KMKYXHMWV2HUK53CPJF5USRWNF33FQBGMG5NPMRAMZAJTO3BU6AA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108994733 (334h19m5.840262353s) [noise=true , address=104.36.82.60:4339 , piece_id=DCXJLRGTJK2TMID2RUBDVKWDOV4SRHAGVELLZY7TERPIACKO6HQQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109200140 (334h19m5.840467759s) [noise=true , address=77.90.31.10:4536 , piece_id=TB3NK2FHULSSUGXBUUWS5JZUEGCXFK3LORPWHSW6546UAUET6RXQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109204497 (334h19m5.840472127s) [noise=true , address=104.36.82.44:4896 , piece_id=GCPBKLGUO337LW65K5PUCDZIMIM4SGKH2L2XYAJDR25KXPKS3QBQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109422278 (334h19m5.840689908s) [noise=true , address=79.127.219.47:4061 , piece_id=PQK2BYCQVCQUECDHHHAPCAEOKZFQCNIL7UXXC7FW4QU36VTM53JQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109435232 (334h19m5.840702853s) [noise=true , address=45.91.116.8:4066 , piece_id=42MWX3KB4OYNODSSONGQVRQHVQPNAYDN7BEQCLOWBFVISZKFV5UA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109635338 (334h19m5.840902959s) [noise=true , address=104.36.82.11:4120 , piece_id=ZVJDHQPPTGG7J4DCW23CUG3NVCEBSNDKSKUFBR6Q2XDIODKS2CRQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109646599 (334h19m5.84091423s) [noise=true , address=77.90.31.21:4902 , piece_id=XNNBMEIPPGRCIFPXHE4RDNBVMKYV777UVDTXYGBTFUXFPUUIL7HA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109856895 (334h19m5.841124525s) [noise=true , address=79.127.219.51:4206 , piece_id=DT27R7X4YZUNSZ2XDWKXLUMIXY6TD25FF473GE7V7Z6BXIJQB6WQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.110069735 (334h19m5.841337366s) [noise=true , address=79.127.201.215:4344 , piece_id=GLXLVWBVLX3WPDVC5G3CA2DAPPF3GZTTN4PKRSHV66H7KO2PGN7A, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.110276726 (334h19m5.841544345s) [noise=true , address=77.90.31.16:4738 , piece_id=XWJADL5V6LBSKWDI32TRV5NZNG2Y5KTWZRKP7HJQOIB3PD75IH4A, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.110529401 (334h19m5.841797031s) [noise=true , address=45.91.116.5:4326 , piece_id=TRF3G7F2SAC4KTRQ4TTMPP6H5GDH5C2ZGY5VOYT7Y6NCSRNLLZOA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.111701505 (334h19m5.842969136s) [noise=true , address=104.36.82.23:4466 , piece_id=OTU3SXJHJT23CBUEVT4NI7MPUBTWRW74FU7JATMGGEUC4FB6JDWA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.194907293 (334h19m5.926174913s) [upload=347532]: Next returned nil segment Aug 22 15:45:25.194933362 (334h19m5.926200992s) [upload=347532]: Waiting for error group managing segments... Aug 22 15:45:25.202079456 (334h19m5.933347077s) [noise=true , address=45.91.116.8:4066 , piece_id=42MWX3KB4OYNODSSONGQVRQHVQPNAYDN7BEQCLOWBFVISZKFV5UA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.202604625 (334h19m5.933872255s) [noise=true , address=79.127.219.51:4206 , piece_id=DT27R7X4YZUNSZ2XDWKXLUMIXY6TD25FF473GE7V7Z6BXIJQB6WQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.202778832 (334h19m5.934046452s) [noise=true , address=79.127.219.47:4061 , piece_id=PQK2BYCQVCQUECDHHHAPCAEOKZFQCNIL7UXXC7FW4QU36VTM53JQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.202957649 (334h19m5.934225279s) [noise=true , address=45.91.116.5:4326 , piece_id=TRF3G7F2SAC4KTRQ4TTMPP6H5GDH5C2ZGY5VOYT7Y6NCSRNLLZOA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.205554464 (334h19m5.936822084s) [noise=true , address=45.91.116.8:4070 , piece_id=2YPJJIPDFIV5SS57USBXJHJFKW4M5TQDVUMJNCERKIX5ZD452Z4A, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.207505926 (334h19m5.938773545s) [noise=true , address=104.36.82.60:4339 , piece_id=DCXJLRGTJK2TMID2RUBDVKWDOV4SRHAGVELLZY7TERPIACKO6HQQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.214577409 (334h19m5.945845039s) [noise=true , address=104.36.82.6:4880 , piece_id=CAUY7U2VJB6MPAPWANT4KYCCP3RGBWH3MA5WF4E7YO3X2KIGUWZA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.215183799 (334h19m5.946451429s) [noise=true , address=104.36.82.11:4120 , piece_id=ZVJDHQPPTGG7J4DCW23CUG3NVCEBSNDKSKUFBR6Q2XDIODKS2CRQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.227204945 (334h19m5.958472576s) [noise=true , address=77.90.31.16:4738 , piece_id=XWJADL5V6LBSKWDI32TRV5NZNG2Y5KTWZRKP7HJQOIB3PD75IH4A, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.231276064 (334h19m5.962543685s) [noise=true , address=77.90.31.15:4702 , piece_id=W37OSPHPZPTQYCHD73KXSAVSUTASTCJAGG3LWMQAPTSPIUUCKUUA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.232214379 (334h19m5.963482s) [noise=true , address=77.90.31.19:4868 , piece_id=PXGGATWZGDBGPRFNITEFZAYPMSEAJCASMWELNBSKCQAGCD54CVIQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.234490052 (334h19m5.965757682s) [noise=true , address=77.90.31.21:4902 , piece_id=XNNBMEIPPGRCIFPXHE4RDNBVMKYV777UVDTXYGBTFUXFPUUIL7HA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.242306687 (334h19m5.973574317s) [noise=true , address=77.90.31.10:4536 , piece_id=TB3NK2FHULSSUGXBUUWS5JZUEGCXFK3LORPWHSW6546UAUET6RXQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.251803884 (334h19m5.983071514s) [noise=true , address=104.36.82.23:4466 , piece_id=OTU3SXJHJT23CBUEVT4NI7MPUBTWRW74FU7JATMGGEUC4FB6JDWA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.251826296 (334h19m5.983093957s) [seg_pos={0 0}, upload=347532]: Segment reached optimal threshold of 14 pieces. Aug 22 15:45:25.251970888 (334h19m5.983238518s) [noise=true , address=45.91.116.11:4121 , piece_id=ZMXYNELKX2KHD5RWH2OU5ZZ7LOCPDAGX4GXB6UBW6J2US75UXWRA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wkujwGr7G6yGYFLiYcxfBnN1pmKY6mHXoAzZWAjGCCiWWZNdh): protocol: expected piece hash; context canceled; EOF Aug 22 15:45:25.252035119 (334h19m5.983302739s) [noise=true , address=77.90.31.12:4623 , piece_id=KMKYXHMWV2HUK53CPJF5USRWNF33FQBGMG5NPMRAMZAJTO3BU6AA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ANjFmZrb9SDcqEHW8CBzeMtwvmceoLH9MtPabAjBw8wXjBuaM): protocol: expected piece hash; context canceled; EOF Aug 22 15:45:25.252430574 (334h19m5.983698224s) [noise=true , address=104.36.82.44:4896 , piece_id=GCPBKLGUO337LW65K5PUCDZIMIM4SGKH2L2XYAJDR25KXPKS3QBQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ndSgjgfZMVQni5tw1ugdTrhJt4c4NagdvgYTbSbjatYYtfu1o): protocol: write tcp 5.161.89.252:59268->104.36.82.44:4896: use of closed network connection; write tcp 5.161.89.252:59268->104.36.82.44:4896: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:59268->104.36.82.44:4896: use of closed network connection Aug 22 15:45:25.252837219 (334h19m5.984104849s) [noise=true , address=79.127.201.215:4344 , piece_id=GLXLVWBVLX3WPDVC5G3CA2DAPPF3GZTTN4PKRSHV66H7KO2PGN7A, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: write tcp 5.161.89.252:10764->79.127.201.215:4344: use of closed network connection; write tcp 5.161.89.252:10764->79.127.201.215:4344: use of closed network connection Aug 22 15:45:25.252866453 (334h19m5.984134083s) [seg_pos={0 0}, upload=347532]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 15:45:25.253131663 (334h19m5.984399293s) [upload=347532]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 15:45:25.253146330 (334h19m5.984413981s) [upload=347532]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 15:45:25.422275527 (334h19m6.153543177s) [upload=347532]: Done uploading segments... Aug 22 15:45:25.422292930 (334h19m6.15356058s) [upload=347532]: Upload finished. err: <nil> Duration: 2.133317031s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 2.966177257s FAIL (2025-08-22 15:55:20 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 2.966209459s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 3.602298479s FAIL (2025-08-22 15:55:06 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 3.60232078s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...........X....X.....................X.......X.............] duration: 1.844119256s FAIL (2025-08-22 15:55:02 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a332dec0f9830710718513902cda341fc779204e956c9b76c091b9655ff15791 != before fead3175f949e8f7847321a6a0be058f5ba8f9601d139b79b5db601e719df2b2 ======LOGS====== Aug 22 15:45:25.052387297 (334h19m5.783654927s) [upload=347532]: Starting upload Aug 22 15:45:25.052448271 (334h19m5.783715891s) [upload=347532]: Done starting upload Aug 22 15:45:25.052562306 (334h19m5.783829936s) [upload=347532]: Uploading segments... Aug 22 15:45:25.052661752 (334h19m5.783929383s) [upload=347532]: Got next segment. Inline: false Aug 22 15:45:25.052697329 (334h19m5.783964959s) [upload=347532]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 15:45:25.052702730 (334h19m5.783970379s) [upload=347532]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 15:45:25.108388744 (334h19m5.839656374s) [seg_pos={0 0}, upload=347532]: Begin upload segment... Aug 22 15:45:25.108436563 (334h19m5.839704193s) [seg_pos={0 0}, upload=347532]: Done begin upload segment. Aug 22 15:45:25.108458765 (334h19m5.839726395s) [noise=true , address=77.90.31.19:4868 , piece_id=PXGGATWZGDBGPRFNITEFZAYPMSEAJCASMWELNBSKCQAGCD54CVIQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108478472 (334h19m5.839746092s) [noise=true , address=45.91.116.8:4070 , piece_id=2YPJJIPDFIV5SS57USBXJHJFKW4M5TQDVUMJNCERKIX5ZD452Z4A, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108550818 (334h19m5.839818439s) [noise=true , address=45.91.116.11:4121 , piece_id=ZMXYNELKX2KHD5RWH2OU5ZZ7LOCPDAGX4GXB6UBW6J2US75UXWRA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108772846 (334h19m5.840040476s) [noise=true , address=104.36.82.6:4880 , piece_id=CAUY7U2VJB6MPAPWANT4KYCCP3RGBWH3MA5WF4E7YO3X2KIGUWZA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108781532 (334h19m5.840049162s) [noise=true , address=77.90.31.15:4702 , piece_id=W37OSPHPZPTQYCHD73KXSAVSUTASTCJAGG3LWMQAPTSPIUUCKUUA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108989513 (334h19m5.840257143s) [noise=true , address=77.90.31.12:4623 , piece_id=KMKYXHMWV2HUK53CPJF5USRWNF33FQBGMG5NPMRAMZAJTO3BU6AA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108994733 (334h19m5.840262353s) [noise=true , address=104.36.82.60:4339 , piece_id=DCXJLRGTJK2TMID2RUBDVKWDOV4SRHAGVELLZY7TERPIACKO6HQQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109200140 (334h19m5.840467759s) [noise=true , address=77.90.31.10:4536 , piece_id=TB3NK2FHULSSUGXBUUWS5JZUEGCXFK3LORPWHSW6546UAUET6RXQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109204497 (334h19m5.840472127s) [noise=true , address=104.36.82.44:4896 , piece_id=GCPBKLGUO337LW65K5PUCDZIMIM4SGKH2L2XYAJDR25KXPKS3QBQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109422278 (334h19m5.840689908s) [noise=true , address=79.127.219.47:4061 , piece_id=PQK2BYCQVCQUECDHHHAPCAEOKZFQCNIL7UXXC7FW4QU36VTM53JQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109435232 (334h19m5.840702853s) [noise=true , address=45.91.116.8:4066 , piece_id=42MWX3KB4OYNODSSONGQVRQHVQPNAYDN7BEQCLOWBFVISZKFV5UA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109635338 (334h19m5.840902959s) [noise=true , address=104.36.82.11:4120 , piece_id=ZVJDHQPPTGG7J4DCW23CUG3NVCEBSNDKSKUFBR6Q2XDIODKS2CRQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109646599 (334h19m5.84091423s) [noise=true , address=77.90.31.21:4902 , piece_id=XNNBMEIPPGRCIFPXHE4RDNBVMKYV777UVDTXYGBTFUXFPUUIL7HA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109856895 (334h19m5.841124525s) [noise=true , address=79.127.219.51:4206 , piece_id=DT27R7X4YZUNSZ2XDWKXLUMIXY6TD25FF473GE7V7Z6BXIJQB6WQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.110069735 (334h19m5.841337366s) [noise=true , address=79.127.201.215:4344 , piece_id=GLXLVWBVLX3WPDVC5G3CA2DAPPF3GZTTN4PKRSHV66H7KO2PGN7A, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.110276726 (334h19m5.841544345s) [noise=true , address=77.90.31.16:4738 , piece_id=XWJADL5V6LBSKWDI32TRV5NZNG2Y5KTWZRKP7HJQOIB3PD75IH4A, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.110529401 (334h19m5.841797031s) [noise=true , address=45.91.116.5:4326 , piece_id=TRF3G7F2SAC4KTRQ4TTMPP6H5GDH5C2ZGY5VOYT7Y6NCSRNLLZOA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.111701505 (334h19m5.842969136s) [noise=true , address=104.36.82.23:4466 , piece_id=OTU3SXJHJT23CBUEVT4NI7MPUBTWRW74FU7JATMGGEUC4FB6JDWA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.194907293 (334h19m5.926174913s) [upload=347532]: Next returned nil segment Aug 22 15:45:25.194933362 (334h19m5.926200992s) [upload=347532]: Waiting for error group managing segments... Aug 22 15:45:25.202079456 (334h19m5.933347077s) [noise=true , address=45.91.116.8:4066 , piece_id=42MWX3KB4OYNODSSONGQVRQHVQPNAYDN7BEQCLOWBFVISZKFV5UA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.202604625 (334h19m5.933872255s) [noise=true , address=79.127.219.51:4206 , piece_id=DT27R7X4YZUNSZ2XDWKXLUMIXY6TD25FF473GE7V7Z6BXIJQB6WQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.202778832 (334h19m5.934046452s) [noise=true , address=79.127.219.47:4061 , piece_id=PQK2BYCQVCQUECDHHHAPCAEOKZFQCNIL7UXXC7FW4QU36VTM53JQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.202957649 (334h19m5.934225279s) [noise=true , address=45.91.116.5:4326 , piece_id=TRF3G7F2SAC4KTRQ4TTMPP6H5GDH5C2ZGY5VOYT7Y6NCSRNLLZOA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.205554464 (334h19m5.936822084s) [noise=true , address=45.91.116.8:4070 , piece_id=2YPJJIPDFIV5SS57USBXJHJFKW4M5TQDVUMJNCERKIX5ZD452Z4A, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.207505926 (334h19m5.938773545s) [noise=true , address=104.36.82.60:4339 , piece_id=DCXJLRGTJK2TMID2RUBDVKWDOV4SRHAGVELLZY7TERPIACKO6HQQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.214577409 (334h19m5.945845039s) [noise=true , address=104.36.82.6:4880 , piece_id=CAUY7U2VJB6MPAPWANT4KYCCP3RGBWH3MA5WF4E7YO3X2KIGUWZA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.215183799 (334h19m5.946451429s) [noise=true , address=104.36.82.11:4120 , piece_id=ZVJDHQPPTGG7J4DCW23CUG3NVCEBSNDKSKUFBR6Q2XDIODKS2CRQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.227204945 (334h19m5.958472576s) [noise=true , address=77.90.31.16:4738 , piece_id=XWJADL5V6LBSKWDI32TRV5NZNG2Y5KTWZRKP7HJQOIB3PD75IH4A, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.231276064 (334h19m5.962543685s) [noise=true , address=77.90.31.15:4702 , piece_id=W37OSPHPZPTQYCHD73KXSAVSUTASTCJAGG3LWMQAPTSPIUUCKUUA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.232214379 (334h19m5.963482s) [noise=true , address=77.90.31.19:4868 , piece_id=PXGGATWZGDBGPRFNITEFZAYPMSEAJCASMWELNBSKCQAGCD54CVIQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.234490052 (334h19m5.965757682s) [noise=true , address=77.90.31.21:4902 , piece_id=XNNBMEIPPGRCIFPXHE4RDNBVMKYV777UVDTXYGBTFUXFPUUIL7HA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.242306687 (334h19m5.973574317s) [noise=true , address=77.90.31.10:4536 , piece_id=TB3NK2FHULSSUGXBUUWS5JZUEGCXFK3LORPWHSW6546UAUET6RXQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.251803884 (334h19m5.983071514s) [noise=true , address=104.36.82.23:4466 , piece_id=OTU3SXJHJT23CBUEVT4NI7MPUBTWRW74FU7JATMGGEUC4FB6JDWA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.251826296 (334h19m5.983093957s) [seg_pos={0 0}, upload=347532]: Segment reached optimal threshold of 14 pieces. Aug 22 15:45:25.251970888 (334h19m5.983238518s) [noise=true , address=45.91.116.11:4121 , piece_id=ZMXYNELKX2KHD5RWH2OU5ZZ7LOCPDAGX4GXB6UBW6J2US75UXWRA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wkujwGr7G6yGYFLiYcxfBnN1pmKY6mHXoAzZWAjGCCiWWZNdh): protocol: expected piece hash; context canceled; EOF Aug 22 15:45:25.252035119 (334h19m5.983302739s) [noise=true , address=77.90.31.12:4623 , piece_id=KMKYXHMWV2HUK53CPJF5USRWNF33FQBGMG5NPMRAMZAJTO3BU6AA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ANjFmZrb9SDcqEHW8CBzeMtwvmceoLH9MtPabAjBw8wXjBuaM): protocol: expected piece hash; context canceled; EOF Aug 22 15:45:25.252430574 (334h19m5.983698224s) [noise=true , address=104.36.82.44:4896 , piece_id=GCPBKLGUO337LW65K5PUCDZIMIM4SGKH2L2XYAJDR25KXPKS3QBQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ndSgjgfZMVQni5tw1ugdTrhJt4c4NagdvgYTbSbjatYYtfu1o): protocol: write tcp 5.161.89.252:59268->104.36.82.44:4896: use of closed network connection; write tcp 5.161.89.252:59268->104.36.82.44:4896: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:59268->104.36.82.44:4896: use of closed network connection Aug 22 15:45:25.252837219 (334h19m5.984104849s) [noise=true , address=79.127.201.215:4344 , piece_id=GLXLVWBVLX3WPDVC5G3CA2DAPPF3GZTTN4PKRSHV66H7KO2PGN7A, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: write tcp 5.161.89.252:10764->79.127.201.215:4344: use of closed network connection; write tcp 5.161.89.252:10764->79.127.201.215:4344: use of closed network connection Aug 22 15:45:25.252866453 (334h19m5.984134083s) [seg_pos={0 0}, upload=347532]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 15:45:25.253131663 (334h19m5.984399293s) [upload=347532]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 15:45:25.253146330 (334h19m5.984413981s) [upload=347532]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 15:45:25.422275527 (334h19m6.153543177s) [upload=347532]: Done uploading segments... Aug 22 15:45:25.422292930 (334h19m6.15356058s) [upload=347532]: Upload finished. err: <nil> Duration: 1.844145725s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [............X....X.....................X.......X............] duration: 1.84991486s FAIL (2025-08-22 15:54:17 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a332dec0f9830710718513902cda341fc779204e956c9b76c091b9655ff15791 != before fead3175f949e8f7847321a6a0be058f5ba8f9601d139b79b5db601e719df2b2 ======LOGS====== Aug 22 15:45:25.052387297 (334h19m5.783654927s) [upload=347532]: Starting upload Aug 22 15:45:25.052448271 (334h19m5.783715891s) [upload=347532]: Done starting upload Aug 22 15:45:25.052562306 (334h19m5.783829936s) [upload=347532]: Uploading segments... Aug 22 15:45:25.052661752 (334h19m5.783929383s) [upload=347532]: Got next segment. Inline: false Aug 22 15:45:25.052697329 (334h19m5.783964959s) [upload=347532]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 15:45:25.052702730 (334h19m5.783970379s) [upload=347532]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 15:45:25.108388744 (334h19m5.839656374s) [seg_pos={0 0}, upload=347532]: Begin upload segment... Aug 22 15:45:25.108436563 (334h19m5.839704193s) [seg_pos={0 0}, upload=347532]: Done begin upload segment. Aug 22 15:45:25.108458765 (334h19m5.839726395s) [noise=true , address=77.90.31.19:4868 , piece_id=PXGGATWZGDBGPRFNITEFZAYPMSEAJCASMWELNBSKCQAGCD54CVIQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108478472 (334h19m5.839746092s) [noise=true , address=45.91.116.8:4070 , piece_id=2YPJJIPDFIV5SS57USBXJHJFKW4M5TQDVUMJNCERKIX5ZD452Z4A, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108550818 (334h19m5.839818439s) [noise=true , address=45.91.116.11:4121 , piece_id=ZMXYNELKX2KHD5RWH2OU5ZZ7LOCPDAGX4GXB6UBW6J2US75UXWRA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108772846 (334h19m5.840040476s) [noise=true , address=104.36.82.6:4880 , piece_id=CAUY7U2VJB6MPAPWANT4KYCCP3RGBWH3MA5WF4E7YO3X2KIGUWZA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108781532 (334h19m5.840049162s) [noise=true , address=77.90.31.15:4702 , piece_id=W37OSPHPZPTQYCHD73KXSAVSUTASTCJAGG3LWMQAPTSPIUUCKUUA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108989513 (334h19m5.840257143s) [noise=true , address=77.90.31.12:4623 , piece_id=KMKYXHMWV2HUK53CPJF5USRWNF33FQBGMG5NPMRAMZAJTO3BU6AA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108994733 (334h19m5.840262353s) [noise=true , address=104.36.82.60:4339 , piece_id=DCXJLRGTJK2TMID2RUBDVKWDOV4SRHAGVELLZY7TERPIACKO6HQQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109200140 (334h19m5.840467759s) [noise=true , address=77.90.31.10:4536 , piece_id=TB3NK2FHULSSUGXBUUWS5JZUEGCXFK3LORPWHSW6546UAUET6RXQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109204497 (334h19m5.840472127s) [noise=true , address=104.36.82.44:4896 , piece_id=GCPBKLGUO337LW65K5PUCDZIMIM4SGKH2L2XYAJDR25KXPKS3QBQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109422278 (334h19m5.840689908s) [noise=true , address=79.127.219.47:4061 , piece_id=PQK2BYCQVCQUECDHHHAPCAEOKZFQCNIL7UXXC7FW4QU36VTM53JQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109435232 (334h19m5.840702853s) [noise=true , address=45.91.116.8:4066 , piece_id=42MWX3KB4OYNODSSONGQVRQHVQPNAYDN7BEQCLOWBFVISZKFV5UA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109635338 (334h19m5.840902959s) [noise=true , address=104.36.82.11:4120 , piece_id=ZVJDHQPPTGG7J4DCW23CUG3NVCEBSNDKSKUFBR6Q2XDIODKS2CRQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109646599 (334h19m5.84091423s) [noise=true , address=77.90.31.21:4902 , piece_id=XNNBMEIPPGRCIFPXHE4RDNBVMKYV777UVDTXYGBTFUXFPUUIL7HA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109856895 (334h19m5.841124525s) [noise=true , address=79.127.219.51:4206 , piece_id=DT27R7X4YZUNSZ2XDWKXLUMIXY6TD25FF473GE7V7Z6BXIJQB6WQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.110069735 (334h19m5.841337366s) [noise=true , address=79.127.201.215:4344 , piece_id=GLXLVWBVLX3WPDVC5G3CA2DAPPF3GZTTN4PKRSHV66H7KO2PGN7A, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.110276726 (334h19m5.841544345s) [noise=true , address=77.90.31.16:4738 , piece_id=XWJADL5V6LBSKWDI32TRV5NZNG2Y5KTWZRKP7HJQOIB3PD75IH4A, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.110529401 (334h19m5.841797031s) [noise=true , address=45.91.116.5:4326 , piece_id=TRF3G7F2SAC4KTRQ4TTMPP6H5GDH5C2ZGY5VOYT7Y6NCSRNLLZOA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.111701505 (334h19m5.842969136s) [noise=true , address=104.36.82.23:4466 , piece_id=OTU3SXJHJT23CBUEVT4NI7MPUBTWRW74FU7JATMGGEUC4FB6JDWA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.194907293 (334h19m5.926174913s) [upload=347532]: Next returned nil segment Aug 22 15:45:25.194933362 (334h19m5.926200992s) [upload=347532]: Waiting for error group managing segments... Aug 22 15:45:25.202079456 (334h19m5.933347077s) [noise=true , address=45.91.116.8:4066 , piece_id=42MWX3KB4OYNODSSONGQVRQHVQPNAYDN7BEQCLOWBFVISZKFV5UA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.202604625 (334h19m5.933872255s) [noise=true , address=79.127.219.51:4206 , piece_id=DT27R7X4YZUNSZ2XDWKXLUMIXY6TD25FF473GE7V7Z6BXIJQB6WQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.202778832 (334h19m5.934046452s) [noise=true , address=79.127.219.47:4061 , piece_id=PQK2BYCQVCQUECDHHHAPCAEOKZFQCNIL7UXXC7FW4QU36VTM53JQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.202957649 (334h19m5.934225279s) [noise=true , address=45.91.116.5:4326 , piece_id=TRF3G7F2SAC4KTRQ4TTMPP6H5GDH5C2ZGY5VOYT7Y6NCSRNLLZOA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.205554464 (334h19m5.936822084s) [noise=true , address=45.91.116.8:4070 , piece_id=2YPJJIPDFIV5SS57USBXJHJFKW4M5TQDVUMJNCERKIX5ZD452Z4A, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.207505926 (334h19m5.938773545s) [noise=true , address=104.36.82.60:4339 , piece_id=DCXJLRGTJK2TMID2RUBDVKWDOV4SRHAGVELLZY7TERPIACKO6HQQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.214577409 (334h19m5.945845039s) [noise=true , address=104.36.82.6:4880 , piece_id=CAUY7U2VJB6MPAPWANT4KYCCP3RGBWH3MA5WF4E7YO3X2KIGUWZA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.215183799 (334h19m5.946451429s) [noise=true , address=104.36.82.11:4120 , piece_id=ZVJDHQPPTGG7J4DCW23CUG3NVCEBSNDKSKUFBR6Q2XDIODKS2CRQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.227204945 (334h19m5.958472576s) [noise=true , address=77.90.31.16:4738 , piece_id=XWJADL5V6LBSKWDI32TRV5NZNG2Y5KTWZRKP7HJQOIB3PD75IH4A, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.231276064 (334h19m5.962543685s) [noise=true , address=77.90.31.15:4702 , piece_id=W37OSPHPZPTQYCHD73KXSAVSUTASTCJAGG3LWMQAPTSPIUUCKUUA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.232214379 (334h19m5.963482s) [noise=true , address=77.90.31.19:4868 , piece_id=PXGGATWZGDBGPRFNITEFZAYPMSEAJCASMWELNBSKCQAGCD54CVIQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.234490052 (334h19m5.965757682s) [noise=true , address=77.90.31.21:4902 , piece_id=XNNBMEIPPGRCIFPXHE4RDNBVMKYV777UVDTXYGBTFUXFPUUIL7HA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.242306687 (334h19m5.973574317s) [noise=true , address=77.90.31.10:4536 , piece_id=TB3NK2FHULSSUGXBUUWS5JZUEGCXFK3LORPWHSW6546UAUET6RXQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.251803884 (334h19m5.983071514s) [noise=true , address=104.36.82.23:4466 , piece_id=OTU3SXJHJT23CBUEVT4NI7MPUBTWRW74FU7JATMGGEUC4FB6JDWA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.251826296 (334h19m5.983093957s) [seg_pos={0 0}, upload=347532]: Segment reached optimal threshold of 14 pieces. Aug 22 15:45:25.251970888 (334h19m5.983238518s) [noise=true , address=45.91.116.11:4121 , piece_id=ZMXYNELKX2KHD5RWH2OU5ZZ7LOCPDAGX4GXB6UBW6J2US75UXWRA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wkujwGr7G6yGYFLiYcxfBnN1pmKY6mHXoAzZWAjGCCiWWZNdh): protocol: expected piece hash; context canceled; EOF Aug 22 15:45:25.252035119 (334h19m5.983302739s) [noise=true , address=77.90.31.12:4623 , piece_id=KMKYXHMWV2HUK53CPJF5USRWNF33FQBGMG5NPMRAMZAJTO3BU6AA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ANjFmZrb9SDcqEHW8CBzeMtwvmceoLH9MtPabAjBw8wXjBuaM): protocol: expected piece hash; context canceled; EOF Aug 22 15:45:25.252430574 (334h19m5.983698224s) [noise=true , address=104.36.82.44:4896 , piece_id=GCPBKLGUO337LW65K5PUCDZIMIM4SGKH2L2XYAJDR25KXPKS3QBQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ndSgjgfZMVQni5tw1ugdTrhJt4c4NagdvgYTbSbjatYYtfu1o): protocol: write tcp 5.161.89.252:59268->104.36.82.44:4896: use of closed network connection; write tcp 5.161.89.252:59268->104.36.82.44:4896: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:59268->104.36.82.44:4896: use of closed network connection Aug 22 15:45:25.252837219 (334h19m5.984104849s) [noise=true , address=79.127.201.215:4344 , piece_id=GLXLVWBVLX3WPDVC5G3CA2DAPPF3GZTTN4PKRSHV66H7KO2PGN7A, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: write tcp 5.161.89.252:10764->79.127.201.215:4344: use of closed network connection; write tcp 5.161.89.252:10764->79.127.201.215:4344: use of closed network connection Aug 22 15:45:25.252866453 (334h19m5.984134083s) [seg_pos={0 0}, upload=347532]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 15:45:25.253131663 (334h19m5.984399293s) [upload=347532]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 15:45:25.253146330 (334h19m5.984413981s) [upload=347532]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 15:45:25.422275527 (334h19m6.153543177s) [upload=347532]: Done uploading segments... Aug 22 15:45:25.422292930 (334h19m6.15356058s) [upload=347532]: Upload finished. err: <nil> Duration: 1.849930218s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 3.137622391s FAIL (2025-08-22 15:54:16 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 3.137644642s core uplink eu1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 2.556583398s FAIL (2025-08-22 15:53:48 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.55661003s core uplink ap1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 3.248030246s FAIL (2025-08-22 15:53:31 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 3.248052697s core uplink eu1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 2.521383039s FAIL (2025-08-22 15:53:12 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.52141499s core uplink ap1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 4.902771186s FAIL (2025-08-22 15:53:07 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 4.902798436s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.............X....X.....................X.......X...........] duration: 707.957768ms FAIL (2025-08-22 15:53:06 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a332dec0f9830710718513902cda341fc779204e956c9b76c091b9655ff15791 != before fead3175f949e8f7847321a6a0be058f5ba8f9601d139b79b5db601e719df2b2 ======LOGS====== Aug 22 15:45:25.052387297 (334h19m5.783654927s) [upload=347532]: Starting upload Aug 22 15:45:25.052448271 (334h19m5.783715891s) [upload=347532]: Done starting upload Aug 22 15:45:25.052562306 (334h19m5.783829936s) [upload=347532]: Uploading segments... Aug 22 15:45:25.052661752 (334h19m5.783929383s) [upload=347532]: Got next segment. Inline: false Aug 22 15:45:25.052697329 (334h19m5.783964959s) [upload=347532]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 15:45:25.052702730 (334h19m5.783970379s) [upload=347532]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 15:45:25.108388744 (334h19m5.839656374s) [seg_pos={0 0}, upload=347532]: Begin upload segment... Aug 22 15:45:25.108436563 (334h19m5.839704193s) [seg_pos={0 0}, upload=347532]: Done begin upload segment. Aug 22 15:45:25.108458765 (334h19m5.839726395s) [noise=true , address=77.90.31.19:4868 , piece_id=PXGGATWZGDBGPRFNITEFZAYPMSEAJCASMWELNBSKCQAGCD54CVIQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108478472 (334h19m5.839746092s) [noise=true , address=45.91.116.8:4070 , piece_id=2YPJJIPDFIV5SS57USBXJHJFKW4M5TQDVUMJNCERKIX5ZD452Z4A, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108550818 (334h19m5.839818439s) [noise=true , address=45.91.116.11:4121 , piece_id=ZMXYNELKX2KHD5RWH2OU5ZZ7LOCPDAGX4GXB6UBW6J2US75UXWRA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108772846 (334h19m5.840040476s) [noise=true , address=104.36.82.6:4880 , piece_id=CAUY7U2VJB6MPAPWANT4KYCCP3RGBWH3MA5WF4E7YO3X2KIGUWZA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108781532 (334h19m5.840049162s) [noise=true , address=77.90.31.15:4702 , piece_id=W37OSPHPZPTQYCHD73KXSAVSUTASTCJAGG3LWMQAPTSPIUUCKUUA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108989513 (334h19m5.840257143s) [noise=true , address=77.90.31.12:4623 , piece_id=KMKYXHMWV2HUK53CPJF5USRWNF33FQBGMG5NPMRAMZAJTO3BU6AA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108994733 (334h19m5.840262353s) [noise=true , address=104.36.82.60:4339 , piece_id=DCXJLRGTJK2TMID2RUBDVKWDOV4SRHAGVELLZY7TERPIACKO6HQQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109200140 (334h19m5.840467759s) [noise=true , address=77.90.31.10:4536 , piece_id=TB3NK2FHULSSUGXBUUWS5JZUEGCXFK3LORPWHSW6546UAUET6RXQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109204497 (334h19m5.840472127s) [noise=true , address=104.36.82.44:4896 , piece_id=GCPBKLGUO337LW65K5PUCDZIMIM4SGKH2L2XYAJDR25KXPKS3QBQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109422278 (334h19m5.840689908s) [noise=true , address=79.127.219.47:4061 , piece_id=PQK2BYCQVCQUECDHHHAPCAEOKZFQCNIL7UXXC7FW4QU36VTM53JQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109435232 (334h19m5.840702853s) [noise=true , address=45.91.116.8:4066 , piece_id=42MWX3KB4OYNODSSONGQVRQHVQPNAYDN7BEQCLOWBFVISZKFV5UA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109635338 (334h19m5.840902959s) [noise=true , address=104.36.82.11:4120 , piece_id=ZVJDHQPPTGG7J4DCW23CUG3NVCEBSNDKSKUFBR6Q2XDIODKS2CRQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109646599 (334h19m5.84091423s) [noise=true , address=77.90.31.21:4902 , piece_id=XNNBMEIPPGRCIFPXHE4RDNBVMKYV777UVDTXYGBTFUXFPUUIL7HA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109856895 (334h19m5.841124525s) [noise=true , address=79.127.219.51:4206 , piece_id=DT27R7X4YZUNSZ2XDWKXLUMIXY6TD25FF473GE7V7Z6BXIJQB6WQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.110069735 (334h19m5.841337366s) [noise=true , address=79.127.201.215:4344 , piece_id=GLXLVWBVLX3WPDVC5G3CA2DAPPF3GZTTN4PKRSHV66H7KO2PGN7A, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.110276726 (334h19m5.841544345s) [noise=true , address=77.90.31.16:4738 , piece_id=XWJADL5V6LBSKWDI32TRV5NZNG2Y5KTWZRKP7HJQOIB3PD75IH4A, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.110529401 (334h19m5.841797031s) [noise=true , address=45.91.116.5:4326 , piece_id=TRF3G7F2SAC4KTRQ4TTMPP6H5GDH5C2ZGY5VOYT7Y6NCSRNLLZOA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.111701505 (334h19m5.842969136s) [noise=true , address=104.36.82.23:4466 , piece_id=OTU3SXJHJT23CBUEVT4NI7MPUBTWRW74FU7JATMGGEUC4FB6JDWA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.194907293 (334h19m5.926174913s) [upload=347532]: Next returned nil segment Aug 22 15:45:25.194933362 (334h19m5.926200992s) [upload=347532]: Waiting for error group managing segments... Aug 22 15:45:25.202079456 (334h19m5.933347077s) [noise=true , address=45.91.116.8:4066 , piece_id=42MWX3KB4OYNODSSONGQVRQHVQPNAYDN7BEQCLOWBFVISZKFV5UA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.202604625 (334h19m5.933872255s) [noise=true , address=79.127.219.51:4206 , piece_id=DT27R7X4YZUNSZ2XDWKXLUMIXY6TD25FF473GE7V7Z6BXIJQB6WQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.202778832 (334h19m5.934046452s) [noise=true , address=79.127.219.47:4061 , piece_id=PQK2BYCQVCQUECDHHHAPCAEOKZFQCNIL7UXXC7FW4QU36VTM53JQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.202957649 (334h19m5.934225279s) [noise=true , address=45.91.116.5:4326 , piece_id=TRF3G7F2SAC4KTRQ4TTMPP6H5GDH5C2ZGY5VOYT7Y6NCSRNLLZOA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.205554464 (334h19m5.936822084s) [noise=true , address=45.91.116.8:4070 , piece_id=2YPJJIPDFIV5SS57USBXJHJFKW4M5TQDVUMJNCERKIX5ZD452Z4A, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.207505926 (334h19m5.938773545s) [noise=true , address=104.36.82.60:4339 , piece_id=DCXJLRGTJK2TMID2RUBDVKWDOV4SRHAGVELLZY7TERPIACKO6HQQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.214577409 (334h19m5.945845039s) [noise=true , address=104.36.82.6:4880 , piece_id=CAUY7U2VJB6MPAPWANT4KYCCP3RGBWH3MA5WF4E7YO3X2KIGUWZA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.215183799 (334h19m5.946451429s) [noise=true , address=104.36.82.11:4120 , piece_id=ZVJDHQPPTGG7J4DCW23CUG3NVCEBSNDKSKUFBR6Q2XDIODKS2CRQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.227204945 (334h19m5.958472576s) [noise=true , address=77.90.31.16:4738 , piece_id=XWJADL5V6LBSKWDI32TRV5NZNG2Y5KTWZRKP7HJQOIB3PD75IH4A, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.231276064 (334h19m5.962543685s) [noise=true , address=77.90.31.15:4702 , piece_id=W37OSPHPZPTQYCHD73KXSAVSUTASTCJAGG3LWMQAPTSPIUUCKUUA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.232214379 (334h19m5.963482s) [noise=true , address=77.90.31.19:4868 , piece_id=PXGGATWZGDBGPRFNITEFZAYPMSEAJCASMWELNBSKCQAGCD54CVIQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.234490052 (334h19m5.965757682s) [noise=true , address=77.90.31.21:4902 , piece_id=XNNBMEIPPGRCIFPXHE4RDNBVMKYV777UVDTXYGBTFUXFPUUIL7HA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.242306687 (334h19m5.973574317s) [noise=true , address=77.90.31.10:4536 , piece_id=TB3NK2FHULSSUGXBUUWS5JZUEGCXFK3LORPWHSW6546UAUET6RXQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.251803884 (334h19m5.983071514s) [noise=true , address=104.36.82.23:4466 , piece_id=OTU3SXJHJT23CBUEVT4NI7MPUBTWRW74FU7JATMGGEUC4FB6JDWA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.251826296 (334h19m5.983093957s) [seg_pos={0 0}, upload=347532]: Segment reached optimal threshold of 14 pieces. Aug 22 15:45:25.251970888 (334h19m5.983238518s) [noise=true , address=45.91.116.11:4121 , piece_id=ZMXYNELKX2KHD5RWH2OU5ZZ7LOCPDAGX4GXB6UBW6J2US75UXWRA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wkujwGr7G6yGYFLiYcxfBnN1pmKY6mHXoAzZWAjGCCiWWZNdh): protocol: expected piece hash; context canceled; EOF Aug 22 15:45:25.252035119 (334h19m5.983302739s) [noise=true , address=77.90.31.12:4623 , piece_id=KMKYXHMWV2HUK53CPJF5USRWNF33FQBGMG5NPMRAMZAJTO3BU6AA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ANjFmZrb9SDcqEHW8CBzeMtwvmceoLH9MtPabAjBw8wXjBuaM): protocol: expected piece hash; context canceled; EOF Aug 22 15:45:25.252430574 (334h19m5.983698224s) [noise=true , address=104.36.82.44:4896 , piece_id=GCPBKLGUO337LW65K5PUCDZIMIM4SGKH2L2XYAJDR25KXPKS3QBQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ndSgjgfZMVQni5tw1ugdTrhJt4c4NagdvgYTbSbjatYYtfu1o): protocol: write tcp 5.161.89.252:59268->104.36.82.44:4896: use of closed network connection; write tcp 5.161.89.252:59268->104.36.82.44:4896: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:59268->104.36.82.44:4896: use of closed network connection Aug 22 15:45:25.252837219 (334h19m5.984104849s) [noise=true , address=79.127.201.215:4344 , piece_id=GLXLVWBVLX3WPDVC5G3CA2DAPPF3GZTTN4PKRSHV66H7KO2PGN7A, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: write tcp 5.161.89.252:10764->79.127.201.215:4344: use of closed network connection; write tcp 5.161.89.252:10764->79.127.201.215:4344: use of closed network connection Aug 22 15:45:25.252866453 (334h19m5.984134083s) [seg_pos={0 0}, upload=347532]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 15:45:25.253131663 (334h19m5.984399293s) [upload=347532]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 15:45:25.253146330 (334h19m5.984413981s) [upload=347532]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 15:45:25.422275527 (334h19m6.153543177s) [upload=347532]: Done uploading segments... Aug 22 15:45:25.422292930 (334h19m6.15356058s) [upload=347532]: Upload finished. err: <nil> Duration: 707.982345ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 3.681066769s FAIL (2025-08-22 15:52:18 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 3.681087538s core uplink eu1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 2.298500195s FAIL (2025-08-22 15:52:11 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.298521624s core uplink ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..............X....X.....................X.......X..........] duration: 1.356834953s FAIL (2025-08-22 15:52:03 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a332dec0f9830710718513902cda341fc779204e956c9b76c091b9655ff15791 != before fead3175f949e8f7847321a6a0be058f5ba8f9601d139b79b5db601e719df2b2 ======LOGS====== Aug 22 15:45:25.052387297 (334h19m5.783654927s) [upload=347532]: Starting upload Aug 22 15:45:25.052448271 (334h19m5.783715891s) [upload=347532]: Done starting upload Aug 22 15:45:25.052562306 (334h19m5.783829936s) [upload=347532]: Uploading segments... Aug 22 15:45:25.052661752 (334h19m5.783929383s) [upload=347532]: Got next segment. Inline: false Aug 22 15:45:25.052697329 (334h19m5.783964959s) [upload=347532]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 15:45:25.052702730 (334h19m5.783970379s) [upload=347532]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 15:45:25.108388744 (334h19m5.839656374s) [seg_pos={0 0}, upload=347532]: Begin upload segment... Aug 22 15:45:25.108436563 (334h19m5.839704193s) [seg_pos={0 0}, upload=347532]: Done begin upload segment. Aug 22 15:45:25.108458765 (334h19m5.839726395s) [noise=true , address=77.90.31.19:4868 , piece_id=PXGGATWZGDBGPRFNITEFZAYPMSEAJCASMWELNBSKCQAGCD54CVIQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108478472 (334h19m5.839746092s) [noise=true , address=45.91.116.8:4070 , piece_id=2YPJJIPDFIV5SS57USBXJHJFKW4M5TQDVUMJNCERKIX5ZD452Z4A, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108550818 (334h19m5.839818439s) [noise=true , address=45.91.116.11:4121 , piece_id=ZMXYNELKX2KHD5RWH2OU5ZZ7LOCPDAGX4GXB6UBW6J2US75UXWRA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108772846 (334h19m5.840040476s) [noise=true , address=104.36.82.6:4880 , piece_id=CAUY7U2VJB6MPAPWANT4KYCCP3RGBWH3MA5WF4E7YO3X2KIGUWZA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108781532 (334h19m5.840049162s) [noise=true , address=77.90.31.15:4702 , piece_id=W37OSPHPZPTQYCHD73KXSAVSUTASTCJAGG3LWMQAPTSPIUUCKUUA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108989513 (334h19m5.840257143s) [noise=true , address=77.90.31.12:4623 , piece_id=KMKYXHMWV2HUK53CPJF5USRWNF33FQBGMG5NPMRAMZAJTO3BU6AA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108994733 (334h19m5.840262353s) [noise=true , address=104.36.82.60:4339 , piece_id=DCXJLRGTJK2TMID2RUBDVKWDOV4SRHAGVELLZY7TERPIACKO6HQQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109200140 (334h19m5.840467759s) [noise=true , address=77.90.31.10:4536 , piece_id=TB3NK2FHULSSUGXBUUWS5JZUEGCXFK3LORPWHSW6546UAUET6RXQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109204497 (334h19m5.840472127s) [noise=true , address=104.36.82.44:4896 , piece_id=GCPBKLGUO337LW65K5PUCDZIMIM4SGKH2L2XYAJDR25KXPKS3QBQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109422278 (334h19m5.840689908s) [noise=true , address=79.127.219.47:4061 , piece_id=PQK2BYCQVCQUECDHHHAPCAEOKZFQCNIL7UXXC7FW4QU36VTM53JQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109435232 (334h19m5.840702853s) [noise=true , address=45.91.116.8:4066 , piece_id=42MWX3KB4OYNODSSONGQVRQHVQPNAYDN7BEQCLOWBFVISZKFV5UA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109635338 (334h19m5.840902959s) [noise=true , address=104.36.82.11:4120 , piece_id=ZVJDHQPPTGG7J4DCW23CUG3NVCEBSNDKSKUFBR6Q2XDIODKS2CRQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109646599 (334h19m5.84091423s) [noise=true , address=77.90.31.21:4902 , piece_id=XNNBMEIPPGRCIFPXHE4RDNBVMKYV777UVDTXYGBTFUXFPUUIL7HA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109856895 (334h19m5.841124525s) [noise=true , address=79.127.219.51:4206 , piece_id=DT27R7X4YZUNSZ2XDWKXLUMIXY6TD25FF473GE7V7Z6BXIJQB6WQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.110069735 (334h19m5.841337366s) [noise=true , address=79.127.201.215:4344 , piece_id=GLXLVWBVLX3WPDVC5G3CA2DAPPF3GZTTN4PKRSHV66H7KO2PGN7A, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.110276726 (334h19m5.841544345s) [noise=true , address=77.90.31.16:4738 , piece_id=XWJADL5V6LBSKWDI32TRV5NZNG2Y5KTWZRKP7HJQOIB3PD75IH4A, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.110529401 (334h19m5.841797031s) [noise=true , address=45.91.116.5:4326 , piece_id=TRF3G7F2SAC4KTRQ4TTMPP6H5GDH5C2ZGY5VOYT7Y6NCSRNLLZOA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.111701505 (334h19m5.842969136s) [noise=true , address=104.36.82.23:4466 , piece_id=OTU3SXJHJT23CBUEVT4NI7MPUBTWRW74FU7JATMGGEUC4FB6JDWA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.194907293 (334h19m5.926174913s) [upload=347532]: Next returned nil segment Aug 22 15:45:25.194933362 (334h19m5.926200992s) [upload=347532]: Waiting for error group managing segments... Aug 22 15:45:25.202079456 (334h19m5.933347077s) [noise=true , address=45.91.116.8:4066 , piece_id=42MWX3KB4OYNODSSONGQVRQHVQPNAYDN7BEQCLOWBFVISZKFV5UA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.202604625 (334h19m5.933872255s) [noise=true , address=79.127.219.51:4206 , piece_id=DT27R7X4YZUNSZ2XDWKXLUMIXY6TD25FF473GE7V7Z6BXIJQB6WQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.202778832 (334h19m5.934046452s) [noise=true , address=79.127.219.47:4061 , piece_id=PQK2BYCQVCQUECDHHHAPCAEOKZFQCNIL7UXXC7FW4QU36VTM53JQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.202957649 (334h19m5.934225279s) [noise=true , address=45.91.116.5:4326 , piece_id=TRF3G7F2SAC4KTRQ4TTMPP6H5GDH5C2ZGY5VOYT7Y6NCSRNLLZOA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.205554464 (334h19m5.936822084s) [noise=true , address=45.91.116.8:4070 , piece_id=2YPJJIPDFIV5SS57USBXJHJFKW4M5TQDVUMJNCERKIX5ZD452Z4A, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.207505926 (334h19m5.938773545s) [noise=true , address=104.36.82.60:4339 , piece_id=DCXJLRGTJK2TMID2RUBDVKWDOV4SRHAGVELLZY7TERPIACKO6HQQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.214577409 (334h19m5.945845039s) [noise=true , address=104.36.82.6:4880 , piece_id=CAUY7U2VJB6MPAPWANT4KYCCP3RGBWH3MA5WF4E7YO3X2KIGUWZA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.215183799 (334h19m5.946451429s) [noise=true , address=104.36.82.11:4120 , piece_id=ZVJDHQPPTGG7J4DCW23CUG3NVCEBSNDKSKUFBR6Q2XDIODKS2CRQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.227204945 (334h19m5.958472576s) [noise=true , address=77.90.31.16:4738 , piece_id=XWJADL5V6LBSKWDI32TRV5NZNG2Y5KTWZRKP7HJQOIB3PD75IH4A, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.231276064 (334h19m5.962543685s) [noise=true , address=77.90.31.15:4702 , piece_id=W37OSPHPZPTQYCHD73KXSAVSUTASTCJAGG3LWMQAPTSPIUUCKUUA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.232214379 (334h19m5.963482s) [noise=true , address=77.90.31.19:4868 , piece_id=PXGGATWZGDBGPRFNITEFZAYPMSEAJCASMWELNBSKCQAGCD54CVIQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.234490052 (334h19m5.965757682s) [noise=true , address=77.90.31.21:4902 , piece_id=XNNBMEIPPGRCIFPXHE4RDNBVMKYV777UVDTXYGBTFUXFPUUIL7HA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.242306687 (334h19m5.973574317s) [noise=true , address=77.90.31.10:4536 , piece_id=TB3NK2FHULSSUGXBUUWS5JZUEGCXFK3LORPWHSW6546UAUET6RXQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.251803884 (334h19m5.983071514s) [noise=true , address=104.36.82.23:4466 , piece_id=OTU3SXJHJT23CBUEVT4NI7MPUBTWRW74FU7JATMGGEUC4FB6JDWA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.251826296 (334h19m5.983093957s) [seg_pos={0 0}, upload=347532]: Segment reached optimal threshold of 14 pieces. Aug 22 15:45:25.251970888 (334h19m5.983238518s) [noise=true , address=45.91.116.11:4121 , piece_id=ZMXYNELKX2KHD5RWH2OU5ZZ7LOCPDAGX4GXB6UBW6J2US75UXWRA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wkujwGr7G6yGYFLiYcxfBnN1pmKY6mHXoAzZWAjGCCiWWZNdh): protocol: expected piece hash; context canceled; EOF Aug 22 15:45:25.252035119 (334h19m5.983302739s) [noise=true , address=77.90.31.12:4623 , piece_id=KMKYXHMWV2HUK53CPJF5USRWNF33FQBGMG5NPMRAMZAJTO3BU6AA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ANjFmZrb9SDcqEHW8CBzeMtwvmceoLH9MtPabAjBw8wXjBuaM): protocol: expected piece hash; context canceled; EOF Aug 22 15:45:25.252430574 (334h19m5.983698224s) [noise=true , address=104.36.82.44:4896 , piece_id=GCPBKLGUO337LW65K5PUCDZIMIM4SGKH2L2XYAJDR25KXPKS3QBQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ndSgjgfZMVQni5tw1ugdTrhJt4c4NagdvgYTbSbjatYYtfu1o): protocol: write tcp 5.161.89.252:59268->104.36.82.44:4896: use of closed network connection; write tcp 5.161.89.252:59268->104.36.82.44:4896: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:59268->104.36.82.44:4896: use of closed network connection Aug 22 15:45:25.252837219 (334h19m5.984104849s) [noise=true , address=79.127.201.215:4344 , piece_id=GLXLVWBVLX3WPDVC5G3CA2DAPPF3GZTTN4PKRSHV66H7KO2PGN7A, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: write tcp 5.161.89.252:10764->79.127.201.215:4344: use of closed network connection; write tcp 5.161.89.252:10764->79.127.201.215:4344: use of closed network connection Aug 22 15:45:25.252866453 (334h19m5.984134083s) [seg_pos={0 0}, upload=347532]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 15:45:25.253131663 (334h19m5.984399293s) [upload=347532]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 15:45:25.253146330 (334h19m5.984413981s) [upload=347532]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 15:45:25.422275527 (334h19m6.153543177s) [upload=347532]: Done uploading segments... Aug 22 15:45:25.422292930 (334h19m6.15356058s) [upload=347532]: Upload finished. err: <nil> Duration: 1.356855552s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 3.606313998s FAIL (2025-08-22 15:51:48 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 3.606335378s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...............X....X.....................X.......X.........] duration: 2.689640019s FAIL (2025-08-22 15:51:34 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a332dec0f9830710718513902cda341fc779204e956c9b76c091b9655ff15791 != before fead3175f949e8f7847321a6a0be058f5ba8f9601d139b79b5db601e719df2b2 ======LOGS====== Aug 22 15:45:25.052387297 (334h19m5.783654927s) [upload=347532]: Starting upload Aug 22 15:45:25.052448271 (334h19m5.783715891s) [upload=347532]: Done starting upload Aug 22 15:45:25.052562306 (334h19m5.783829936s) [upload=347532]: Uploading segments... Aug 22 15:45:25.052661752 (334h19m5.783929383s) [upload=347532]: Got next segment. Inline: false Aug 22 15:45:25.052697329 (334h19m5.783964959s) [upload=347532]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 15:45:25.052702730 (334h19m5.783970379s) [upload=347532]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 15:45:25.108388744 (334h19m5.839656374s) [seg_pos={0 0}, upload=347532]: Begin upload segment... Aug 22 15:45:25.108436563 (334h19m5.839704193s) [seg_pos={0 0}, upload=347532]: Done begin upload segment. Aug 22 15:45:25.108458765 (334h19m5.839726395s) [noise=true , address=77.90.31.19:4868 , piece_id=PXGGATWZGDBGPRFNITEFZAYPMSEAJCASMWELNBSKCQAGCD54CVIQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108478472 (334h19m5.839746092s) [noise=true , address=45.91.116.8:4070 , piece_id=2YPJJIPDFIV5SS57USBXJHJFKW4M5TQDVUMJNCERKIX5ZD452Z4A, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108550818 (334h19m5.839818439s) [noise=true , address=45.91.116.11:4121 , piece_id=ZMXYNELKX2KHD5RWH2OU5ZZ7LOCPDAGX4GXB6UBW6J2US75UXWRA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108772846 (334h19m5.840040476s) [noise=true , address=104.36.82.6:4880 , piece_id=CAUY7U2VJB6MPAPWANT4KYCCP3RGBWH3MA5WF4E7YO3X2KIGUWZA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108781532 (334h19m5.840049162s) [noise=true , address=77.90.31.15:4702 , piece_id=W37OSPHPZPTQYCHD73KXSAVSUTASTCJAGG3LWMQAPTSPIUUCKUUA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108989513 (334h19m5.840257143s) [noise=true , address=77.90.31.12:4623 , piece_id=KMKYXHMWV2HUK53CPJF5USRWNF33FQBGMG5NPMRAMZAJTO3BU6AA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108994733 (334h19m5.840262353s) [noise=true , address=104.36.82.60:4339 , piece_id=DCXJLRGTJK2TMID2RUBDVKWDOV4SRHAGVELLZY7TERPIACKO6HQQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109200140 (334h19m5.840467759s) [noise=true , address=77.90.31.10:4536 , piece_id=TB3NK2FHULSSUGXBUUWS5JZUEGCXFK3LORPWHSW6546UAUET6RXQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109204497 (334h19m5.840472127s) [noise=true , address=104.36.82.44:4896 , piece_id=GCPBKLGUO337LW65K5PUCDZIMIM4SGKH2L2XYAJDR25KXPKS3QBQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109422278 (334h19m5.840689908s) [noise=true , address=79.127.219.47:4061 , piece_id=PQK2BYCQVCQUECDHHHAPCAEOKZFQCNIL7UXXC7FW4QU36VTM53JQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109435232 (334h19m5.840702853s) [noise=true , address=45.91.116.8:4066 , piece_id=42MWX3KB4OYNODSSONGQVRQHVQPNAYDN7BEQCLOWBFVISZKFV5UA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109635338 (334h19m5.840902959s) [noise=true , address=104.36.82.11:4120 , piece_id=ZVJDHQPPTGG7J4DCW23CUG3NVCEBSNDKSKUFBR6Q2XDIODKS2CRQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109646599 (334h19m5.84091423s) [noise=true , address=77.90.31.21:4902 , piece_id=XNNBMEIPPGRCIFPXHE4RDNBVMKYV777UVDTXYGBTFUXFPUUIL7HA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109856895 (334h19m5.841124525s) [noise=true , address=79.127.219.51:4206 , piece_id=DT27R7X4YZUNSZ2XDWKXLUMIXY6TD25FF473GE7V7Z6BXIJQB6WQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.110069735 (334h19m5.841337366s) [noise=true , address=79.127.201.215:4344 , piece_id=GLXLVWBVLX3WPDVC5G3CA2DAPPF3GZTTN4PKRSHV66H7KO2PGN7A, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.110276726 (334h19m5.841544345s) [noise=true , address=77.90.31.16:4738 , piece_id=XWJADL5V6LBSKWDI32TRV5NZNG2Y5KTWZRKP7HJQOIB3PD75IH4A, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.110529401 (334h19m5.841797031s) [noise=true , address=45.91.116.5:4326 , piece_id=TRF3G7F2SAC4KTRQ4TTMPP6H5GDH5C2ZGY5VOYT7Y6NCSRNLLZOA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.111701505 (334h19m5.842969136s) [noise=true , address=104.36.82.23:4466 , piece_id=OTU3SXJHJT23CBUEVT4NI7MPUBTWRW74FU7JATMGGEUC4FB6JDWA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.194907293 (334h19m5.926174913s) [upload=347532]: Next returned nil segment Aug 22 15:45:25.194933362 (334h19m5.926200992s) [upload=347532]: Waiting for error group managing segments... Aug 22 15:45:25.202079456 (334h19m5.933347077s) [noise=true , address=45.91.116.8:4066 , piece_id=42MWX3KB4OYNODSSONGQVRQHVQPNAYDN7BEQCLOWBFVISZKFV5UA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.202604625 (334h19m5.933872255s) [noise=true , address=79.127.219.51:4206 , piece_id=DT27R7X4YZUNSZ2XDWKXLUMIXY6TD25FF473GE7V7Z6BXIJQB6WQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.202778832 (334h19m5.934046452s) [noise=true , address=79.127.219.47:4061 , piece_id=PQK2BYCQVCQUECDHHHAPCAEOKZFQCNIL7UXXC7FW4QU36VTM53JQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.202957649 (334h19m5.934225279s) [noise=true , address=45.91.116.5:4326 , piece_id=TRF3G7F2SAC4KTRQ4TTMPP6H5GDH5C2ZGY5VOYT7Y6NCSRNLLZOA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.205554464 (334h19m5.936822084s) [noise=true , address=45.91.116.8:4070 , piece_id=2YPJJIPDFIV5SS57USBXJHJFKW4M5TQDVUMJNCERKIX5ZD452Z4A, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.207505926 (334h19m5.938773545s) [noise=true , address=104.36.82.60:4339 , piece_id=DCXJLRGTJK2TMID2RUBDVKWDOV4SRHAGVELLZY7TERPIACKO6HQQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.214577409 (334h19m5.945845039s) [noise=true , address=104.36.82.6:4880 , piece_id=CAUY7U2VJB6MPAPWANT4KYCCP3RGBWH3MA5WF4E7YO3X2KIGUWZA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.215183799 (334h19m5.946451429s) [noise=true , address=104.36.82.11:4120 , piece_id=ZVJDHQPPTGG7J4DCW23CUG3NVCEBSNDKSKUFBR6Q2XDIODKS2CRQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.227204945 (334h19m5.958472576s) [noise=true , address=77.90.31.16:4738 , piece_id=XWJADL5V6LBSKWDI32TRV5NZNG2Y5KTWZRKP7HJQOIB3PD75IH4A, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.231276064 (334h19m5.962543685s) [noise=true , address=77.90.31.15:4702 , piece_id=W37OSPHPZPTQYCHD73KXSAVSUTASTCJAGG3LWMQAPTSPIUUCKUUA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.232214379 (334h19m5.963482s) [noise=true , address=77.90.31.19:4868 , piece_id=PXGGATWZGDBGPRFNITEFZAYPMSEAJCASMWELNBSKCQAGCD54CVIQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.234490052 (334h19m5.965757682s) [noise=true , address=77.90.31.21:4902 , piece_id=XNNBMEIPPGRCIFPXHE4RDNBVMKYV777UVDTXYGBTFUXFPUUIL7HA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.242306687 (334h19m5.973574317s) [noise=true , address=77.90.31.10:4536 , piece_id=TB3NK2FHULSSUGXBUUWS5JZUEGCXFK3LORPWHSW6546UAUET6RXQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.251803884 (334h19m5.983071514s) [noise=true , address=104.36.82.23:4466 , piece_id=OTU3SXJHJT23CBUEVT4NI7MPUBTWRW74FU7JATMGGEUC4FB6JDWA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.251826296 (334h19m5.983093957s) [seg_pos={0 0}, upload=347532]: Segment reached optimal threshold of 14 pieces. Aug 22 15:45:25.251970888 (334h19m5.983238518s) [noise=true , address=45.91.116.11:4121 , piece_id=ZMXYNELKX2KHD5RWH2OU5ZZ7LOCPDAGX4GXB6UBW6J2US75UXWRA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wkujwGr7G6yGYFLiYcxfBnN1pmKY6mHXoAzZWAjGCCiWWZNdh): protocol: expected piece hash; context canceled; EOF Aug 22 15:45:25.252035119 (334h19m5.983302739s) [noise=true , address=77.90.31.12:4623 , piece_id=KMKYXHMWV2HUK53CPJF5USRWNF33FQBGMG5NPMRAMZAJTO3BU6AA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ANjFmZrb9SDcqEHW8CBzeMtwvmceoLH9MtPabAjBw8wXjBuaM): protocol: expected piece hash; context canceled; EOF Aug 22 15:45:25.252430574 (334h19m5.983698224s) [noise=true , address=104.36.82.44:4896 , piece_id=GCPBKLGUO337LW65K5PUCDZIMIM4SGKH2L2XYAJDR25KXPKS3QBQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ndSgjgfZMVQni5tw1ugdTrhJt4c4NagdvgYTbSbjatYYtfu1o): protocol: write tcp 5.161.89.252:59268->104.36.82.44:4896: use of closed network connection; write tcp 5.161.89.252:59268->104.36.82.44:4896: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:59268->104.36.82.44:4896: use of closed network connection Aug 22 15:45:25.252837219 (334h19m5.984104849s) [noise=true , address=79.127.201.215:4344 , piece_id=GLXLVWBVLX3WPDVC5G3CA2DAPPF3GZTTN4PKRSHV66H7KO2PGN7A, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: write tcp 5.161.89.252:10764->79.127.201.215:4344: use of closed network connection; write tcp 5.161.89.252:10764->79.127.201.215:4344: use of closed network connection Aug 22 15:45:25.252866453 (334h19m5.984134083s) [seg_pos={0 0}, upload=347532]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 15:45:25.253131663 (334h19m5.984399293s) [upload=347532]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 15:45:25.253146330 (334h19m5.984413981s) [upload=347532]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 15:45:25.422275527 (334h19m6.153543177s) [upload=347532]: Done uploading segments... Aug 22 15:45:25.422292930 (334h19m6.15356058s) [upload=347532]: Upload finished. err: <nil> Duration: 2.689664674s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 2.212863164s FAIL (2025-08-22 15:51:16 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.212882291s core uplink ap1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 5.571562859s FAIL (2025-08-22 15:51:13 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 5.571582396s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [................X....X.....................X.......X........] duration: 2.040335155s FAIL (2025-08-22 15:51:05 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a332dec0f9830710718513902cda341fc779204e956c9b76c091b9655ff15791 != before fead3175f949e8f7847321a6a0be058f5ba8f9601d139b79b5db601e719df2b2 ======LOGS====== Aug 22 15:45:25.052387297 (334h19m5.783654927s) [upload=347532]: Starting upload Aug 22 15:45:25.052448271 (334h19m5.783715891s) [upload=347532]: Done starting upload Aug 22 15:45:25.052562306 (334h19m5.783829936s) [upload=347532]: Uploading segments... Aug 22 15:45:25.052661752 (334h19m5.783929383s) [upload=347532]: Got next segment. Inline: false Aug 22 15:45:25.052697329 (334h19m5.783964959s) [upload=347532]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 15:45:25.052702730 (334h19m5.783970379s) [upload=347532]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 15:45:25.108388744 (334h19m5.839656374s) [seg_pos={0 0}, upload=347532]: Begin upload segment... Aug 22 15:45:25.108436563 (334h19m5.839704193s) [seg_pos={0 0}, upload=347532]: Done begin upload segment. Aug 22 15:45:25.108458765 (334h19m5.839726395s) [noise=true , address=77.90.31.19:4868 , piece_id=PXGGATWZGDBGPRFNITEFZAYPMSEAJCASMWELNBSKCQAGCD54CVIQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108478472 (334h19m5.839746092s) [noise=true , address=45.91.116.8:4070 , piece_id=2YPJJIPDFIV5SS57USBXJHJFKW4M5TQDVUMJNCERKIX5ZD452Z4A, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108550818 (334h19m5.839818439s) [noise=true , address=45.91.116.11:4121 , piece_id=ZMXYNELKX2KHD5RWH2OU5ZZ7LOCPDAGX4GXB6UBW6J2US75UXWRA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108772846 (334h19m5.840040476s) [noise=true , address=104.36.82.6:4880 , piece_id=CAUY7U2VJB6MPAPWANT4KYCCP3RGBWH3MA5WF4E7YO3X2KIGUWZA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108781532 (334h19m5.840049162s) [noise=true , address=77.90.31.15:4702 , piece_id=W37OSPHPZPTQYCHD73KXSAVSUTASTCJAGG3LWMQAPTSPIUUCKUUA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108989513 (334h19m5.840257143s) [noise=true , address=77.90.31.12:4623 , piece_id=KMKYXHMWV2HUK53CPJF5USRWNF33FQBGMG5NPMRAMZAJTO3BU6AA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108994733 (334h19m5.840262353s) [noise=true , address=104.36.82.60:4339 , piece_id=DCXJLRGTJK2TMID2RUBDVKWDOV4SRHAGVELLZY7TERPIACKO6HQQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109200140 (334h19m5.840467759s) [noise=true , address=77.90.31.10:4536 , piece_id=TB3NK2FHULSSUGXBUUWS5JZUEGCXFK3LORPWHSW6546UAUET6RXQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109204497 (334h19m5.840472127s) [noise=true , address=104.36.82.44:4896 , piece_id=GCPBKLGUO337LW65K5PUCDZIMIM4SGKH2L2XYAJDR25KXPKS3QBQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109422278 (334h19m5.840689908s) [noise=true , address=79.127.219.47:4061 , piece_id=PQK2BYCQVCQUECDHHHAPCAEOKZFQCNIL7UXXC7FW4QU36VTM53JQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109435232 (334h19m5.840702853s) [noise=true , address=45.91.116.8:4066 , piece_id=42MWX3KB4OYNODSSONGQVRQHVQPNAYDN7BEQCLOWBFVISZKFV5UA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109635338 (334h19m5.840902959s) [noise=true , address=104.36.82.11:4120 , piece_id=ZVJDHQPPTGG7J4DCW23CUG3NVCEBSNDKSKUFBR6Q2XDIODKS2CRQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109646599 (334h19m5.84091423s) [noise=true , address=77.90.31.21:4902 , piece_id=XNNBMEIPPGRCIFPXHE4RDNBVMKYV777UVDTXYGBTFUXFPUUIL7HA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109856895 (334h19m5.841124525s) [noise=true , address=79.127.219.51:4206 , piece_id=DT27R7X4YZUNSZ2XDWKXLUMIXY6TD25FF473GE7V7Z6BXIJQB6WQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.110069735 (334h19m5.841337366s) [noise=true , address=79.127.201.215:4344 , piece_id=GLXLVWBVLX3WPDVC5G3CA2DAPPF3GZTTN4PKRSHV66H7KO2PGN7A, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.110276726 (334h19m5.841544345s) [noise=true , address=77.90.31.16:4738 , piece_id=XWJADL5V6LBSKWDI32TRV5NZNG2Y5KTWZRKP7HJQOIB3PD75IH4A, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.110529401 (334h19m5.841797031s) [noise=true , address=45.91.116.5:4326 , piece_id=TRF3G7F2SAC4KTRQ4TTMPP6H5GDH5C2ZGY5VOYT7Y6NCSRNLLZOA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.111701505 (334h19m5.842969136s) [noise=true , address=104.36.82.23:4466 , piece_id=OTU3SXJHJT23CBUEVT4NI7MPUBTWRW74FU7JATMGGEUC4FB6JDWA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.194907293 (334h19m5.926174913s) [upload=347532]: Next returned nil segment Aug 22 15:45:25.194933362 (334h19m5.926200992s) [upload=347532]: Waiting for error group managing segments... Aug 22 15:45:25.202079456 (334h19m5.933347077s) [noise=true , address=45.91.116.8:4066 , piece_id=42MWX3KB4OYNODSSONGQVRQHVQPNAYDN7BEQCLOWBFVISZKFV5UA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.202604625 (334h19m5.933872255s) [noise=true , address=79.127.219.51:4206 , piece_id=DT27R7X4YZUNSZ2XDWKXLUMIXY6TD25FF473GE7V7Z6BXIJQB6WQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.202778832 (334h19m5.934046452s) [noise=true , address=79.127.219.47:4061 , piece_id=PQK2BYCQVCQUECDHHHAPCAEOKZFQCNIL7UXXC7FW4QU36VTM53JQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.202957649 (334h19m5.934225279s) [noise=true , address=45.91.116.5:4326 , piece_id=TRF3G7F2SAC4KTRQ4TTMPP6H5GDH5C2ZGY5VOYT7Y6NCSRNLLZOA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.205554464 (334h19m5.936822084s) [noise=true , address=45.91.116.8:4070 , piece_id=2YPJJIPDFIV5SS57USBXJHJFKW4M5TQDVUMJNCERKIX5ZD452Z4A, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.207505926 (334h19m5.938773545s) [noise=true , address=104.36.82.60:4339 , piece_id=DCXJLRGTJK2TMID2RUBDVKWDOV4SRHAGVELLZY7TERPIACKO6HQQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.214577409 (334h19m5.945845039s) [noise=true , address=104.36.82.6:4880 , piece_id=CAUY7U2VJB6MPAPWANT4KYCCP3RGBWH3MA5WF4E7YO3X2KIGUWZA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.215183799 (334h19m5.946451429s) [noise=true , address=104.36.82.11:4120 , piece_id=ZVJDHQPPTGG7J4DCW23CUG3NVCEBSNDKSKUFBR6Q2XDIODKS2CRQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.227204945 (334h19m5.958472576s) [noise=true , address=77.90.31.16:4738 , piece_id=XWJADL5V6LBSKWDI32TRV5NZNG2Y5KTWZRKP7HJQOIB3PD75IH4A, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.231276064 (334h19m5.962543685s) [noise=true , address=77.90.31.15:4702 , piece_id=W37OSPHPZPTQYCHD73KXSAVSUTASTCJAGG3LWMQAPTSPIUUCKUUA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.232214379 (334h19m5.963482s) [noise=true , address=77.90.31.19:4868 , piece_id=PXGGATWZGDBGPRFNITEFZAYPMSEAJCASMWELNBSKCQAGCD54CVIQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.234490052 (334h19m5.965757682s) [noise=true , address=77.90.31.21:4902 , piece_id=XNNBMEIPPGRCIFPXHE4RDNBVMKYV777UVDTXYGBTFUXFPUUIL7HA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.242306687 (334h19m5.973574317s) [noise=true , address=77.90.31.10:4536 , piece_id=TB3NK2FHULSSUGXBUUWS5JZUEGCXFK3LORPWHSW6546UAUET6RXQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.251803884 (334h19m5.983071514s) [noise=true , address=104.36.82.23:4466 , piece_id=OTU3SXJHJT23CBUEVT4NI7MPUBTWRW74FU7JATMGGEUC4FB6JDWA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.251826296 (334h19m5.983093957s) [seg_pos={0 0}, upload=347532]: Segment reached optimal threshold of 14 pieces. Aug 22 15:45:25.251970888 (334h19m5.983238518s) [noise=true , address=45.91.116.11:4121 , piece_id=ZMXYNELKX2KHD5RWH2OU5ZZ7LOCPDAGX4GXB6UBW6J2US75UXWRA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wkujwGr7G6yGYFLiYcxfBnN1pmKY6mHXoAzZWAjGCCiWWZNdh): protocol: expected piece hash; context canceled; EOF Aug 22 15:45:25.252035119 (334h19m5.983302739s) [noise=true , address=77.90.31.12:4623 , piece_id=KMKYXHMWV2HUK53CPJF5USRWNF33FQBGMG5NPMRAMZAJTO3BU6AA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ANjFmZrb9SDcqEHW8CBzeMtwvmceoLH9MtPabAjBw8wXjBuaM): protocol: expected piece hash; context canceled; EOF Aug 22 15:45:25.252430574 (334h19m5.983698224s) [noise=true , address=104.36.82.44:4896 , piece_id=GCPBKLGUO337LW65K5PUCDZIMIM4SGKH2L2XYAJDR25KXPKS3QBQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ndSgjgfZMVQni5tw1ugdTrhJt4c4NagdvgYTbSbjatYYtfu1o): protocol: write tcp 5.161.89.252:59268->104.36.82.44:4896: use of closed network connection; write tcp 5.161.89.252:59268->104.36.82.44:4896: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:59268->104.36.82.44:4896: use of closed network connection Aug 22 15:45:25.252837219 (334h19m5.984104849s) [noise=true , address=79.127.201.215:4344 , piece_id=GLXLVWBVLX3WPDVC5G3CA2DAPPF3GZTTN4PKRSHV66H7KO2PGN7A, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: write tcp 5.161.89.252:10764->79.127.201.215:4344: use of closed network connection; write tcp 5.161.89.252:10764->79.127.201.215:4344: use of closed network connection Aug 22 15:45:25.252866453 (334h19m5.984134083s) [seg_pos={0 0}, upload=347532]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 15:45:25.253131663 (334h19m5.984399293s) [upload=347532]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 15:45:25.253146330 (334h19m5.984413981s) [upload=347532]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 15:45:25.422275527 (334h19m6.153543177s) [upload=347532]: Done uploading segments... Aug 22 15:45:25.422292930 (334h19m6.15356058s) [upload=347532]: Upload finished. err: <nil> Duration: 2.040359691s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 3.563230202s FAIL (2025-08-22 15:50:57 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 3.563261039s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 2.616968314s FAIL (2025-08-22 15:50:41 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.617016745s core uplink ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.................X....X.....................X.......X.......] duration: 1.762926808s FAIL (2025-08-22 15:50:34 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a332dec0f9830710718513902cda341fc779204e956c9b76c091b9655ff15791 != before fead3175f949e8f7847321a6a0be058f5ba8f9601d139b79b5db601e719df2b2 ======LOGS====== Aug 22 15:45:25.052387297 (334h19m5.783654927s) [upload=347532]: Starting upload Aug 22 15:45:25.052448271 (334h19m5.783715891s) [upload=347532]: Done starting upload Aug 22 15:45:25.052562306 (334h19m5.783829936s) [upload=347532]: Uploading segments... Aug 22 15:45:25.052661752 (334h19m5.783929383s) [upload=347532]: Got next segment. Inline: false Aug 22 15:45:25.052697329 (334h19m5.783964959s) [upload=347532]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 15:45:25.052702730 (334h19m5.783970379s) [upload=347532]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 15:45:25.108388744 (334h19m5.839656374s) [seg_pos={0 0}, upload=347532]: Begin upload segment... Aug 22 15:45:25.108436563 (334h19m5.839704193s) [seg_pos={0 0}, upload=347532]: Done begin upload segment. Aug 22 15:45:25.108458765 (334h19m5.839726395s) [noise=true , address=77.90.31.19:4868 , piece_id=PXGGATWZGDBGPRFNITEFZAYPMSEAJCASMWELNBSKCQAGCD54CVIQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108478472 (334h19m5.839746092s) [noise=true , address=45.91.116.8:4070 , piece_id=2YPJJIPDFIV5SS57USBXJHJFKW4M5TQDVUMJNCERKIX5ZD452Z4A, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108550818 (334h19m5.839818439s) [noise=true , address=45.91.116.11:4121 , piece_id=ZMXYNELKX2KHD5RWH2OU5ZZ7LOCPDAGX4GXB6UBW6J2US75UXWRA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108772846 (334h19m5.840040476s) [noise=true , address=104.36.82.6:4880 , piece_id=CAUY7U2VJB6MPAPWANT4KYCCP3RGBWH3MA5WF4E7YO3X2KIGUWZA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108781532 (334h19m5.840049162s) [noise=true , address=77.90.31.15:4702 , piece_id=W37OSPHPZPTQYCHD73KXSAVSUTASTCJAGG3LWMQAPTSPIUUCKUUA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108989513 (334h19m5.840257143s) [noise=true , address=77.90.31.12:4623 , piece_id=KMKYXHMWV2HUK53CPJF5USRWNF33FQBGMG5NPMRAMZAJTO3BU6AA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108994733 (334h19m5.840262353s) [noise=true , address=104.36.82.60:4339 , piece_id=DCXJLRGTJK2TMID2RUBDVKWDOV4SRHAGVELLZY7TERPIACKO6HQQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109200140 (334h19m5.840467759s) [noise=true , address=77.90.31.10:4536 , piece_id=TB3NK2FHULSSUGXBUUWS5JZUEGCXFK3LORPWHSW6546UAUET6RXQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109204497 (334h19m5.840472127s) [noise=true , address=104.36.82.44:4896 , piece_id=GCPBKLGUO337LW65K5PUCDZIMIM4SGKH2L2XYAJDR25KXPKS3QBQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109422278 (334h19m5.840689908s) [noise=true , address=79.127.219.47:4061 , piece_id=PQK2BYCQVCQUECDHHHAPCAEOKZFQCNIL7UXXC7FW4QU36VTM53JQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109435232 (334h19m5.840702853s) [noise=true , address=45.91.116.8:4066 , piece_id=42MWX3KB4OYNODSSONGQVRQHVQPNAYDN7BEQCLOWBFVISZKFV5UA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109635338 (334h19m5.840902959s) [noise=true , address=104.36.82.11:4120 , piece_id=ZVJDHQPPTGG7J4DCW23CUG3NVCEBSNDKSKUFBR6Q2XDIODKS2CRQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109646599 (334h19m5.84091423s) [noise=true , address=77.90.31.21:4902 , piece_id=XNNBMEIPPGRCIFPXHE4RDNBVMKYV777UVDTXYGBTFUXFPUUIL7HA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109856895 (334h19m5.841124525s) [noise=true , address=79.127.219.51:4206 , piece_id=DT27R7X4YZUNSZ2XDWKXLUMIXY6TD25FF473GE7V7Z6BXIJQB6WQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.110069735 (334h19m5.841337366s) [noise=true , address=79.127.201.215:4344 , piece_id=GLXLVWBVLX3WPDVC5G3CA2DAPPF3GZTTN4PKRSHV66H7KO2PGN7A, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.110276726 (334h19m5.841544345s) [noise=true , address=77.90.31.16:4738 , piece_id=XWJADL5V6LBSKWDI32TRV5NZNG2Y5KTWZRKP7HJQOIB3PD75IH4A, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.110529401 (334h19m5.841797031s) [noise=true , address=45.91.116.5:4326 , piece_id=TRF3G7F2SAC4KTRQ4TTMPP6H5GDH5C2ZGY5VOYT7Y6NCSRNLLZOA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.111701505 (334h19m5.842969136s) [noise=true , address=104.36.82.23:4466 , piece_id=OTU3SXJHJT23CBUEVT4NI7MPUBTWRW74FU7JATMGGEUC4FB6JDWA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.194907293 (334h19m5.926174913s) [upload=347532]: Next returned nil segment Aug 22 15:45:25.194933362 (334h19m5.926200992s) [upload=347532]: Waiting for error group managing segments... Aug 22 15:45:25.202079456 (334h19m5.933347077s) [noise=true , address=45.91.116.8:4066 , piece_id=42MWX3KB4OYNODSSONGQVRQHVQPNAYDN7BEQCLOWBFVISZKFV5UA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.202604625 (334h19m5.933872255s) [noise=true , address=79.127.219.51:4206 , piece_id=DT27R7X4YZUNSZ2XDWKXLUMIXY6TD25FF473GE7V7Z6BXIJQB6WQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.202778832 (334h19m5.934046452s) [noise=true , address=79.127.219.47:4061 , piece_id=PQK2BYCQVCQUECDHHHAPCAEOKZFQCNIL7UXXC7FW4QU36VTM53JQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.202957649 (334h19m5.934225279s) [noise=true , address=45.91.116.5:4326 , piece_id=TRF3G7F2SAC4KTRQ4TTMPP6H5GDH5C2ZGY5VOYT7Y6NCSRNLLZOA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.205554464 (334h19m5.936822084s) [noise=true , address=45.91.116.8:4070 , piece_id=2YPJJIPDFIV5SS57USBXJHJFKW4M5TQDVUMJNCERKIX5ZD452Z4A, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.207505926 (334h19m5.938773545s) [noise=true , address=104.36.82.60:4339 , piece_id=DCXJLRGTJK2TMID2RUBDVKWDOV4SRHAGVELLZY7TERPIACKO6HQQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.214577409 (334h19m5.945845039s) [noise=true , address=104.36.82.6:4880 , piece_id=CAUY7U2VJB6MPAPWANT4KYCCP3RGBWH3MA5WF4E7YO3X2KIGUWZA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.215183799 (334h19m5.946451429s) [noise=true , address=104.36.82.11:4120 , piece_id=ZVJDHQPPTGG7J4DCW23CUG3NVCEBSNDKSKUFBR6Q2XDIODKS2CRQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.227204945 (334h19m5.958472576s) [noise=true , address=77.90.31.16:4738 , piece_id=XWJADL5V6LBSKWDI32TRV5NZNG2Y5KTWZRKP7HJQOIB3PD75IH4A, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.231276064 (334h19m5.962543685s) [noise=true , address=77.90.31.15:4702 , piece_id=W37OSPHPZPTQYCHD73KXSAVSUTASTCJAGG3LWMQAPTSPIUUCKUUA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.232214379 (334h19m5.963482s) [noise=true , address=77.90.31.19:4868 , piece_id=PXGGATWZGDBGPRFNITEFZAYPMSEAJCASMWELNBSKCQAGCD54CVIQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.234490052 (334h19m5.965757682s) [noise=true , address=77.90.31.21:4902 , piece_id=XNNBMEIPPGRCIFPXHE4RDNBVMKYV777UVDTXYGBTFUXFPUUIL7HA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.242306687 (334h19m5.973574317s) [noise=true , address=77.90.31.10:4536 , piece_id=TB3NK2FHULSSUGXBUUWS5JZUEGCXFK3LORPWHSW6546UAUET6RXQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.251803884 (334h19m5.983071514s) [noise=true , address=104.36.82.23:4466 , piece_id=OTU3SXJHJT23CBUEVT4NI7MPUBTWRW74FU7JATMGGEUC4FB6JDWA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.251826296 (334h19m5.983093957s) [seg_pos={0 0}, upload=347532]: Segment reached optimal threshold of 14 pieces. Aug 22 15:45:25.251970888 (334h19m5.983238518s) [noise=true , address=45.91.116.11:4121 , piece_id=ZMXYNELKX2KHD5RWH2OU5ZZ7LOCPDAGX4GXB6UBW6J2US75UXWRA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wkujwGr7G6yGYFLiYcxfBnN1pmKY6mHXoAzZWAjGCCiWWZNdh): protocol: expected piece hash; context canceled; EOF Aug 22 15:45:25.252035119 (334h19m5.983302739s) [noise=true , address=77.90.31.12:4623 , piece_id=KMKYXHMWV2HUK53CPJF5USRWNF33FQBGMG5NPMRAMZAJTO3BU6AA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ANjFmZrb9SDcqEHW8CBzeMtwvmceoLH9MtPabAjBw8wXjBuaM): protocol: expected piece hash; context canceled; EOF Aug 22 15:45:25.252430574 (334h19m5.983698224s) [noise=true , address=104.36.82.44:4896 , piece_id=GCPBKLGUO337LW65K5PUCDZIMIM4SGKH2L2XYAJDR25KXPKS3QBQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ndSgjgfZMVQni5tw1ugdTrhJt4c4NagdvgYTbSbjatYYtfu1o): protocol: write tcp 5.161.89.252:59268->104.36.82.44:4896: use of closed network connection; write tcp 5.161.89.252:59268->104.36.82.44:4896: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:59268->104.36.82.44:4896: use of closed network connection Aug 22 15:45:25.252837219 (334h19m5.984104849s) [noise=true , address=79.127.201.215:4344 , piece_id=GLXLVWBVLX3WPDVC5G3CA2DAPPF3GZTTN4PKRSHV66H7KO2PGN7A, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: write tcp 5.161.89.252:10764->79.127.201.215:4344: use of closed network connection; write tcp 5.161.89.252:10764->79.127.201.215:4344: use of closed network connection Aug 22 15:45:25.252866453 (334h19m5.984134083s) [seg_pos={0 0}, upload=347532]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 15:45:25.253131663 (334h19m5.984399293s) [upload=347532]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 15:45:25.253146330 (334h19m5.984413981s) [upload=347532]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 15:45:25.422275527 (334h19m6.153543177s) [upload=347532]: Done uploading segments... Aug 22 15:45:25.422292930 (334h19m6.15356058s) [upload=347532]: Upload finished. err: <nil> Duration: 1.76294931s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 3.707511928s FAIL (2025-08-22 15:50:28 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 3.707534371s core uplink eu1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 2.794178855s FAIL (2025-08-22 15:50:00 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.794199926s core uplink ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..................X....X.....................X.......X......] duration: 939.624872ms FAIL (2025-08-22 15:49:37 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a332dec0f9830710718513902cda341fc779204e956c9b76c091b9655ff15791 != before fead3175f949e8f7847321a6a0be058f5ba8f9601d139b79b5db601e719df2b2 ======LOGS====== Aug 22 15:45:25.052387297 (334h19m5.783654927s) [upload=347532]: Starting upload Aug 22 15:45:25.052448271 (334h19m5.783715891s) [upload=347532]: Done starting upload Aug 22 15:45:25.052562306 (334h19m5.783829936s) [upload=347532]: Uploading segments... Aug 22 15:45:25.052661752 (334h19m5.783929383s) [upload=347532]: Got next segment. Inline: false Aug 22 15:45:25.052697329 (334h19m5.783964959s) [upload=347532]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 15:45:25.052702730 (334h19m5.783970379s) [upload=347532]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 15:45:25.108388744 (334h19m5.839656374s) [seg_pos={0 0}, upload=347532]: Begin upload segment... Aug 22 15:45:25.108436563 (334h19m5.839704193s) [seg_pos={0 0}, upload=347532]: Done begin upload segment. Aug 22 15:45:25.108458765 (334h19m5.839726395s) [noise=true , address=77.90.31.19:4868 , piece_id=PXGGATWZGDBGPRFNITEFZAYPMSEAJCASMWELNBSKCQAGCD54CVIQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108478472 (334h19m5.839746092s) [noise=true , address=45.91.116.8:4070 , piece_id=2YPJJIPDFIV5SS57USBXJHJFKW4M5TQDVUMJNCERKIX5ZD452Z4A, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108550818 (334h19m5.839818439s) [noise=true , address=45.91.116.11:4121 , piece_id=ZMXYNELKX2KHD5RWH2OU5ZZ7LOCPDAGX4GXB6UBW6J2US75UXWRA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108772846 (334h19m5.840040476s) [noise=true , address=104.36.82.6:4880 , piece_id=CAUY7U2VJB6MPAPWANT4KYCCP3RGBWH3MA5WF4E7YO3X2KIGUWZA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108781532 (334h19m5.840049162s) [noise=true , address=77.90.31.15:4702 , piece_id=W37OSPHPZPTQYCHD73KXSAVSUTASTCJAGG3LWMQAPTSPIUUCKUUA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108989513 (334h19m5.840257143s) [noise=true , address=77.90.31.12:4623 , piece_id=KMKYXHMWV2HUK53CPJF5USRWNF33FQBGMG5NPMRAMZAJTO3BU6AA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108994733 (334h19m5.840262353s) [noise=true , address=104.36.82.60:4339 , piece_id=DCXJLRGTJK2TMID2RUBDVKWDOV4SRHAGVELLZY7TERPIACKO6HQQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109200140 (334h19m5.840467759s) [noise=true , address=77.90.31.10:4536 , piece_id=TB3NK2FHULSSUGXBUUWS5JZUEGCXFK3LORPWHSW6546UAUET6RXQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109204497 (334h19m5.840472127s) [noise=true , address=104.36.82.44:4896 , piece_id=GCPBKLGUO337LW65K5PUCDZIMIM4SGKH2L2XYAJDR25KXPKS3QBQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109422278 (334h19m5.840689908s) [noise=true , address=79.127.219.47:4061 , piece_id=PQK2BYCQVCQUECDHHHAPCAEOKZFQCNIL7UXXC7FW4QU36VTM53JQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109435232 (334h19m5.840702853s) [noise=true , address=45.91.116.8:4066 , piece_id=42MWX3KB4OYNODSSONGQVRQHVQPNAYDN7BEQCLOWBFVISZKFV5UA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109635338 (334h19m5.840902959s) [noise=true , address=104.36.82.11:4120 , piece_id=ZVJDHQPPTGG7J4DCW23CUG3NVCEBSNDKSKUFBR6Q2XDIODKS2CRQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109646599 (334h19m5.84091423s) [noise=true , address=77.90.31.21:4902 , piece_id=XNNBMEIPPGRCIFPXHE4RDNBVMKYV777UVDTXYGBTFUXFPUUIL7HA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109856895 (334h19m5.841124525s) [noise=true , address=79.127.219.51:4206 , piece_id=DT27R7X4YZUNSZ2XDWKXLUMIXY6TD25FF473GE7V7Z6BXIJQB6WQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.110069735 (334h19m5.841337366s) [noise=true , address=79.127.201.215:4344 , piece_id=GLXLVWBVLX3WPDVC5G3CA2DAPPF3GZTTN4PKRSHV66H7KO2PGN7A, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.110276726 (334h19m5.841544345s) [noise=true , address=77.90.31.16:4738 , piece_id=XWJADL5V6LBSKWDI32TRV5NZNG2Y5KTWZRKP7HJQOIB3PD75IH4A, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.110529401 (334h19m5.841797031s) [noise=true , address=45.91.116.5:4326 , piece_id=TRF3G7F2SAC4KTRQ4TTMPP6H5GDH5C2ZGY5VOYT7Y6NCSRNLLZOA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.111701505 (334h19m5.842969136s) [noise=true , address=104.36.82.23:4466 , piece_id=OTU3SXJHJT23CBUEVT4NI7MPUBTWRW74FU7JATMGGEUC4FB6JDWA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.194907293 (334h19m5.926174913s) [upload=347532]: Next returned nil segment Aug 22 15:45:25.194933362 (334h19m5.926200992s) [upload=347532]: Waiting for error group managing segments... Aug 22 15:45:25.202079456 (334h19m5.933347077s) [noise=true , address=45.91.116.8:4066 , piece_id=42MWX3KB4OYNODSSONGQVRQHVQPNAYDN7BEQCLOWBFVISZKFV5UA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.202604625 (334h19m5.933872255s) [noise=true , address=79.127.219.51:4206 , piece_id=DT27R7X4YZUNSZ2XDWKXLUMIXY6TD25FF473GE7V7Z6BXIJQB6WQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.202778832 (334h19m5.934046452s) [noise=true , address=79.127.219.47:4061 , piece_id=PQK2BYCQVCQUECDHHHAPCAEOKZFQCNIL7UXXC7FW4QU36VTM53JQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.202957649 (334h19m5.934225279s) [noise=true , address=45.91.116.5:4326 , piece_id=TRF3G7F2SAC4KTRQ4TTMPP6H5GDH5C2ZGY5VOYT7Y6NCSRNLLZOA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.205554464 (334h19m5.936822084s) [noise=true , address=45.91.116.8:4070 , piece_id=2YPJJIPDFIV5SS57USBXJHJFKW4M5TQDVUMJNCERKIX5ZD452Z4A, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.207505926 (334h19m5.938773545s) [noise=true , address=104.36.82.60:4339 , piece_id=DCXJLRGTJK2TMID2RUBDVKWDOV4SRHAGVELLZY7TERPIACKO6HQQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.214577409 (334h19m5.945845039s) [noise=true , address=104.36.82.6:4880 , piece_id=CAUY7U2VJB6MPAPWANT4KYCCP3RGBWH3MA5WF4E7YO3X2KIGUWZA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.215183799 (334h19m5.946451429s) [noise=true , address=104.36.82.11:4120 , piece_id=ZVJDHQPPTGG7J4DCW23CUG3NVCEBSNDKSKUFBR6Q2XDIODKS2CRQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.227204945 (334h19m5.958472576s) [noise=true , address=77.90.31.16:4738 , piece_id=XWJADL5V6LBSKWDI32TRV5NZNG2Y5KTWZRKP7HJQOIB3PD75IH4A, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.231276064 (334h19m5.962543685s) [noise=true , address=77.90.31.15:4702 , piece_id=W37OSPHPZPTQYCHD73KXSAVSUTASTCJAGG3LWMQAPTSPIUUCKUUA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.232214379 (334h19m5.963482s) [noise=true , address=77.90.31.19:4868 , piece_id=PXGGATWZGDBGPRFNITEFZAYPMSEAJCASMWELNBSKCQAGCD54CVIQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.234490052 (334h19m5.965757682s) [noise=true , address=77.90.31.21:4902 , piece_id=XNNBMEIPPGRCIFPXHE4RDNBVMKYV777UVDTXYGBTFUXFPUUIL7HA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.242306687 (334h19m5.973574317s) [noise=true , address=77.90.31.10:4536 , piece_id=TB3NK2FHULSSUGXBUUWS5JZUEGCXFK3LORPWHSW6546UAUET6RXQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.251803884 (334h19m5.983071514s) [noise=true , address=104.36.82.23:4466 , piece_id=OTU3SXJHJT23CBUEVT4NI7MPUBTWRW74FU7JATMGGEUC4FB6JDWA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.251826296 (334h19m5.983093957s) [seg_pos={0 0}, upload=347532]: Segment reached optimal threshold of 14 pieces. Aug 22 15:45:25.251970888 (334h19m5.983238518s) [noise=true , address=45.91.116.11:4121 , piece_id=ZMXYNELKX2KHD5RWH2OU5ZZ7LOCPDAGX4GXB6UBW6J2US75UXWRA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wkujwGr7G6yGYFLiYcxfBnN1pmKY6mHXoAzZWAjGCCiWWZNdh): protocol: expected piece hash; context canceled; EOF Aug 22 15:45:25.252035119 (334h19m5.983302739s) [noise=true , address=77.90.31.12:4623 , piece_id=KMKYXHMWV2HUK53CPJF5USRWNF33FQBGMG5NPMRAMZAJTO3BU6AA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ANjFmZrb9SDcqEHW8CBzeMtwvmceoLH9MtPabAjBw8wXjBuaM): protocol: expected piece hash; context canceled; EOF Aug 22 15:45:25.252430574 (334h19m5.983698224s) [noise=true , address=104.36.82.44:4896 , piece_id=GCPBKLGUO337LW65K5PUCDZIMIM4SGKH2L2XYAJDR25KXPKS3QBQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ndSgjgfZMVQni5tw1ugdTrhJt4c4NagdvgYTbSbjatYYtfu1o): protocol: write tcp 5.161.89.252:59268->104.36.82.44:4896: use of closed network connection; write tcp 5.161.89.252:59268->104.36.82.44:4896: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:59268->104.36.82.44:4896: use of closed network connection Aug 22 15:45:25.252837219 (334h19m5.984104849s) [noise=true , address=79.127.201.215:4344 , piece_id=GLXLVWBVLX3WPDVC5G3CA2DAPPF3GZTTN4PKRSHV66H7KO2PGN7A, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: write tcp 5.161.89.252:10764->79.127.201.215:4344: use of closed network connection; write tcp 5.161.89.252:10764->79.127.201.215:4344: use of closed network connection Aug 22 15:45:25.252866453 (334h19m5.984134083s) [seg_pos={0 0}, upload=347532]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 15:45:25.253131663 (334h19m5.984399293s) [upload=347532]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 15:45:25.253146330 (334h19m5.984413981s) [upload=347532]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 15:45:25.422275527 (334h19m6.153543177s) [upload=347532]: Done uploading segments... Aug 22 15:45:25.422292930 (334h19m6.15356058s) [upload=347532]: Upload finished. err: <nil> Duration: 939.649168ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 2.428444811s FAIL (2025-08-22 15:49:34 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.428472184s core uplink ap1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 2.762714816s FAIL (2025-08-22 15:49:20 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 2.762746466s core uplink eu1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 2.205400274s FAIL (2025-08-22 15:49:11 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.205423818s core uplink ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...................X....X.....................X.......X.....] duration: 760.123683ms FAIL (2025-08-22 15:49:04 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a332dec0f9830710718513902cda341fc779204e956c9b76c091b9655ff15791 != before fead3175f949e8f7847321a6a0be058f5ba8f9601d139b79b5db601e719df2b2 ======LOGS====== Aug 22 15:45:25.052387297 (334h19m5.783654927s) [upload=347532]: Starting upload Aug 22 15:45:25.052448271 (334h19m5.783715891s) [upload=347532]: Done starting upload Aug 22 15:45:25.052562306 (334h19m5.783829936s) [upload=347532]: Uploading segments... Aug 22 15:45:25.052661752 (334h19m5.783929383s) [upload=347532]: Got next segment. Inline: false Aug 22 15:45:25.052697329 (334h19m5.783964959s) [upload=347532]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 15:45:25.052702730 (334h19m5.783970379s) [upload=347532]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 15:45:25.108388744 (334h19m5.839656374s) [seg_pos={0 0}, upload=347532]: Begin upload segment... Aug 22 15:45:25.108436563 (334h19m5.839704193s) [seg_pos={0 0}, upload=347532]: Done begin upload segment. Aug 22 15:45:25.108458765 (334h19m5.839726395s) [noise=true , address=77.90.31.19:4868 , piece_id=PXGGATWZGDBGPRFNITEFZAYPMSEAJCASMWELNBSKCQAGCD54CVIQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108478472 (334h19m5.839746092s) [noise=true , address=45.91.116.8:4070 , piece_id=2YPJJIPDFIV5SS57USBXJHJFKW4M5TQDVUMJNCERKIX5ZD452Z4A, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108550818 (334h19m5.839818439s) [noise=true , address=45.91.116.11:4121 , piece_id=ZMXYNELKX2KHD5RWH2OU5ZZ7LOCPDAGX4GXB6UBW6J2US75UXWRA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108772846 (334h19m5.840040476s) [noise=true , address=104.36.82.6:4880 , piece_id=CAUY7U2VJB6MPAPWANT4KYCCP3RGBWH3MA5WF4E7YO3X2KIGUWZA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108781532 (334h19m5.840049162s) [noise=true , address=77.90.31.15:4702 , piece_id=W37OSPHPZPTQYCHD73KXSAVSUTASTCJAGG3LWMQAPTSPIUUCKUUA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108989513 (334h19m5.840257143s) [noise=true , address=77.90.31.12:4623 , piece_id=KMKYXHMWV2HUK53CPJF5USRWNF33FQBGMG5NPMRAMZAJTO3BU6AA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108994733 (334h19m5.840262353s) [noise=true , address=104.36.82.60:4339 , piece_id=DCXJLRGTJK2TMID2RUBDVKWDOV4SRHAGVELLZY7TERPIACKO6HQQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109200140 (334h19m5.840467759s) [noise=true , address=77.90.31.10:4536 , piece_id=TB3NK2FHULSSUGXBUUWS5JZUEGCXFK3LORPWHSW6546UAUET6RXQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109204497 (334h19m5.840472127s) [noise=true , address=104.36.82.44:4896 , piece_id=GCPBKLGUO337LW65K5PUCDZIMIM4SGKH2L2XYAJDR25KXPKS3QBQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109422278 (334h19m5.840689908s) [noise=true , address=79.127.219.47:4061 , piece_id=PQK2BYCQVCQUECDHHHAPCAEOKZFQCNIL7UXXC7FW4QU36VTM53JQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109435232 (334h19m5.840702853s) [noise=true , address=45.91.116.8:4066 , piece_id=42MWX3KB4OYNODSSONGQVRQHVQPNAYDN7BEQCLOWBFVISZKFV5UA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109635338 (334h19m5.840902959s) [noise=true , address=104.36.82.11:4120 , piece_id=ZVJDHQPPTGG7J4DCW23CUG3NVCEBSNDKSKUFBR6Q2XDIODKS2CRQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109646599 (334h19m5.84091423s) [noise=true , address=77.90.31.21:4902 , piece_id=XNNBMEIPPGRCIFPXHE4RDNBVMKYV777UVDTXYGBTFUXFPUUIL7HA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109856895 (334h19m5.841124525s) [noise=true , address=79.127.219.51:4206 , piece_id=DT27R7X4YZUNSZ2XDWKXLUMIXY6TD25FF473GE7V7Z6BXIJQB6WQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.110069735 (334h19m5.841337366s) [noise=true , address=79.127.201.215:4344 , piece_id=GLXLVWBVLX3WPDVC5G3CA2DAPPF3GZTTN4PKRSHV66H7KO2PGN7A, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.110276726 (334h19m5.841544345s) [noise=true , address=77.90.31.16:4738 , piece_id=XWJADL5V6LBSKWDI32TRV5NZNG2Y5KTWZRKP7HJQOIB3PD75IH4A, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.110529401 (334h19m5.841797031s) [noise=true , address=45.91.116.5:4326 , piece_id=TRF3G7F2SAC4KTRQ4TTMPP6H5GDH5C2ZGY5VOYT7Y6NCSRNLLZOA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.111701505 (334h19m5.842969136s) [noise=true , address=104.36.82.23:4466 , piece_id=OTU3SXJHJT23CBUEVT4NI7MPUBTWRW74FU7JATMGGEUC4FB6JDWA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.194907293 (334h19m5.926174913s) [upload=347532]: Next returned nil segment Aug 22 15:45:25.194933362 (334h19m5.926200992s) [upload=347532]: Waiting for error group managing segments... Aug 22 15:45:25.202079456 (334h19m5.933347077s) [noise=true , address=45.91.116.8:4066 , piece_id=42MWX3KB4OYNODSSONGQVRQHVQPNAYDN7BEQCLOWBFVISZKFV5UA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.202604625 (334h19m5.933872255s) [noise=true , address=79.127.219.51:4206 , piece_id=DT27R7X4YZUNSZ2XDWKXLUMIXY6TD25FF473GE7V7Z6BXIJQB6WQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.202778832 (334h19m5.934046452s) [noise=true , address=79.127.219.47:4061 , piece_id=PQK2BYCQVCQUECDHHHAPCAEOKZFQCNIL7UXXC7FW4QU36VTM53JQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.202957649 (334h19m5.934225279s) [noise=true , address=45.91.116.5:4326 , piece_id=TRF3G7F2SAC4KTRQ4TTMPP6H5GDH5C2ZGY5VOYT7Y6NCSRNLLZOA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.205554464 (334h19m5.936822084s) [noise=true , address=45.91.116.8:4070 , piece_id=2YPJJIPDFIV5SS57USBXJHJFKW4M5TQDVUMJNCERKIX5ZD452Z4A, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.207505926 (334h19m5.938773545s) [noise=true , address=104.36.82.60:4339 , piece_id=DCXJLRGTJK2TMID2RUBDVKWDOV4SRHAGVELLZY7TERPIACKO6HQQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.214577409 (334h19m5.945845039s) [noise=true , address=104.36.82.6:4880 , piece_id=CAUY7U2VJB6MPAPWANT4KYCCP3RGBWH3MA5WF4E7YO3X2KIGUWZA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.215183799 (334h19m5.946451429s) [noise=true , address=104.36.82.11:4120 , piece_id=ZVJDHQPPTGG7J4DCW23CUG3NVCEBSNDKSKUFBR6Q2XDIODKS2CRQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.227204945 (334h19m5.958472576s) [noise=true , address=77.90.31.16:4738 , piece_id=XWJADL5V6LBSKWDI32TRV5NZNG2Y5KTWZRKP7HJQOIB3PD75IH4A, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.231276064 (334h19m5.962543685s) [noise=true , address=77.90.31.15:4702 , piece_id=W37OSPHPZPTQYCHD73KXSAVSUTASTCJAGG3LWMQAPTSPIUUCKUUA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.232214379 (334h19m5.963482s) [noise=true , address=77.90.31.19:4868 , piece_id=PXGGATWZGDBGPRFNITEFZAYPMSEAJCASMWELNBSKCQAGCD54CVIQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.234490052 (334h19m5.965757682s) [noise=true , address=77.90.31.21:4902 , piece_id=XNNBMEIPPGRCIFPXHE4RDNBVMKYV777UVDTXYGBTFUXFPUUIL7HA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.242306687 (334h19m5.973574317s) [noise=true , address=77.90.31.10:4536 , piece_id=TB3NK2FHULSSUGXBUUWS5JZUEGCXFK3LORPWHSW6546UAUET6RXQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.251803884 (334h19m5.983071514s) [noise=true , address=104.36.82.23:4466 , piece_id=OTU3SXJHJT23CBUEVT4NI7MPUBTWRW74FU7JATMGGEUC4FB6JDWA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.251826296 (334h19m5.983093957s) [seg_pos={0 0}, upload=347532]: Segment reached optimal threshold of 14 pieces. Aug 22 15:45:25.251970888 (334h19m5.983238518s) [noise=true , address=45.91.116.11:4121 , piece_id=ZMXYNELKX2KHD5RWH2OU5ZZ7LOCPDAGX4GXB6UBW6J2US75UXWRA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wkujwGr7G6yGYFLiYcxfBnN1pmKY6mHXoAzZWAjGCCiWWZNdh): protocol: expected piece hash; context canceled; EOF Aug 22 15:45:25.252035119 (334h19m5.983302739s) [noise=true , address=77.90.31.12:4623 , piece_id=KMKYXHMWV2HUK53CPJF5USRWNF33FQBGMG5NPMRAMZAJTO3BU6AA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ANjFmZrb9SDcqEHW8CBzeMtwvmceoLH9MtPabAjBw8wXjBuaM): protocol: expected piece hash; context canceled; EOF Aug 22 15:45:25.252430574 (334h19m5.983698224s) [noise=true , address=104.36.82.44:4896 , piece_id=GCPBKLGUO337LW65K5PUCDZIMIM4SGKH2L2XYAJDR25KXPKS3QBQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ndSgjgfZMVQni5tw1ugdTrhJt4c4NagdvgYTbSbjatYYtfu1o): protocol: write tcp 5.161.89.252:59268->104.36.82.44:4896: use of closed network connection; write tcp 5.161.89.252:59268->104.36.82.44:4896: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:59268->104.36.82.44:4896: use of closed network connection Aug 22 15:45:25.252837219 (334h19m5.984104849s) [noise=true , address=79.127.201.215:4344 , piece_id=GLXLVWBVLX3WPDVC5G3CA2DAPPF3GZTTN4PKRSHV66H7KO2PGN7A, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: write tcp 5.161.89.252:10764->79.127.201.215:4344: use of closed network connection; write tcp 5.161.89.252:10764->79.127.201.215:4344: use of closed network connection Aug 22 15:45:25.252866453 (334h19m5.984134083s) [seg_pos={0 0}, upload=347532]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 15:45:25.253131663 (334h19m5.984399293s) [upload=347532]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 15:45:25.253146330 (334h19m5.984413981s) [upload=347532]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 15:45:25.422275527 (334h19m6.153543177s) [upload=347532]: Done uploading segments... Aug 22 15:45:25.422292930 (334h19m6.15356058s) [upload=347532]: Upload finished. err: <nil> Duration: 760.152596ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [....................X....X.....................X.......X....] duration: 1.754722402s FAIL (2025-08-22 15:48:16 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a332dec0f9830710718513902cda341fc779204e956c9b76c091b9655ff15791 != before fead3175f949e8f7847321a6a0be058f5ba8f9601d139b79b5db601e719df2b2 ======LOGS====== Aug 22 15:45:25.052387297 (334h19m5.783654927s) [upload=347532]: Starting upload Aug 22 15:45:25.052448271 (334h19m5.783715891s) [upload=347532]: Done starting upload Aug 22 15:45:25.052562306 (334h19m5.783829936s) [upload=347532]: Uploading segments... Aug 22 15:45:25.052661752 (334h19m5.783929383s) [upload=347532]: Got next segment. Inline: false Aug 22 15:45:25.052697329 (334h19m5.783964959s) [upload=347532]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 15:45:25.052702730 (334h19m5.783970379s) [upload=347532]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 15:45:25.108388744 (334h19m5.839656374s) [seg_pos={0 0}, upload=347532]: Begin upload segment... Aug 22 15:45:25.108436563 (334h19m5.839704193s) [seg_pos={0 0}, upload=347532]: Done begin upload segment. Aug 22 15:45:25.108458765 (334h19m5.839726395s) [noise=true , address=77.90.31.19:4868 , piece_id=PXGGATWZGDBGPRFNITEFZAYPMSEAJCASMWELNBSKCQAGCD54CVIQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108478472 (334h19m5.839746092s) [noise=true , address=45.91.116.8:4070 , piece_id=2YPJJIPDFIV5SS57USBXJHJFKW4M5TQDVUMJNCERKIX5ZD452Z4A, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108550818 (334h19m5.839818439s) [noise=true , address=45.91.116.11:4121 , piece_id=ZMXYNELKX2KHD5RWH2OU5ZZ7LOCPDAGX4GXB6UBW6J2US75UXWRA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108772846 (334h19m5.840040476s) [noise=true , address=104.36.82.6:4880 , piece_id=CAUY7U2VJB6MPAPWANT4KYCCP3RGBWH3MA5WF4E7YO3X2KIGUWZA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108781532 (334h19m5.840049162s) [noise=true , address=77.90.31.15:4702 , piece_id=W37OSPHPZPTQYCHD73KXSAVSUTASTCJAGG3LWMQAPTSPIUUCKUUA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108989513 (334h19m5.840257143s) [noise=true , address=77.90.31.12:4623 , piece_id=KMKYXHMWV2HUK53CPJF5USRWNF33FQBGMG5NPMRAMZAJTO3BU6AA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.108994733 (334h19m5.840262353s) [noise=true , address=104.36.82.60:4339 , piece_id=DCXJLRGTJK2TMID2RUBDVKWDOV4SRHAGVELLZY7TERPIACKO6HQQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109200140 (334h19m5.840467759s) [noise=true , address=77.90.31.10:4536 , piece_id=TB3NK2FHULSSUGXBUUWS5JZUEGCXFK3LORPWHSW6546UAUET6RXQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109204497 (334h19m5.840472127s) [noise=true , address=104.36.82.44:4896 , piece_id=GCPBKLGUO337LW65K5PUCDZIMIM4SGKH2L2XYAJDR25KXPKS3QBQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109422278 (334h19m5.840689908s) [noise=true , address=79.127.219.47:4061 , piece_id=PQK2BYCQVCQUECDHHHAPCAEOKZFQCNIL7UXXC7FW4QU36VTM53JQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109435232 (334h19m5.840702853s) [noise=true , address=45.91.116.8:4066 , piece_id=42MWX3KB4OYNODSSONGQVRQHVQPNAYDN7BEQCLOWBFVISZKFV5UA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109635338 (334h19m5.840902959s) [noise=true , address=104.36.82.11:4120 , piece_id=ZVJDHQPPTGG7J4DCW23CUG3NVCEBSNDKSKUFBR6Q2XDIODKS2CRQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109646599 (334h19m5.84091423s) [noise=true , address=77.90.31.21:4902 , piece_id=XNNBMEIPPGRCIFPXHE4RDNBVMKYV777UVDTXYGBTFUXFPUUIL7HA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.109856895 (334h19m5.841124525s) [noise=true , address=79.127.219.51:4206 , piece_id=DT27R7X4YZUNSZ2XDWKXLUMIXY6TD25FF473GE7V7Z6BXIJQB6WQ, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.110069735 (334h19m5.841337366s) [noise=true , address=79.127.201.215:4344 , piece_id=GLXLVWBVLX3WPDVC5G3CA2DAPPF3GZTTN4PKRSHV66H7KO2PGN7A, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.110276726 (334h19m5.841544345s) [noise=true , address=77.90.31.16:4738 , piece_id=XWJADL5V6LBSKWDI32TRV5NZNG2Y5KTWZRKP7HJQOIB3PD75IH4A, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.110529401 (334h19m5.841797031s) [noise=true , address=45.91.116.5:4326 , piece_id=TRF3G7F2SAC4KTRQ4TTMPP6H5GDH5C2ZGY5VOYT7Y6NCSRNLLZOA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.111701505 (334h19m5.842969136s) [noise=true , address=104.36.82.23:4466 , piece_id=OTU3SXJHJT23CBUEVT4NI7MPUBTWRW74FU7JATMGGEUC4FB6JDWA, seg_pos={0 0}, upload=347532]: Uploading piece... Aug 22 15:45:25.194907293 (334h19m5.926174913s) [upload=347532]: Next returned nil segment Aug 22 15:45:25.194933362 (334h19m5.926200992s) [upload=347532]: Waiting for error group managing segments... Aug 22 15:45:25.202079456 (334h19m5.933347077s) [noise=true , address=45.91.116.8:4066 , piece_id=42MWX3KB4OYNODSSONGQVRQHVQPNAYDN7BEQCLOWBFVISZKFV5UA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.202604625 (334h19m5.933872255s) [noise=true , address=79.127.219.51:4206 , piece_id=DT27R7X4YZUNSZ2XDWKXLUMIXY6TD25FF473GE7V7Z6BXIJQB6WQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.202778832 (334h19m5.934046452s) [noise=true , address=79.127.219.47:4061 , piece_id=PQK2BYCQVCQUECDHHHAPCAEOKZFQCNIL7UXXC7FW4QU36VTM53JQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.202957649 (334h19m5.934225279s) [noise=true , address=45.91.116.5:4326 , piece_id=TRF3G7F2SAC4KTRQ4TTMPP6H5GDH5C2ZGY5VOYT7Y6NCSRNLLZOA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.205554464 (334h19m5.936822084s) [noise=true , address=45.91.116.8:4070 , piece_id=2YPJJIPDFIV5SS57USBXJHJFKW4M5TQDVUMJNCERKIX5ZD452Z4A, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.207505926 (334h19m5.938773545s) [noise=true , address=104.36.82.60:4339 , piece_id=DCXJLRGTJK2TMID2RUBDVKWDOV4SRHAGVELLZY7TERPIACKO6HQQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.214577409 (334h19m5.945845039s) [noise=true , address=104.36.82.6:4880 , piece_id=CAUY7U2VJB6MPAPWANT4KYCCP3RGBWH3MA5WF4E7YO3X2KIGUWZA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.215183799 (334h19m5.946451429s) [noise=true , address=104.36.82.11:4120 , piece_id=ZVJDHQPPTGG7J4DCW23CUG3NVCEBSNDKSKUFBR6Q2XDIODKS2CRQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.227204945 (334h19m5.958472576s) [noise=true , address=77.90.31.16:4738 , piece_id=XWJADL5V6LBSKWDI32TRV5NZNG2Y5KTWZRKP7HJQOIB3PD75IH4A, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.231276064 (334h19m5.962543685s) [noise=true , address=77.90.31.15:4702 , piece_id=W37OSPHPZPTQYCHD73KXSAVSUTASTCJAGG3LWMQAPTSPIUUCKUUA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.232214379 (334h19m5.963482s) [noise=true , address=77.90.31.19:4868 , piece_id=PXGGATWZGDBGPRFNITEFZAYPMSEAJCASMWELNBSKCQAGCD54CVIQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.234490052 (334h19m5.965757682s) [noise=true , address=77.90.31.21:4902 , piece_id=XNNBMEIPPGRCIFPXHE4RDNBVMKYV777UVDTXYGBTFUXFPUUIL7HA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.242306687 (334h19m5.973574317s) [noise=true , address=77.90.31.10:4536 , piece_id=TB3NK2FHULSSUGXBUUWS5JZUEGCXFK3LORPWHSW6546UAUET6RXQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.251803884 (334h19m5.983071514s) [noise=true , address=104.36.82.23:4466 , piece_id=OTU3SXJHJT23CBUEVT4NI7MPUBTWRW74FU7JATMGGEUC4FB6JDWA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: <nil> Aug 22 15:45:25.251826296 (334h19m5.983093957s) [seg_pos={0 0}, upload=347532]: Segment reached optimal threshold of 14 pieces. Aug 22 15:45:25.251970888 (334h19m5.983238518s) [noise=true , address=45.91.116.11:4121 , piece_id=ZMXYNELKX2KHD5RWH2OU5ZZ7LOCPDAGX4GXB6UBW6J2US75UXWRA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wkujwGr7G6yGYFLiYcxfBnN1pmKY6mHXoAzZWAjGCCiWWZNdh): protocol: expected piece hash; context canceled; EOF Aug 22 15:45:25.252035119 (334h19m5.983302739s) [noise=true , address=77.90.31.12:4623 , piece_id=KMKYXHMWV2HUK53CPJF5USRWNF33FQBGMG5NPMRAMZAJTO3BU6AA, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ANjFmZrb9SDcqEHW8CBzeMtwvmceoLH9MtPabAjBw8wXjBuaM): protocol: expected piece hash; context canceled; EOF Aug 22 15:45:25.252430574 (334h19m5.983698224s) [noise=true , address=104.36.82.44:4896 , piece_id=GCPBKLGUO337LW65K5PUCDZIMIM4SGKH2L2XYAJDR25KXPKS3QBQ, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ndSgjgfZMVQni5tw1ugdTrhJt4c4NagdvgYTbSbjatYYtfu1o): protocol: write tcp 5.161.89.252:59268->104.36.82.44:4896: use of closed network connection; write tcp 5.161.89.252:59268->104.36.82.44:4896: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:59268->104.36.82.44:4896: use of closed network connection Aug 22 15:45:25.252837219 (334h19m5.984104849s) [noise=true , address=79.127.201.215:4344 , piece_id=GLXLVWBVLX3WPDVC5G3CA2DAPPF3GZTTN4PKRSHV66H7KO2PGN7A, seg_pos={0 0}, upload=347532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: write tcp 5.161.89.252:10764->79.127.201.215:4344: use of closed network connection; write tcp 5.161.89.252:10764->79.127.201.215:4344: use of closed network connection Aug 22 15:45:25.252866453 (334h19m5.984134083s) [seg_pos={0 0}, upload=347532]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 15:45:25.253131663 (334h19m5.984399293s) [upload=347532]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 15:45:25.253146330 (334h19m5.984413981s) [upload=347532]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 15:45:25.422275527 (334h19m6.153543177s) [upload=347532]: Done uploading segments... Aug 22 15:45:25.422292930 (334h19m6.15356058s) [upload=347532]: Upload finished. err: <nil> Duration: 1.754752728s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 2.619164833s FAIL (2025-08-22 15:48:11 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.61918447s core uplink ap1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)