Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [....X..................................X....................] duration: 769.365583ms FAIL (2025-08-15 05:57:22 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 15 05:44:22.781048516 (156h18m3.512316206s) [upload=162649]: Starting upload Aug 15 05:44:22.781143685 (156h18m3.512411345s) [upload=162649]: Done starting upload Aug 15 05:44:22.781205261 (156h18m3.51247291s) [upload=162649]: Uploading segments... Aug 15 05:44:22.781552763 (156h18m3.512820423s) [upload=162649]: Got next segment. Inline: false Aug 15 05:44:22.781613949 (156h18m3.512881639s) [upload=162649]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 05:44:22.781623357 (156h18m3.512891007s) [upload=162649]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 15 05:44:22.853583217 (156h18m3.584850848s) [seg_pos={0 0}, upload=162649]: Begin upload segment... Aug 15 05:44:22.853614857 (156h18m3.584882487s) [seg_pos={0 0}, upload=162649]: Done begin upload segment. Aug 15 05:44:22.853622912 (156h18m3.584890532s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.853630877 (156h18m3.584898507s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.853960808 (156h18m3.585228438s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854221948 (156h18m3.585489578s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854487648 (156h18m3.585755278s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854706198 (156h18m3.585973818s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854916283 (156h18m3.586183903s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855122541 (156h18m3.586390161s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855323318 (156h18m3.586590939s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855572116 (156h18m3.586839736s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855783854 (156h18m3.587051484s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856043823 (156h18m3.587311442s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856221917 (156h18m3.587489547s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856474260 (156h18m3.587741891s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856684717 (156h18m3.587952347s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856890473 (156h18m3.588158103s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.857137107 (156h18m3.588404727s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.857407986 (156h18m3.588675616s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.931933679 (156h18m3.663201319s) [upload=162649]: Next returned nil segment Aug 15 05:44:22.931946533 (156h18m3.663214163s) [upload=162649]: Waiting for error group managing segments... Aug 15 05:44:22.941125163 (156h18m3.672392803s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.941816452 (156h18m3.673084082s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.942102801 (156h18m3.673370441s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.942329847 (156h18m3.673597477s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.942519253 (156h18m3.673786883s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.944005966 (156h18m3.675273607s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.945343752 (156h18m3.676611392s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.948716731 (156h18m3.679984381s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.954674047 (156h18m3.685941687s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.956262041 (156h18m3.687529671s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.964011115 (156h18m3.695278766s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.973878009 (156h18m3.705145659s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:23.033905123 (156h18m3.765172773s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:23.039146835 (156h18m3.770414484s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:23.039177702 (156h18m3.770445353s) [seg_pos={0 0}, upload=162649]: Segment reached optimal threshold of 14 pieces. Aug 15 05:44:23.039726664 (156h18m3.770994314s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: read tcp 5.161.89.252:55162->66.23.193.175:4556: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 05:44:23.039827213 (156h18m3.771094874s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KNKWRTR6pZfxWFcFwsEKaqGsUMBBSTBsxvmeKsV1GDfEBvQk7): protocol: read tcp 5.161.89.252:18818->79.127.201.215:4352: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 05:44:23.039977666 (156h18m3.771245316s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DsmdSnS2m7eL7TKCoyegaYK46jVo96qXPMxQWSaSCdZ7NbdKm): protocol: read tcp 5.161.89.252:24186->64.49.13.169:4714: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 05:44:23.040119473 (156h18m3.771387133s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eqkG9kQB7wFYRNUY3P77MLwBrwXKuEXvJku3B63FZn6rK5y5d): protocol: context canceled; context canceled Aug 15 05:44:23.040146273 (156h18m3.771413923s) [seg_pos={0 0}, upload=162649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 15 05:44:23.040241311 (156h18m3.771508962s) [upload=162649]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 15 05:44:23.040250929 (156h18m3.77151862s) [upload=162649]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 05:44:23.148699216 (156h18m3.879966877s) [upload=162649]: Done uploading segments... Aug 15 05:44:23.148718513 (156h18m3.879986163s) [upload=162649]: Upload finished. err: <nil> Duration: 769.388467ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [........X.....X...............X.............................] duration: 426.707287ms FAIL (2025-08-15 05:57:21 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:39:32.377895512 (156h13m13.109163133s) [upload=162565]: Starting upload Aug 15 05:39:32.377934446 (156h13m13.109202066s) [upload=162565]: Done starting upload Aug 15 05:39:32.377970092 (156h13m13.109237722s) [upload=162565]: Uploading segments... Aug 15 05:39:32.378004016 (156h13m13.109271646s) [upload=162565]: Got next segment. Inline: true Aug 15 05:39:32.378008174 (156h13m13.109275794s) [upload=162565]: Waiting for error group managing segments... Aug 15 05:39:32.378039042 (156h13m13.109306672s) [upload=162565]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 05:39:32.378042799 (156h13m13.109310429s) [upload=162565]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 15 05:39:32.378045124 (156h13m13.109312754s) [upload=162565]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 05:39:32.380223698 (156h13m13.111491318s) [upload=162565]: Done uploading segments... Aug 15 05:39:32.380230541 (156h13m13.111498161s) [upload=162565]: Upload finished. err: metaclient: Too Many Requests Duration:* 426.720143ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.........X.....X...............X............................] duration: 111.977462ms FAIL (2025-08-15 05:56:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:39:32.377895512 (156h13m13.109163133s) [upload=162565]: Starting upload Aug 15 05:39:32.377934446 (156h13m13.109202066s) [upload=162565]: Done starting upload Aug 15 05:39:32.377970092 (156h13m13.109237722s) [upload=162565]: Uploading segments... Aug 15 05:39:32.378004016 (156h13m13.109271646s) [upload=162565]: Got next segment. Inline: true Aug 15 05:39:32.378008174 (156h13m13.109275794s) [upload=162565]: Waiting for error group managing segments... Aug 15 05:39:32.378039042 (156h13m13.109306672s) [upload=162565]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 05:39:32.378042799 (156h13m13.109310429s) [upload=162565]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 15 05:39:32.378045124 (156h13m13.109312754s) [upload=162565]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 05:39:32.380223698 (156h13m13.111491318s) [upload=162565]: Done uploading segments... Aug 15 05:39:32.380230541 (156h13m13.111498161s) [upload=162565]: Upload finished. err: metaclient: Too Many Requests Duration:* 111.997179ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....X..................................X...................] duration: 567.722525ms FAIL (2025-08-15 05:56:29 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 15 05:44:22.781048516 (156h18m3.512316206s) [upload=162649]: Starting upload Aug 15 05:44:22.781143685 (156h18m3.512411345s) [upload=162649]: Done starting upload Aug 15 05:44:22.781205261 (156h18m3.51247291s) [upload=162649]: Uploading segments... Aug 15 05:44:22.781552763 (156h18m3.512820423s) [upload=162649]: Got next segment. Inline: false Aug 15 05:44:22.781613949 (156h18m3.512881639s) [upload=162649]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 05:44:22.781623357 (156h18m3.512891007s) [upload=162649]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 15 05:44:22.853583217 (156h18m3.584850848s) [seg_pos={0 0}, upload=162649]: Begin upload segment... Aug 15 05:44:22.853614857 (156h18m3.584882487s) [seg_pos={0 0}, upload=162649]: Done begin upload segment. Aug 15 05:44:22.853622912 (156h18m3.584890532s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.853630877 (156h18m3.584898507s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.853960808 (156h18m3.585228438s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854221948 (156h18m3.585489578s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854487648 (156h18m3.585755278s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854706198 (156h18m3.585973818s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854916283 (156h18m3.586183903s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855122541 (156h18m3.586390161s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855323318 (156h18m3.586590939s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855572116 (156h18m3.586839736s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855783854 (156h18m3.587051484s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856043823 (156h18m3.587311442s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856221917 (156h18m3.587489547s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856474260 (156h18m3.587741891s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856684717 (156h18m3.587952347s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856890473 (156h18m3.588158103s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.857137107 (156h18m3.588404727s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.857407986 (156h18m3.588675616s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.931933679 (156h18m3.663201319s) [upload=162649]: Next returned nil segment Aug 15 05:44:22.931946533 (156h18m3.663214163s) [upload=162649]: Waiting for error group managing segments... Aug 15 05:44:22.941125163 (156h18m3.672392803s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.941816452 (156h18m3.673084082s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.942102801 (156h18m3.673370441s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.942329847 (156h18m3.673597477s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.942519253 (156h18m3.673786883s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.944005966 (156h18m3.675273607s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.945343752 (156h18m3.676611392s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.948716731 (156h18m3.679984381s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.954674047 (156h18m3.685941687s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.956262041 (156h18m3.687529671s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.964011115 (156h18m3.695278766s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.973878009 (156h18m3.705145659s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:23.033905123 (156h18m3.765172773s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:23.039146835 (156h18m3.770414484s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:23.039177702 (156h18m3.770445353s) [seg_pos={0 0}, upload=162649]: Segment reached optimal threshold of 14 pieces. Aug 15 05:44:23.039726664 (156h18m3.770994314s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: read tcp 5.161.89.252:55162->66.23.193.175:4556: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 05:44:23.039827213 (156h18m3.771094874s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KNKWRTR6pZfxWFcFwsEKaqGsUMBBSTBsxvmeKsV1GDfEBvQk7): protocol: read tcp 5.161.89.252:18818->79.127.201.215:4352: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 05:44:23.039977666 (156h18m3.771245316s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DsmdSnS2m7eL7TKCoyegaYK46jVo96qXPMxQWSaSCdZ7NbdKm): protocol: read tcp 5.161.89.252:24186->64.49.13.169:4714: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 05:44:23.040119473 (156h18m3.771387133s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eqkG9kQB7wFYRNUY3P77MLwBrwXKuEXvJku3B63FZn6rK5y5d): protocol: context canceled; context canceled Aug 15 05:44:23.040146273 (156h18m3.771413923s) [seg_pos={0 0}, upload=162649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 15 05:44:23.040241311 (156h18m3.771508962s) [upload=162649]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 15 05:44:23.040250929 (156h18m3.77151862s) [upload=162649]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 05:44:23.148699216 (156h18m3.879966877s) [upload=162649]: Done uploading segments... Aug 15 05:44:23.148718513 (156h18m3.879986163s) [upload=162649]: Upload finished. err: <nil> Duration: 567.734697ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 161.413125ms FAIL (2025-08-15 05:56:25 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 161.435196ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..........X.....X...............X...........................] duration: 118.876382ms FAIL (2025-08-15 05:56:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:39:32.377895512 (156h13m13.109163133s) [upload=162565]: Starting upload Aug 15 05:39:32.377934446 (156h13m13.109202066s) [upload=162565]: Done starting upload Aug 15 05:39:32.377970092 (156h13m13.109237722s) [upload=162565]: Uploading segments... Aug 15 05:39:32.378004016 (156h13m13.109271646s) [upload=162565]: Got next segment. Inline: true Aug 15 05:39:32.378008174 (156h13m13.109275794s) [upload=162565]: Waiting for error group managing segments... Aug 15 05:39:32.378039042 (156h13m13.109306672s) [upload=162565]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 05:39:32.378042799 (156h13m13.109310429s) [upload=162565]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 15 05:39:32.378045124 (156h13m13.109312754s) [upload=162565]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 05:39:32.380223698 (156h13m13.111491318s) [upload=162565]: Done uploading segments... Aug 15 05:39:32.380230541 (156h13m13.111498161s) [upload=162565]: Upload finished. err: metaclient: Too Many Requests Duration:* 118.894816ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [......X..................................X..................] duration: 361.168849ms FAIL (2025-08-15 05:56:01 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 15 05:44:22.781048516 (156h18m3.512316206s) [upload=162649]: Starting upload Aug 15 05:44:22.781143685 (156h18m3.512411345s) [upload=162649]: Done starting upload Aug 15 05:44:22.781205261 (156h18m3.51247291s) [upload=162649]: Uploading segments... Aug 15 05:44:22.781552763 (156h18m3.512820423s) [upload=162649]: Got next segment. Inline: false Aug 15 05:44:22.781613949 (156h18m3.512881639s) [upload=162649]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 05:44:22.781623357 (156h18m3.512891007s) [upload=162649]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 15 05:44:22.853583217 (156h18m3.584850848s) [seg_pos={0 0}, upload=162649]: Begin upload segment... Aug 15 05:44:22.853614857 (156h18m3.584882487s) [seg_pos={0 0}, upload=162649]: Done begin upload segment. Aug 15 05:44:22.853622912 (156h18m3.584890532s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.853630877 (156h18m3.584898507s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.853960808 (156h18m3.585228438s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854221948 (156h18m3.585489578s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854487648 (156h18m3.585755278s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854706198 (156h18m3.585973818s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854916283 (156h18m3.586183903s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855122541 (156h18m3.586390161s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855323318 (156h18m3.586590939s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855572116 (156h18m3.586839736s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855783854 (156h18m3.587051484s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856043823 (156h18m3.587311442s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856221917 (156h18m3.587489547s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856474260 (156h18m3.587741891s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856684717 (156h18m3.587952347s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856890473 (156h18m3.588158103s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.857137107 (156h18m3.588404727s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.857407986 (156h18m3.588675616s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.931933679 (156h18m3.663201319s) [upload=162649]: Next returned nil segment Aug 15 05:44:22.931946533 (156h18m3.663214163s) [upload=162649]: Waiting for error group managing segments... Aug 15 05:44:22.941125163 (156h18m3.672392803s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.941816452 (156h18m3.673084082s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.942102801 (156h18m3.673370441s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.942329847 (156h18m3.673597477s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.942519253 (156h18m3.673786883s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.944005966 (156h18m3.675273607s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.945343752 (156h18m3.676611392s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.948716731 (156h18m3.679984381s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.954674047 (156h18m3.685941687s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.956262041 (156h18m3.687529671s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.964011115 (156h18m3.695278766s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.973878009 (156h18m3.705145659s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:23.033905123 (156h18m3.765172773s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:23.039146835 (156h18m3.770414484s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:23.039177702 (156h18m3.770445353s) [seg_pos={0 0}, upload=162649]: Segment reached optimal threshold of 14 pieces. Aug 15 05:44:23.039726664 (156h18m3.770994314s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: read tcp 5.161.89.252:55162->66.23.193.175:4556: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 05:44:23.039827213 (156h18m3.771094874s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KNKWRTR6pZfxWFcFwsEKaqGsUMBBSTBsxvmeKsV1GDfEBvQk7): protocol: read tcp 5.161.89.252:18818->79.127.201.215:4352: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 05:44:23.039977666 (156h18m3.771245316s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DsmdSnS2m7eL7TKCoyegaYK46jVo96qXPMxQWSaSCdZ7NbdKm): protocol: read tcp 5.161.89.252:24186->64.49.13.169:4714: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 05:44:23.040119473 (156h18m3.771387133s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eqkG9kQB7wFYRNUY3P77MLwBrwXKuEXvJku3B63FZn6rK5y5d): protocol: context canceled; context canceled Aug 15 05:44:23.040146273 (156h18m3.771413923s) [seg_pos={0 0}, upload=162649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 15 05:44:23.040241311 (156h18m3.771508962s) [upload=162649]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 15 05:44:23.040250929 (156h18m3.77151862s) [upload=162649]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 05:44:23.148699216 (156h18m3.879966877s) [upload=162649]: Done uploading segments... Aug 15 05:44:23.148718513 (156h18m3.879986163s) [upload=162649]: Upload finished. err: <nil> Duration: 361.202832ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......X..................................X.................] duration: 374.616771ms FAIL (2025-08-15 05:55:32 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 15 05:44:22.781048516 (156h18m3.512316206s) [upload=162649]: Starting upload Aug 15 05:44:22.781143685 (156h18m3.512411345s) [upload=162649]: Done starting upload Aug 15 05:44:22.781205261 (156h18m3.51247291s) [upload=162649]: Uploading segments... Aug 15 05:44:22.781552763 (156h18m3.512820423s) [upload=162649]: Got next segment. Inline: false Aug 15 05:44:22.781613949 (156h18m3.512881639s) [upload=162649]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 05:44:22.781623357 (156h18m3.512891007s) [upload=162649]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 15 05:44:22.853583217 (156h18m3.584850848s) [seg_pos={0 0}, upload=162649]: Begin upload segment... Aug 15 05:44:22.853614857 (156h18m3.584882487s) [seg_pos={0 0}, upload=162649]: Done begin upload segment. Aug 15 05:44:22.853622912 (156h18m3.584890532s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.853630877 (156h18m3.584898507s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.853960808 (156h18m3.585228438s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854221948 (156h18m3.585489578s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854487648 (156h18m3.585755278s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854706198 (156h18m3.585973818s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854916283 (156h18m3.586183903s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855122541 (156h18m3.586390161s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855323318 (156h18m3.586590939s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855572116 (156h18m3.586839736s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855783854 (156h18m3.587051484s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856043823 (156h18m3.587311442s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856221917 (156h18m3.587489547s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856474260 (156h18m3.587741891s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856684717 (156h18m3.587952347s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856890473 (156h18m3.588158103s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.857137107 (156h18m3.588404727s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.857407986 (156h18m3.588675616s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.931933679 (156h18m3.663201319s) [upload=162649]: Next returned nil segment Aug 15 05:44:22.931946533 (156h18m3.663214163s) [upload=162649]: Waiting for error group managing segments... Aug 15 05:44:22.941125163 (156h18m3.672392803s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.941816452 (156h18m3.673084082s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.942102801 (156h18m3.673370441s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.942329847 (156h18m3.673597477s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.942519253 (156h18m3.673786883s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.944005966 (156h18m3.675273607s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.945343752 (156h18m3.676611392s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.948716731 (156h18m3.679984381s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.954674047 (156h18m3.685941687s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.956262041 (156h18m3.687529671s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.964011115 (156h18m3.695278766s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.973878009 (156h18m3.705145659s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:23.033905123 (156h18m3.765172773s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:23.039146835 (156h18m3.770414484s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:23.039177702 (156h18m3.770445353s) [seg_pos={0 0}, upload=162649]: Segment reached optimal threshold of 14 pieces. Aug 15 05:44:23.039726664 (156h18m3.770994314s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: read tcp 5.161.89.252:55162->66.23.193.175:4556: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 05:44:23.039827213 (156h18m3.771094874s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KNKWRTR6pZfxWFcFwsEKaqGsUMBBSTBsxvmeKsV1GDfEBvQk7): protocol: read tcp 5.161.89.252:18818->79.127.201.215:4352: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 05:44:23.039977666 (156h18m3.771245316s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DsmdSnS2m7eL7TKCoyegaYK46jVo96qXPMxQWSaSCdZ7NbdKm): protocol: read tcp 5.161.89.252:24186->64.49.13.169:4714: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 05:44:23.040119473 (156h18m3.771387133s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eqkG9kQB7wFYRNUY3P77MLwBrwXKuEXvJku3B63FZn6rK5y5d): protocol: context canceled; context canceled Aug 15 05:44:23.040146273 (156h18m3.771413923s) [seg_pos={0 0}, upload=162649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 15 05:44:23.040241311 (156h18m3.771508962s) [upload=162649]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 15 05:44:23.040250929 (156h18m3.77151862s) [upload=162649]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 05:44:23.148699216 (156h18m3.879966877s) [upload=162649]: Done uploading segments... Aug 15 05:44:23.148718513 (156h18m3.879986163s) [upload=162649]: Upload finished. err: <nil> Duration: 374.633313ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 201.486037ms FAIL (2025-08-15 05:55:32 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 201.509601ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [........X..................................X................] duration: 394.738365ms FAIL (2025-08-15 05:55:14 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 15 05:44:22.781048516 (156h18m3.512316206s) [upload=162649]: Starting upload Aug 15 05:44:22.781143685 (156h18m3.512411345s) [upload=162649]: Done starting upload Aug 15 05:44:22.781205261 (156h18m3.51247291s) [upload=162649]: Uploading segments... Aug 15 05:44:22.781552763 (156h18m3.512820423s) [upload=162649]: Got next segment. Inline: false Aug 15 05:44:22.781613949 (156h18m3.512881639s) [upload=162649]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 05:44:22.781623357 (156h18m3.512891007s) [upload=162649]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 15 05:44:22.853583217 (156h18m3.584850848s) [seg_pos={0 0}, upload=162649]: Begin upload segment... Aug 15 05:44:22.853614857 (156h18m3.584882487s) [seg_pos={0 0}, upload=162649]: Done begin upload segment. Aug 15 05:44:22.853622912 (156h18m3.584890532s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.853630877 (156h18m3.584898507s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.853960808 (156h18m3.585228438s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854221948 (156h18m3.585489578s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854487648 (156h18m3.585755278s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854706198 (156h18m3.585973818s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854916283 (156h18m3.586183903s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855122541 (156h18m3.586390161s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855323318 (156h18m3.586590939s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855572116 (156h18m3.586839736s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855783854 (156h18m3.587051484s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856043823 (156h18m3.587311442s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856221917 (156h18m3.587489547s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856474260 (156h18m3.587741891s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856684717 (156h18m3.587952347s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856890473 (156h18m3.588158103s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.857137107 (156h18m3.588404727s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.857407986 (156h18m3.588675616s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.931933679 (156h18m3.663201319s) [upload=162649]: Next returned nil segment Aug 15 05:44:22.931946533 (156h18m3.663214163s) [upload=162649]: Waiting for error group managing segments... Aug 15 05:44:22.941125163 (156h18m3.672392803s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.941816452 (156h18m3.673084082s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.942102801 (156h18m3.673370441s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.942329847 (156h18m3.673597477s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.942519253 (156h18m3.673786883s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.944005966 (156h18m3.675273607s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.945343752 (156h18m3.676611392s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.948716731 (156h18m3.679984381s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.954674047 (156h18m3.685941687s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.956262041 (156h18m3.687529671s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.964011115 (156h18m3.695278766s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.973878009 (156h18m3.705145659s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:23.033905123 (156h18m3.765172773s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:23.039146835 (156h18m3.770414484s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:23.039177702 (156h18m3.770445353s) [seg_pos={0 0}, upload=162649]: Segment reached optimal threshold of 14 pieces. Aug 15 05:44:23.039726664 (156h18m3.770994314s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: read tcp 5.161.89.252:55162->66.23.193.175:4556: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 05:44:23.039827213 (156h18m3.771094874s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KNKWRTR6pZfxWFcFwsEKaqGsUMBBSTBsxvmeKsV1GDfEBvQk7): protocol: read tcp 5.161.89.252:18818->79.127.201.215:4352: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 05:44:23.039977666 (156h18m3.771245316s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DsmdSnS2m7eL7TKCoyegaYK46jVo96qXPMxQWSaSCdZ7NbdKm): protocol: read tcp 5.161.89.252:24186->64.49.13.169:4714: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 05:44:23.040119473 (156h18m3.771387133s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eqkG9kQB7wFYRNUY3P77MLwBrwXKuEXvJku3B63FZn6rK5y5d): protocol: context canceled; context canceled Aug 15 05:44:23.040146273 (156h18m3.771413923s) [seg_pos={0 0}, upload=162649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 15 05:44:23.040241311 (156h18m3.771508962s) [upload=162649]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 15 05:44:23.040250929 (156h18m3.77151862s) [upload=162649]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 05:44:23.148699216 (156h18m3.879966877s) [upload=162649]: Done uploading segments... Aug 15 05:44:23.148718513 (156h18m3.879986163s) [upload=162649]: Upload finished. err: <nil> Duration: 394.761469ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...........X.....X...............X..........................] duration: 171.650528ms FAIL (2025-08-15 05:55:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:39:32.377895512 (156h13m13.109163133s) [upload=162565]: Starting upload Aug 15 05:39:32.377934446 (156h13m13.109202066s) [upload=162565]: Done starting upload Aug 15 05:39:32.377970092 (156h13m13.109237722s) [upload=162565]: Uploading segments... Aug 15 05:39:32.378004016 (156h13m13.109271646s) [upload=162565]: Got next segment. Inline: true Aug 15 05:39:32.378008174 (156h13m13.109275794s) [upload=162565]: Waiting for error group managing segments... Aug 15 05:39:32.378039042 (156h13m13.109306672s) [upload=162565]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 05:39:32.378042799 (156h13m13.109310429s) [upload=162565]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 15 05:39:32.378045124 (156h13m13.109312754s) [upload=162565]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 05:39:32.380223698 (156h13m13.111491318s) [upload=162565]: Done uploading segments... Aug 15 05:39:32.380230541 (156h13m13.111498161s) [upload=162565]: Upload finished. err: metaclient: Too Many Requests Duration:* 171.663663ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 290.800107ms FAIL (2025-08-15 05:54:50 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 290.820175ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [............X.....X...............X.........................] duration: 130.486308ms FAIL (2025-08-15 05:54:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:39:32.377895512 (156h13m13.109163133s) [upload=162565]: Starting upload Aug 15 05:39:32.377934446 (156h13m13.109202066s) [upload=162565]: Done starting upload Aug 15 05:39:32.377970092 (156h13m13.109237722s) [upload=162565]: Uploading segments... Aug 15 05:39:32.378004016 (156h13m13.109271646s) [upload=162565]: Got next segment. Inline: true Aug 15 05:39:32.378008174 (156h13m13.109275794s) [upload=162565]: Waiting for error group managing segments... Aug 15 05:39:32.378039042 (156h13m13.109306672s) [upload=162565]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 05:39:32.378042799 (156h13m13.109310429s) [upload=162565]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 15 05:39:32.378045124 (156h13m13.109312754s) [upload=162565]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 05:39:32.380223698 (156h13m13.111491318s) [upload=162565]: Done uploading segments... Aug 15 05:39:32.380230541 (156h13m13.111498161s) [upload=162565]: Upload finished. err: metaclient: Too Many Requests Duration:* 130.514533ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........X..................................X...............] duration: 716.796791ms FAIL (2025-08-15 05:54:40 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 15 05:44:22.781048516 (156h18m3.512316206s) [upload=162649]: Starting upload Aug 15 05:44:22.781143685 (156h18m3.512411345s) [upload=162649]: Done starting upload Aug 15 05:44:22.781205261 (156h18m3.51247291s) [upload=162649]: Uploading segments... Aug 15 05:44:22.781552763 (156h18m3.512820423s) [upload=162649]: Got next segment. Inline: false Aug 15 05:44:22.781613949 (156h18m3.512881639s) [upload=162649]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 05:44:22.781623357 (156h18m3.512891007s) [upload=162649]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 15 05:44:22.853583217 (156h18m3.584850848s) [seg_pos={0 0}, upload=162649]: Begin upload segment... Aug 15 05:44:22.853614857 (156h18m3.584882487s) [seg_pos={0 0}, upload=162649]: Done begin upload segment. Aug 15 05:44:22.853622912 (156h18m3.584890532s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.853630877 (156h18m3.584898507s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.853960808 (156h18m3.585228438s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854221948 (156h18m3.585489578s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854487648 (156h18m3.585755278s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854706198 (156h18m3.585973818s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854916283 (156h18m3.586183903s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855122541 (156h18m3.586390161s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855323318 (156h18m3.586590939s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855572116 (156h18m3.586839736s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855783854 (156h18m3.587051484s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856043823 (156h18m3.587311442s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856221917 (156h18m3.587489547s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856474260 (156h18m3.587741891s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856684717 (156h18m3.587952347s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856890473 (156h18m3.588158103s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.857137107 (156h18m3.588404727s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.857407986 (156h18m3.588675616s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.931933679 (156h18m3.663201319s) [upload=162649]: Next returned nil segment Aug 15 05:44:22.931946533 (156h18m3.663214163s) [upload=162649]: Waiting for error group managing segments... Aug 15 05:44:22.941125163 (156h18m3.672392803s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.941816452 (156h18m3.673084082s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.942102801 (156h18m3.673370441s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.942329847 (156h18m3.673597477s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.942519253 (156h18m3.673786883s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.944005966 (156h18m3.675273607s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.945343752 (156h18m3.676611392s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.948716731 (156h18m3.679984381s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.954674047 (156h18m3.685941687s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.956262041 (156h18m3.687529671s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.964011115 (156h18m3.695278766s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.973878009 (156h18m3.705145659s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:23.033905123 (156h18m3.765172773s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:23.039146835 (156h18m3.770414484s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:23.039177702 (156h18m3.770445353s) [seg_pos={0 0}, upload=162649]: Segment reached optimal threshold of 14 pieces. Aug 15 05:44:23.039726664 (156h18m3.770994314s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: read tcp 5.161.89.252:55162->66.23.193.175:4556: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 05:44:23.039827213 (156h18m3.771094874s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KNKWRTR6pZfxWFcFwsEKaqGsUMBBSTBsxvmeKsV1GDfEBvQk7): protocol: read tcp 5.161.89.252:18818->79.127.201.215:4352: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 05:44:23.039977666 (156h18m3.771245316s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DsmdSnS2m7eL7TKCoyegaYK46jVo96qXPMxQWSaSCdZ7NbdKm): protocol: read tcp 5.161.89.252:24186->64.49.13.169:4714: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 05:44:23.040119473 (156h18m3.771387133s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eqkG9kQB7wFYRNUY3P77MLwBrwXKuEXvJku3B63FZn6rK5y5d): protocol: context canceled; context canceled Aug 15 05:44:23.040146273 (156h18m3.771413923s) [seg_pos={0 0}, upload=162649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 15 05:44:23.040241311 (156h18m3.771508962s) [upload=162649]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 15 05:44:23.040250929 (156h18m3.77151862s) [upload=162649]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 05:44:23.148699216 (156h18m3.879966877s) [upload=162649]: Done uploading segments... Aug 15 05:44:23.148718513 (156h18m3.879986163s) [upload=162649]: Upload finished. err: <nil> Duration: 716.815226ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........X..................................X..............] duration: 394.610364ms FAIL (2025-08-15 05:54:24 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 15 05:44:22.781048516 (156h18m3.512316206s) [upload=162649]: Starting upload Aug 15 05:44:22.781143685 (156h18m3.512411345s) [upload=162649]: Done starting upload Aug 15 05:44:22.781205261 (156h18m3.51247291s) [upload=162649]: Uploading segments... Aug 15 05:44:22.781552763 (156h18m3.512820423s) [upload=162649]: Got next segment. Inline: false Aug 15 05:44:22.781613949 (156h18m3.512881639s) [upload=162649]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 05:44:22.781623357 (156h18m3.512891007s) [upload=162649]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 15 05:44:22.853583217 (156h18m3.584850848s) [seg_pos={0 0}, upload=162649]: Begin upload segment... Aug 15 05:44:22.853614857 (156h18m3.584882487s) [seg_pos={0 0}, upload=162649]: Done begin upload segment. Aug 15 05:44:22.853622912 (156h18m3.584890532s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.853630877 (156h18m3.584898507s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.853960808 (156h18m3.585228438s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854221948 (156h18m3.585489578s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854487648 (156h18m3.585755278s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854706198 (156h18m3.585973818s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854916283 (156h18m3.586183903s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855122541 (156h18m3.586390161s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855323318 (156h18m3.586590939s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855572116 (156h18m3.586839736s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855783854 (156h18m3.587051484s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856043823 (156h18m3.587311442s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856221917 (156h18m3.587489547s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856474260 (156h18m3.587741891s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856684717 (156h18m3.587952347s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856890473 (156h18m3.588158103s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.857137107 (156h18m3.588404727s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.857407986 (156h18m3.588675616s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.931933679 (156h18m3.663201319s) [upload=162649]: Next returned nil segment Aug 15 05:44:22.931946533 (156h18m3.663214163s) [upload=162649]: Waiting for error group managing segments... Aug 15 05:44:22.941125163 (156h18m3.672392803s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.941816452 (156h18m3.673084082s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.942102801 (156h18m3.673370441s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.942329847 (156h18m3.673597477s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.942519253 (156h18m3.673786883s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.944005966 (156h18m3.675273607s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.945343752 (156h18m3.676611392s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.948716731 (156h18m3.679984381s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.954674047 (156h18m3.685941687s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.956262041 (156h18m3.687529671s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.964011115 (156h18m3.695278766s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.973878009 (156h18m3.705145659s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:23.033905123 (156h18m3.765172773s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:23.039146835 (156h18m3.770414484s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:23.039177702 (156h18m3.770445353s) [seg_pos={0 0}, upload=162649]: Segment reached optimal threshold of 14 pieces. Aug 15 05:44:23.039726664 (156h18m3.770994314s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: read tcp 5.161.89.252:55162->66.23.193.175:4556: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 05:44:23.039827213 (156h18m3.771094874s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KNKWRTR6pZfxWFcFwsEKaqGsUMBBSTBsxvmeKsV1GDfEBvQk7): protocol: read tcp 5.161.89.252:18818->79.127.201.215:4352: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 05:44:23.039977666 (156h18m3.771245316s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DsmdSnS2m7eL7TKCoyegaYK46jVo96qXPMxQWSaSCdZ7NbdKm): protocol: read tcp 5.161.89.252:24186->64.49.13.169:4714: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 05:44:23.040119473 (156h18m3.771387133s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eqkG9kQB7wFYRNUY3P77MLwBrwXKuEXvJku3B63FZn6rK5y5d): protocol: context canceled; context canceled Aug 15 05:44:23.040146273 (156h18m3.771413923s) [seg_pos={0 0}, upload=162649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 15 05:44:23.040241311 (156h18m3.771508962s) [upload=162649]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 15 05:44:23.040250929 (156h18m3.77151862s) [upload=162649]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 05:44:23.148699216 (156h18m3.879966877s) [upload=162649]: Done uploading segments... Aug 15 05:44:23.148718513 (156h18m3.879986163s) [upload=162649]: Upload finished. err: <nil> Duration: 394.631092ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.............X.....X...............X........................] duration: 215.23227ms FAIL (2025-08-15 05:54:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:39:32.377895512 (156h13m13.109163133s) [upload=162565]: Starting upload Aug 15 05:39:32.377934446 (156h13m13.109202066s) [upload=162565]: Done starting upload Aug 15 05:39:32.377970092 (156h13m13.109237722s) [upload=162565]: Uploading segments... Aug 15 05:39:32.378004016 (156h13m13.109271646s) [upload=162565]: Got next segment. Inline: true Aug 15 05:39:32.378008174 (156h13m13.109275794s) [upload=162565]: Waiting for error group managing segments... Aug 15 05:39:32.378039042 (156h13m13.109306672s) [upload=162565]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 05:39:32.378042799 (156h13m13.109310429s) [upload=162565]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 15 05:39:32.378045124 (156h13m13.109312754s) [upload=162565]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 05:39:32.380223698 (156h13m13.111491318s) [upload=162565]: Done uploading segments... Aug 15 05:39:32.380230541 (156h13m13.111498161s) [upload=162565]: Upload finished. err: metaclient: Too Many Requests Duration:* 215.272325ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 838.022622ms FAIL (2025-08-15 05:54:01 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 838.04305ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...........X..................................X.............] duration: 549.64035ms FAIL (2025-08-15 05:53:45 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 15 05:44:22.781048516 (156h18m3.512316206s) [upload=162649]: Starting upload Aug 15 05:44:22.781143685 (156h18m3.512411345s) [upload=162649]: Done starting upload Aug 15 05:44:22.781205261 (156h18m3.51247291s) [upload=162649]: Uploading segments... Aug 15 05:44:22.781552763 (156h18m3.512820423s) [upload=162649]: Got next segment. Inline: false Aug 15 05:44:22.781613949 (156h18m3.512881639s) [upload=162649]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 05:44:22.781623357 (156h18m3.512891007s) [upload=162649]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 15 05:44:22.853583217 (156h18m3.584850848s) [seg_pos={0 0}, upload=162649]: Begin upload segment... Aug 15 05:44:22.853614857 (156h18m3.584882487s) [seg_pos={0 0}, upload=162649]: Done begin upload segment. Aug 15 05:44:22.853622912 (156h18m3.584890532s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.853630877 (156h18m3.584898507s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.853960808 (156h18m3.585228438s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854221948 (156h18m3.585489578s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854487648 (156h18m3.585755278s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854706198 (156h18m3.585973818s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854916283 (156h18m3.586183903s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855122541 (156h18m3.586390161s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855323318 (156h18m3.586590939s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855572116 (156h18m3.586839736s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855783854 (156h18m3.587051484s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856043823 (156h18m3.587311442s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856221917 (156h18m3.587489547s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856474260 (156h18m3.587741891s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856684717 (156h18m3.587952347s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856890473 (156h18m3.588158103s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.857137107 (156h18m3.588404727s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.857407986 (156h18m3.588675616s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.931933679 (156h18m3.663201319s) [upload=162649]: Next returned nil segment Aug 15 05:44:22.931946533 (156h18m3.663214163s) [upload=162649]: Waiting for error group managing segments... Aug 15 05:44:22.941125163 (156h18m3.672392803s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.941816452 (156h18m3.673084082s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.942102801 (156h18m3.673370441s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.942329847 (156h18m3.673597477s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.942519253 (156h18m3.673786883s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.944005966 (156h18m3.675273607s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.945343752 (156h18m3.676611392s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.948716731 (156h18m3.679984381s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.954674047 (156h18m3.685941687s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.956262041 (156h18m3.687529671s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.964011115 (156h18m3.695278766s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.973878009 (156h18m3.705145659s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:23.033905123 (156h18m3.765172773s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:23.039146835 (156h18m3.770414484s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:23.039177702 (156h18m3.770445353s) [seg_pos={0 0}, upload=162649]: Segment reached optimal threshold of 14 pieces. Aug 15 05:44:23.039726664 (156h18m3.770994314s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: read tcp 5.161.89.252:55162->66.23.193.175:4556: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 05:44:23.039827213 (156h18m3.771094874s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KNKWRTR6pZfxWFcFwsEKaqGsUMBBSTBsxvmeKsV1GDfEBvQk7): protocol: read tcp 5.161.89.252:18818->79.127.201.215:4352: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 05:44:23.039977666 (156h18m3.771245316s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DsmdSnS2m7eL7TKCoyegaYK46jVo96qXPMxQWSaSCdZ7NbdKm): protocol: read tcp 5.161.89.252:24186->64.49.13.169:4714: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 05:44:23.040119473 (156h18m3.771387133s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eqkG9kQB7wFYRNUY3P77MLwBrwXKuEXvJku3B63FZn6rK5y5d): protocol: context canceled; context canceled Aug 15 05:44:23.040146273 (156h18m3.771413923s) [seg_pos={0 0}, upload=162649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 15 05:44:23.040241311 (156h18m3.771508962s) [upload=162649]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 15 05:44:23.040250929 (156h18m3.77151862s) [upload=162649]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 05:44:23.148699216 (156h18m3.879966877s) [upload=162649]: Done uploading segments... Aug 15 05:44:23.148718513 (156h18m3.879986163s) [upload=162649]: Upload finished. err: <nil> Duration: 549.663724ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 208.363669ms FAIL (2025-08-15 05:53:32 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 208.383075ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [............X..................................X............] duration: 432.420959ms FAIL (2025-08-15 05:53:19 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 15 05:44:22.781048516 (156h18m3.512316206s) [upload=162649]: Starting upload Aug 15 05:44:22.781143685 (156h18m3.512411345s) [upload=162649]: Done starting upload Aug 15 05:44:22.781205261 (156h18m3.51247291s) [upload=162649]: Uploading segments... Aug 15 05:44:22.781552763 (156h18m3.512820423s) [upload=162649]: Got next segment. Inline: false Aug 15 05:44:22.781613949 (156h18m3.512881639s) [upload=162649]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 05:44:22.781623357 (156h18m3.512891007s) [upload=162649]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 15 05:44:22.853583217 (156h18m3.584850848s) [seg_pos={0 0}, upload=162649]: Begin upload segment... Aug 15 05:44:22.853614857 (156h18m3.584882487s) [seg_pos={0 0}, upload=162649]: Done begin upload segment. Aug 15 05:44:22.853622912 (156h18m3.584890532s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.853630877 (156h18m3.584898507s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.853960808 (156h18m3.585228438s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854221948 (156h18m3.585489578s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854487648 (156h18m3.585755278s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854706198 (156h18m3.585973818s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854916283 (156h18m3.586183903s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855122541 (156h18m3.586390161s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855323318 (156h18m3.586590939s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855572116 (156h18m3.586839736s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855783854 (156h18m3.587051484s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856043823 (156h18m3.587311442s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856221917 (156h18m3.587489547s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856474260 (156h18m3.587741891s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856684717 (156h18m3.587952347s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856890473 (156h18m3.588158103s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.857137107 (156h18m3.588404727s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.857407986 (156h18m3.588675616s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.931933679 (156h18m3.663201319s) [upload=162649]: Next returned nil segment Aug 15 05:44:22.931946533 (156h18m3.663214163s) [upload=162649]: Waiting for error group managing segments... Aug 15 05:44:22.941125163 (156h18m3.672392803s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.941816452 (156h18m3.673084082s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.942102801 (156h18m3.673370441s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.942329847 (156h18m3.673597477s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.942519253 (156h18m3.673786883s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.944005966 (156h18m3.675273607s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.945343752 (156h18m3.676611392s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.948716731 (156h18m3.679984381s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.954674047 (156h18m3.685941687s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.956262041 (156h18m3.687529671s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.964011115 (156h18m3.695278766s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.973878009 (156h18m3.705145659s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:23.033905123 (156h18m3.765172773s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:23.039146835 (156h18m3.770414484s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:23.039177702 (156h18m3.770445353s) [seg_pos={0 0}, upload=162649]: Segment reached optimal threshold of 14 pieces. Aug 15 05:44:23.039726664 (156h18m3.770994314s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: read tcp 5.161.89.252:55162->66.23.193.175:4556: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 05:44:23.039827213 (156h18m3.771094874s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KNKWRTR6pZfxWFcFwsEKaqGsUMBBSTBsxvmeKsV1GDfEBvQk7): protocol: read tcp 5.161.89.252:18818->79.127.201.215:4352: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 05:44:23.039977666 (156h18m3.771245316s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DsmdSnS2m7eL7TKCoyegaYK46jVo96qXPMxQWSaSCdZ7NbdKm): protocol: read tcp 5.161.89.252:24186->64.49.13.169:4714: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 05:44:23.040119473 (156h18m3.771387133s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eqkG9kQB7wFYRNUY3P77MLwBrwXKuEXvJku3B63FZn6rK5y5d): protocol: context canceled; context canceled Aug 15 05:44:23.040146273 (156h18m3.771413923s) [seg_pos={0 0}, upload=162649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 15 05:44:23.040241311 (156h18m3.771508962s) [upload=162649]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 15 05:44:23.040250929 (156h18m3.77151862s) [upload=162649]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 05:44:23.148699216 (156h18m3.879966877s) [upload=162649]: Done uploading segments... Aug 15 05:44:23.148718513 (156h18m3.879986163s) [upload=162649]: Upload finished. err: <nil> Duration: 432.444453ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 205.670435ms FAIL (2025-08-15 05:53:16 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 205.688059ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..............X.....X...............X.......................] duration: 116.407676ms FAIL (2025-08-15 05:53:10 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:39:32.377895512 (156h13m13.109163133s) [upload=162565]: Starting upload Aug 15 05:39:32.377934446 (156h13m13.109202066s) [upload=162565]: Done starting upload Aug 15 05:39:32.377970092 (156h13m13.109237722s) [upload=162565]: Uploading segments... Aug 15 05:39:32.378004016 (156h13m13.109271646s) [upload=162565]: Got next segment. Inline: true Aug 15 05:39:32.378008174 (156h13m13.109275794s) [upload=162565]: Waiting for error group managing segments... Aug 15 05:39:32.378039042 (156h13m13.109306672s) [upload=162565]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 05:39:32.378042799 (156h13m13.109310429s) [upload=162565]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 15 05:39:32.378045124 (156h13m13.109312754s) [upload=162565]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 05:39:32.380223698 (156h13m13.111491318s) [upload=162565]: Done uploading segments... Aug 15 05:39:32.380230541 (156h13m13.111498161s) [upload=162565]: Upload finished. err: metaclient: Too Many Requests Duration:* 116.43124ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...............X.....X...............X......................] duration: 123.592552ms FAIL (2025-08-15 05:52:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:39:32.377895512 (156h13m13.109163133s) [upload=162565]: Starting upload Aug 15 05:39:32.377934446 (156h13m13.109202066s) [upload=162565]: Done starting upload Aug 15 05:39:32.377970092 (156h13m13.109237722s) [upload=162565]: Uploading segments... Aug 15 05:39:32.378004016 (156h13m13.109271646s) [upload=162565]: Got next segment. Inline: true Aug 15 05:39:32.378008174 (156h13m13.109275794s) [upload=162565]: Waiting for error group managing segments... Aug 15 05:39:32.378039042 (156h13m13.109306672s) [upload=162565]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 05:39:32.378042799 (156h13m13.109310429s) [upload=162565]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 15 05:39:32.378045124 (156h13m13.109312754s) [upload=162565]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 05:39:32.380223698 (156h13m13.111491318s) [upload=162565]: Done uploading segments... Aug 15 05:39:32.380230541 (156h13m13.111498161s) [upload=162565]: Upload finished. err: metaclient: Too Many Requests Duration:* 123.624101ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [................X.....X...............X.....................] duration: 368.350552ms FAIL (2025-08-15 05:52:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:39:32.377895512 (156h13m13.109163133s) [upload=162565]: Starting upload Aug 15 05:39:32.377934446 (156h13m13.109202066s) [upload=162565]: Done starting upload Aug 15 05:39:32.377970092 (156h13m13.109237722s) [upload=162565]: Uploading segments... Aug 15 05:39:32.378004016 (156h13m13.109271646s) [upload=162565]: Got next segment. Inline: true Aug 15 05:39:32.378008174 (156h13m13.109275794s) [upload=162565]: Waiting for error group managing segments... Aug 15 05:39:32.378039042 (156h13m13.109306672s) [upload=162565]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 05:39:32.378042799 (156h13m13.109310429s) [upload=162565]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 15 05:39:32.378045124 (156h13m13.109312754s) [upload=162565]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 05:39:32.380223698 (156h13m13.111491318s) [upload=162565]: Done uploading segments... Aug 15 05:39:32.380230541 (156h13m13.111498161s) [upload=162565]: Upload finished. err: metaclient: Too Many Requests Duration:* 368.373134ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 158.699693ms FAIL (2025-08-15 05:52:28 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 158.716825ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.............X..................................X...........] duration: 481.809617ms FAIL (2025-08-15 05:52:13 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 15 05:44:22.781048516 (156h18m3.512316206s) [upload=162649]: Starting upload Aug 15 05:44:22.781143685 (156h18m3.512411345s) [upload=162649]: Done starting upload Aug 15 05:44:22.781205261 (156h18m3.51247291s) [upload=162649]: Uploading segments... Aug 15 05:44:22.781552763 (156h18m3.512820423s) [upload=162649]: Got next segment. Inline: false Aug 15 05:44:22.781613949 (156h18m3.512881639s) [upload=162649]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 05:44:22.781623357 (156h18m3.512891007s) [upload=162649]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 15 05:44:22.853583217 (156h18m3.584850848s) [seg_pos={0 0}, upload=162649]: Begin upload segment... Aug 15 05:44:22.853614857 (156h18m3.584882487s) [seg_pos={0 0}, upload=162649]: Done begin upload segment. Aug 15 05:44:22.853622912 (156h18m3.584890532s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.853630877 (156h18m3.584898507s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.853960808 (156h18m3.585228438s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854221948 (156h18m3.585489578s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854487648 (156h18m3.585755278s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854706198 (156h18m3.585973818s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854916283 (156h18m3.586183903s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855122541 (156h18m3.586390161s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855323318 (156h18m3.586590939s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855572116 (156h18m3.586839736s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855783854 (156h18m3.587051484s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856043823 (156h18m3.587311442s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856221917 (156h18m3.587489547s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856474260 (156h18m3.587741891s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856684717 (156h18m3.587952347s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856890473 (156h18m3.588158103s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.857137107 (156h18m3.588404727s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.857407986 (156h18m3.588675616s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.931933679 (156h18m3.663201319s) [upload=162649]: Next returned nil segment Aug 15 05:44:22.931946533 (156h18m3.663214163s) [upload=162649]: Waiting for error group managing segments... Aug 15 05:44:22.941125163 (156h18m3.672392803s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.941816452 (156h18m3.673084082s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.942102801 (156h18m3.673370441s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.942329847 (156h18m3.673597477s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.942519253 (156h18m3.673786883s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.944005966 (156h18m3.675273607s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.945343752 (156h18m3.676611392s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.948716731 (156h18m3.679984381s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.954674047 (156h18m3.685941687s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.956262041 (156h18m3.687529671s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.964011115 (156h18m3.695278766s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.973878009 (156h18m3.705145659s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:23.033905123 (156h18m3.765172773s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:23.039146835 (156h18m3.770414484s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:23.039177702 (156h18m3.770445353s) [seg_pos={0 0}, upload=162649]: Segment reached optimal threshold of 14 pieces. Aug 15 05:44:23.039726664 (156h18m3.770994314s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: read tcp 5.161.89.252:55162->66.23.193.175:4556: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 05:44:23.039827213 (156h18m3.771094874s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KNKWRTR6pZfxWFcFwsEKaqGsUMBBSTBsxvmeKsV1GDfEBvQk7): protocol: read tcp 5.161.89.252:18818->79.127.201.215:4352: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 05:44:23.039977666 (156h18m3.771245316s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DsmdSnS2m7eL7TKCoyegaYK46jVo96qXPMxQWSaSCdZ7NbdKm): protocol: read tcp 5.161.89.252:24186->64.49.13.169:4714: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 05:44:23.040119473 (156h18m3.771387133s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eqkG9kQB7wFYRNUY3P77MLwBrwXKuEXvJku3B63FZn6rK5y5d): protocol: context canceled; context canceled Aug 15 05:44:23.040146273 (156h18m3.771413923s) [seg_pos={0 0}, upload=162649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 15 05:44:23.040241311 (156h18m3.771508962s) [upload=162649]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 15 05:44:23.040250929 (156h18m3.77151862s) [upload=162649]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 05:44:23.148699216 (156h18m3.879966877s) [upload=162649]: Done uploading segments... Aug 15 05:44:23.148718513 (156h18m3.879986163s) [upload=162649]: Upload finished. err: <nil> Duration: 481.846665ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..............X..................................X..........] duration: 430.780485ms FAIL (2025-08-15 05:51:43 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 15 05:44:22.781048516 (156h18m3.512316206s) [upload=162649]: Starting upload Aug 15 05:44:22.781143685 (156h18m3.512411345s) [upload=162649]: Done starting upload Aug 15 05:44:22.781205261 (156h18m3.51247291s) [upload=162649]: Uploading segments... Aug 15 05:44:22.781552763 (156h18m3.512820423s) [upload=162649]: Got next segment. Inline: false Aug 15 05:44:22.781613949 (156h18m3.512881639s) [upload=162649]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 05:44:22.781623357 (156h18m3.512891007s) [upload=162649]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 15 05:44:22.853583217 (156h18m3.584850848s) [seg_pos={0 0}, upload=162649]: Begin upload segment... Aug 15 05:44:22.853614857 (156h18m3.584882487s) [seg_pos={0 0}, upload=162649]: Done begin upload segment. Aug 15 05:44:22.853622912 (156h18m3.584890532s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.853630877 (156h18m3.584898507s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.853960808 (156h18m3.585228438s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854221948 (156h18m3.585489578s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854487648 (156h18m3.585755278s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854706198 (156h18m3.585973818s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854916283 (156h18m3.586183903s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855122541 (156h18m3.586390161s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855323318 (156h18m3.586590939s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855572116 (156h18m3.586839736s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855783854 (156h18m3.587051484s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856043823 (156h18m3.587311442s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856221917 (156h18m3.587489547s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856474260 (156h18m3.587741891s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856684717 (156h18m3.587952347s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856890473 (156h18m3.588158103s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.857137107 (156h18m3.588404727s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.857407986 (156h18m3.588675616s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.931933679 (156h18m3.663201319s) [upload=162649]: Next returned nil segment Aug 15 05:44:22.931946533 (156h18m3.663214163s) [upload=162649]: Waiting for error group managing segments... Aug 15 05:44:22.941125163 (156h18m3.672392803s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.941816452 (156h18m3.673084082s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.942102801 (156h18m3.673370441s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.942329847 (156h18m3.673597477s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.942519253 (156h18m3.673786883s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.944005966 (156h18m3.675273607s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.945343752 (156h18m3.676611392s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.948716731 (156h18m3.679984381s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.954674047 (156h18m3.685941687s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.956262041 (156h18m3.687529671s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.964011115 (156h18m3.695278766s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.973878009 (156h18m3.705145659s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:23.033905123 (156h18m3.765172773s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:23.039146835 (156h18m3.770414484s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:23.039177702 (156h18m3.770445353s) [seg_pos={0 0}, upload=162649]: Segment reached optimal threshold of 14 pieces. Aug 15 05:44:23.039726664 (156h18m3.770994314s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: read tcp 5.161.89.252:55162->66.23.193.175:4556: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 05:44:23.039827213 (156h18m3.771094874s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KNKWRTR6pZfxWFcFwsEKaqGsUMBBSTBsxvmeKsV1GDfEBvQk7): protocol: read tcp 5.161.89.252:18818->79.127.201.215:4352: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 05:44:23.039977666 (156h18m3.771245316s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DsmdSnS2m7eL7TKCoyegaYK46jVo96qXPMxQWSaSCdZ7NbdKm): protocol: read tcp 5.161.89.252:24186->64.49.13.169:4714: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 05:44:23.040119473 (156h18m3.771387133s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eqkG9kQB7wFYRNUY3P77MLwBrwXKuEXvJku3B63FZn6rK5y5d): protocol: context canceled; context canceled Aug 15 05:44:23.040146273 (156h18m3.771413923s) [seg_pos={0 0}, upload=162649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 15 05:44:23.040241311 (156h18m3.771508962s) [upload=162649]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 15 05:44:23.040250929 (156h18m3.77151862s) [upload=162649]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 05:44:23.148699216 (156h18m3.879966877s) [upload=162649]: Done uploading segments... Aug 15 05:44:23.148718513 (156h18m3.879986163s) [upload=162649]: Upload finished. err: <nil> Duration: 430.803036ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.................X.....X...............X....................] duration: 108.044696ms FAIL (2025-08-15 05:51:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:39:32.377895512 (156h13m13.109163133s) [upload=162565]: Starting upload Aug 15 05:39:32.377934446 (156h13m13.109202066s) [upload=162565]: Done starting upload Aug 15 05:39:32.377970092 (156h13m13.109237722s) [upload=162565]: Uploading segments... Aug 15 05:39:32.378004016 (156h13m13.109271646s) [upload=162565]: Got next segment. Inline: true Aug 15 05:39:32.378008174 (156h13m13.109275794s) [upload=162565]: Waiting for error group managing segments... Aug 15 05:39:32.378039042 (156h13m13.109306672s) [upload=162565]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 05:39:32.378042799 (156h13m13.109310429s) [upload=162565]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 15 05:39:32.378045124 (156h13m13.109312754s) [upload=162565]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 05:39:32.380223698 (156h13m13.111491318s) [upload=162565]: Done uploading segments... Aug 15 05:39:32.380230541 (156h13m13.111498161s) [upload=162565]: Upload finished. err: metaclient: Too Many Requests Duration:* 108.063882ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 183.261604ms FAIL (2025-08-15 05:51:38 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 183.283476ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..................X.....X...............X...................] duration: 114.602131ms FAIL (2025-08-15 05:50:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:39:32.377895512 (156h13m13.109163133s) [upload=162565]: Starting upload Aug 15 05:39:32.377934446 (156h13m13.109202066s) [upload=162565]: Done starting upload Aug 15 05:39:32.377970092 (156h13m13.109237722s) [upload=162565]: Uploading segments... Aug 15 05:39:32.378004016 (156h13m13.109271646s) [upload=162565]: Got next segment. Inline: true Aug 15 05:39:32.378008174 (156h13m13.109275794s) [upload=162565]: Waiting for error group managing segments... Aug 15 05:39:32.378039042 (156h13m13.109306672s) [upload=162565]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 05:39:32.378042799 (156h13m13.109310429s) [upload=162565]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 15 05:39:32.378045124 (156h13m13.109312754s) [upload=162565]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 05:39:32.380223698 (156h13m13.111491318s) [upload=162565]: Done uploading segments... Aug 15 05:39:32.380230541 (156h13m13.111498161s) [upload=162565]: Upload finished. err: metaclient: Too Many Requests Duration:* 114.625344ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 201.516559ms FAIL (2025-08-15 05:50:37 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 201.541386ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............X..................................X.........] duration: 423.345107ms FAIL (2025-08-15 05:50:30 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 15 05:44:22.781048516 (156h18m3.512316206s) [upload=162649]: Starting upload Aug 15 05:44:22.781143685 (156h18m3.512411345s) [upload=162649]: Done starting upload Aug 15 05:44:22.781205261 (156h18m3.51247291s) [upload=162649]: Uploading segments... Aug 15 05:44:22.781552763 (156h18m3.512820423s) [upload=162649]: Got next segment. Inline: false Aug 15 05:44:22.781613949 (156h18m3.512881639s) [upload=162649]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 05:44:22.781623357 (156h18m3.512891007s) [upload=162649]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 15 05:44:22.853583217 (156h18m3.584850848s) [seg_pos={0 0}, upload=162649]: Begin upload segment... Aug 15 05:44:22.853614857 (156h18m3.584882487s) [seg_pos={0 0}, upload=162649]: Done begin upload segment. Aug 15 05:44:22.853622912 (156h18m3.584890532s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.853630877 (156h18m3.584898507s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.853960808 (156h18m3.585228438s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854221948 (156h18m3.585489578s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854487648 (156h18m3.585755278s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854706198 (156h18m3.585973818s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854916283 (156h18m3.586183903s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855122541 (156h18m3.586390161s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855323318 (156h18m3.586590939s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855572116 (156h18m3.586839736s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855783854 (156h18m3.587051484s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856043823 (156h18m3.587311442s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856221917 (156h18m3.587489547s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856474260 (156h18m3.587741891s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856684717 (156h18m3.587952347s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856890473 (156h18m3.588158103s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.857137107 (156h18m3.588404727s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.857407986 (156h18m3.588675616s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.931933679 (156h18m3.663201319s) [upload=162649]: Next returned nil segment Aug 15 05:44:22.931946533 (156h18m3.663214163s) [upload=162649]: Waiting for error group managing segments... Aug 15 05:44:22.941125163 (156h18m3.672392803s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.941816452 (156h18m3.673084082s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.942102801 (156h18m3.673370441s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.942329847 (156h18m3.673597477s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.942519253 (156h18m3.673786883s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.944005966 (156h18m3.675273607s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.945343752 (156h18m3.676611392s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.948716731 (156h18m3.679984381s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.954674047 (156h18m3.685941687s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.956262041 (156h18m3.687529671s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.964011115 (156h18m3.695278766s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.973878009 (156h18m3.705145659s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:23.033905123 (156h18m3.765172773s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:23.039146835 (156h18m3.770414484s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:23.039177702 (156h18m3.770445353s) [seg_pos={0 0}, upload=162649]: Segment reached optimal threshold of 14 pieces. Aug 15 05:44:23.039726664 (156h18m3.770994314s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: read tcp 5.161.89.252:55162->66.23.193.175:4556: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 05:44:23.039827213 (156h18m3.771094874s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KNKWRTR6pZfxWFcFwsEKaqGsUMBBSTBsxvmeKsV1GDfEBvQk7): protocol: read tcp 5.161.89.252:18818->79.127.201.215:4352: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 05:44:23.039977666 (156h18m3.771245316s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DsmdSnS2m7eL7TKCoyegaYK46jVo96qXPMxQWSaSCdZ7NbdKm): protocol: read tcp 5.161.89.252:24186->64.49.13.169:4714: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 05:44:23.040119473 (156h18m3.771387133s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eqkG9kQB7wFYRNUY3P77MLwBrwXKuEXvJku3B63FZn6rK5y5d): protocol: context canceled; context canceled Aug 15 05:44:23.040146273 (156h18m3.771413923s) [seg_pos={0 0}, upload=162649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 15 05:44:23.040241311 (156h18m3.771508962s) [upload=162649]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 15 05:44:23.040250929 (156h18m3.77151862s) [upload=162649]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 05:44:23.148699216 (156h18m3.879966877s) [upload=162649]: Done uploading segments... Aug 15 05:44:23.148718513 (156h18m3.879986163s) [upload=162649]: Upload finished. err: <nil> Duration: 423.364946ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 175.310516ms FAIL (2025-08-15 05:50:21 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 175.336354ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...................X.....X...............X..................] duration: 124.85734ms FAIL (2025-08-15 05:49:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:39:32.377895512 (156h13m13.109163133s) [upload=162565]: Starting upload Aug 15 05:39:32.377934446 (156h13m13.109202066s) [upload=162565]: Done starting upload Aug 15 05:39:32.377970092 (156h13m13.109237722s) [upload=162565]: Uploading segments... Aug 15 05:39:32.378004016 (156h13m13.109271646s) [upload=162565]: Got next segment. Inline: true Aug 15 05:39:32.378008174 (156h13m13.109275794s) [upload=162565]: Waiting for error group managing segments... Aug 15 05:39:32.378039042 (156h13m13.109306672s) [upload=162565]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 05:39:32.378042799 (156h13m13.109310429s) [upload=162565]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 15 05:39:32.378045124 (156h13m13.109312754s) [upload=162565]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 05:39:32.380223698 (156h13m13.111491318s) [upload=162565]: Done uploading segments... Aug 15 05:39:32.380230541 (156h13m13.111498161s) [upload=162565]: Upload finished. err: metaclient: Too Many Requests Duration:* 124.879873ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [X...............X..................................X........] duration: 454.393972ms FAIL (2025-08-15 05:49:52 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 15 05:44:22.781048516 (156h18m3.512316206s) [upload=162649]: Starting upload Aug 15 05:44:22.781143685 (156h18m3.512411345s) [upload=162649]: Done starting upload Aug 15 05:44:22.781205261 (156h18m3.51247291s) [upload=162649]: Uploading segments... Aug 15 05:44:22.781552763 (156h18m3.512820423s) [upload=162649]: Got next segment. Inline: false Aug 15 05:44:22.781613949 (156h18m3.512881639s) [upload=162649]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 05:44:22.781623357 (156h18m3.512891007s) [upload=162649]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 15 05:44:22.853583217 (156h18m3.584850848s) [seg_pos={0 0}, upload=162649]: Begin upload segment... Aug 15 05:44:22.853614857 (156h18m3.584882487s) [seg_pos={0 0}, upload=162649]: Done begin upload segment. Aug 15 05:44:22.853622912 (156h18m3.584890532s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.853630877 (156h18m3.584898507s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.853960808 (156h18m3.585228438s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854221948 (156h18m3.585489578s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854487648 (156h18m3.585755278s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854706198 (156h18m3.585973818s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854916283 (156h18m3.586183903s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855122541 (156h18m3.586390161s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855323318 (156h18m3.586590939s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855572116 (156h18m3.586839736s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855783854 (156h18m3.587051484s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856043823 (156h18m3.587311442s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856221917 (156h18m3.587489547s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856474260 (156h18m3.587741891s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856684717 (156h18m3.587952347s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856890473 (156h18m3.588158103s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.857137107 (156h18m3.588404727s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.857407986 (156h18m3.588675616s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.931933679 (156h18m3.663201319s) [upload=162649]: Next returned nil segment Aug 15 05:44:22.931946533 (156h18m3.663214163s) [upload=162649]: Waiting for error group managing segments... Aug 15 05:44:22.941125163 (156h18m3.672392803s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.941816452 (156h18m3.673084082s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.942102801 (156h18m3.673370441s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.942329847 (156h18m3.673597477s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.942519253 (156h18m3.673786883s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.944005966 (156h18m3.675273607s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.945343752 (156h18m3.676611392s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.948716731 (156h18m3.679984381s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.954674047 (156h18m3.685941687s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.956262041 (156h18m3.687529671s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.964011115 (156h18m3.695278766s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.973878009 (156h18m3.705145659s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:23.033905123 (156h18m3.765172773s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:23.039146835 (156h18m3.770414484s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:23.039177702 (156h18m3.770445353s) [seg_pos={0 0}, upload=162649]: Segment reached optimal threshold of 14 pieces. Aug 15 05:44:23.039726664 (156h18m3.770994314s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: read tcp 5.161.89.252:55162->66.23.193.175:4556: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 05:44:23.039827213 (156h18m3.771094874s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KNKWRTR6pZfxWFcFwsEKaqGsUMBBSTBsxvmeKsV1GDfEBvQk7): protocol: read tcp 5.161.89.252:18818->79.127.201.215:4352: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 05:44:23.039977666 (156h18m3.771245316s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DsmdSnS2m7eL7TKCoyegaYK46jVo96qXPMxQWSaSCdZ7NbdKm): protocol: read tcp 5.161.89.252:24186->64.49.13.169:4714: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 05:44:23.040119473 (156h18m3.771387133s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eqkG9kQB7wFYRNUY3P77MLwBrwXKuEXvJku3B63FZn6rK5y5d): protocol: context canceled; context canceled Aug 15 05:44:23.040146273 (156h18m3.771413923s) [seg_pos={0 0}, upload=162649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 15 05:44:23.040241311 (156h18m3.771508962s) [upload=162649]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 15 05:44:23.040250929 (156h18m3.77151862s) [upload=162649]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 05:44:23.148699216 (156h18m3.879966877s) [upload=162649]: Done uploading segments... Aug 15 05:44:23.148718513 (156h18m3.879986163s) [upload=162649]: Upload finished. err: <nil> Duration: 454.416474ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 645.758824ms FAIL (2025-08-15 05:49:40 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 645.781035ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [....................X.....X...............X.................] duration: 137.73745ms FAIL (2025-08-15 05:49:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:39:32.377895512 (156h13m13.109163133s) [upload=162565]: Starting upload Aug 15 05:39:32.377934446 (156h13m13.109202066s) [upload=162565]: Done starting upload Aug 15 05:39:32.377970092 (156h13m13.109237722s) [upload=162565]: Uploading segments... Aug 15 05:39:32.378004016 (156h13m13.109271646s) [upload=162565]: Got next segment. Inline: true Aug 15 05:39:32.378008174 (156h13m13.109275794s) [upload=162565]: Waiting for error group managing segments... Aug 15 05:39:32.378039042 (156h13m13.109306672s) [upload=162565]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 05:39:32.378042799 (156h13m13.109310429s) [upload=162565]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 15 05:39:32.378045124 (156h13m13.109312754s) [upload=162565]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 05:39:32.380223698 (156h13m13.111491318s) [upload=162565]: Done uploading segments... Aug 15 05:39:32.380230541 (156h13m13.111498161s) [upload=162565]: Upload finished. err: metaclient: Too Many Requests Duration:* 137.759983ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 666.29554ms FAIL (2025-08-15 05:49:10 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 666.311821ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.X...............X..................................X.......] duration: 1.20242341s FAIL (2025-08-15 05:48:55 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 15 05:44:22.781048516 (156h18m3.512316206s) [upload=162649]: Starting upload Aug 15 05:44:22.781143685 (156h18m3.512411345s) [upload=162649]: Done starting upload Aug 15 05:44:22.781205261 (156h18m3.51247291s) [upload=162649]: Uploading segments... Aug 15 05:44:22.781552763 (156h18m3.512820423s) [upload=162649]: Got next segment. Inline: false Aug 15 05:44:22.781613949 (156h18m3.512881639s) [upload=162649]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 05:44:22.781623357 (156h18m3.512891007s) [upload=162649]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 15 05:44:22.853583217 (156h18m3.584850848s) [seg_pos={0 0}, upload=162649]: Begin upload segment... Aug 15 05:44:22.853614857 (156h18m3.584882487s) [seg_pos={0 0}, upload=162649]: Done begin upload segment. Aug 15 05:44:22.853622912 (156h18m3.584890532s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.853630877 (156h18m3.584898507s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.853960808 (156h18m3.585228438s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854221948 (156h18m3.585489578s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854487648 (156h18m3.585755278s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854706198 (156h18m3.585973818s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854916283 (156h18m3.586183903s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855122541 (156h18m3.586390161s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855323318 (156h18m3.586590939s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855572116 (156h18m3.586839736s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855783854 (156h18m3.587051484s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856043823 (156h18m3.587311442s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856221917 (156h18m3.587489547s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856474260 (156h18m3.587741891s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856684717 (156h18m3.587952347s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856890473 (156h18m3.588158103s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.857137107 (156h18m3.588404727s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.857407986 (156h18m3.588675616s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.931933679 (156h18m3.663201319s) [upload=162649]: Next returned nil segment Aug 15 05:44:22.931946533 (156h18m3.663214163s) [upload=162649]: Waiting for error group managing segments... Aug 15 05:44:22.941125163 (156h18m3.672392803s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.941816452 (156h18m3.673084082s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.942102801 (156h18m3.673370441s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.942329847 (156h18m3.673597477s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.942519253 (156h18m3.673786883s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.944005966 (156h18m3.675273607s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.945343752 (156h18m3.676611392s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.948716731 (156h18m3.679984381s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.954674047 (156h18m3.685941687s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.956262041 (156h18m3.687529671s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.964011115 (156h18m3.695278766s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.973878009 (156h18m3.705145659s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:23.033905123 (156h18m3.765172773s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:23.039146835 (156h18m3.770414484s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:23.039177702 (156h18m3.770445353s) [seg_pos={0 0}, upload=162649]: Segment reached optimal threshold of 14 pieces. Aug 15 05:44:23.039726664 (156h18m3.770994314s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: read tcp 5.161.89.252:55162->66.23.193.175:4556: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 05:44:23.039827213 (156h18m3.771094874s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KNKWRTR6pZfxWFcFwsEKaqGsUMBBSTBsxvmeKsV1GDfEBvQk7): protocol: read tcp 5.161.89.252:18818->79.127.201.215:4352: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 05:44:23.039977666 (156h18m3.771245316s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DsmdSnS2m7eL7TKCoyegaYK46jVo96qXPMxQWSaSCdZ7NbdKm): protocol: read tcp 5.161.89.252:24186->64.49.13.169:4714: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 05:44:23.040119473 (156h18m3.771387133s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eqkG9kQB7wFYRNUY3P77MLwBrwXKuEXvJku3B63FZn6rK5y5d): protocol: context canceled; context canceled Aug 15 05:44:23.040146273 (156h18m3.771413923s) [seg_pos={0 0}, upload=162649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 15 05:44:23.040241311 (156h18m3.771508962s) [upload=162649]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 15 05:44:23.040250929 (156h18m3.77151862s) [upload=162649]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 05:44:23.148699216 (156h18m3.879966877s) [upload=162649]: Done uploading segments... Aug 15 05:44:23.148718513 (156h18m3.879986163s) [upload=162649]: Upload finished. err: <nil> Duration: 1.202450701s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.....................X.....X...............X................] duration: 391.920306ms FAIL (2025-08-15 05:48:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:39:32.377895512 (156h13m13.109163133s) [upload=162565]: Starting upload Aug 15 05:39:32.377934446 (156h13m13.109202066s) [upload=162565]: Done starting upload Aug 15 05:39:32.377970092 (156h13m13.109237722s) [upload=162565]: Uploading segments... Aug 15 05:39:32.378004016 (156h13m13.109271646s) [upload=162565]: Got next segment. Inline: true Aug 15 05:39:32.378008174 (156h13m13.109275794s) [upload=162565]: Waiting for error group managing segments... Aug 15 05:39:32.378039042 (156h13m13.109306672s) [upload=162565]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 05:39:32.378042799 (156h13m13.109310429s) [upload=162565]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 15 05:39:32.378045124 (156h13m13.109312754s) [upload=162565]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 05:39:32.380223698 (156h13m13.111491318s) [upload=162565]: Done uploading segments... Aug 15 05:39:32.380230541 (156h13m13.111498161s) [upload=162565]: Upload finished. err: metaclient: Too Many Requests Duration:* 391.939993ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [......................X.....X...............X...............] duration: 130.402394ms FAIL (2025-08-15 05:48:16 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:39:32.377895512 (156h13m13.109163133s) [upload=162565]: Starting upload Aug 15 05:39:32.377934446 (156h13m13.109202066s) [upload=162565]: Done starting upload Aug 15 05:39:32.377970092 (156h13m13.109237722s) [upload=162565]: Uploading segments... Aug 15 05:39:32.378004016 (156h13m13.109271646s) [upload=162565]: Got next segment. Inline: true Aug 15 05:39:32.378008174 (156h13m13.109275794s) [upload=162565]: Waiting for error group managing segments... Aug 15 05:39:32.378039042 (156h13m13.109306672s) [upload=162565]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 05:39:32.378042799 (156h13m13.109310429s) [upload=162565]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 15 05:39:32.378045124 (156h13m13.109312754s) [upload=162565]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 05:39:32.380223698 (156h13m13.111491318s) [upload=162565]: Done uploading segments... Aug 15 05:39:32.380230541 (156h13m13.111498161s) [upload=162565]: Upload finished. err: metaclient: Too Many Requests Duration:* 130.429936ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..X...............X..................................X......] duration: 393.16811ms FAIL (2025-08-15 05:48:14 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 15 05:44:22.781048516 (156h18m3.512316206s) [upload=162649]: Starting upload Aug 15 05:44:22.781143685 (156h18m3.512411345s) [upload=162649]: Done starting upload Aug 15 05:44:22.781205261 (156h18m3.51247291s) [upload=162649]: Uploading segments... Aug 15 05:44:22.781552763 (156h18m3.512820423s) [upload=162649]: Got next segment. Inline: false Aug 15 05:44:22.781613949 (156h18m3.512881639s) [upload=162649]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 05:44:22.781623357 (156h18m3.512891007s) [upload=162649]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 15 05:44:22.853583217 (156h18m3.584850848s) [seg_pos={0 0}, upload=162649]: Begin upload segment... Aug 15 05:44:22.853614857 (156h18m3.584882487s) [seg_pos={0 0}, upload=162649]: Done begin upload segment. Aug 15 05:44:22.853622912 (156h18m3.584890532s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.853630877 (156h18m3.584898507s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.853960808 (156h18m3.585228438s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854221948 (156h18m3.585489578s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854487648 (156h18m3.585755278s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854706198 (156h18m3.585973818s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854916283 (156h18m3.586183903s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855122541 (156h18m3.586390161s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855323318 (156h18m3.586590939s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855572116 (156h18m3.586839736s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855783854 (156h18m3.587051484s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856043823 (156h18m3.587311442s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856221917 (156h18m3.587489547s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856474260 (156h18m3.587741891s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856684717 (156h18m3.587952347s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856890473 (156h18m3.588158103s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.857137107 (156h18m3.588404727s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.857407986 (156h18m3.588675616s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.931933679 (156h18m3.663201319s) [upload=162649]: Next returned nil segment Aug 15 05:44:22.931946533 (156h18m3.663214163s) [upload=162649]: Waiting for error group managing segments... Aug 15 05:44:22.941125163 (156h18m3.672392803s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.941816452 (156h18m3.673084082s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.942102801 (156h18m3.673370441s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.942329847 (156h18m3.673597477s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.942519253 (156h18m3.673786883s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.944005966 (156h18m3.675273607s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.945343752 (156h18m3.676611392s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.948716731 (156h18m3.679984381s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.954674047 (156h18m3.685941687s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.956262041 (156h18m3.687529671s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.964011115 (156h18m3.695278766s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.973878009 (156h18m3.705145659s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:23.033905123 (156h18m3.765172773s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:23.039146835 (156h18m3.770414484s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:23.039177702 (156h18m3.770445353s) [seg_pos={0 0}, upload=162649]: Segment reached optimal threshold of 14 pieces. Aug 15 05:44:23.039726664 (156h18m3.770994314s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: read tcp 5.161.89.252:55162->66.23.193.175:4556: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 05:44:23.039827213 (156h18m3.771094874s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KNKWRTR6pZfxWFcFwsEKaqGsUMBBSTBsxvmeKsV1GDfEBvQk7): protocol: read tcp 5.161.89.252:18818->79.127.201.215:4352: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 05:44:23.039977666 (156h18m3.771245316s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DsmdSnS2m7eL7TKCoyegaYK46jVo96qXPMxQWSaSCdZ7NbdKm): protocol: read tcp 5.161.89.252:24186->64.49.13.169:4714: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 05:44:23.040119473 (156h18m3.771387133s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eqkG9kQB7wFYRNUY3P77MLwBrwXKuEXvJku3B63FZn6rK5y5d): protocol: context canceled; context canceled Aug 15 05:44:23.040146273 (156h18m3.771413923s) [seg_pos={0 0}, upload=162649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 15 05:44:23.040241311 (156h18m3.771508962s) [upload=162649]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 15 05:44:23.040250929 (156h18m3.77151862s) [upload=162649]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 05:44:23.148699216 (156h18m3.879966877s) [upload=162649]: Done uploading segments... Aug 15 05:44:23.148718513 (156h18m3.879986163s) [upload=162649]: Upload finished. err: <nil> Duration: 393.19453ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 246.757631ms FAIL (2025-08-15 05:48:04 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 246.782386ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...X...............X..................................X.....] duration: 397.322836ms FAIL (2025-08-15 05:47:42 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 15 05:44:22.781048516 (156h18m3.512316206s) [upload=162649]: Starting upload Aug 15 05:44:22.781143685 (156h18m3.512411345s) [upload=162649]: Done starting upload Aug 15 05:44:22.781205261 (156h18m3.51247291s) [upload=162649]: Uploading segments... Aug 15 05:44:22.781552763 (156h18m3.512820423s) [upload=162649]: Got next segment. Inline: false Aug 15 05:44:22.781613949 (156h18m3.512881639s) [upload=162649]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 05:44:22.781623357 (156h18m3.512891007s) [upload=162649]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 15 05:44:22.853583217 (156h18m3.584850848s) [seg_pos={0 0}, upload=162649]: Begin upload segment... Aug 15 05:44:22.853614857 (156h18m3.584882487s) [seg_pos={0 0}, upload=162649]: Done begin upload segment. Aug 15 05:44:22.853622912 (156h18m3.584890532s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.853630877 (156h18m3.584898507s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.853960808 (156h18m3.585228438s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854221948 (156h18m3.585489578s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854487648 (156h18m3.585755278s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854706198 (156h18m3.585973818s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854916283 (156h18m3.586183903s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855122541 (156h18m3.586390161s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855323318 (156h18m3.586590939s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855572116 (156h18m3.586839736s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855783854 (156h18m3.587051484s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856043823 (156h18m3.587311442s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856221917 (156h18m3.587489547s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856474260 (156h18m3.587741891s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856684717 (156h18m3.587952347s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856890473 (156h18m3.588158103s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.857137107 (156h18m3.588404727s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.857407986 (156h18m3.588675616s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.931933679 (156h18m3.663201319s) [upload=162649]: Next returned nil segment Aug 15 05:44:22.931946533 (156h18m3.663214163s) [upload=162649]: Waiting for error group managing segments... Aug 15 05:44:22.941125163 (156h18m3.672392803s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.941816452 (156h18m3.673084082s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.942102801 (156h18m3.673370441s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.942329847 (156h18m3.673597477s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.942519253 (156h18m3.673786883s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.944005966 (156h18m3.675273607s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.945343752 (156h18m3.676611392s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.948716731 (156h18m3.679984381s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.954674047 (156h18m3.685941687s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.956262041 (156h18m3.687529671s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.964011115 (156h18m3.695278766s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.973878009 (156h18m3.705145659s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:23.033905123 (156h18m3.765172773s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:23.039146835 (156h18m3.770414484s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:23.039177702 (156h18m3.770445353s) [seg_pos={0 0}, upload=162649]: Segment reached optimal threshold of 14 pieces. Aug 15 05:44:23.039726664 (156h18m3.770994314s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: read tcp 5.161.89.252:55162->66.23.193.175:4556: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 05:44:23.039827213 (156h18m3.771094874s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KNKWRTR6pZfxWFcFwsEKaqGsUMBBSTBsxvmeKsV1GDfEBvQk7): protocol: read tcp 5.161.89.252:18818->79.127.201.215:4352: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 05:44:23.039977666 (156h18m3.771245316s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DsmdSnS2m7eL7TKCoyegaYK46jVo96qXPMxQWSaSCdZ7NbdKm): protocol: read tcp 5.161.89.252:24186->64.49.13.169:4714: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 05:44:23.040119473 (156h18m3.771387133s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eqkG9kQB7wFYRNUY3P77MLwBrwXKuEXvJku3B63FZn6rK5y5d): protocol: context canceled; context canceled Aug 15 05:44:23.040146273 (156h18m3.771413923s) [seg_pos={0 0}, upload=162649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 15 05:44:23.040241311 (156h18m3.771508962s) [upload=162649]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 15 05:44:23.040250929 (156h18m3.77151862s) [upload=162649]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 05:44:23.148699216 (156h18m3.879966877s) [upload=162649]: Done uploading segments... Aug 15 05:44:23.148718513 (156h18m3.879986163s) [upload=162649]: Upload finished. err: <nil> Duration: 397.346691ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.......................X.....X...............X..............] duration: 429.497192ms FAIL (2025-08-15 05:47:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:39:32.377895512 (156h13m13.109163133s) [upload=162565]: Starting upload Aug 15 05:39:32.377934446 (156h13m13.109202066s) [upload=162565]: Done starting upload Aug 15 05:39:32.377970092 (156h13m13.109237722s) [upload=162565]: Uploading segments... Aug 15 05:39:32.378004016 (156h13m13.109271646s) [upload=162565]: Got next segment. Inline: true Aug 15 05:39:32.378008174 (156h13m13.109275794s) [upload=162565]: Waiting for error group managing segments... Aug 15 05:39:32.378039042 (156h13m13.109306672s) [upload=162565]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 05:39:32.378042799 (156h13m13.109310429s) [upload=162565]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 15 05:39:32.378045124 (156h13m13.109312754s) [upload=162565]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 05:39:32.380223698 (156h13m13.111491318s) [upload=162565]: Done uploading segments... Aug 15 05:39:32.380230541 (156h13m13.111498161s) [upload=162565]: Upload finished. err: metaclient: Too Many Requests Duration:* 429.528202ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 297.256525ms FAIL (2025-08-15 05:47:13 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 297.279167ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [........................X.....X...............X.............] duration: 145.345621ms FAIL (2025-08-15 05:46:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:39:32.377895512 (156h13m13.109163133s) [upload=162565]: Starting upload Aug 15 05:39:32.377934446 (156h13m13.109202066s) [upload=162565]: Done starting upload Aug 15 05:39:32.377970092 (156h13m13.109237722s) [upload=162565]: Uploading segments... Aug 15 05:39:32.378004016 (156h13m13.109271646s) [upload=162565]: Got next segment. Inline: true Aug 15 05:39:32.378008174 (156h13m13.109275794s) [upload=162565]: Waiting for error group managing segments... Aug 15 05:39:32.378039042 (156h13m13.109306672s) [upload=162565]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 05:39:32.378042799 (156h13m13.109310429s) [upload=162565]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 15 05:39:32.378045124 (156h13m13.109312754s) [upload=162565]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 05:39:32.380223698 (156h13m13.111491318s) [upload=162565]: Done uploading segments... Aug 15 05:39:32.380230541 (156h13m13.111498161s) [upload=162565]: Upload finished. err: metaclient: Too Many Requests Duration:* 145.366301ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [....X...............X..................................X....] duration: 419.633637ms FAIL (2025-08-15 05:46:33 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 15 05:44:22.781048516 (156h18m3.512316206s) [upload=162649]: Starting upload Aug 15 05:44:22.781143685 (156h18m3.512411345s) [upload=162649]: Done starting upload Aug 15 05:44:22.781205261 (156h18m3.51247291s) [upload=162649]: Uploading segments... Aug 15 05:44:22.781552763 (156h18m3.512820423s) [upload=162649]: Got next segment. Inline: false Aug 15 05:44:22.781613949 (156h18m3.512881639s) [upload=162649]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 05:44:22.781623357 (156h18m3.512891007s) [upload=162649]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 15 05:44:22.853583217 (156h18m3.584850848s) [seg_pos={0 0}, upload=162649]: Begin upload segment... Aug 15 05:44:22.853614857 (156h18m3.584882487s) [seg_pos={0 0}, upload=162649]: Done begin upload segment. Aug 15 05:44:22.853622912 (156h18m3.584890532s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.853630877 (156h18m3.584898507s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.853960808 (156h18m3.585228438s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854221948 (156h18m3.585489578s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854487648 (156h18m3.585755278s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854706198 (156h18m3.585973818s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854916283 (156h18m3.586183903s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855122541 (156h18m3.586390161s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855323318 (156h18m3.586590939s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855572116 (156h18m3.586839736s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855783854 (156h18m3.587051484s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856043823 (156h18m3.587311442s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856221917 (156h18m3.587489547s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856474260 (156h18m3.587741891s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856684717 (156h18m3.587952347s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856890473 (156h18m3.588158103s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.857137107 (156h18m3.588404727s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.857407986 (156h18m3.588675616s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.931933679 (156h18m3.663201319s) [upload=162649]: Next returned nil segment Aug 15 05:44:22.931946533 (156h18m3.663214163s) [upload=162649]: Waiting for error group managing segments... Aug 15 05:44:22.941125163 (156h18m3.672392803s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.941816452 (156h18m3.673084082s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.942102801 (156h18m3.673370441s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.942329847 (156h18m3.673597477s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.942519253 (156h18m3.673786883s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.944005966 (156h18m3.675273607s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.945343752 (156h18m3.676611392s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.948716731 (156h18m3.679984381s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.954674047 (156h18m3.685941687s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.956262041 (156h18m3.687529671s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.964011115 (156h18m3.695278766s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.973878009 (156h18m3.705145659s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:23.033905123 (156h18m3.765172773s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:23.039146835 (156h18m3.770414484s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:23.039177702 (156h18m3.770445353s) [seg_pos={0 0}, upload=162649]: Segment reached optimal threshold of 14 pieces. Aug 15 05:44:23.039726664 (156h18m3.770994314s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: read tcp 5.161.89.252:55162->66.23.193.175:4556: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 05:44:23.039827213 (156h18m3.771094874s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KNKWRTR6pZfxWFcFwsEKaqGsUMBBSTBsxvmeKsV1GDfEBvQk7): protocol: read tcp 5.161.89.252:18818->79.127.201.215:4352: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 05:44:23.039977666 (156h18m3.771245316s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DsmdSnS2m7eL7TKCoyegaYK46jVo96qXPMxQWSaSCdZ7NbdKm): protocol: read tcp 5.161.89.252:24186->64.49.13.169:4714: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 05:44:23.040119473 (156h18m3.771387133s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eqkG9kQB7wFYRNUY3P77MLwBrwXKuEXvJku3B63FZn6rK5y5d): protocol: context canceled; context canceled Aug 15 05:44:23.040146273 (156h18m3.771413923s) [seg_pos={0 0}, upload=162649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 15 05:44:23.040241311 (156h18m3.771508962s) [upload=162649]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 15 05:44:23.040250929 (156h18m3.77151862s) [upload=162649]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 05:44:23.148699216 (156h18m3.879966877s) [upload=162649]: Done uploading segments... Aug 15 05:44:23.148718513 (156h18m3.879986163s) [upload=162649]: Upload finished. err: <nil> Duration: 419.653895ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.........................X.....X...............X............] duration: 138.528971ms FAIL (2025-08-15 05:46:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:39:32.377895512 (156h13m13.109163133s) [upload=162565]: Starting upload Aug 15 05:39:32.377934446 (156h13m13.109202066s) [upload=162565]: Done starting upload Aug 15 05:39:32.377970092 (156h13m13.109237722s) [upload=162565]: Uploading segments... Aug 15 05:39:32.378004016 (156h13m13.109271646s) [upload=162565]: Got next segment. Inline: true Aug 15 05:39:32.378008174 (156h13m13.109275794s) [upload=162565]: Waiting for error group managing segments... Aug 15 05:39:32.378039042 (156h13m13.109306672s) [upload=162565]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 05:39:32.378042799 (156h13m13.109310429s) [upload=162565]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 15 05:39:32.378045124 (156h13m13.109312754s) [upload=162565]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 05:39:32.380223698 (156h13m13.111491318s) [upload=162565]: Done uploading segments... Aug 15 05:39:32.380230541 (156h13m13.111498161s) [upload=162565]: Upload finished. err: metaclient: Too Many Requests Duration:* 138.550992ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 293.825972ms FAIL (2025-08-15 05:46:13 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 293.839579ms core uplink us1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)