Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 297.256525ms FAIL (2025-08-15 05:47:13 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 297.279167ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [........................X.....X...............X.............] duration: 145.345621ms FAIL (2025-08-15 05:46:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:39:32.377895512 (156h13m13.109163133s) [upload=162565]: Starting upload Aug 15 05:39:32.377934446 (156h13m13.109202066s) [upload=162565]: Done starting upload Aug 15 05:39:32.377970092 (156h13m13.109237722s) [upload=162565]: Uploading segments... Aug 15 05:39:32.378004016 (156h13m13.109271646s) [upload=162565]: Got next segment. Inline: true Aug 15 05:39:32.378008174 (156h13m13.109275794s) [upload=162565]: Waiting for error group managing segments... Aug 15 05:39:32.378039042 (156h13m13.109306672s) [upload=162565]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 05:39:32.378042799 (156h13m13.109310429s) [upload=162565]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 15 05:39:32.378045124 (156h13m13.109312754s) [upload=162565]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 05:39:32.380223698 (156h13m13.111491318s) [upload=162565]: Done uploading segments... Aug 15 05:39:32.380230541 (156h13m13.111498161s) [upload=162565]: Upload finished. err: metaclient: Too Many Requests Duration:* 145.366301ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [....X...............X..................................X....] duration: 419.633637ms FAIL (2025-08-15 05:46:33 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 15 05:44:22.781048516 (156h18m3.512316206s) [upload=162649]: Starting upload Aug 15 05:44:22.781143685 (156h18m3.512411345s) [upload=162649]: Done starting upload Aug 15 05:44:22.781205261 (156h18m3.51247291s) [upload=162649]: Uploading segments... Aug 15 05:44:22.781552763 (156h18m3.512820423s) [upload=162649]: Got next segment. Inline: false Aug 15 05:44:22.781613949 (156h18m3.512881639s) [upload=162649]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 05:44:22.781623357 (156h18m3.512891007s) [upload=162649]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 15 05:44:22.853583217 (156h18m3.584850848s) [seg_pos={0 0}, upload=162649]: Begin upload segment... Aug 15 05:44:22.853614857 (156h18m3.584882487s) [seg_pos={0 0}, upload=162649]: Done begin upload segment. Aug 15 05:44:22.853622912 (156h18m3.584890532s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.853630877 (156h18m3.584898507s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.853960808 (156h18m3.585228438s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854221948 (156h18m3.585489578s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854487648 (156h18m3.585755278s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854706198 (156h18m3.585973818s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854916283 (156h18m3.586183903s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855122541 (156h18m3.586390161s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855323318 (156h18m3.586590939s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855572116 (156h18m3.586839736s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855783854 (156h18m3.587051484s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856043823 (156h18m3.587311442s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856221917 (156h18m3.587489547s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856474260 (156h18m3.587741891s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856684717 (156h18m3.587952347s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856890473 (156h18m3.588158103s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.857137107 (156h18m3.588404727s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.857407986 (156h18m3.588675616s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.931933679 (156h18m3.663201319s) [upload=162649]: Next returned nil segment Aug 15 05:44:22.931946533 (156h18m3.663214163s) [upload=162649]: Waiting for error group managing segments... Aug 15 05:44:22.941125163 (156h18m3.672392803s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.941816452 (156h18m3.673084082s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.942102801 (156h18m3.673370441s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.942329847 (156h18m3.673597477s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.942519253 (156h18m3.673786883s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.944005966 (156h18m3.675273607s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.945343752 (156h18m3.676611392s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.948716731 (156h18m3.679984381s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.954674047 (156h18m3.685941687s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.956262041 (156h18m3.687529671s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.964011115 (156h18m3.695278766s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.973878009 (156h18m3.705145659s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:23.033905123 (156h18m3.765172773s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:23.039146835 (156h18m3.770414484s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:23.039177702 (156h18m3.770445353s) [seg_pos={0 0}, upload=162649]: Segment reached optimal threshold of 14 pieces. Aug 15 05:44:23.039726664 (156h18m3.770994314s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: read tcp 5.161.89.252:55162->66.23.193.175:4556: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 05:44:23.039827213 (156h18m3.771094874s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KNKWRTR6pZfxWFcFwsEKaqGsUMBBSTBsxvmeKsV1GDfEBvQk7): protocol: read tcp 5.161.89.252:18818->79.127.201.215:4352: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 05:44:23.039977666 (156h18m3.771245316s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DsmdSnS2m7eL7TKCoyegaYK46jVo96qXPMxQWSaSCdZ7NbdKm): protocol: read tcp 5.161.89.252:24186->64.49.13.169:4714: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 05:44:23.040119473 (156h18m3.771387133s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eqkG9kQB7wFYRNUY3P77MLwBrwXKuEXvJku3B63FZn6rK5y5d): protocol: context canceled; context canceled Aug 15 05:44:23.040146273 (156h18m3.771413923s) [seg_pos={0 0}, upload=162649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 15 05:44:23.040241311 (156h18m3.771508962s) [upload=162649]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 15 05:44:23.040250929 (156h18m3.77151862s) [upload=162649]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 05:44:23.148699216 (156h18m3.879966877s) [upload=162649]: Done uploading segments... Aug 15 05:44:23.148718513 (156h18m3.879986163s) [upload=162649]: Upload finished. err: <nil> Duration: 419.653895ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.........................X.....X...............X............] duration: 138.528971ms FAIL (2025-08-15 05:46:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:39:32.377895512 (156h13m13.109163133s) [upload=162565]: Starting upload Aug 15 05:39:32.377934446 (156h13m13.109202066s) [upload=162565]: Done starting upload Aug 15 05:39:32.377970092 (156h13m13.109237722s) [upload=162565]: Uploading segments... Aug 15 05:39:32.378004016 (156h13m13.109271646s) [upload=162565]: Got next segment. Inline: true Aug 15 05:39:32.378008174 (156h13m13.109275794s) [upload=162565]: Waiting for error group managing segments... Aug 15 05:39:32.378039042 (156h13m13.109306672s) [upload=162565]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 05:39:32.378042799 (156h13m13.109310429s) [upload=162565]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 15 05:39:32.378045124 (156h13m13.109312754s) [upload=162565]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 05:39:32.380223698 (156h13m13.111491318s) [upload=162565]: Done uploading segments... Aug 15 05:39:32.380230541 (156h13m13.111498161s) [upload=162565]: Upload finished. err: metaclient: Too Many Requests Duration:* 138.550992ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 293.825972ms FAIL (2025-08-15 05:46:13 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 293.839579ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.....X...............X..................................X...] duration: 376.298984ms FAIL (2025-08-15 05:45:49 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 15 05:44:22.781048516 (156h18m3.512316206s) [upload=162649]: Starting upload Aug 15 05:44:22.781143685 (156h18m3.512411345s) [upload=162649]: Done starting upload Aug 15 05:44:22.781205261 (156h18m3.51247291s) [upload=162649]: Uploading segments... Aug 15 05:44:22.781552763 (156h18m3.512820423s) [upload=162649]: Got next segment. Inline: false Aug 15 05:44:22.781613949 (156h18m3.512881639s) [upload=162649]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 05:44:22.781623357 (156h18m3.512891007s) [upload=162649]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 15 05:44:22.853583217 (156h18m3.584850848s) [seg_pos={0 0}, upload=162649]: Begin upload segment... Aug 15 05:44:22.853614857 (156h18m3.584882487s) [seg_pos={0 0}, upload=162649]: Done begin upload segment. Aug 15 05:44:22.853622912 (156h18m3.584890532s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.853630877 (156h18m3.584898507s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.853960808 (156h18m3.585228438s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854221948 (156h18m3.585489578s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854487648 (156h18m3.585755278s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854706198 (156h18m3.585973818s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854916283 (156h18m3.586183903s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855122541 (156h18m3.586390161s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855323318 (156h18m3.586590939s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855572116 (156h18m3.586839736s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855783854 (156h18m3.587051484s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856043823 (156h18m3.587311442s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856221917 (156h18m3.587489547s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856474260 (156h18m3.587741891s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856684717 (156h18m3.587952347s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856890473 (156h18m3.588158103s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.857137107 (156h18m3.588404727s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.857407986 (156h18m3.588675616s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.931933679 (156h18m3.663201319s) [upload=162649]: Next returned nil segment Aug 15 05:44:22.931946533 (156h18m3.663214163s) [upload=162649]: Waiting for error group managing segments... Aug 15 05:44:22.941125163 (156h18m3.672392803s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.941816452 (156h18m3.673084082s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.942102801 (156h18m3.673370441s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.942329847 (156h18m3.673597477s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.942519253 (156h18m3.673786883s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.944005966 (156h18m3.675273607s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.945343752 (156h18m3.676611392s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.948716731 (156h18m3.679984381s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.954674047 (156h18m3.685941687s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.956262041 (156h18m3.687529671s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.964011115 (156h18m3.695278766s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.973878009 (156h18m3.705145659s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:23.033905123 (156h18m3.765172773s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:23.039146835 (156h18m3.770414484s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:23.039177702 (156h18m3.770445353s) [seg_pos={0 0}, upload=162649]: Segment reached optimal threshold of 14 pieces. Aug 15 05:44:23.039726664 (156h18m3.770994314s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: read tcp 5.161.89.252:55162->66.23.193.175:4556: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 05:44:23.039827213 (156h18m3.771094874s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KNKWRTR6pZfxWFcFwsEKaqGsUMBBSTBsxvmeKsV1GDfEBvQk7): protocol: read tcp 5.161.89.252:18818->79.127.201.215:4352: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 05:44:23.039977666 (156h18m3.771245316s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DsmdSnS2m7eL7TKCoyegaYK46jVo96qXPMxQWSaSCdZ7NbdKm): protocol: read tcp 5.161.89.252:24186->64.49.13.169:4714: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 05:44:23.040119473 (156h18m3.771387133s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eqkG9kQB7wFYRNUY3P77MLwBrwXKuEXvJku3B63FZn6rK5y5d): protocol: context canceled; context canceled Aug 15 05:44:23.040146273 (156h18m3.771413923s) [seg_pos={0 0}, upload=162649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 15 05:44:23.040241311 (156h18m3.771508962s) [upload=162649]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 15 05:44:23.040250929 (156h18m3.77151862s) [upload=162649]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 05:44:23.148699216 (156h18m3.879966877s) [upload=162649]: Done uploading segments... Aug 15 05:44:23.148718513 (156h18m3.879986163s) [upload=162649]: Upload finished. err: <nil> Duration: 376.325594ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 207.182147ms FAIL (2025-08-15 05:45:48 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 207.21022ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..........................X.....X...............X...........] duration: 124.302823ms FAIL (2025-08-15 05:45:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:39:32.377895512 (156h13m13.109163133s) [upload=162565]: Starting upload Aug 15 05:39:32.377934446 (156h13m13.109202066s) [upload=162565]: Done starting upload Aug 15 05:39:32.377970092 (156h13m13.109237722s) [upload=162565]: Uploading segments... Aug 15 05:39:32.378004016 (156h13m13.109271646s) [upload=162565]: Got next segment. Inline: true Aug 15 05:39:32.378008174 (156h13m13.109275794s) [upload=162565]: Waiting for error group managing segments... Aug 15 05:39:32.378039042 (156h13m13.109306672s) [upload=162565]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 05:39:32.378042799 (156h13m13.109310429s) [upload=162565]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 15 05:39:32.378045124 (156h13m13.109312754s) [upload=162565]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 05:39:32.380223698 (156h13m13.111491318s) [upload=162565]: Done uploading segments... Aug 15 05:39:32.380230541 (156h13m13.111498161s) [upload=162565]: Upload finished. err: metaclient: Too Many Requests Duration:* 124.32841ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 283.488658ms FAIL (2025-08-15 05:45:24 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 283.520187ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [......X...............X..................................X..] duration: 670.460482ms FAIL (2025-08-15 05:45:16 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 15 05:44:22.781048516 (156h18m3.512316206s) [upload=162649]: Starting upload Aug 15 05:44:22.781143685 (156h18m3.512411345s) [upload=162649]: Done starting upload Aug 15 05:44:22.781205261 (156h18m3.51247291s) [upload=162649]: Uploading segments... Aug 15 05:44:22.781552763 (156h18m3.512820423s) [upload=162649]: Got next segment. Inline: false Aug 15 05:44:22.781613949 (156h18m3.512881639s) [upload=162649]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 05:44:22.781623357 (156h18m3.512891007s) [upload=162649]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 15 05:44:22.853583217 (156h18m3.584850848s) [seg_pos={0 0}, upload=162649]: Begin upload segment... Aug 15 05:44:22.853614857 (156h18m3.584882487s) [seg_pos={0 0}, upload=162649]: Done begin upload segment. Aug 15 05:44:22.853622912 (156h18m3.584890532s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.853630877 (156h18m3.584898507s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.853960808 (156h18m3.585228438s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854221948 (156h18m3.585489578s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854487648 (156h18m3.585755278s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854706198 (156h18m3.585973818s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854916283 (156h18m3.586183903s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855122541 (156h18m3.586390161s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855323318 (156h18m3.586590939s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855572116 (156h18m3.586839736s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855783854 (156h18m3.587051484s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856043823 (156h18m3.587311442s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856221917 (156h18m3.587489547s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856474260 (156h18m3.587741891s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856684717 (156h18m3.587952347s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856890473 (156h18m3.588158103s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.857137107 (156h18m3.588404727s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.857407986 (156h18m3.588675616s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.931933679 (156h18m3.663201319s) [upload=162649]: Next returned nil segment Aug 15 05:44:22.931946533 (156h18m3.663214163s) [upload=162649]: Waiting for error group managing segments... Aug 15 05:44:22.941125163 (156h18m3.672392803s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.941816452 (156h18m3.673084082s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.942102801 (156h18m3.673370441s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.942329847 (156h18m3.673597477s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.942519253 (156h18m3.673786883s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.944005966 (156h18m3.675273607s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.945343752 (156h18m3.676611392s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.948716731 (156h18m3.679984381s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.954674047 (156h18m3.685941687s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.956262041 (156h18m3.687529671s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.964011115 (156h18m3.695278766s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.973878009 (156h18m3.705145659s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:23.033905123 (156h18m3.765172773s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:23.039146835 (156h18m3.770414484s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:23.039177702 (156h18m3.770445353s) [seg_pos={0 0}, upload=162649]: Segment reached optimal threshold of 14 pieces. Aug 15 05:44:23.039726664 (156h18m3.770994314s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: read tcp 5.161.89.252:55162->66.23.193.175:4556: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 05:44:23.039827213 (156h18m3.771094874s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KNKWRTR6pZfxWFcFwsEKaqGsUMBBSTBsxvmeKsV1GDfEBvQk7): protocol: read tcp 5.161.89.252:18818->79.127.201.215:4352: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 05:44:23.039977666 (156h18m3.771245316s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DsmdSnS2m7eL7TKCoyegaYK46jVo96qXPMxQWSaSCdZ7NbdKm): protocol: read tcp 5.161.89.252:24186->64.49.13.169:4714: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 05:44:23.040119473 (156h18m3.771387133s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eqkG9kQB7wFYRNUY3P77MLwBrwXKuEXvJku3B63FZn6rK5y5d): protocol: context canceled; context canceled Aug 15 05:44:23.040146273 (156h18m3.771413923s) [seg_pos={0 0}, upload=162649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 15 05:44:23.040241311 (156h18m3.771508962s) [upload=162649]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 15 05:44:23.040250929 (156h18m3.77151862s) [upload=162649]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 05:44:23.148699216 (156h18m3.879966877s) [upload=162649]: Done uploading segments... Aug 15 05:44:23.148718513 (156h18m3.879986163s) [upload=162649]: Upload finished. err: <nil> Duration: 670.483095ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...........................X.....X...............X..........] duration: 307.066207ms FAIL (2025-08-15 05:45:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:39:32.377895512 (156h13m13.109163133s) [upload=162565]: Starting upload Aug 15 05:39:32.377934446 (156h13m13.109202066s) [upload=162565]: Done starting upload Aug 15 05:39:32.377970092 (156h13m13.109237722s) [upload=162565]: Uploading segments... Aug 15 05:39:32.378004016 (156h13m13.109271646s) [upload=162565]: Got next segment. Inline: true Aug 15 05:39:32.378008174 (156h13m13.109275794s) [upload=162565]: Waiting for error group managing segments... Aug 15 05:39:32.378039042 (156h13m13.109306672s) [upload=162565]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 05:39:32.378042799 (156h13m13.109310429s) [upload=162565]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 15 05:39:32.378045124 (156h13m13.109312754s) [upload=162565]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 05:39:32.380223698 (156h13m13.111491318s) [upload=162565]: Done uploading segments... Aug 15 05:39:32.380230541 (156h13m13.111498161s) [upload=162565]: Upload finished. err: metaclient: Too Many Requests Duration:* 307.085996ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 190.882283ms FAIL (2025-08-15 05:44:53 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 190.903201ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.......X...............X..................................X.] duration: 534.595093ms FAIL (2025-08-15 05:44:43 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 15 05:44:22.781048516 (156h18m3.512316206s) [upload=162649]: Starting upload Aug 15 05:44:22.781143685 (156h18m3.512411345s) [upload=162649]: Done starting upload Aug 15 05:44:22.781205261 (156h18m3.51247291s) [upload=162649]: Uploading segments... Aug 15 05:44:22.781552763 (156h18m3.512820423s) [upload=162649]: Got next segment. Inline: false Aug 15 05:44:22.781613949 (156h18m3.512881639s) [upload=162649]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 05:44:22.781623357 (156h18m3.512891007s) [upload=162649]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 15 05:44:22.853583217 (156h18m3.584850848s) [seg_pos={0 0}, upload=162649]: Begin upload segment... Aug 15 05:44:22.853614857 (156h18m3.584882487s) [seg_pos={0 0}, upload=162649]: Done begin upload segment. Aug 15 05:44:22.853622912 (156h18m3.584890532s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.853630877 (156h18m3.584898507s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.853960808 (156h18m3.585228438s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854221948 (156h18m3.585489578s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854487648 (156h18m3.585755278s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854706198 (156h18m3.585973818s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854916283 (156h18m3.586183903s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855122541 (156h18m3.586390161s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855323318 (156h18m3.586590939s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855572116 (156h18m3.586839736s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855783854 (156h18m3.587051484s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856043823 (156h18m3.587311442s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856221917 (156h18m3.587489547s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856474260 (156h18m3.587741891s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856684717 (156h18m3.587952347s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856890473 (156h18m3.588158103s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.857137107 (156h18m3.588404727s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.857407986 (156h18m3.588675616s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.931933679 (156h18m3.663201319s) [upload=162649]: Next returned nil segment Aug 15 05:44:22.931946533 (156h18m3.663214163s) [upload=162649]: Waiting for error group managing segments... Aug 15 05:44:22.941125163 (156h18m3.672392803s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.941816452 (156h18m3.673084082s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.942102801 (156h18m3.673370441s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.942329847 (156h18m3.673597477s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.942519253 (156h18m3.673786883s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.944005966 (156h18m3.675273607s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.945343752 (156h18m3.676611392s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.948716731 (156h18m3.679984381s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.954674047 (156h18m3.685941687s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.956262041 (156h18m3.687529671s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.964011115 (156h18m3.695278766s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.973878009 (156h18m3.705145659s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:23.033905123 (156h18m3.765172773s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:23.039146835 (156h18m3.770414484s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:23.039177702 (156h18m3.770445353s) [seg_pos={0 0}, upload=162649]: Segment reached optimal threshold of 14 pieces. Aug 15 05:44:23.039726664 (156h18m3.770994314s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: read tcp 5.161.89.252:55162->66.23.193.175:4556: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 05:44:23.039827213 (156h18m3.771094874s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KNKWRTR6pZfxWFcFwsEKaqGsUMBBSTBsxvmeKsV1GDfEBvQk7): protocol: read tcp 5.161.89.252:18818->79.127.201.215:4352: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 05:44:23.039977666 (156h18m3.771245316s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DsmdSnS2m7eL7TKCoyegaYK46jVo96qXPMxQWSaSCdZ7NbdKm): protocol: read tcp 5.161.89.252:24186->64.49.13.169:4714: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 05:44:23.040119473 (156h18m3.771387133s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eqkG9kQB7wFYRNUY3P77MLwBrwXKuEXvJku3B63FZn6rK5y5d): protocol: context canceled; context canceled Aug 15 05:44:23.040146273 (156h18m3.771413923s) [seg_pos={0 0}, upload=162649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 15 05:44:23.040241311 (156h18m3.771508962s) [upload=162649]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 15 05:44:23.040250929 (156h18m3.77151862s) [upload=162649]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 05:44:23.148699216 (156h18m3.879966877s) [upload=162649]: Done uploading segments... Aug 15 05:44:23.148718513 (156h18m3.879986163s) [upload=162649]: Upload finished. err: <nil> Duration: 534.61429ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [............................X.....X...............X.........] duration: 568.685303ms FAIL (2025-08-15 05:44:37 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:39:32.377895512 (156h13m13.109163133s) [upload=162565]: Starting upload Aug 15 05:39:32.377934446 (156h13m13.109202066s) [upload=162565]: Done starting upload Aug 15 05:39:32.377970092 (156h13m13.109237722s) [upload=162565]: Uploading segments... Aug 15 05:39:32.378004016 (156h13m13.109271646s) [upload=162565]: Got next segment. Inline: true Aug 15 05:39:32.378008174 (156h13m13.109275794s) [upload=162565]: Waiting for error group managing segments... Aug 15 05:39:32.378039042 (156h13m13.109306672s) [upload=162565]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 05:39:32.378042799 (156h13m13.109310429s) [upload=162565]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 15 05:39:32.378045124 (156h13m13.109312754s) [upload=162565]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 05:39:32.380223698 (156h13m13.111491318s) [upload=162565]: Done uploading segments... Aug 15 05:39:32.380230541 (156h13m13.111498161s) [upload=162565]: Upload finished. err: metaclient: Too Many Requests Duration:* 568.709538ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [........X...............X..................................X] duration: 612.181821ms FAIL (2025-08-15 05:44:23 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 15 05:44:22.781048516 (156h18m3.512316206s) [upload=162649]: Starting upload Aug 15 05:44:22.781143685 (156h18m3.512411345s) [upload=162649]: Done starting upload Aug 15 05:44:22.781205261 (156h18m3.51247291s) [upload=162649]: Uploading segments... Aug 15 05:44:22.781552763 (156h18m3.512820423s) [upload=162649]: Got next segment. Inline: false Aug 15 05:44:22.781613949 (156h18m3.512881639s) [upload=162649]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 05:44:22.781623357 (156h18m3.512891007s) [upload=162649]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 15 05:44:22.853583217 (156h18m3.584850848s) [seg_pos={0 0}, upload=162649]: Begin upload segment... Aug 15 05:44:22.853614857 (156h18m3.584882487s) [seg_pos={0 0}, upload=162649]: Done begin upload segment. Aug 15 05:44:22.853622912 (156h18m3.584890532s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.853630877 (156h18m3.584898507s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.853960808 (156h18m3.585228438s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854221948 (156h18m3.585489578s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854487648 (156h18m3.585755278s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854706198 (156h18m3.585973818s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.854916283 (156h18m3.586183903s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855122541 (156h18m3.586390161s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855323318 (156h18m3.586590939s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855572116 (156h18m3.586839736s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.855783854 (156h18m3.587051484s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856043823 (156h18m3.587311442s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856221917 (156h18m3.587489547s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856474260 (156h18m3.587741891s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856684717 (156h18m3.587952347s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.856890473 (156h18m3.588158103s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.857137107 (156h18m3.588404727s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.857407986 (156h18m3.588675616s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Uploading piece... Aug 15 05:44:22.931933679 (156h18m3.663201319s) [upload=162649]: Next returned nil segment Aug 15 05:44:22.931946533 (156h18m3.663214163s) [upload=162649]: Waiting for error group managing segments... Aug 15 05:44:22.941125163 (156h18m3.672392803s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.941816452 (156h18m3.673084082s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.942102801 (156h18m3.673370441s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.942329847 (156h18m3.673597477s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.942519253 (156h18m3.673786883s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.944005966 (156h18m3.675273607s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.945343752 (156h18m3.676611392s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.948716731 (156h18m3.679984381s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.954674047 (156h18m3.685941687s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.956262041 (156h18m3.687529671s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.964011115 (156h18m3.695278766s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:22.973878009 (156h18m3.705145659s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:23.033905123 (156h18m3.765172773s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:23.039146835 (156h18m3.770414484s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil> Aug 15 05:44:23.039177702 (156h18m3.770445353s) [seg_pos={0 0}, upload=162649]: Segment reached optimal threshold of 14 pieces. Aug 15 05:44:23.039726664 (156h18m3.770994314s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: read tcp 5.161.89.252:55162->66.23.193.175:4556: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 05:44:23.039827213 (156h18m3.771094874s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KNKWRTR6pZfxWFcFwsEKaqGsUMBBSTBsxvmeKsV1GDfEBvQk7): protocol: read tcp 5.161.89.252:18818->79.127.201.215:4352: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 05:44:23.039977666 (156h18m3.771245316s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DsmdSnS2m7eL7TKCoyegaYK46jVo96qXPMxQWSaSCdZ7NbdKm): protocol: read tcp 5.161.89.252:24186->64.49.13.169:4714: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 05:44:23.040119473 (156h18m3.771387133s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eqkG9kQB7wFYRNUY3P77MLwBrwXKuEXvJku3B63FZn6rK5y5d): protocol: context canceled; context canceled Aug 15 05:44:23.040146273 (156h18m3.771413923s) [seg_pos={0 0}, upload=162649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 15 05:44:23.040241311 (156h18m3.771508962s) [upload=162649]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 15 05:44:23.040250929 (156h18m3.77151862s) [upload=162649]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 05:44:23.148699216 (156h18m3.879966877s) [upload=162649]: Done uploading segments... Aug 15 05:44:23.148718513 (156h18m3.879986163s) [upload=162649]: Upload finished. err: <nil> Duration: 612.203232ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 209.393373ms FAIL (2025-08-15 05:44:18 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 209.415695ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........X...............X..................................] duration: 615.37908ms FAIL (2025-08-15 05:43:56 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:14:43.026246263 (155h48m23.757513964s) [upload=162139]: Starting upload Aug 15 05:14:43.026322296 (155h48m23.757589946s) [upload=162139]: Done starting upload Aug 15 05:14:43.026704666 (155h48m23.757972315s) [upload=162139]: Uploading segments... Aug 15 05:14:43.026761442 (155h48m23.758029122s) [upload=162139]: Got next segment. Inline: false Aug 15 05:14:43.026823739 (155h48m23.758091429s) [upload=162139]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 05:14:43.026833477 (155h48m23.758101137s) [upload=162139]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 15 05:14:43.034801276 (155h48m23.766068937s) [upload=162139]: Next segment err: metaclient: Too Many Requests Aug 15 05:14:43.034829269 (155h48m23.766096919s) [upload=162139]: Done uploading segments... Aug 15 05:14:43.034851721 (155h48m23.766119381s) [upload=162139]: Upload finished. err: metaclient: Too Many Requests Duration: 615.405248ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.............................X.....X...............X........] duration: 259.853247ms FAIL (2025-08-15 05:43:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:39:32.377895512 (156h13m13.109163133s) [upload=162565]: Starting upload Aug 15 05:39:32.377934446 (156h13m13.109202066s) [upload=162565]: Done starting upload Aug 15 05:39:32.377970092 (156h13m13.109237722s) [upload=162565]: Uploading segments... Aug 15 05:39:32.378004016 (156h13m13.109271646s) [upload=162565]: Got next segment. Inline: true Aug 15 05:39:32.378008174 (156h13m13.109275794s) [upload=162565]: Waiting for error group managing segments... Aug 15 05:39:32.378039042 (156h13m13.109306672s) [upload=162565]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 05:39:32.378042799 (156h13m13.109310429s) [upload=162565]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 15 05:39:32.378045124 (156h13m13.109312754s) [upload=162565]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 05:39:32.380223698 (156h13m13.111491318s) [upload=162565]: Done uploading segments... Aug 15 05:39:32.380230541 (156h13m13.111498161s) [upload=162565]: Upload finished. err: metaclient: Too Many Requests Duration:* 259.869256ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..............................X.....X...............X.......] duration: 121.82774ms FAIL (2025-08-15 05:43:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:39:32.377895512 (156h13m13.109163133s) [upload=162565]: Starting upload Aug 15 05:39:32.377934446 (156h13m13.109202066s) [upload=162565]: Done starting upload Aug 15 05:39:32.377970092 (156h13m13.109237722s) [upload=162565]: Uploading segments... Aug 15 05:39:32.378004016 (156h13m13.109271646s) [upload=162565]: Got next segment. Inline: true Aug 15 05:39:32.378008174 (156h13m13.109275794s) [upload=162565]: Waiting for error group managing segments... Aug 15 05:39:32.378039042 (156h13m13.109306672s) [upload=162565]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 05:39:32.378042799 (156h13m13.109310429s) [upload=162565]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 15 05:39:32.378045124 (156h13m13.109312754s) [upload=162565]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 05:39:32.380223698 (156h13m13.111491318s) [upload=162565]: Done uploading segments... Aug 15 05:39:32.380230541 (156h13m13.111498161s) [upload=162565]: Upload finished. err: metaclient: Too Many Requests Duration:* 121.866875ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 380.686509ms FAIL (2025-08-15 05:43:06 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 380.706798ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........X...............X.................................] duration: 442.204026ms FAIL (2025-08-15 05:43:01 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:14:43.026246263 (155h48m23.757513964s) [upload=162139]: Starting upload Aug 15 05:14:43.026322296 (155h48m23.757589946s) [upload=162139]: Done starting upload Aug 15 05:14:43.026704666 (155h48m23.757972315s) [upload=162139]: Uploading segments... Aug 15 05:14:43.026761442 (155h48m23.758029122s) [upload=162139]: Got next segment. Inline: false Aug 15 05:14:43.026823739 (155h48m23.758091429s) [upload=162139]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 05:14:43.026833477 (155h48m23.758101137s) [upload=162139]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 15 05:14:43.034801276 (155h48m23.766068937s) [upload=162139]: Next segment err: metaclient: Too Many Requests Aug 15 05:14:43.034829269 (155h48m23.766096919s) [upload=162139]: Done uploading segments... Aug 15 05:14:43.034851721 (155h48m23.766119381s) [upload=162139]: Upload finished. err: metaclient: Too Many Requests Duration: 442.316887ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...............................X.....X...............X......] duration: 174.618117ms FAIL (2025-08-15 05:42:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:39:32.377895512 (156h13m13.109163133s) [upload=162565]: Starting upload Aug 15 05:39:32.377934446 (156h13m13.109202066s) [upload=162565]: Done starting upload Aug 15 05:39:32.377970092 (156h13m13.109237722s) [upload=162565]: Uploading segments... Aug 15 05:39:32.378004016 (156h13m13.109271646s) [upload=162565]: Got next segment. Inline: true Aug 15 05:39:32.378008174 (156h13m13.109275794s) [upload=162565]: Waiting for error group managing segments... Aug 15 05:39:32.378039042 (156h13m13.109306672s) [upload=162565]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 05:39:32.378042799 (156h13m13.109310429s) [upload=162565]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 15 05:39:32.378045124 (156h13m13.109312754s) [upload=162565]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 05:39:32.380223698 (156h13m13.111491318s) [upload=162565]: Done uploading segments... Aug 15 05:39:32.380230541 (156h13m13.111498161s) [upload=162565]: Upload finished. err: metaclient: Too Many Requests Duration:* 174.642603ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...........X...............X................................] duration: 626.701147ms FAIL (2025-08-15 05:42:05 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:14:43.026246263 (155h48m23.757513964s) [upload=162139]: Starting upload Aug 15 05:14:43.026322296 (155h48m23.757589946s) [upload=162139]: Done starting upload Aug 15 05:14:43.026704666 (155h48m23.757972315s) [upload=162139]: Uploading segments... Aug 15 05:14:43.026761442 (155h48m23.758029122s) [upload=162139]: Got next segment. Inline: false Aug 15 05:14:43.026823739 (155h48m23.758091429s) [upload=162139]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 05:14:43.026833477 (155h48m23.758101137s) [upload=162139]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 15 05:14:43.034801276 (155h48m23.766068937s) [upload=162139]: Next segment err: metaclient: Too Many Requests Aug 15 05:14:43.034829269 (155h48m23.766096919s) [upload=162139]: Done uploading segments... Aug 15 05:14:43.034851721 (155h48m23.766119381s) [upload=162139]: Upload finished. err: metaclient: Too Many Requests Duration: 626.725563ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 668.906559ms FAIL (2025-08-15 05:42:01 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 668.936294ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [................................X.....X...............X.....] duration: 122.652535ms FAIL (2025-08-15 05:41:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:39:32.377895512 (156h13m13.109163133s) [upload=162565]: Starting upload Aug 15 05:39:32.377934446 (156h13m13.109202066s) [upload=162565]: Done starting upload Aug 15 05:39:32.377970092 (156h13m13.109237722s) [upload=162565]: Uploading segments... Aug 15 05:39:32.378004016 (156h13m13.109271646s) [upload=162565]: Got next segment. Inline: true Aug 15 05:39:32.378008174 (156h13m13.109275794s) [upload=162565]: Waiting for error group managing segments... Aug 15 05:39:32.378039042 (156h13m13.109306672s) [upload=162565]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 05:39:32.378042799 (156h13m13.109310429s) [upload=162565]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 15 05:39:32.378045124 (156h13m13.109312754s) [upload=162565]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 05:39:32.380223698 (156h13m13.111491318s) [upload=162565]: Done uploading segments... Aug 15 05:39:32.380230541 (156h13m13.111498161s) [upload=162565]: Upload finished. err: metaclient: Too Many Requests Duration:* 122.674374ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 227.993378ms FAIL (2025-08-15 05:41:37 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 228.019417ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.................................X.....X...............X....] duration: 148.021463ms FAIL (2025-08-15 05:41:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:39:32.377895512 (156h13m13.109163133s) [upload=162565]: Starting upload Aug 15 05:39:32.377934446 (156h13m13.109202066s) [upload=162565]: Done starting upload Aug 15 05:39:32.377970092 (156h13m13.109237722s) [upload=162565]: Uploading segments... Aug 15 05:39:32.378004016 (156h13m13.109271646s) [upload=162565]: Got next segment. Inline: true Aug 15 05:39:32.378008174 (156h13m13.109275794s) [upload=162565]: Waiting for error group managing segments... Aug 15 05:39:32.378039042 (156h13m13.109306672s) [upload=162565]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 05:39:32.378042799 (156h13m13.109310429s) [upload=162565]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 15 05:39:32.378045124 (156h13m13.109312754s) [upload=162565]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 05:39:32.380223698 (156h13m13.111491318s) [upload=162565]: Done uploading segments... Aug 15 05:39:32.380230541 (156h13m13.111498161s) [upload=162565]: Upload finished. err: metaclient: Too Many Requests Duration:* 148.04078ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..................................X.....X...............X...] duration: 853.152848ms FAIL (2025-08-15 05:41:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:39:32.377895512 (156h13m13.109163133s) [upload=162565]: Starting upload Aug 15 05:39:32.377934446 (156h13m13.109202066s) [upload=162565]: Done starting upload Aug 15 05:39:32.377970092 (156h13m13.109237722s) [upload=162565]: Uploading segments... Aug 15 05:39:32.378004016 (156h13m13.109271646s) [upload=162565]: Got next segment. Inline: true Aug 15 05:39:32.378008174 (156h13m13.109275794s) [upload=162565]: Waiting for error group managing segments... Aug 15 05:39:32.378039042 (156h13m13.109306672s) [upload=162565]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 05:39:32.378042799 (156h13m13.109310429s) [upload=162565]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 15 05:39:32.378045124 (156h13m13.109312754s) [upload=162565]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 05:39:32.380223698 (156h13m13.111491318s) [upload=162565]: Done uploading segments... Aug 15 05:39:32.380230541 (156h13m13.111498161s) [upload=162565]: Upload finished. err: metaclient: Too Many Requests Duration:* 853.175029ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [............X...............X...............................] duration: 331.640212ms FAIL (2025-08-15 05:41:08 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:14:43.026246263 (155h48m23.757513964s) [upload=162139]: Starting upload Aug 15 05:14:43.026322296 (155h48m23.757589946s) [upload=162139]: Done starting upload Aug 15 05:14:43.026704666 (155h48m23.757972315s) [upload=162139]: Uploading segments... Aug 15 05:14:43.026761442 (155h48m23.758029122s) [upload=162139]: Got next segment. Inline: false Aug 15 05:14:43.026823739 (155h48m23.758091429s) [upload=162139]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 05:14:43.026833477 (155h48m23.758101137s) [upload=162139]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 15 05:14:43.034801276 (155h48m23.766068937s) [upload=162139]: Next segment err: metaclient: Too Many Requests Aug 15 05:14:43.034829269 (155h48m23.766096919s) [upload=162139]: Done uploading segments... Aug 15 05:14:43.034851721 (155h48m23.766119381s) [upload=162139]: Upload finished. err: metaclient: Too Many Requests Duration: 331.67087ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...................................X.....X...............X..] duration: 116.301377ms FAIL (2025-08-15 05:40:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:39:32.377895512 (156h13m13.109163133s) [upload=162565]: Starting upload Aug 15 05:39:32.377934446 (156h13m13.109202066s) [upload=162565]: Done starting upload Aug 15 05:39:32.377970092 (156h13m13.109237722s) [upload=162565]: Uploading segments... Aug 15 05:39:32.378004016 (156h13m13.109271646s) [upload=162565]: Got next segment. Inline: true Aug 15 05:39:32.378008174 (156h13m13.109275794s) [upload=162565]: Waiting for error group managing segments... Aug 15 05:39:32.378039042 (156h13m13.109306672s) [upload=162565]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 05:39:32.378042799 (156h13m13.109310429s) [upload=162565]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 15 05:39:32.378045124 (156h13m13.109312754s) [upload=162565]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 05:39:32.380223698 (156h13m13.111491318s) [upload=162565]: Done uploading segments... Aug 15 05:39:32.380230541 (156h13m13.111498161s) [upload=162565]: Upload finished. err: metaclient: Too Many Requests Duration:* 116.321514ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 184.989693ms FAIL (2025-08-15 05:40:35 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 185.068751ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 205.075999ms FAIL (2025-08-15 05:40:16 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 205.098111ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.............X...............X..............................] duration: 318.952668ms FAIL (2025-08-15 05:40:02 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:14:43.026246263 (155h48m23.757513964s) [upload=162139]: Starting upload Aug 15 05:14:43.026322296 (155h48m23.757589946s) [upload=162139]: Done starting upload Aug 15 05:14:43.026704666 (155h48m23.757972315s) [upload=162139]: Uploading segments... Aug 15 05:14:43.026761442 (155h48m23.758029122s) [upload=162139]: Got next segment. Inline: false Aug 15 05:14:43.026823739 (155h48m23.758091429s) [upload=162139]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 05:14:43.026833477 (155h48m23.758101137s) [upload=162139]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 15 05:14:43.034801276 (155h48m23.766068937s) [upload=162139]: Next segment err: metaclient: Too Many Requests Aug 15 05:14:43.034829269 (155h48m23.766096919s) [upload=162139]: Done uploading segments... Aug 15 05:14:43.034851721 (155h48m23.766119381s) [upload=162139]: Upload finished. err: metaclient: Too Many Requests Duration: 318.976051ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [....................................X.....X...............X.] duration: 195.897779ms FAIL (2025-08-15 05:39:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:39:32.377895512 (156h13m13.109163133s) [upload=162565]: Starting upload Aug 15 05:39:32.377934446 (156h13m13.109202066s) [upload=162565]: Done starting upload Aug 15 05:39:32.377970092 (156h13m13.109237722s) [upload=162565]: Uploading segments... Aug 15 05:39:32.378004016 (156h13m13.109271646s) [upload=162565]: Got next segment. Inline: true Aug 15 05:39:32.378008174 (156h13m13.109275794s) [upload=162565]: Waiting for error group managing segments... Aug 15 05:39:32.378039042 (156h13m13.109306672s) [upload=162565]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 05:39:32.378042799 (156h13m13.109310429s) [upload=162565]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 15 05:39:32.378045124 (156h13m13.109312754s) [upload=162565]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 05:39:32.380223698 (156h13m13.111491318s) [upload=162565]: Done uploading segments... Aug 15 05:39:32.380230541 (156h13m13.111498161s) [upload=162565]: Upload finished. err: metaclient: Too Many Requests Duration:* 195.916263ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 227.719795ms FAIL (2025-08-15 05:39:49 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 227.734692ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.....................................X.....X...............X] duration: 15.006573ms FAIL (2025-08-15 05:39:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:39:32.377895512 (156h13m13.109163133s) [upload=162565]: Starting upload Aug 15 05:39:32.377934446 (156h13m13.109202066s) [upload=162565]: Done starting upload Aug 15 05:39:32.377970092 (156h13m13.109237722s) [upload=162565]: Uploading segments... Aug 15 05:39:32.378004016 (156h13m13.109271646s) [upload=162565]: Got next segment. Inline: true Aug 15 05:39:32.378008174 (156h13m13.109275794s) [upload=162565]: Waiting for error group managing segments... Aug 15 05:39:32.378039042 (156h13m13.109306672s) [upload=162565]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 05:39:32.378042799 (156h13m13.109310429s) [upload=162565]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 15 05:39:32.378045124 (156h13m13.109312754s) [upload=162565]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 05:39:32.380223698 (156h13m13.111491318s) [upload=162565]: Done uploading segments... Aug 15 05:39:32.380230541 (156h13m13.111498161s) [upload=162565]: Upload finished. err: metaclient: Too Many Requests Duration:* 15.022452ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 232.200226ms FAIL (2025-08-15 05:39:12 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 232.225644ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..............X...............X.............................] duration: 306.719887ms FAIL (2025-08-15 05:39:02 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:14:43.026246263 (155h48m23.757513964s) [upload=162139]: Starting upload Aug 15 05:14:43.026322296 (155h48m23.757589946s) [upload=162139]: Done starting upload Aug 15 05:14:43.026704666 (155h48m23.757972315s) [upload=162139]: Uploading segments... Aug 15 05:14:43.026761442 (155h48m23.758029122s) [upload=162139]: Got next segment. Inline: false Aug 15 05:14:43.026823739 (155h48m23.758091429s) [upload=162139]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 05:14:43.026833477 (155h48m23.758101137s) [upload=162139]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 15 05:14:43.034801276 (155h48m23.766068937s) [upload=162139]: Next segment err: metaclient: Too Many Requests Aug 15 05:14:43.034829269 (155h48m23.766096919s) [upload=162139]: Done uploading segments... Aug 15 05:14:43.034851721 (155h48m23.766119381s) [upload=162139]: Upload finished. err: metaclient: Too Many Requests Duration: 306.744082ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 307.54104ms FAIL (2025-08-15 05:38:56 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 307.565446ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [......................................X.....X...............] duration: 319.58206ms FAIL (2025-08-15 05:38:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:29:10.625413412 (156h2m51.356681042s) [upload=162388]: Starting upload Aug 15 05:29:10.625464928 (156h2m51.356732558s) [upload=162388]: Done starting upload Aug 15 05:29:10.625509342 (156h2m51.356776972s) [upload=162388]: Uploading segments... Aug 15 05:29:10.625537325 (156h2m51.356804955s) [upload=162388]: Got next segment. Inline: true Aug 15 05:29:10.625541944 (156h2m51.356809574s) [upload=162388]: Waiting for error group managing segments... Aug 15 05:29:10.625574755 (156h2m51.356842385s) [upload=162388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 05:29:10.625578442 (156h2m51.356846063s) [upload=162388]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 15 05:29:10.625580907 (156h2m51.356848537s) [upload=162388]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 05:29:10.628287364 (156h2m51.359554994s) [upload=162388]: Done uploading segments... Aug 15 05:29:10.628299677 (156h2m51.359567307s) [upload=162388]: Upload finished. err: metaclient: Too Many Requests Duration:* 319.609643ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 202.416139ms FAIL (2025-08-15 05:38:26 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 202.433943ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.......................................X.....X..............] duration: 122.403501ms FAIL (2025-08-15 05:37:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:29:10.625413412 (156h2m51.356681042s) [upload=162388]: Starting upload Aug 15 05:29:10.625464928 (156h2m51.356732558s) [upload=162388]: Done starting upload Aug 15 05:29:10.625509342 (156h2m51.356776972s) [upload=162388]: Uploading segments... Aug 15 05:29:10.625537325 (156h2m51.356804955s) [upload=162388]: Got next segment. Inline: true Aug 15 05:29:10.625541944 (156h2m51.356809574s) [upload=162388]: Waiting for error group managing segments... Aug 15 05:29:10.625574755 (156h2m51.356842385s) [upload=162388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 05:29:10.625578442 (156h2m51.356846063s) [upload=162388]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 15 05:29:10.625580907 (156h2m51.356848537s) [upload=162388]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 05:29:10.628287364 (156h2m51.359554994s) [upload=162388]: Done uploading segments... Aug 15 05:29:10.628299677 (156h2m51.359567307s) [upload=162388]: Upload finished. err: metaclient: Too Many Requests Duration:* 122.427605ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............X...............X............................] duration: 337.9247ms FAIL (2025-08-15 05:37:57 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:14:43.026246263 (155h48m23.757513964s) [upload=162139]: Starting upload Aug 15 05:14:43.026322296 (155h48m23.757589946s) [upload=162139]: Done starting upload Aug 15 05:14:43.026704666 (155h48m23.757972315s) [upload=162139]: Uploading segments... Aug 15 05:14:43.026761442 (155h48m23.758029122s) [upload=162139]: Got next segment. Inline: false Aug 15 05:14:43.026823739 (155h48m23.758091429s) [upload=162139]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 05:14:43.026833477 (155h48m23.758101137s) [upload=162139]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 15 05:14:43.034801276 (155h48m23.766068937s) [upload=162139]: Next segment err: metaclient: Too Many Requests Aug 15 05:14:43.034829269 (155h48m23.766096919s) [upload=162139]: Done uploading segments... Aug 15 05:14:43.034851721 (155h48m23.766119381s) [upload=162139]: Upload finished. err: metaclient: Too Many Requests Duration: 337.947202ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 170.45754ms FAIL (2025-08-15 05:37:11 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 170.487696ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [................X...............X...........................] duration: 348.990346ms FAIL (2025-08-15 05:36:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:14:43.026246263 (155h48m23.757513964s) [upload=162139]: Starting upload Aug 15 05:14:43.026322296 (155h48m23.757589946s) [upload=162139]: Done starting upload Aug 15 05:14:43.026704666 (155h48m23.757972315s) [upload=162139]: Uploading segments... Aug 15 05:14:43.026761442 (155h48m23.758029122s) [upload=162139]: Got next segment. Inline: false Aug 15 05:14:43.026823739 (155h48m23.758091429s) [upload=162139]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 05:14:43.026833477 (155h48m23.758101137s) [upload=162139]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 15 05:14:43.034801276 (155h48m23.766068937s) [upload=162139]: Next segment err: metaclient: Too Many Requests Aug 15 05:14:43.034829269 (155h48m23.766096919s) [upload=162139]: Done uploading segments... Aug 15 05:14:43.034851721 (155h48m23.766119381s) [upload=162139]: Upload finished. err: metaclient: Too Many Requests Duration: 349.011255ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [........................................X.....X.............] duration: 127.150141ms FAIL (2025-08-15 05:36:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:29:10.625413412 (156h2m51.356681042s) [upload=162388]: Starting upload Aug 15 05:29:10.625464928 (156h2m51.356732558s) [upload=162388]: Done starting upload Aug 15 05:29:10.625509342 (156h2m51.356776972s) [upload=162388]: Uploading segments... Aug 15 05:29:10.625537325 (156h2m51.356804955s) [upload=162388]: Got next segment. Inline: true Aug 15 05:29:10.625541944 (156h2m51.356809574s) [upload=162388]: Waiting for error group managing segments... Aug 15 05:29:10.625574755 (156h2m51.356842385s) [upload=162388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 05:29:10.625578442 (156h2m51.356846063s) [upload=162388]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 15 05:29:10.625580907 (156h2m51.356848537s) [upload=162388]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 05:29:10.628287364 (156h2m51.359554994s) [upload=162388]: Done uploading segments... Aug 15 05:29:10.628299677 (156h2m51.359567307s) [upload=162388]: Upload finished. err: metaclient: Too Many Requests Duration:* 127.172803ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.........................................X.....X............] duration: 123.451479ms FAIL (2025-08-15 05:36:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:29:10.625413412 (156h2m51.356681042s) [upload=162388]: Starting upload Aug 15 05:29:10.625464928 (156h2m51.356732558s) [upload=162388]: Done starting upload Aug 15 05:29:10.625509342 (156h2m51.356776972s) [upload=162388]: Uploading segments... Aug 15 05:29:10.625537325 (156h2m51.356804955s) [upload=162388]: Got next segment. Inline: true Aug 15 05:29:10.625541944 (156h2m51.356809574s) [upload=162388]: Waiting for error group managing segments... Aug 15 05:29:10.625574755 (156h2m51.356842385s) [upload=162388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 05:29:10.625578442 (156h2m51.356846063s) [upload=162388]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 15 05:29:10.625580907 (156h2m51.356848537s) [upload=162388]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 05:29:10.628287364 (156h2m51.359554994s) [upload=162388]: Done uploading segments... Aug 15 05:29:10.628299677 (156h2m51.359567307s) [upload=162388]: Upload finished. err: metaclient: Too Many Requests Duration:* 123.470554ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 450.543594ms FAIL (2025-08-15 05:36:00 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 450.563661ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.................X...............X..........................] duration: 393.638467ms FAIL (2025-08-15 05:35:57 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:14:43.026246263 (155h48m23.757513964s) [upload=162139]: Starting upload Aug 15 05:14:43.026322296 (155h48m23.757589946s) [upload=162139]: Done starting upload Aug 15 05:14:43.026704666 (155h48m23.757972315s) [upload=162139]: Uploading segments... Aug 15 05:14:43.026761442 (155h48m23.758029122s) [upload=162139]: Got next segment. Inline: false Aug 15 05:14:43.026823739 (155h48m23.758091429s) [upload=162139]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 05:14:43.026833477 (155h48m23.758101137s) [upload=162139]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 15 05:14:43.034801276 (155h48m23.766068937s) [upload=162139]: Next segment err: metaclient: Too Many Requests Aug 15 05:14:43.034829269 (155h48m23.766096919s) [upload=162139]: Done uploading segments... Aug 15 05:14:43.034851721 (155h48m23.766119381s) [upload=162139]: Upload finished. err: metaclient: Too Many Requests Duration: 393.674426ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..........................................X.....X...........] duration: 128.175337ms FAIL (2025-08-15 05:35:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 05:29:10.625413412 (156h2m51.356681042s) [upload=162388]: Starting upload Aug 15 05:29:10.625464928 (156h2m51.356732558s) [upload=162388]: Done starting upload Aug 15 05:29:10.625509342 (156h2m51.356776972s) [upload=162388]: Uploading segments... Aug 15 05:29:10.625537325 (156h2m51.356804955s) [upload=162388]: Got next segment. Inline: true Aug 15 05:29:10.625541944 (156h2m51.356809574s) [upload=162388]: Waiting for error group managing segments... Aug 15 05:29:10.625574755 (156h2m51.356842385s) [upload=162388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 05:29:10.625578442 (156h2m51.356846063s) [upload=162388]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 15 05:29:10.625580907 (156h2m51.356848537s) [upload=162388]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 05:29:10.628287364 (156h2m51.359554994s) [upload=162388]: Done uploading segments... Aug 15 05:29:10.628299677 (156h2m51.359567307s) [upload=162388]: Upload finished. err: metaclient: Too Many Requests Duration:* 128.19821ms core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)