Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
941.10239ms
FAIL (2025-08-22 23:23:33 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 23:16:12.834814859 (341h49m53.56608251s) [upload=355345]: Starting upload Aug 22 23:16:12.834855054 (341h49m53.566122675s) [upload=355345]: Done starting upload Aug 22 23:16:12.834971062 (341h49m53.566238682s) [upload=355345]: Uploading segments... Aug 22 23:16:12.835164355 (341h49m53.566431986s) [upload=355345]: Got next segment. Inline: false Aug 22 23:16:12.835197678 (341h49m53.566465298s) [upload=355345]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 23:16:12.835202087 (341h49m53.566469706s) [upload=355345]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 23:16:12.838521276 (341h49m53.569788906s) [upload=355345]: Next segment err: metaclient: Too Many Requests Aug 22 23:16:12.838537678 (341h49m53.569805297s) [upload=355345]: Done uploading segments... Aug 22 23:16:12.838546483 (341h49m53.569814104s) [upload=355345]: Upload finished. err: metaclient: Too Many Requests
Duration: 941.127137ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
3.071127387s
FAIL (2025-08-22 23:23:22 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
59]: Uploading piece...
Aug 22 22:53:29.611585477 (341h27m10.342853137s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612050902 (341h27m10.343318552s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612464942 (341h27m10.343732591s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612857369 (341h27m10.34412503s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613271678 (341h27m10.344539329s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613655671 (341h27m10.344923321s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614059881 (341h27m10.345327542s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614540405 (341h27m10.345808065s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614942673 (341h27m10.346210322s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.615322797 (341h27m10.346590508s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.618240035 (341h27m10.349507685s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:30.106040273 (341h27m10.837307893s) [upload=354959]: Next returned nil segment
Aug 22 22:53:30.106057475 (341h27m10.837325105s) [upload=354959]: Waiting for error group managing segments...
Aug 22 22:53:30.265188790 (341h27m10.99645643s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.265907802 (341h27m10.997175453s) [noise=true , address=81.171.14.70:4039 , piece_id=UGLARCJIGPJ5BN2PWYD4NM62Z74HLMBKRCCYEKFP2ZAZBGWSYIRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.266528711 (341h27m10.997796351s) [noise=true , address=81.171.14.70:4035 , piece_id=6M22EYTZY734SCUSTKUGF3PNJ2QJLKMA2MAZXV6VPOOM2W4EUUUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.267544280 (341h27m10.998811931s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.268723619 (341h27m10.99999126s) [noise=true , address=89.149.201.147:4015 , piece_id=5WP6YFYWCVWL7QRS2VCDJP576AHQ66NJW742XOW324DIIXMLSBEQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270432624 (341h27m11.001700254s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270515790 (341h27m11.001783431s) [noise=true , address=81.171.14.70:4025 , piece_id=3PV4YNDGP33PBZUHYWLXRSEE3QZO2ZFL2PCEXYSSEWGGWVTFRLPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.271054975 (341h27m11.002322595s) [noise=true , address=81.171.14.70:4031 , piece_id=O6BNM3FOD76GP5I3MJKNZXREQH7XRG7ZOHDNNXRD7HKTSABASTUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.273453727 (341h27m11.004721367s) [noise=true , address=81.171.14.70:4044 , piece_id=JAMFLVIXOT4KL2OPPZGQFLV35GUPBBRX6673QJMB6YDRBZFOGG7Q, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.274998804 (341h27m11.006266424s) [noise=true , address=185.167.204.205:4027 , piece_id=NDAULJLWJRAIVPPNHYKT3WJHG5JS2F6B7RLQQXFJOL3QBNPTADMA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277211505 (341h27m11.008479146s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277435196 (341h27m11.008702816s) [noise=true , address=185.167.204.206:4072 , piece_id=XYAPWQELW5EUKLR62OGEEQVBGNQUTS2J4CC4PLPNTEXP2SWNQRIA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279287400 (341h27m11.01055504s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279410051 (341h27m11.010677681s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280438876 (341h27m11.011706507s) [noise=true , address=185.167.204.206:4056 , piece_id=BQTKVXFXDWMZCV7UBQDMJTE6DII572Q3AJM3JCTW66AP6DIWY5MQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280910263 (341h27m11.012177893s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.281986407 (341h27m11.013254028s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282394265 (341h27m11.013666674s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282761165 (341h27m11.014028785s) [noise=true , address=185.167.204.206:4062 , piece_id=C6LI537WYQRJHUVBTDJCZK35KQHT5JBBLENH5WVGPDJFWCU3RTWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283174292 (341h27m11.014441911s) [noise=true , address=185.167.204.205:4023 , piece_id=YZXWFCP5WW4ARBUTA6XNWHU3KU5U23OMASCOFORJNL6T3UZQDGWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283847198 (341h27m11.015114838s) [noise=true , address=185.167.204.206:4063 , piece_id=E7N65C5KMWXYA67LJW4FLIWRNUP45QNS7OTUYK64UMW2AVWXT7IQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.285333653 (341h27m11.016601274s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.287128550 (341h27m11.01839617s) [noise=true , address=185.167.204.205:4030 , piece_id=V5B4VQCRBKXTTY4PJRVWV5C54HV2MX7PHC53UNKKP7Y3SJJGBARA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.292510313 (341h27m11.023777933s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.296039952 (341h27m11.027307572s) [noise=true , address=185.167.204.206:4068 , piece_id=5WUPBASDPHH7SGA3HLRLN3HMLMABMZTCO5YFUFVLT2FPC4DLFCPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301208034 (341h27m11.032475664s) [noise=true , address=81.171.14.70:4046 , piece_id=4YNKZGJQYOJEB3FFDIK6XALSTARBBMPYCE4GEWIQ5RQROFUHE6CA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301226198 (341h27m11.032493828s) [seg_pos={0 0}, upload=354959]: Segment reached optimal threshold of 26 pieces.
Aug 22 22:53:30.301343489 (341h27m11.032611129s) [noise=true , address=81.171.14.70:4036 , piece_id=OTQRXXAW43EQPVOUO54E6EUPTUZLRPWMHWBV62OKMTUI5QZMDZVQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF
Aug 22 22:53:30.301530851 (341h27m11.032798481s) [noise=true , address=185.167.204.205:4033 , piece_id=ROIUSDQL7GNXUULS6VLF6OIPG6UJOJTNEYLS6THCFIOP3LTL2SBA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe): protocol: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection
Aug 22 22:53:30.301547272 (341h27m11.032814902s) [seg_pos={0 0}, upload=354959]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Aug 22 22:53:30.301638825 (341h27m11.032906455s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 22:53:30.301644756 (341h27m11.032912386s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 22:56:04.281070862 (341h29m45.012338492s) [upload=354959]: Done uploading segments...
Aug 22 22:56:04.281085750 (341h29m45.012353381s) [upload=354959]: Upload finished. err: metaclient: context deadline exceeded
Duration: 3.071144309s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
773.751517ms
FAIL (2025-08-22 23:23:13 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 23:16:12.834814859 (341h49m53.56608251s) [upload=355345]: Starting upload Aug 22 23:16:12.834855054 (341h49m53.566122675s) [upload=355345]: Done starting upload Aug 22 23:16:12.834971062 (341h49m53.566238682s) [upload=355345]: Uploading segments... Aug 22 23:16:12.835164355 (341h49m53.566431986s) [upload=355345]: Got next segment. Inline: false Aug 22 23:16:12.835197678 (341h49m53.566465298s) [upload=355345]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 23:16:12.835202087 (341h49m53.566469706s) [upload=355345]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 23:16:12.838521276 (341h49m53.569788906s) [upload=355345]: Next segment err: metaclient: Too Many Requests Aug 22 23:16:12.838537678 (341h49m53.569805297s) [upload=355345]: Done uploading segments... Aug 22 23:16:12.838546483 (341h49m53.569814104s) [upload=355345]: Upload finished. err: metaclient: Too Many Requests
Duration: 773.77956ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
2.941929202s
FAIL (2025-08-22 23:23:06 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
59]: Uploading piece...
Aug 22 22:53:29.611585477 (341h27m10.342853137s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612050902 (341h27m10.343318552s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612464942 (341h27m10.343732591s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612857369 (341h27m10.34412503s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613271678 (341h27m10.344539329s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613655671 (341h27m10.344923321s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614059881 (341h27m10.345327542s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614540405 (341h27m10.345808065s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614942673 (341h27m10.346210322s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.615322797 (341h27m10.346590508s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.618240035 (341h27m10.349507685s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:30.106040273 (341h27m10.837307893s) [upload=354959]: Next returned nil segment
Aug 22 22:53:30.106057475 (341h27m10.837325105s) [upload=354959]: Waiting for error group managing segments...
Aug 22 22:53:30.265188790 (341h27m10.99645643s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.265907802 (341h27m10.997175453s) [noise=true , address=81.171.14.70:4039 , piece_id=UGLARCJIGPJ5BN2PWYD4NM62Z74HLMBKRCCYEKFP2ZAZBGWSYIRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.266528711 (341h27m10.997796351s) [noise=true , address=81.171.14.70:4035 , piece_id=6M22EYTZY734SCUSTKUGF3PNJ2QJLKMA2MAZXV6VPOOM2W4EUUUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.267544280 (341h27m10.998811931s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.268723619 (341h27m10.99999126s) [noise=true , address=89.149.201.147:4015 , piece_id=5WP6YFYWCVWL7QRS2VCDJP576AHQ66NJW742XOW324DIIXMLSBEQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270432624 (341h27m11.001700254s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270515790 (341h27m11.001783431s) [noise=true , address=81.171.14.70:4025 , piece_id=3PV4YNDGP33PBZUHYWLXRSEE3QZO2ZFL2PCEXYSSEWGGWVTFRLPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.271054975 (341h27m11.002322595s) [noise=true , address=81.171.14.70:4031 , piece_id=O6BNM3FOD76GP5I3MJKNZXREQH7XRG7ZOHDNNXRD7HKTSABASTUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.273453727 (341h27m11.004721367s) [noise=true , address=81.171.14.70:4044 , piece_id=JAMFLVIXOT4KL2OPPZGQFLV35GUPBBRX6673QJMB6YDRBZFOGG7Q, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.274998804 (341h27m11.006266424s) [noise=true , address=185.167.204.205:4027 , piece_id=NDAULJLWJRAIVPPNHYKT3WJHG5JS2F6B7RLQQXFJOL3QBNPTADMA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277211505 (341h27m11.008479146s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277435196 (341h27m11.008702816s) [noise=true , address=185.167.204.206:4072 , piece_id=XYAPWQELW5EUKLR62OGEEQVBGNQUTS2J4CC4PLPNTEXP2SWNQRIA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279287400 (341h27m11.01055504s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279410051 (341h27m11.010677681s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280438876 (341h27m11.011706507s) [noise=true , address=185.167.204.206:4056 , piece_id=BQTKVXFXDWMZCV7UBQDMJTE6DII572Q3AJM3JCTW66AP6DIWY5MQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280910263 (341h27m11.012177893s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.281986407 (341h27m11.013254028s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282394265 (341h27m11.013666674s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282761165 (341h27m11.014028785s) [noise=true , address=185.167.204.206:4062 , piece_id=C6LI537WYQRJHUVBTDJCZK35KQHT5JBBLENH5WVGPDJFWCU3RTWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283174292 (341h27m11.014441911s) [noise=true , address=185.167.204.205:4023 , piece_id=YZXWFCP5WW4ARBUTA6XNWHU3KU5U23OMASCOFORJNL6T3UZQDGWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283847198 (341h27m11.015114838s) [noise=true , address=185.167.204.206:4063 , piece_id=E7N65C5KMWXYA67LJW4FLIWRNUP45QNS7OTUYK64UMW2AVWXT7IQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.285333653 (341h27m11.016601274s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.287128550 (341h27m11.01839617s) [noise=true , address=185.167.204.205:4030 , piece_id=V5B4VQCRBKXTTY4PJRVWV5C54HV2MX7PHC53UNKKP7Y3SJJGBARA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.292510313 (341h27m11.023777933s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.296039952 (341h27m11.027307572s) [noise=true , address=185.167.204.206:4068 , piece_id=5WUPBASDPHH7SGA3HLRLN3HMLMABMZTCO5YFUFVLT2FPC4DLFCPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301208034 (341h27m11.032475664s) [noise=true , address=81.171.14.70:4046 , piece_id=4YNKZGJQYOJEB3FFDIK6XALSTARBBMPYCE4GEWIQ5RQROFUHE6CA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301226198 (341h27m11.032493828s) [seg_pos={0 0}, upload=354959]: Segment reached optimal threshold of 26 pieces.
Aug 22 22:53:30.301343489 (341h27m11.032611129s) [noise=true , address=81.171.14.70:4036 , piece_id=OTQRXXAW43EQPVOUO54E6EUPTUZLRPWMHWBV62OKMTUI5QZMDZVQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF
Aug 22 22:53:30.301530851 (341h27m11.032798481s) [noise=true , address=185.167.204.205:4033 , piece_id=ROIUSDQL7GNXUULS6VLF6OIPG6UJOJTNEYLS6THCFIOP3LTL2SBA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe): protocol: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection
Aug 22 22:53:30.301547272 (341h27m11.032814902s) [seg_pos={0 0}, upload=354959]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Aug 22 22:53:30.301638825 (341h27m11.032906455s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 22:53:30.301644756 (341h27m11.032912386s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 22:56:04.281070862 (341h29m45.012338492s) [upload=354959]: Done uploading segments...
Aug 22 22:56:04.281085750 (341h29m45.012353381s) [upload=354959]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.941953077s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [............................X......X........................] duration:
170.429329ms
FAIL (2025-08-22 23:22:47 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 22 23:04:34.193786424 (341h38m14.925054054s) [upload=355145]: Starting upload Aug 22 23:04:34.193855373 (341h38m14.925123003s) [upload=355145]: Done starting upload Aug 22 23:04:34.193917851 (341h38m14.925185481s) [upload=355145]: Uploading segments... Aug 22 23:04:34.193995587 (341h38m14.925263217s) [upload=355145]: Got next segment. Inline: true Aug 22 23:04:34.194002741 (341h38m14.925270371s) [upload=355145]: Waiting for error group managing segments... Aug 22 23:04:34.194052023 (341h38m14.925319653s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 23:04:34.194058906 (341h38m14.925326526s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 23:04:34.194063054 (341h38m14.925330684s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 23:04:34.545689514 (341h38m15.276957164s) [upload=355145]: Done uploading segments... Aug 22 23:04:34.545718478 (341h38m15.276986128s) [upload=355145]: Upload finished. err: <nil>
Duration: 170.449367ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............................X......X.......................] duration:
249.549716ms
FAIL (2025-08-22 23:22:22 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 22 23:04:34.193786424 (341h38m14.925054054s) [upload=355145]: Starting upload Aug 22 23:04:34.193855373 (341h38m14.925123003s) [upload=355145]: Done starting upload Aug 22 23:04:34.193917851 (341h38m14.925185481s) [upload=355145]: Uploading segments... Aug 22 23:04:34.193995587 (341h38m14.925263217s) [upload=355145]: Got next segment. Inline: true Aug 22 23:04:34.194002741 (341h38m14.925270371s) [upload=355145]: Waiting for error group managing segments... Aug 22 23:04:34.194052023 (341h38m14.925319653s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 23:04:34.194058906 (341h38m14.925326526s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 23:04:34.194063054 (341h38m14.925330684s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 23:04:34.545689514 (341h38m15.276957164s) [upload=355145]: Done uploading segments... Aug 22 23:04:34.545718478 (341h38m15.276986128s) [upload=355145]: Upload finished. err: <nil>
Duration: 249.569853ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
2.450156893s
FAIL (2025-08-22 23:22:20 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 23:16:12.834814859 (341h49m53.56608251s) [upload=355345]: Starting upload Aug 22 23:16:12.834855054 (341h49m53.566122675s) [upload=355345]: Done starting upload Aug 22 23:16:12.834971062 (341h49m53.566238682s) [upload=355345]: Uploading segments... Aug 22 23:16:12.835164355 (341h49m53.566431986s) [upload=355345]: Got next segment. Inline: false Aug 22 23:16:12.835197678 (341h49m53.566465298s) [upload=355345]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 23:16:12.835202087 (341h49m53.566469706s) [upload=355345]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 23:16:12.838521276 (341h49m53.569788906s) [upload=355345]: Next segment err: metaclient: Too Many Requests Aug 22 23:16:12.838537678 (341h49m53.569805297s) [upload=355345]: Done uploading segments... Aug 22 23:16:12.838546483 (341h49m53.569814104s) [upload=355345]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.450177491s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
6.544248806s
FAIL (2025-08-22 23:22:20 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
59]: Uploading piece...
Aug 22 22:53:29.611585477 (341h27m10.342853137s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612050902 (341h27m10.343318552s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612464942 (341h27m10.343732591s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612857369 (341h27m10.34412503s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613271678 (341h27m10.344539329s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613655671 (341h27m10.344923321s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614059881 (341h27m10.345327542s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614540405 (341h27m10.345808065s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614942673 (341h27m10.346210322s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.615322797 (341h27m10.346590508s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.618240035 (341h27m10.349507685s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:30.106040273 (341h27m10.837307893s) [upload=354959]: Next returned nil segment
Aug 22 22:53:30.106057475 (341h27m10.837325105s) [upload=354959]: Waiting for error group managing segments...
Aug 22 22:53:30.265188790 (341h27m10.99645643s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.265907802 (341h27m10.997175453s) [noise=true , address=81.171.14.70:4039 , piece_id=UGLARCJIGPJ5BN2PWYD4NM62Z74HLMBKRCCYEKFP2ZAZBGWSYIRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.266528711 (341h27m10.997796351s) [noise=true , address=81.171.14.70:4035 , piece_id=6M22EYTZY734SCUSTKUGF3PNJ2QJLKMA2MAZXV6VPOOM2W4EUUUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.267544280 (341h27m10.998811931s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.268723619 (341h27m10.99999126s) [noise=true , address=89.149.201.147:4015 , piece_id=5WP6YFYWCVWL7QRS2VCDJP576AHQ66NJW742XOW324DIIXMLSBEQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270432624 (341h27m11.001700254s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270515790 (341h27m11.001783431s) [noise=true , address=81.171.14.70:4025 , piece_id=3PV4YNDGP33PBZUHYWLXRSEE3QZO2ZFL2PCEXYSSEWGGWVTFRLPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.271054975 (341h27m11.002322595s) [noise=true , address=81.171.14.70:4031 , piece_id=O6BNM3FOD76GP5I3MJKNZXREQH7XRG7ZOHDNNXRD7HKTSABASTUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.273453727 (341h27m11.004721367s) [noise=true , address=81.171.14.70:4044 , piece_id=JAMFLVIXOT4KL2OPPZGQFLV35GUPBBRX6673QJMB6YDRBZFOGG7Q, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.274998804 (341h27m11.006266424s) [noise=true , address=185.167.204.205:4027 , piece_id=NDAULJLWJRAIVPPNHYKT3WJHG5JS2F6B7RLQQXFJOL3QBNPTADMA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277211505 (341h27m11.008479146s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277435196 (341h27m11.008702816s) [noise=true , address=185.167.204.206:4072 , piece_id=XYAPWQELW5EUKLR62OGEEQVBGNQUTS2J4CC4PLPNTEXP2SWNQRIA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279287400 (341h27m11.01055504s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279410051 (341h27m11.010677681s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280438876 (341h27m11.011706507s) [noise=true , address=185.167.204.206:4056 , piece_id=BQTKVXFXDWMZCV7UBQDMJTE6DII572Q3AJM3JCTW66AP6DIWY5MQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280910263 (341h27m11.012177893s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.281986407 (341h27m11.013254028s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282394265 (341h27m11.013666674s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282761165 (341h27m11.014028785s) [noise=true , address=185.167.204.206:4062 , piece_id=C6LI537WYQRJHUVBTDJCZK35KQHT5JBBLENH5WVGPDJFWCU3RTWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283174292 (341h27m11.014441911s) [noise=true , address=185.167.204.205:4023 , piece_id=YZXWFCP5WW4ARBUTA6XNWHU3KU5U23OMASCOFORJNL6T3UZQDGWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283847198 (341h27m11.015114838s) [noise=true , address=185.167.204.206:4063 , piece_id=E7N65C5KMWXYA67LJW4FLIWRNUP45QNS7OTUYK64UMW2AVWXT7IQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.285333653 (341h27m11.016601274s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.287128550 (341h27m11.01839617s) [noise=true , address=185.167.204.205:4030 , piece_id=V5B4VQCRBKXTTY4PJRVWV5C54HV2MX7PHC53UNKKP7Y3SJJGBARA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.292510313 (341h27m11.023777933s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.296039952 (341h27m11.027307572s) [noise=true , address=185.167.204.206:4068 , piece_id=5WUPBASDPHH7SGA3HLRLN3HMLMABMZTCO5YFUFVLT2FPC4DLFCPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301208034 (341h27m11.032475664s) [noise=true , address=81.171.14.70:4046 , piece_id=4YNKZGJQYOJEB3FFDIK6XALSTARBBMPYCE4GEWIQ5RQROFUHE6CA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301226198 (341h27m11.032493828s) [seg_pos={0 0}, upload=354959]: Segment reached optimal threshold of 26 pieces.
Aug 22 22:53:30.301343489 (341h27m11.032611129s) [noise=true , address=81.171.14.70:4036 , piece_id=OTQRXXAW43EQPVOUO54E6EUPTUZLRPWMHWBV62OKMTUI5QZMDZVQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF
Aug 22 22:53:30.301530851 (341h27m11.032798481s) [noise=true , address=185.167.204.205:4033 , piece_id=ROIUSDQL7GNXUULS6VLF6OIPG6UJOJTNEYLS6THCFIOP3LTL2SBA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe): protocol: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection
Aug 22 22:53:30.301547272 (341h27m11.032814902s) [seg_pos={0 0}, upload=354959]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Aug 22 22:53:30.301638825 (341h27m11.032906455s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 22:53:30.301644756 (341h27m11.032912386s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 22:56:04.281070862 (341h29m45.012338492s) [upload=354959]: Done uploading segments...
Aug 22 22:56:04.281085750 (341h29m45.012353381s) [upload=354959]: Upload finished. err: metaclient: context deadline exceeded
Duration: 6.544280675s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
1.950580006s
FAIL (2025-08-22 23:22:01 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 23:16:12.834814859 (341h49m53.56608251s) [upload=355345]: Starting upload Aug 22 23:16:12.834855054 (341h49m53.566122675s) [upload=355345]: Done starting upload Aug 22 23:16:12.834971062 (341h49m53.566238682s) [upload=355345]: Uploading segments... Aug 22 23:16:12.835164355 (341h49m53.566431986s) [upload=355345]: Got next segment. Inline: false Aug 22 23:16:12.835197678 (341h49m53.566465298s) [upload=355345]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 23:16:12.835202087 (341h49m53.566469706s) [upload=355345]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 23:16:12.838521276 (341h49m53.569788906s) [upload=355345]: Next segment err: metaclient: Too Many Requests Aug 22 23:16:12.838537678 (341h49m53.569805297s) [upload=355345]: Done uploading segments... Aug 22 23:16:12.838546483 (341h49m53.569814104s) [upload=355345]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.950603019s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
2.512266823s
FAIL (2025-08-22 23:21:36 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
59]: Uploading piece...
Aug 22 22:53:29.611585477 (341h27m10.342853137s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612050902 (341h27m10.343318552s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612464942 (341h27m10.343732591s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612857369 (341h27m10.34412503s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613271678 (341h27m10.344539329s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613655671 (341h27m10.344923321s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614059881 (341h27m10.345327542s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614540405 (341h27m10.345808065s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614942673 (341h27m10.346210322s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.615322797 (341h27m10.346590508s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.618240035 (341h27m10.349507685s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:30.106040273 (341h27m10.837307893s) [upload=354959]: Next returned nil segment
Aug 22 22:53:30.106057475 (341h27m10.837325105s) [upload=354959]: Waiting for error group managing segments...
Aug 22 22:53:30.265188790 (341h27m10.99645643s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.265907802 (341h27m10.997175453s) [noise=true , address=81.171.14.70:4039 , piece_id=UGLARCJIGPJ5BN2PWYD4NM62Z74HLMBKRCCYEKFP2ZAZBGWSYIRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.266528711 (341h27m10.997796351s) [noise=true , address=81.171.14.70:4035 , piece_id=6M22EYTZY734SCUSTKUGF3PNJ2QJLKMA2MAZXV6VPOOM2W4EUUUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.267544280 (341h27m10.998811931s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.268723619 (341h27m10.99999126s) [noise=true , address=89.149.201.147:4015 , piece_id=5WP6YFYWCVWL7QRS2VCDJP576AHQ66NJW742XOW324DIIXMLSBEQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270432624 (341h27m11.001700254s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270515790 (341h27m11.001783431s) [noise=true , address=81.171.14.70:4025 , piece_id=3PV4YNDGP33PBZUHYWLXRSEE3QZO2ZFL2PCEXYSSEWGGWVTFRLPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.271054975 (341h27m11.002322595s) [noise=true , address=81.171.14.70:4031 , piece_id=O6BNM3FOD76GP5I3MJKNZXREQH7XRG7ZOHDNNXRD7HKTSABASTUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.273453727 (341h27m11.004721367s) [noise=true , address=81.171.14.70:4044 , piece_id=JAMFLVIXOT4KL2OPPZGQFLV35GUPBBRX6673QJMB6YDRBZFOGG7Q, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.274998804 (341h27m11.006266424s) [noise=true , address=185.167.204.205:4027 , piece_id=NDAULJLWJRAIVPPNHYKT3WJHG5JS2F6B7RLQQXFJOL3QBNPTADMA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277211505 (341h27m11.008479146s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277435196 (341h27m11.008702816s) [noise=true , address=185.167.204.206:4072 , piece_id=XYAPWQELW5EUKLR62OGEEQVBGNQUTS2J4CC4PLPNTEXP2SWNQRIA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279287400 (341h27m11.01055504s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279410051 (341h27m11.010677681s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280438876 (341h27m11.011706507s) [noise=true , address=185.167.204.206:4056 , piece_id=BQTKVXFXDWMZCV7UBQDMJTE6DII572Q3AJM3JCTW66AP6DIWY5MQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280910263 (341h27m11.012177893s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.281986407 (341h27m11.013254028s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282394265 (341h27m11.013666674s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282761165 (341h27m11.014028785s) [noise=true , address=185.167.204.206:4062 , piece_id=C6LI537WYQRJHUVBTDJCZK35KQHT5JBBLENH5WVGPDJFWCU3RTWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283174292 (341h27m11.014441911s) [noise=true , address=185.167.204.205:4023 , piece_id=YZXWFCP5WW4ARBUTA6XNWHU3KU5U23OMASCOFORJNL6T3UZQDGWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283847198 (341h27m11.015114838s) [noise=true , address=185.167.204.206:4063 , piece_id=E7N65C5KMWXYA67LJW4FLIWRNUP45QNS7OTUYK64UMW2AVWXT7IQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.285333653 (341h27m11.016601274s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.287128550 (341h27m11.01839617s) [noise=true , address=185.167.204.205:4030 , piece_id=V5B4VQCRBKXTTY4PJRVWV5C54HV2MX7PHC53UNKKP7Y3SJJGBARA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.292510313 (341h27m11.023777933s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.296039952 (341h27m11.027307572s) [noise=true , address=185.167.204.206:4068 , piece_id=5WUPBASDPHH7SGA3HLRLN3HMLMABMZTCO5YFUFVLT2FPC4DLFCPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301208034 (341h27m11.032475664s) [noise=true , address=81.171.14.70:4046 , piece_id=4YNKZGJQYOJEB3FFDIK6XALSTARBBMPYCE4GEWIQ5RQROFUHE6CA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301226198 (341h27m11.032493828s) [seg_pos={0 0}, upload=354959]: Segment reached optimal threshold of 26 pieces.
Aug 22 22:53:30.301343489 (341h27m11.032611129s) [noise=true , address=81.171.14.70:4036 , piece_id=OTQRXXAW43EQPVOUO54E6EUPTUZLRPWMHWBV62OKMTUI5QZMDZVQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF
Aug 22 22:53:30.301530851 (341h27m11.032798481s) [noise=true , address=185.167.204.205:4033 , piece_id=ROIUSDQL7GNXUULS6VLF6OIPG6UJOJTNEYLS6THCFIOP3LTL2SBA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe): protocol: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection
Aug 22 22:53:30.301547272 (341h27m11.032814902s) [seg_pos={0 0}, upload=354959]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Aug 22 22:53:30.301638825 (341h27m11.032906455s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 22:53:30.301644756 (341h27m11.032912386s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 22:56:04.281070862 (341h29m45.012338492s) [upload=354959]: Done uploading segments...
Aug 22 22:56:04.281085750 (341h29m45.012353381s) [upload=354959]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.512288383s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............................X......X......................] duration:
205.490596ms
FAIL (2025-08-22 23:21:22 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 22 23:04:34.193786424 (341h38m14.925054054s) [upload=355145]: Starting upload Aug 22 23:04:34.193855373 (341h38m14.925123003s) [upload=355145]: Done starting upload Aug 22 23:04:34.193917851 (341h38m14.925185481s) [upload=355145]: Uploading segments... Aug 22 23:04:34.193995587 (341h38m14.925263217s) [upload=355145]: Got next segment. Inline: true Aug 22 23:04:34.194002741 (341h38m14.925270371s) [upload=355145]: Waiting for error group managing segments... Aug 22 23:04:34.194052023 (341h38m14.925319653s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 23:04:34.194058906 (341h38m14.925326526s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 23:04:34.194063054 (341h38m14.925330684s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 23:04:34.545689514 (341h38m15.276957164s) [upload=355145]: Done uploading segments... Aug 22 23:04:34.545718478 (341h38m15.276986128s) [upload=355145]: Upload finished. err: <nil>
Duration: 205.632723ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
2.824706479s
FAIL (2025-08-22 23:21:14 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
59]: Uploading piece...
Aug 22 22:53:29.611585477 (341h27m10.342853137s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612050902 (341h27m10.343318552s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612464942 (341h27m10.343732591s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612857369 (341h27m10.34412503s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613271678 (341h27m10.344539329s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613655671 (341h27m10.344923321s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614059881 (341h27m10.345327542s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614540405 (341h27m10.345808065s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614942673 (341h27m10.346210322s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.615322797 (341h27m10.346590508s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.618240035 (341h27m10.349507685s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:30.106040273 (341h27m10.837307893s) [upload=354959]: Next returned nil segment
Aug 22 22:53:30.106057475 (341h27m10.837325105s) [upload=354959]: Waiting for error group managing segments...
Aug 22 22:53:30.265188790 (341h27m10.99645643s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.265907802 (341h27m10.997175453s) [noise=true , address=81.171.14.70:4039 , piece_id=UGLARCJIGPJ5BN2PWYD4NM62Z74HLMBKRCCYEKFP2ZAZBGWSYIRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.266528711 (341h27m10.997796351s) [noise=true , address=81.171.14.70:4035 , piece_id=6M22EYTZY734SCUSTKUGF3PNJ2QJLKMA2MAZXV6VPOOM2W4EUUUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.267544280 (341h27m10.998811931s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.268723619 (341h27m10.99999126s) [noise=true , address=89.149.201.147:4015 , piece_id=5WP6YFYWCVWL7QRS2VCDJP576AHQ66NJW742XOW324DIIXMLSBEQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270432624 (341h27m11.001700254s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270515790 (341h27m11.001783431s) [noise=true , address=81.171.14.70:4025 , piece_id=3PV4YNDGP33PBZUHYWLXRSEE3QZO2ZFL2PCEXYSSEWGGWVTFRLPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.271054975 (341h27m11.002322595s) [noise=true , address=81.171.14.70:4031 , piece_id=O6BNM3FOD76GP5I3MJKNZXREQH7XRG7ZOHDNNXRD7HKTSABASTUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.273453727 (341h27m11.004721367s) [noise=true , address=81.171.14.70:4044 , piece_id=JAMFLVIXOT4KL2OPPZGQFLV35GUPBBRX6673QJMB6YDRBZFOGG7Q, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.274998804 (341h27m11.006266424s) [noise=true , address=185.167.204.205:4027 , piece_id=NDAULJLWJRAIVPPNHYKT3WJHG5JS2F6B7RLQQXFJOL3QBNPTADMA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277211505 (341h27m11.008479146s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277435196 (341h27m11.008702816s) [noise=true , address=185.167.204.206:4072 , piece_id=XYAPWQELW5EUKLR62OGEEQVBGNQUTS2J4CC4PLPNTEXP2SWNQRIA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279287400 (341h27m11.01055504s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279410051 (341h27m11.010677681s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280438876 (341h27m11.011706507s) [noise=true , address=185.167.204.206:4056 , piece_id=BQTKVXFXDWMZCV7UBQDMJTE6DII572Q3AJM3JCTW66AP6DIWY5MQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280910263 (341h27m11.012177893s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.281986407 (341h27m11.013254028s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282394265 (341h27m11.013666674s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282761165 (341h27m11.014028785s) [noise=true , address=185.167.204.206:4062 , piece_id=C6LI537WYQRJHUVBTDJCZK35KQHT5JBBLENH5WVGPDJFWCU3RTWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283174292 (341h27m11.014441911s) [noise=true , address=185.167.204.205:4023 , piece_id=YZXWFCP5WW4ARBUTA6XNWHU3KU5U23OMASCOFORJNL6T3UZQDGWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283847198 (341h27m11.015114838s) [noise=true , address=185.167.204.206:4063 , piece_id=E7N65C5KMWXYA67LJW4FLIWRNUP45QNS7OTUYK64UMW2AVWXT7IQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.285333653 (341h27m11.016601274s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.287128550 (341h27m11.01839617s) [noise=true , address=185.167.204.205:4030 , piece_id=V5B4VQCRBKXTTY4PJRVWV5C54HV2MX7PHC53UNKKP7Y3SJJGBARA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.292510313 (341h27m11.023777933s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.296039952 (341h27m11.027307572s) [noise=true , address=185.167.204.206:4068 , piece_id=5WUPBASDPHH7SGA3HLRLN3HMLMABMZTCO5YFUFVLT2FPC4DLFCPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301208034 (341h27m11.032475664s) [noise=true , address=81.171.14.70:4046 , piece_id=4YNKZGJQYOJEB3FFDIK6XALSTARBBMPYCE4GEWIQ5RQROFUHE6CA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301226198 (341h27m11.032493828s) [seg_pos={0 0}, upload=354959]: Segment reached optimal threshold of 26 pieces.
Aug 22 22:53:30.301343489 (341h27m11.032611129s) [noise=true , address=81.171.14.70:4036 , piece_id=OTQRXXAW43EQPVOUO54E6EUPTUZLRPWMHWBV62OKMTUI5QZMDZVQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF
Aug 22 22:53:30.301530851 (341h27m11.032798481s) [noise=true , address=185.167.204.205:4033 , piece_id=ROIUSDQL7GNXUULS6VLF6OIPG6UJOJTNEYLS6THCFIOP3LTL2SBA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe): protocol: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection
Aug 22 22:53:30.301547272 (341h27m11.032814902s) [seg_pos={0 0}, upload=354959]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Aug 22 22:53:30.301638825 (341h27m11.032906455s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 22:53:30.301644756 (341h27m11.032912386s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 22:56:04.281070862 (341h29m45.012338492s) [upload=354959]: Done uploading segments...
Aug 22 22:56:04.281085750 (341h29m45.012353381s) [upload=354959]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.824725395s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
612.446816ms
FAIL (2025-08-22 23:21:00 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 23:16:12.834814859 (341h49m53.56608251s) [upload=355345]: Starting upload Aug 22 23:16:12.834855054 (341h49m53.566122675s) [upload=355345]: Done starting upload Aug 22 23:16:12.834971062 (341h49m53.566238682s) [upload=355345]: Uploading segments... Aug 22 23:16:12.835164355 (341h49m53.566431986s) [upload=355345]: Got next segment. Inline: false Aug 22 23:16:12.835197678 (341h49m53.566465298s) [upload=355345]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 23:16:12.835202087 (341h49m53.566469706s) [upload=355345]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 23:16:12.838521276 (341h49m53.569788906s) [upload=355345]: Next segment err: metaclient: Too Many Requests Aug 22 23:16:12.838537678 (341h49m53.569805297s) [upload=355345]: Done uploading segments... Aug 22 23:16:12.838546483 (341h49m53.569814104s) [upload=355345]: Upload finished. err: metaclient: Too Many Requests
Duration: 612.474267ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
2.731244294s
FAIL (2025-08-22 23:20:57 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
59]: Uploading piece...
Aug 22 22:53:29.611585477 (341h27m10.342853137s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612050902 (341h27m10.343318552s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612464942 (341h27m10.343732591s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612857369 (341h27m10.34412503s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613271678 (341h27m10.344539329s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613655671 (341h27m10.344923321s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614059881 (341h27m10.345327542s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614540405 (341h27m10.345808065s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614942673 (341h27m10.346210322s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.615322797 (341h27m10.346590508s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.618240035 (341h27m10.349507685s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:30.106040273 (341h27m10.837307893s) [upload=354959]: Next returned nil segment
Aug 22 22:53:30.106057475 (341h27m10.837325105s) [upload=354959]: Waiting for error group managing segments...
Aug 22 22:53:30.265188790 (341h27m10.99645643s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.265907802 (341h27m10.997175453s) [noise=true , address=81.171.14.70:4039 , piece_id=UGLARCJIGPJ5BN2PWYD4NM62Z74HLMBKRCCYEKFP2ZAZBGWSYIRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.266528711 (341h27m10.997796351s) [noise=true , address=81.171.14.70:4035 , piece_id=6M22EYTZY734SCUSTKUGF3PNJ2QJLKMA2MAZXV6VPOOM2W4EUUUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.267544280 (341h27m10.998811931s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.268723619 (341h27m10.99999126s) [noise=true , address=89.149.201.147:4015 , piece_id=5WP6YFYWCVWL7QRS2VCDJP576AHQ66NJW742XOW324DIIXMLSBEQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270432624 (341h27m11.001700254s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270515790 (341h27m11.001783431s) [noise=true , address=81.171.14.70:4025 , piece_id=3PV4YNDGP33PBZUHYWLXRSEE3QZO2ZFL2PCEXYSSEWGGWVTFRLPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.271054975 (341h27m11.002322595s) [noise=true , address=81.171.14.70:4031 , piece_id=O6BNM3FOD76GP5I3MJKNZXREQH7XRG7ZOHDNNXRD7HKTSABASTUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.273453727 (341h27m11.004721367s) [noise=true , address=81.171.14.70:4044 , piece_id=JAMFLVIXOT4KL2OPPZGQFLV35GUPBBRX6673QJMB6YDRBZFOGG7Q, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.274998804 (341h27m11.006266424s) [noise=true , address=185.167.204.205:4027 , piece_id=NDAULJLWJRAIVPPNHYKT3WJHG5JS2F6B7RLQQXFJOL3QBNPTADMA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277211505 (341h27m11.008479146s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277435196 (341h27m11.008702816s) [noise=true , address=185.167.204.206:4072 , piece_id=XYAPWQELW5EUKLR62OGEEQVBGNQUTS2J4CC4PLPNTEXP2SWNQRIA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279287400 (341h27m11.01055504s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279410051 (341h27m11.010677681s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280438876 (341h27m11.011706507s) [noise=true , address=185.167.204.206:4056 , piece_id=BQTKVXFXDWMZCV7UBQDMJTE6DII572Q3AJM3JCTW66AP6DIWY5MQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280910263 (341h27m11.012177893s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.281986407 (341h27m11.013254028s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282394265 (341h27m11.013666674s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282761165 (341h27m11.014028785s) [noise=true , address=185.167.204.206:4062 , piece_id=C6LI537WYQRJHUVBTDJCZK35KQHT5JBBLENH5WVGPDJFWCU3RTWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283174292 (341h27m11.014441911s) [noise=true , address=185.167.204.205:4023 , piece_id=YZXWFCP5WW4ARBUTA6XNWHU3KU5U23OMASCOFORJNL6T3UZQDGWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283847198 (341h27m11.015114838s) [noise=true , address=185.167.204.206:4063 , piece_id=E7N65C5KMWXYA67LJW4FLIWRNUP45QNS7OTUYK64UMW2AVWXT7IQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.285333653 (341h27m11.016601274s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.287128550 (341h27m11.01839617s) [noise=true , address=185.167.204.205:4030 , piece_id=V5B4VQCRBKXTTY4PJRVWV5C54HV2MX7PHC53UNKKP7Y3SJJGBARA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.292510313 (341h27m11.023777933s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.296039952 (341h27m11.027307572s) [noise=true , address=185.167.204.206:4068 , piece_id=5WUPBASDPHH7SGA3HLRLN3HMLMABMZTCO5YFUFVLT2FPC4DLFCPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301208034 (341h27m11.032475664s) [noise=true , address=81.171.14.70:4046 , piece_id=4YNKZGJQYOJEB3FFDIK6XALSTARBBMPYCE4GEWIQ5RQROFUHE6CA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301226198 (341h27m11.032493828s) [seg_pos={0 0}, upload=354959]: Segment reached optimal threshold of 26 pieces.
Aug 22 22:53:30.301343489 (341h27m11.032611129s) [noise=true , address=81.171.14.70:4036 , piece_id=OTQRXXAW43EQPVOUO54E6EUPTUZLRPWMHWBV62OKMTUI5QZMDZVQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF
Aug 22 22:53:30.301530851 (341h27m11.032798481s) [noise=true , address=185.167.204.205:4033 , piece_id=ROIUSDQL7GNXUULS6VLF6OIPG6UJOJTNEYLS6THCFIOP3LTL2SBA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe): protocol: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection
Aug 22 22:53:30.301547272 (341h27m11.032814902s) [seg_pos={0 0}, upload=354959]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Aug 22 22:53:30.301638825 (341h27m11.032906455s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 22:53:30.301644756 (341h27m11.032912386s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 22:56:04.281070862 (341h29m45.012338492s) [upload=354959]: Done uploading segments...
Aug 22 22:56:04.281085750 (341h29m45.012353381s) [upload=354959]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.731265963s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............................X......X.....................] duration:
155.977529ms
FAIL (2025-08-22 23:20:49 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 22 23:04:34.193786424 (341h38m14.925054054s) [upload=355145]: Starting upload Aug 22 23:04:34.193855373 (341h38m14.925123003s) [upload=355145]: Done starting upload Aug 22 23:04:34.193917851 (341h38m14.925185481s) [upload=355145]: Uploading segments... Aug 22 23:04:34.193995587 (341h38m14.925263217s) [upload=355145]: Got next segment. Inline: true Aug 22 23:04:34.194002741 (341h38m14.925270371s) [upload=355145]: Waiting for error group managing segments... Aug 22 23:04:34.194052023 (341h38m14.925319653s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 23:04:34.194058906 (341h38m14.925326526s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 23:04:34.194063054 (341h38m14.925330684s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 23:04:34.545689514 (341h38m15.276957164s) [upload=355145]: Done uploading segments... Aug 22 23:04:34.545718478 (341h38m15.276986128s) [upload=355145]: Upload finished. err: <nil>
Duration: 155.996905ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
1.410678045s
FAIL (2025-08-22 23:20:46 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 23:16:12.834814859 (341h49m53.56608251s) [upload=355345]: Starting upload Aug 22 23:16:12.834855054 (341h49m53.566122675s) [upload=355345]: Done starting upload Aug 22 23:16:12.834971062 (341h49m53.566238682s) [upload=355345]: Uploading segments... Aug 22 23:16:12.835164355 (341h49m53.566431986s) [upload=355345]: Got next segment. Inline: false Aug 22 23:16:12.835197678 (341h49m53.566465298s) [upload=355345]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 23:16:12.835202087 (341h49m53.566469706s) [upload=355345]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 23:16:12.838521276 (341h49m53.569788906s) [upload=355345]: Next segment err: metaclient: Too Many Requests Aug 22 23:16:12.838537678 (341h49m53.569805297s) [upload=355345]: Done uploading segments... Aug 22 23:16:12.838546483 (341h49m53.569814104s) [upload=355345]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.410696001s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
2.860495199s
FAIL (2025-08-22 23:20:12 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
59]: Uploading piece...
Aug 22 22:53:29.611585477 (341h27m10.342853137s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612050902 (341h27m10.343318552s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612464942 (341h27m10.343732591s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612857369 (341h27m10.34412503s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613271678 (341h27m10.344539329s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613655671 (341h27m10.344923321s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614059881 (341h27m10.345327542s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614540405 (341h27m10.345808065s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614942673 (341h27m10.346210322s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.615322797 (341h27m10.346590508s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.618240035 (341h27m10.349507685s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:30.106040273 (341h27m10.837307893s) [upload=354959]: Next returned nil segment
Aug 22 22:53:30.106057475 (341h27m10.837325105s) [upload=354959]: Waiting for error group managing segments...
Aug 22 22:53:30.265188790 (341h27m10.99645643s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.265907802 (341h27m10.997175453s) [noise=true , address=81.171.14.70:4039 , piece_id=UGLARCJIGPJ5BN2PWYD4NM62Z74HLMBKRCCYEKFP2ZAZBGWSYIRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.266528711 (341h27m10.997796351s) [noise=true , address=81.171.14.70:4035 , piece_id=6M22EYTZY734SCUSTKUGF3PNJ2QJLKMA2MAZXV6VPOOM2W4EUUUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.267544280 (341h27m10.998811931s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.268723619 (341h27m10.99999126s) [noise=true , address=89.149.201.147:4015 , piece_id=5WP6YFYWCVWL7QRS2VCDJP576AHQ66NJW742XOW324DIIXMLSBEQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270432624 (341h27m11.001700254s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270515790 (341h27m11.001783431s) [noise=true , address=81.171.14.70:4025 , piece_id=3PV4YNDGP33PBZUHYWLXRSEE3QZO2ZFL2PCEXYSSEWGGWVTFRLPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.271054975 (341h27m11.002322595s) [noise=true , address=81.171.14.70:4031 , piece_id=O6BNM3FOD76GP5I3MJKNZXREQH7XRG7ZOHDNNXRD7HKTSABASTUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.273453727 (341h27m11.004721367s) [noise=true , address=81.171.14.70:4044 , piece_id=JAMFLVIXOT4KL2OPPZGQFLV35GUPBBRX6673QJMB6YDRBZFOGG7Q, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.274998804 (341h27m11.006266424s) [noise=true , address=185.167.204.205:4027 , piece_id=NDAULJLWJRAIVPPNHYKT3WJHG5JS2F6B7RLQQXFJOL3QBNPTADMA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277211505 (341h27m11.008479146s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277435196 (341h27m11.008702816s) [noise=true , address=185.167.204.206:4072 , piece_id=XYAPWQELW5EUKLR62OGEEQVBGNQUTS2J4CC4PLPNTEXP2SWNQRIA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279287400 (341h27m11.01055504s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279410051 (341h27m11.010677681s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280438876 (341h27m11.011706507s) [noise=true , address=185.167.204.206:4056 , piece_id=BQTKVXFXDWMZCV7UBQDMJTE6DII572Q3AJM3JCTW66AP6DIWY5MQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280910263 (341h27m11.012177893s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.281986407 (341h27m11.013254028s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282394265 (341h27m11.013666674s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282761165 (341h27m11.014028785s) [noise=true , address=185.167.204.206:4062 , piece_id=C6LI537WYQRJHUVBTDJCZK35KQHT5JBBLENH5WVGPDJFWCU3RTWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283174292 (341h27m11.014441911s) [noise=true , address=185.167.204.205:4023 , piece_id=YZXWFCP5WW4ARBUTA6XNWHU3KU5U23OMASCOFORJNL6T3UZQDGWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283847198 (341h27m11.015114838s) [noise=true , address=185.167.204.206:4063 , piece_id=E7N65C5KMWXYA67LJW4FLIWRNUP45QNS7OTUYK64UMW2AVWXT7IQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.285333653 (341h27m11.016601274s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.287128550 (341h27m11.01839617s) [noise=true , address=185.167.204.205:4030 , piece_id=V5B4VQCRBKXTTY4PJRVWV5C54HV2MX7PHC53UNKKP7Y3SJJGBARA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.292510313 (341h27m11.023777933s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.296039952 (341h27m11.027307572s) [noise=true , address=185.167.204.206:4068 , piece_id=5WUPBASDPHH7SGA3HLRLN3HMLMABMZTCO5YFUFVLT2FPC4DLFCPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301208034 (341h27m11.032475664s) [noise=true , address=81.171.14.70:4046 , piece_id=4YNKZGJQYOJEB3FFDIK6XALSTARBBMPYCE4GEWIQ5RQROFUHE6CA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301226198 (341h27m11.032493828s) [seg_pos={0 0}, upload=354959]: Segment reached optimal threshold of 26 pieces.
Aug 22 22:53:30.301343489 (341h27m11.032611129s) [noise=true , address=81.171.14.70:4036 , piece_id=OTQRXXAW43EQPVOUO54E6EUPTUZLRPWMHWBV62OKMTUI5QZMDZVQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF
Aug 22 22:53:30.301530851 (341h27m11.032798481s) [noise=true , address=185.167.204.205:4033 , piece_id=ROIUSDQL7GNXUULS6VLF6OIPG6UJOJTNEYLS6THCFIOP3LTL2SBA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe): protocol: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection
Aug 22 22:53:30.301547272 (341h27m11.032814902s) [seg_pos={0 0}, upload=354959]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Aug 22 22:53:30.301638825 (341h27m11.032906455s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 22:53:30.301644756 (341h27m11.032912386s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 22:56:04.281070862 (341h29m45.012338492s) [upload=354959]: Done uploading segments...
Aug 22 22:56:04.281085750 (341h29m45.012353381s) [upload=354959]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.860524744s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [................................X......X....................] duration:
554.776408ms
FAIL (2025-08-22 23:19:38 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 22 23:04:34.193786424 (341h38m14.925054054s) [upload=355145]: Starting upload Aug 22 23:04:34.193855373 (341h38m14.925123003s) [upload=355145]: Done starting upload Aug 22 23:04:34.193917851 (341h38m14.925185481s) [upload=355145]: Uploading segments... Aug 22 23:04:34.193995587 (341h38m14.925263217s) [upload=355145]: Got next segment. Inline: true Aug 22 23:04:34.194002741 (341h38m14.925270371s) [upload=355145]: Waiting for error group managing segments... Aug 22 23:04:34.194052023 (341h38m14.925319653s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 23:04:34.194058906 (341h38m14.925326526s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 23:04:34.194063054 (341h38m14.925330684s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 23:04:34.545689514 (341h38m15.276957164s) [upload=355145]: Done uploading segments... Aug 22 23:04:34.545718478 (341h38m15.276986128s) [upload=355145]: Upload finished. err: <nil>
Duration: 554.795174ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [X.....................................................X.....] duration:
2.015527758s
FAIL (2025-08-22 23:19:36 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 23:16:12.834814859 (341h49m53.56608251s) [upload=355345]: Starting upload Aug 22 23:16:12.834855054 (341h49m53.566122675s) [upload=355345]: Done starting upload Aug 22 23:16:12.834971062 (341h49m53.566238682s) [upload=355345]: Uploading segments... Aug 22 23:16:12.835164355 (341h49m53.566431986s) [upload=355345]: Got next segment. Inline: false Aug 22 23:16:12.835197678 (341h49m53.566465298s) [upload=355345]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 23:16:12.835202087 (341h49m53.566469706s) [upload=355345]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 23:16:12.838521276 (341h49m53.569788906s) [upload=355345]: Next segment err: metaclient: Too Many Requests Aug 22 23:16:12.838537678 (341h49m53.569805297s) [upload=355345]: Done uploading segments... Aug 22 23:16:12.838546483 (341h49m53.569814104s) [upload=355345]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.015552996s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.X.....................................................X....] duration:
1.57361097s
FAIL (2025-08-22 23:19:15 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 23:16:12.834814859 (341h49m53.56608251s) [upload=355345]: Starting upload Aug 22 23:16:12.834855054 (341h49m53.566122675s) [upload=355345]: Done starting upload Aug 22 23:16:12.834971062 (341h49m53.566238682s) [upload=355345]: Uploading segments... Aug 22 23:16:12.835164355 (341h49m53.566431986s) [upload=355345]: Got next segment. Inline: false Aug 22 23:16:12.835197678 (341h49m53.566465298s) [upload=355345]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 23:16:12.835202087 (341h49m53.566469706s) [upload=355345]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 23:16:12.838521276 (341h49m53.569788906s) [upload=355345]: Next segment err: metaclient: Too Many Requests Aug 22 23:16:12.838537678 (341h49m53.569805297s) [upload=355345]: Done uploading segments... Aug 22 23:16:12.838546483 (341h49m53.569814104s) [upload=355345]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.573630377s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
3.064143339s
FAIL (2025-08-22 23:19:06 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
59]: Uploading piece...
Aug 22 22:53:29.611585477 (341h27m10.342853137s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612050902 (341h27m10.343318552s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612464942 (341h27m10.343732591s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612857369 (341h27m10.34412503s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613271678 (341h27m10.344539329s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613655671 (341h27m10.344923321s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614059881 (341h27m10.345327542s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614540405 (341h27m10.345808065s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614942673 (341h27m10.346210322s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.615322797 (341h27m10.346590508s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.618240035 (341h27m10.349507685s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:30.106040273 (341h27m10.837307893s) [upload=354959]: Next returned nil segment
Aug 22 22:53:30.106057475 (341h27m10.837325105s) [upload=354959]: Waiting for error group managing segments...
Aug 22 22:53:30.265188790 (341h27m10.99645643s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.265907802 (341h27m10.997175453s) [noise=true , address=81.171.14.70:4039 , piece_id=UGLARCJIGPJ5BN2PWYD4NM62Z74HLMBKRCCYEKFP2ZAZBGWSYIRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.266528711 (341h27m10.997796351s) [noise=true , address=81.171.14.70:4035 , piece_id=6M22EYTZY734SCUSTKUGF3PNJ2QJLKMA2MAZXV6VPOOM2W4EUUUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.267544280 (341h27m10.998811931s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.268723619 (341h27m10.99999126s) [noise=true , address=89.149.201.147:4015 , piece_id=5WP6YFYWCVWL7QRS2VCDJP576AHQ66NJW742XOW324DIIXMLSBEQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270432624 (341h27m11.001700254s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270515790 (341h27m11.001783431s) [noise=true , address=81.171.14.70:4025 , piece_id=3PV4YNDGP33PBZUHYWLXRSEE3QZO2ZFL2PCEXYSSEWGGWVTFRLPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.271054975 (341h27m11.002322595s) [noise=true , address=81.171.14.70:4031 , piece_id=O6BNM3FOD76GP5I3MJKNZXREQH7XRG7ZOHDNNXRD7HKTSABASTUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.273453727 (341h27m11.004721367s) [noise=true , address=81.171.14.70:4044 , piece_id=JAMFLVIXOT4KL2OPPZGQFLV35GUPBBRX6673QJMB6YDRBZFOGG7Q, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.274998804 (341h27m11.006266424s) [noise=true , address=185.167.204.205:4027 , piece_id=NDAULJLWJRAIVPPNHYKT3WJHG5JS2F6B7RLQQXFJOL3QBNPTADMA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277211505 (341h27m11.008479146s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277435196 (341h27m11.008702816s) [noise=true , address=185.167.204.206:4072 , piece_id=XYAPWQELW5EUKLR62OGEEQVBGNQUTS2J4CC4PLPNTEXP2SWNQRIA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279287400 (341h27m11.01055504s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279410051 (341h27m11.010677681s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280438876 (341h27m11.011706507s) [noise=true , address=185.167.204.206:4056 , piece_id=BQTKVXFXDWMZCV7UBQDMJTE6DII572Q3AJM3JCTW66AP6DIWY5MQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280910263 (341h27m11.012177893s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.281986407 (341h27m11.013254028s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282394265 (341h27m11.013666674s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282761165 (341h27m11.014028785s) [noise=true , address=185.167.204.206:4062 , piece_id=C6LI537WYQRJHUVBTDJCZK35KQHT5JBBLENH5WVGPDJFWCU3RTWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283174292 (341h27m11.014441911s) [noise=true , address=185.167.204.205:4023 , piece_id=YZXWFCP5WW4ARBUTA6XNWHU3KU5U23OMASCOFORJNL6T3UZQDGWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283847198 (341h27m11.015114838s) [noise=true , address=185.167.204.206:4063 , piece_id=E7N65C5KMWXYA67LJW4FLIWRNUP45QNS7OTUYK64UMW2AVWXT7IQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.285333653 (341h27m11.016601274s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.287128550 (341h27m11.01839617s) [noise=true , address=185.167.204.205:4030 , piece_id=V5B4VQCRBKXTTY4PJRVWV5C54HV2MX7PHC53UNKKP7Y3SJJGBARA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.292510313 (341h27m11.023777933s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.296039952 (341h27m11.027307572s) [noise=true , address=185.167.204.206:4068 , piece_id=5WUPBASDPHH7SGA3HLRLN3HMLMABMZTCO5YFUFVLT2FPC4DLFCPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301208034 (341h27m11.032475664s) [noise=true , address=81.171.14.70:4046 , piece_id=4YNKZGJQYOJEB3FFDIK6XALSTARBBMPYCE4GEWIQ5RQROFUHE6CA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301226198 (341h27m11.032493828s) [seg_pos={0 0}, upload=354959]: Segment reached optimal threshold of 26 pieces.
Aug 22 22:53:30.301343489 (341h27m11.032611129s) [noise=true , address=81.171.14.70:4036 , piece_id=OTQRXXAW43EQPVOUO54E6EUPTUZLRPWMHWBV62OKMTUI5QZMDZVQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF
Aug 22 22:53:30.301530851 (341h27m11.032798481s) [noise=true , address=185.167.204.205:4033 , piece_id=ROIUSDQL7GNXUULS6VLF6OIPG6UJOJTNEYLS6THCFIOP3LTL2SBA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe): protocol: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection
Aug 22 22:53:30.301547272 (341h27m11.032814902s) [seg_pos={0 0}, upload=354959]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Aug 22 22:53:30.301638825 (341h27m11.032906455s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 22:53:30.301644756 (341h27m11.032912386s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 22:56:04.281070862 (341h29m45.012338492s) [upload=354959]: Done uploading segments...
Aug 22 22:56:04.281085750 (341h29m45.012353381s) [upload=354959]: Upload finished. err: metaclient: context deadline exceeded
Duration: 3.0642079s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..X.....................................................X...] duration:
1.798494529s
FAIL (2025-08-22 23:18:43 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 23:16:12.834814859 (341h49m53.56608251s) [upload=355345]: Starting upload Aug 22 23:16:12.834855054 (341h49m53.566122675s) [upload=355345]: Done starting upload Aug 22 23:16:12.834971062 (341h49m53.566238682s) [upload=355345]: Uploading segments... Aug 22 23:16:12.835164355 (341h49m53.566431986s) [upload=355345]: Got next segment. Inline: false Aug 22 23:16:12.835197678 (341h49m53.566465298s) [upload=355345]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 23:16:12.835202087 (341h49m53.566469706s) [upload=355345]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 23:16:12.838521276 (341h49m53.569788906s) [upload=355345]: Next segment err: metaclient: Too Many Requests Aug 22 23:16:12.838537678 (341h49m53.569805297s) [upload=355345]: Done uploading segments... Aug 22 23:16:12.838546483 (341h49m53.569814104s) [upload=355345]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.798521249s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................................X......X...................] duration:
169.290066ms
FAIL (2025-08-22 23:18:29 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 22 23:04:34.193786424 (341h38m14.925054054s) [upload=355145]: Starting upload Aug 22 23:04:34.193855373 (341h38m14.925123003s) [upload=355145]: Done starting upload Aug 22 23:04:34.193917851 (341h38m14.925185481s) [upload=355145]: Uploading segments... Aug 22 23:04:34.193995587 (341h38m14.925263217s) [upload=355145]: Got next segment. Inline: true Aug 22 23:04:34.194002741 (341h38m14.925270371s) [upload=355145]: Waiting for error group managing segments... Aug 22 23:04:34.194052023 (341h38m14.925319653s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 23:04:34.194058906 (341h38m14.925326526s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 23:04:34.194063054 (341h38m14.925330684s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 23:04:34.545689514 (341h38m15.276957164s) [upload=355145]: Done uploading segments... Aug 22 23:04:34.545718478 (341h38m15.276986128s) [upload=355145]: Upload finished. err: <nil>
Duration: 169.32444ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
3.046169315s
FAIL (2025-08-22 23:18:15 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
59]: Uploading piece...
Aug 22 22:53:29.611585477 (341h27m10.342853137s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612050902 (341h27m10.343318552s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612464942 (341h27m10.343732591s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612857369 (341h27m10.34412503s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613271678 (341h27m10.344539329s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613655671 (341h27m10.344923321s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614059881 (341h27m10.345327542s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614540405 (341h27m10.345808065s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614942673 (341h27m10.346210322s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.615322797 (341h27m10.346590508s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.618240035 (341h27m10.349507685s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:30.106040273 (341h27m10.837307893s) [upload=354959]: Next returned nil segment
Aug 22 22:53:30.106057475 (341h27m10.837325105s) [upload=354959]: Waiting for error group managing segments...
Aug 22 22:53:30.265188790 (341h27m10.99645643s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.265907802 (341h27m10.997175453s) [noise=true , address=81.171.14.70:4039 , piece_id=UGLARCJIGPJ5BN2PWYD4NM62Z74HLMBKRCCYEKFP2ZAZBGWSYIRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.266528711 (341h27m10.997796351s) [noise=true , address=81.171.14.70:4035 , piece_id=6M22EYTZY734SCUSTKUGF3PNJ2QJLKMA2MAZXV6VPOOM2W4EUUUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.267544280 (341h27m10.998811931s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.268723619 (341h27m10.99999126s) [noise=true , address=89.149.201.147:4015 , piece_id=5WP6YFYWCVWL7QRS2VCDJP576AHQ66NJW742XOW324DIIXMLSBEQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270432624 (341h27m11.001700254s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270515790 (341h27m11.001783431s) [noise=true , address=81.171.14.70:4025 , piece_id=3PV4YNDGP33PBZUHYWLXRSEE3QZO2ZFL2PCEXYSSEWGGWVTFRLPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.271054975 (341h27m11.002322595s) [noise=true , address=81.171.14.70:4031 , piece_id=O6BNM3FOD76GP5I3MJKNZXREQH7XRG7ZOHDNNXRD7HKTSABASTUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.273453727 (341h27m11.004721367s) [noise=true , address=81.171.14.70:4044 , piece_id=JAMFLVIXOT4KL2OPPZGQFLV35GUPBBRX6673QJMB6YDRBZFOGG7Q, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.274998804 (341h27m11.006266424s) [noise=true , address=185.167.204.205:4027 , piece_id=NDAULJLWJRAIVPPNHYKT3WJHG5JS2F6B7RLQQXFJOL3QBNPTADMA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277211505 (341h27m11.008479146s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277435196 (341h27m11.008702816s) [noise=true , address=185.167.204.206:4072 , piece_id=XYAPWQELW5EUKLR62OGEEQVBGNQUTS2J4CC4PLPNTEXP2SWNQRIA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279287400 (341h27m11.01055504s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279410051 (341h27m11.010677681s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280438876 (341h27m11.011706507s) [noise=true , address=185.167.204.206:4056 , piece_id=BQTKVXFXDWMZCV7UBQDMJTE6DII572Q3AJM3JCTW66AP6DIWY5MQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280910263 (341h27m11.012177893s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.281986407 (341h27m11.013254028s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282394265 (341h27m11.013666674s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282761165 (341h27m11.014028785s) [noise=true , address=185.167.204.206:4062 , piece_id=C6LI537WYQRJHUVBTDJCZK35KQHT5JBBLENH5WVGPDJFWCU3RTWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283174292 (341h27m11.014441911s) [noise=true , address=185.167.204.205:4023 , piece_id=YZXWFCP5WW4ARBUTA6XNWHU3KU5U23OMASCOFORJNL6T3UZQDGWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283847198 (341h27m11.015114838s) [noise=true , address=185.167.204.206:4063 , piece_id=E7N65C5KMWXYA67LJW4FLIWRNUP45QNS7OTUYK64UMW2AVWXT7IQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.285333653 (341h27m11.016601274s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.287128550 (341h27m11.01839617s) [noise=true , address=185.167.204.205:4030 , piece_id=V5B4VQCRBKXTTY4PJRVWV5C54HV2MX7PHC53UNKKP7Y3SJJGBARA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.292510313 (341h27m11.023777933s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.296039952 (341h27m11.027307572s) [noise=true , address=185.167.204.206:4068 , piece_id=5WUPBASDPHH7SGA3HLRLN3HMLMABMZTCO5YFUFVLT2FPC4DLFCPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301208034 (341h27m11.032475664s) [noise=true , address=81.171.14.70:4046 , piece_id=4YNKZGJQYOJEB3FFDIK6XALSTARBBMPYCE4GEWIQ5RQROFUHE6CA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301226198 (341h27m11.032493828s) [seg_pos={0 0}, upload=354959]: Segment reached optimal threshold of 26 pieces.
Aug 22 22:53:30.301343489 (341h27m11.032611129s) [noise=true , address=81.171.14.70:4036 , piece_id=OTQRXXAW43EQPVOUO54E6EUPTUZLRPWMHWBV62OKMTUI5QZMDZVQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF
Aug 22 22:53:30.301530851 (341h27m11.032798481s) [noise=true , address=185.167.204.205:4033 , piece_id=ROIUSDQL7GNXUULS6VLF6OIPG6UJOJTNEYLS6THCFIOP3LTL2SBA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe): protocol: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection
Aug 22 22:53:30.301547272 (341h27m11.032814902s) [seg_pos={0 0}, upload=354959]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Aug 22 22:53:30.301638825 (341h27m11.032906455s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 22:53:30.301644756 (341h27m11.032912386s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 22:56:04.281070862 (341h29m45.012338492s) [upload=354959]: Done uploading segments...
Aug 22 22:56:04.281085750 (341h29m45.012353381s) [upload=354959]: Upload finished. err: metaclient: context deadline exceeded
Duration: 3.046196977s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...X.....................................................X..] duration:
1.64449963s
FAIL (2025-08-22 23:17:56 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 23:16:12.834814859 (341h49m53.56608251s) [upload=355345]: Starting upload Aug 22 23:16:12.834855054 (341h49m53.566122675s) [upload=355345]: Done starting upload Aug 22 23:16:12.834971062 (341h49m53.566238682s) [upload=355345]: Uploading segments... Aug 22 23:16:12.835164355 (341h49m53.566431986s) [upload=355345]: Got next segment. Inline: false Aug 22 23:16:12.835197678 (341h49m53.566465298s) [upload=355345]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 23:16:12.835202087 (341h49m53.566469706s) [upload=355345]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 23:16:12.838521276 (341h49m53.569788906s) [upload=355345]: Next segment err: metaclient: Too Many Requests Aug 22 23:16:12.838537678 (341h49m53.569805297s) [upload=355345]: Done uploading segments... Aug 22 23:16:12.838546483 (341h49m53.569814104s) [upload=355345]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.644520038s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
2.959925116s
FAIL (2025-08-22 23:17:45 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
59]: Uploading piece...
Aug 22 22:53:29.611585477 (341h27m10.342853137s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612050902 (341h27m10.343318552s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612464942 (341h27m10.343732591s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612857369 (341h27m10.34412503s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613271678 (341h27m10.344539329s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613655671 (341h27m10.344923321s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614059881 (341h27m10.345327542s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614540405 (341h27m10.345808065s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614942673 (341h27m10.346210322s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.615322797 (341h27m10.346590508s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.618240035 (341h27m10.349507685s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:30.106040273 (341h27m10.837307893s) [upload=354959]: Next returned nil segment
Aug 22 22:53:30.106057475 (341h27m10.837325105s) [upload=354959]: Waiting for error group managing segments...
Aug 22 22:53:30.265188790 (341h27m10.99645643s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.265907802 (341h27m10.997175453s) [noise=true , address=81.171.14.70:4039 , piece_id=UGLARCJIGPJ5BN2PWYD4NM62Z74HLMBKRCCYEKFP2ZAZBGWSYIRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.266528711 (341h27m10.997796351s) [noise=true , address=81.171.14.70:4035 , piece_id=6M22EYTZY734SCUSTKUGF3PNJ2QJLKMA2MAZXV6VPOOM2W4EUUUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.267544280 (341h27m10.998811931s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.268723619 (341h27m10.99999126s) [noise=true , address=89.149.201.147:4015 , piece_id=5WP6YFYWCVWL7QRS2VCDJP576AHQ66NJW742XOW324DIIXMLSBEQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270432624 (341h27m11.001700254s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270515790 (341h27m11.001783431s) [noise=true , address=81.171.14.70:4025 , piece_id=3PV4YNDGP33PBZUHYWLXRSEE3QZO2ZFL2PCEXYSSEWGGWVTFRLPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.271054975 (341h27m11.002322595s) [noise=true , address=81.171.14.70:4031 , piece_id=O6BNM3FOD76GP5I3MJKNZXREQH7XRG7ZOHDNNXRD7HKTSABASTUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.273453727 (341h27m11.004721367s) [noise=true , address=81.171.14.70:4044 , piece_id=JAMFLVIXOT4KL2OPPZGQFLV35GUPBBRX6673QJMB6YDRBZFOGG7Q, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.274998804 (341h27m11.006266424s) [noise=true , address=185.167.204.205:4027 , piece_id=NDAULJLWJRAIVPPNHYKT3WJHG5JS2F6B7RLQQXFJOL3QBNPTADMA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277211505 (341h27m11.008479146s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277435196 (341h27m11.008702816s) [noise=true , address=185.167.204.206:4072 , piece_id=XYAPWQELW5EUKLR62OGEEQVBGNQUTS2J4CC4PLPNTEXP2SWNQRIA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279287400 (341h27m11.01055504s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279410051 (341h27m11.010677681s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280438876 (341h27m11.011706507s) [noise=true , address=185.167.204.206:4056 , piece_id=BQTKVXFXDWMZCV7UBQDMJTE6DII572Q3AJM3JCTW66AP6DIWY5MQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280910263 (341h27m11.012177893s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.281986407 (341h27m11.013254028s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282394265 (341h27m11.013666674s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282761165 (341h27m11.014028785s) [noise=true , address=185.167.204.206:4062 , piece_id=C6LI537WYQRJHUVBTDJCZK35KQHT5JBBLENH5WVGPDJFWCU3RTWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283174292 (341h27m11.014441911s) [noise=true , address=185.167.204.205:4023 , piece_id=YZXWFCP5WW4ARBUTA6XNWHU3KU5U23OMASCOFORJNL6T3UZQDGWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283847198 (341h27m11.015114838s) [noise=true , address=185.167.204.206:4063 , piece_id=E7N65C5KMWXYA67LJW4FLIWRNUP45QNS7OTUYK64UMW2AVWXT7IQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.285333653 (341h27m11.016601274s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.287128550 (341h27m11.01839617s) [noise=true , address=185.167.204.205:4030 , piece_id=V5B4VQCRBKXTTY4PJRVWV5C54HV2MX7PHC53UNKKP7Y3SJJGBARA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.292510313 (341h27m11.023777933s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.296039952 (341h27m11.027307572s) [noise=true , address=185.167.204.206:4068 , piece_id=5WUPBASDPHH7SGA3HLRLN3HMLMABMZTCO5YFUFVLT2FPC4DLFCPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301208034 (341h27m11.032475664s) [noise=true , address=81.171.14.70:4046 , piece_id=4YNKZGJQYOJEB3FFDIK6XALSTARBBMPYCE4GEWIQ5RQROFUHE6CA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301226198 (341h27m11.032493828s) [seg_pos={0 0}, upload=354959]: Segment reached optimal threshold of 26 pieces.
Aug 22 22:53:30.301343489 (341h27m11.032611129s) [noise=true , address=81.171.14.70:4036 , piece_id=OTQRXXAW43EQPVOUO54E6EUPTUZLRPWMHWBV62OKMTUI5QZMDZVQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF
Aug 22 22:53:30.301530851 (341h27m11.032798481s) [noise=true , address=185.167.204.205:4033 , piece_id=ROIUSDQL7GNXUULS6VLF6OIPG6UJOJTNEYLS6THCFIOP3LTL2SBA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe): protocol: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection
Aug 22 22:53:30.301547272 (341h27m11.032814902s) [seg_pos={0 0}, upload=354959]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Aug 22 22:53:30.301638825 (341h27m11.032906455s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 22:53:30.301644756 (341h27m11.032912386s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 22:56:04.281070862 (341h29m45.012338492s) [upload=354959]: Done uploading segments...
Aug 22 22:56:04.281085750 (341h29m45.012353381s) [upload=354959]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.959945094s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................................X......X..................] duration:
251.221217ms
FAIL (2025-08-22 23:17:34 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 22 23:04:34.193786424 (341h38m14.925054054s) [upload=355145]: Starting upload Aug 22 23:04:34.193855373 (341h38m14.925123003s) [upload=355145]: Done starting upload Aug 22 23:04:34.193917851 (341h38m14.925185481s) [upload=355145]: Uploading segments... Aug 22 23:04:34.193995587 (341h38m14.925263217s) [upload=355145]: Got next segment. Inline: true Aug 22 23:04:34.194002741 (341h38m14.925270371s) [upload=355145]: Waiting for error group managing segments... Aug 22 23:04:34.194052023 (341h38m14.925319653s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 23:04:34.194058906 (341h38m14.925326526s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 23:04:34.194063054 (341h38m14.925330684s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 23:04:34.545689514 (341h38m15.276957164s) [upload=355145]: Done uploading segments... Aug 22 23:04:34.545718478 (341h38m15.276986128s) [upload=355145]: Upload finished. err: <nil>
Duration: 251.251015ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....X.....................................................X.] duration:
1.637240069s
FAIL (2025-08-22 23:17:23 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 23:16:12.834814859 (341h49m53.56608251s) [upload=355345]: Starting upload Aug 22 23:16:12.834855054 (341h49m53.566122675s) [upload=355345]: Done starting upload Aug 22 23:16:12.834971062 (341h49m53.566238682s) [upload=355345]: Uploading segments... Aug 22 23:16:12.835164355 (341h49m53.566431986s) [upload=355345]: Got next segment. Inline: false Aug 22 23:16:12.835197678 (341h49m53.566465298s) [upload=355345]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 23:16:12.835202087 (341h49m53.566469706s) [upload=355345]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 23:16:12.838521276 (341h49m53.569788906s) [upload=355345]: Next segment err: metaclient: Too Many Requests Aug 22 23:16:12.838537678 (341h49m53.569805297s) [upload=355345]: Done uploading segments... Aug 22 23:16:12.838546483 (341h49m53.569814104s) [upload=355345]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.637258504s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
2.399751875s
FAIL (2025-08-22 23:17:15 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
59]: Uploading piece...
Aug 22 22:53:29.611585477 (341h27m10.342853137s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612050902 (341h27m10.343318552s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612464942 (341h27m10.343732591s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612857369 (341h27m10.34412503s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613271678 (341h27m10.344539329s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613655671 (341h27m10.344923321s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614059881 (341h27m10.345327542s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614540405 (341h27m10.345808065s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614942673 (341h27m10.346210322s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.615322797 (341h27m10.346590508s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.618240035 (341h27m10.349507685s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:30.106040273 (341h27m10.837307893s) [upload=354959]: Next returned nil segment
Aug 22 22:53:30.106057475 (341h27m10.837325105s) [upload=354959]: Waiting for error group managing segments...
Aug 22 22:53:30.265188790 (341h27m10.99645643s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.265907802 (341h27m10.997175453s) [noise=true , address=81.171.14.70:4039 , piece_id=UGLARCJIGPJ5BN2PWYD4NM62Z74HLMBKRCCYEKFP2ZAZBGWSYIRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.266528711 (341h27m10.997796351s) [noise=true , address=81.171.14.70:4035 , piece_id=6M22EYTZY734SCUSTKUGF3PNJ2QJLKMA2MAZXV6VPOOM2W4EUUUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.267544280 (341h27m10.998811931s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.268723619 (341h27m10.99999126s) [noise=true , address=89.149.201.147:4015 , piece_id=5WP6YFYWCVWL7QRS2VCDJP576AHQ66NJW742XOW324DIIXMLSBEQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270432624 (341h27m11.001700254s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270515790 (341h27m11.001783431s) [noise=true , address=81.171.14.70:4025 , piece_id=3PV4YNDGP33PBZUHYWLXRSEE3QZO2ZFL2PCEXYSSEWGGWVTFRLPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.271054975 (341h27m11.002322595s) [noise=true , address=81.171.14.70:4031 , piece_id=O6BNM3FOD76GP5I3MJKNZXREQH7XRG7ZOHDNNXRD7HKTSABASTUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.273453727 (341h27m11.004721367s) [noise=true , address=81.171.14.70:4044 , piece_id=JAMFLVIXOT4KL2OPPZGQFLV35GUPBBRX6673QJMB6YDRBZFOGG7Q, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.274998804 (341h27m11.006266424s) [noise=true , address=185.167.204.205:4027 , piece_id=NDAULJLWJRAIVPPNHYKT3WJHG5JS2F6B7RLQQXFJOL3QBNPTADMA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277211505 (341h27m11.008479146s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277435196 (341h27m11.008702816s) [noise=true , address=185.167.204.206:4072 , piece_id=XYAPWQELW5EUKLR62OGEEQVBGNQUTS2J4CC4PLPNTEXP2SWNQRIA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279287400 (341h27m11.01055504s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279410051 (341h27m11.010677681s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280438876 (341h27m11.011706507s) [noise=true , address=185.167.204.206:4056 , piece_id=BQTKVXFXDWMZCV7UBQDMJTE6DII572Q3AJM3JCTW66AP6DIWY5MQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280910263 (341h27m11.012177893s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.281986407 (341h27m11.013254028s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282394265 (341h27m11.013666674s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282761165 (341h27m11.014028785s) [noise=true , address=185.167.204.206:4062 , piece_id=C6LI537WYQRJHUVBTDJCZK35KQHT5JBBLENH5WVGPDJFWCU3RTWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283174292 (341h27m11.014441911s) [noise=true , address=185.167.204.205:4023 , piece_id=YZXWFCP5WW4ARBUTA6XNWHU3KU5U23OMASCOFORJNL6T3UZQDGWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283847198 (341h27m11.015114838s) [noise=true , address=185.167.204.206:4063 , piece_id=E7N65C5KMWXYA67LJW4FLIWRNUP45QNS7OTUYK64UMW2AVWXT7IQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.285333653 (341h27m11.016601274s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.287128550 (341h27m11.01839617s) [noise=true , address=185.167.204.205:4030 , piece_id=V5B4VQCRBKXTTY4PJRVWV5C54HV2MX7PHC53UNKKP7Y3SJJGBARA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.292510313 (341h27m11.023777933s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.296039952 (341h27m11.027307572s) [noise=true , address=185.167.204.206:4068 , piece_id=5WUPBASDPHH7SGA3HLRLN3HMLMABMZTCO5YFUFVLT2FPC4DLFCPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301208034 (341h27m11.032475664s) [noise=true , address=81.171.14.70:4046 , piece_id=4YNKZGJQYOJEB3FFDIK6XALSTARBBMPYCE4GEWIQ5RQROFUHE6CA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301226198 (341h27m11.032493828s) [seg_pos={0 0}, upload=354959]: Segment reached optimal threshold of 26 pieces.
Aug 22 22:53:30.301343489 (341h27m11.032611129s) [noise=true , address=81.171.14.70:4036 , piece_id=OTQRXXAW43EQPVOUO54E6EUPTUZLRPWMHWBV62OKMTUI5QZMDZVQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF
Aug 22 22:53:30.301530851 (341h27m11.032798481s) [noise=true , address=185.167.204.205:4033 , piece_id=ROIUSDQL7GNXUULS6VLF6OIPG6UJOJTNEYLS6THCFIOP3LTL2SBA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe): protocol: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection
Aug 22 22:53:30.301547272 (341h27m11.032814902s) [seg_pos={0 0}, upload=354959]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Aug 22 22:53:30.301638825 (341h27m11.032906455s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 22:53:30.301644756 (341h27m11.032912386s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 22:56:04.281070862 (341h29m45.012338492s) [upload=354959]: Done uploading segments...
Aug 22 22:56:04.281085750 (341h29m45.012353381s) [upload=354959]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.399780518s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
6.678178384s
FAIL (2025-08-22 23:17:04 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
59]: Uploading piece...
Aug 22 22:53:29.611585477 (341h27m10.342853137s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612050902 (341h27m10.343318552s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612464942 (341h27m10.343732591s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612857369 (341h27m10.34412503s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613271678 (341h27m10.344539329s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613655671 (341h27m10.344923321s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614059881 (341h27m10.345327542s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614540405 (341h27m10.345808065s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614942673 (341h27m10.346210322s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.615322797 (341h27m10.346590508s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.618240035 (341h27m10.349507685s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:30.106040273 (341h27m10.837307893s) [upload=354959]: Next returned nil segment
Aug 22 22:53:30.106057475 (341h27m10.837325105s) [upload=354959]: Waiting for error group managing segments...
Aug 22 22:53:30.265188790 (341h27m10.99645643s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.265907802 (341h27m10.997175453s) [noise=true , address=81.171.14.70:4039 , piece_id=UGLARCJIGPJ5BN2PWYD4NM62Z74HLMBKRCCYEKFP2ZAZBGWSYIRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.266528711 (341h27m10.997796351s) [noise=true , address=81.171.14.70:4035 , piece_id=6M22EYTZY734SCUSTKUGF3PNJ2QJLKMA2MAZXV6VPOOM2W4EUUUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.267544280 (341h27m10.998811931s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.268723619 (341h27m10.99999126s) [noise=true , address=89.149.201.147:4015 , piece_id=5WP6YFYWCVWL7QRS2VCDJP576AHQ66NJW742XOW324DIIXMLSBEQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270432624 (341h27m11.001700254s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270515790 (341h27m11.001783431s) [noise=true , address=81.171.14.70:4025 , piece_id=3PV4YNDGP33PBZUHYWLXRSEE3QZO2ZFL2PCEXYSSEWGGWVTFRLPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.271054975 (341h27m11.002322595s) [noise=true , address=81.171.14.70:4031 , piece_id=O6BNM3FOD76GP5I3MJKNZXREQH7XRG7ZOHDNNXRD7HKTSABASTUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.273453727 (341h27m11.004721367s) [noise=true , address=81.171.14.70:4044 , piece_id=JAMFLVIXOT4KL2OPPZGQFLV35GUPBBRX6673QJMB6YDRBZFOGG7Q, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.274998804 (341h27m11.006266424s) [noise=true , address=185.167.204.205:4027 , piece_id=NDAULJLWJRAIVPPNHYKT3WJHG5JS2F6B7RLQQXFJOL3QBNPTADMA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277211505 (341h27m11.008479146s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277435196 (341h27m11.008702816s) [noise=true , address=185.167.204.206:4072 , piece_id=XYAPWQELW5EUKLR62OGEEQVBGNQUTS2J4CC4PLPNTEXP2SWNQRIA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279287400 (341h27m11.01055504s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279410051 (341h27m11.010677681s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280438876 (341h27m11.011706507s) [noise=true , address=185.167.204.206:4056 , piece_id=BQTKVXFXDWMZCV7UBQDMJTE6DII572Q3AJM3JCTW66AP6DIWY5MQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280910263 (341h27m11.012177893s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.281986407 (341h27m11.013254028s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282394265 (341h27m11.013666674s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282761165 (341h27m11.014028785s) [noise=true , address=185.167.204.206:4062 , piece_id=C6LI537WYQRJHUVBTDJCZK35KQHT5JBBLENH5WVGPDJFWCU3RTWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283174292 (341h27m11.014441911s) [noise=true , address=185.167.204.205:4023 , piece_id=YZXWFCP5WW4ARBUTA6XNWHU3KU5U23OMASCOFORJNL6T3UZQDGWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283847198 (341h27m11.015114838s) [noise=true , address=185.167.204.206:4063 , piece_id=E7N65C5KMWXYA67LJW4FLIWRNUP45QNS7OTUYK64UMW2AVWXT7IQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.285333653 (341h27m11.016601274s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.287128550 (341h27m11.01839617s) [noise=true , address=185.167.204.205:4030 , piece_id=V5B4VQCRBKXTTY4PJRVWV5C54HV2MX7PHC53UNKKP7Y3SJJGBARA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.292510313 (341h27m11.023777933s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.296039952 (341h27m11.027307572s) [noise=true , address=185.167.204.206:4068 , piece_id=5WUPBASDPHH7SGA3HLRLN3HMLMABMZTCO5YFUFVLT2FPC4DLFCPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301208034 (341h27m11.032475664s) [noise=true , address=81.171.14.70:4046 , piece_id=4YNKZGJQYOJEB3FFDIK6XALSTARBBMPYCE4GEWIQ5RQROFUHE6CA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301226198 (341h27m11.032493828s) [seg_pos={0 0}, upload=354959]: Segment reached optimal threshold of 26 pieces.
Aug 22 22:53:30.301343489 (341h27m11.032611129s) [noise=true , address=81.171.14.70:4036 , piece_id=OTQRXXAW43EQPVOUO54E6EUPTUZLRPWMHWBV62OKMTUI5QZMDZVQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF
Aug 22 22:53:30.301530851 (341h27m11.032798481s) [noise=true , address=185.167.204.205:4033 , piece_id=ROIUSDQL7GNXUULS6VLF6OIPG6UJOJTNEYLS6THCFIOP3LTL2SBA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe): protocol: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection
Aug 22 22:53:30.301547272 (341h27m11.032814902s) [seg_pos={0 0}, upload=354959]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Aug 22 22:53:30.301638825 (341h27m11.032906455s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 22:53:30.301644756 (341h27m11.032912386s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 22:56:04.281070862 (341h29m45.012338492s) [upload=354959]: Done uploading segments...
Aug 22 22:56:04.281085750 (341h29m45.012353381s) [upload=354959]: Upload finished. err: metaclient: context deadline exceeded
Duration: 6.678201117s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...................................X......X.................] duration:
776.602257ms
FAIL (2025-08-22 23:16:39 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 22 23:04:34.193786424 (341h38m14.925054054s) [upload=355145]: Starting upload Aug 22 23:04:34.193855373 (341h38m14.925123003s) [upload=355145]: Done starting upload Aug 22 23:04:34.193917851 (341h38m14.925185481s) [upload=355145]: Uploading segments... Aug 22 23:04:34.193995587 (341h38m14.925263217s) [upload=355145]: Got next segment. Inline: true Aug 22 23:04:34.194002741 (341h38m14.925270371s) [upload=355145]: Waiting for error group managing segments... Aug 22 23:04:34.194052023 (341h38m14.925319653s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 23:04:34.194058906 (341h38m14.925326526s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 23:04:34.194063054 (341h38m14.925330684s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 23:04:34.545689514 (341h38m15.276957164s) [upload=355145]: Done uploading segments... Aug 22 23:04:34.545718478 (341h38m15.276986128s) [upload=355145]: Upload finished. err: <nil>
Duration: 776.62552ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
6.210653117s
FAIL (2025-08-22 23:16:35 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
59]: Uploading piece...
Aug 22 22:53:29.611585477 (341h27m10.342853137s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612050902 (341h27m10.343318552s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612464942 (341h27m10.343732591s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612857369 (341h27m10.34412503s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613271678 (341h27m10.344539329s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613655671 (341h27m10.344923321s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614059881 (341h27m10.345327542s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614540405 (341h27m10.345808065s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614942673 (341h27m10.346210322s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.615322797 (341h27m10.346590508s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.618240035 (341h27m10.349507685s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:30.106040273 (341h27m10.837307893s) [upload=354959]: Next returned nil segment
Aug 22 22:53:30.106057475 (341h27m10.837325105s) [upload=354959]: Waiting for error group managing segments...
Aug 22 22:53:30.265188790 (341h27m10.99645643s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.265907802 (341h27m10.997175453s) [noise=true , address=81.171.14.70:4039 , piece_id=UGLARCJIGPJ5BN2PWYD4NM62Z74HLMBKRCCYEKFP2ZAZBGWSYIRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.266528711 (341h27m10.997796351s) [noise=true , address=81.171.14.70:4035 , piece_id=6M22EYTZY734SCUSTKUGF3PNJ2QJLKMA2MAZXV6VPOOM2W4EUUUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.267544280 (341h27m10.998811931s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.268723619 (341h27m10.99999126s) [noise=true , address=89.149.201.147:4015 , piece_id=5WP6YFYWCVWL7QRS2VCDJP576AHQ66NJW742XOW324DIIXMLSBEQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270432624 (341h27m11.001700254s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270515790 (341h27m11.001783431s) [noise=true , address=81.171.14.70:4025 , piece_id=3PV4YNDGP33PBZUHYWLXRSEE3QZO2ZFL2PCEXYSSEWGGWVTFRLPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.271054975 (341h27m11.002322595s) [noise=true , address=81.171.14.70:4031 , piece_id=O6BNM3FOD76GP5I3MJKNZXREQH7XRG7ZOHDNNXRD7HKTSABASTUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.273453727 (341h27m11.004721367s) [noise=true , address=81.171.14.70:4044 , piece_id=JAMFLVIXOT4KL2OPPZGQFLV35GUPBBRX6673QJMB6YDRBZFOGG7Q, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.274998804 (341h27m11.006266424s) [noise=true , address=185.167.204.205:4027 , piece_id=NDAULJLWJRAIVPPNHYKT3WJHG5JS2F6B7RLQQXFJOL3QBNPTADMA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277211505 (341h27m11.008479146s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277435196 (341h27m11.008702816s) [noise=true , address=185.167.204.206:4072 , piece_id=XYAPWQELW5EUKLR62OGEEQVBGNQUTS2J4CC4PLPNTEXP2SWNQRIA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279287400 (341h27m11.01055504s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279410051 (341h27m11.010677681s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280438876 (341h27m11.011706507s) [noise=true , address=185.167.204.206:4056 , piece_id=BQTKVXFXDWMZCV7UBQDMJTE6DII572Q3AJM3JCTW66AP6DIWY5MQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280910263 (341h27m11.012177893s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.281986407 (341h27m11.013254028s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282394265 (341h27m11.013666674s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282761165 (341h27m11.014028785s) [noise=true , address=185.167.204.206:4062 , piece_id=C6LI537WYQRJHUVBTDJCZK35KQHT5JBBLENH5WVGPDJFWCU3RTWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283174292 (341h27m11.014441911s) [noise=true , address=185.167.204.205:4023 , piece_id=YZXWFCP5WW4ARBUTA6XNWHU3KU5U23OMASCOFORJNL6T3UZQDGWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283847198 (341h27m11.015114838s) [noise=true , address=185.167.204.206:4063 , piece_id=E7N65C5KMWXYA67LJW4FLIWRNUP45QNS7OTUYK64UMW2AVWXT7IQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.285333653 (341h27m11.016601274s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.287128550 (341h27m11.01839617s) [noise=true , address=185.167.204.205:4030 , piece_id=V5B4VQCRBKXTTY4PJRVWV5C54HV2MX7PHC53UNKKP7Y3SJJGBARA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.292510313 (341h27m11.023777933s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.296039952 (341h27m11.027307572s) [noise=true , address=185.167.204.206:4068 , piece_id=5WUPBASDPHH7SGA3HLRLN3HMLMABMZTCO5YFUFVLT2FPC4DLFCPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301208034 (341h27m11.032475664s) [noise=true , address=81.171.14.70:4046 , piece_id=4YNKZGJQYOJEB3FFDIK6XALSTARBBMPYCE4GEWIQ5RQROFUHE6CA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301226198 (341h27m11.032493828s) [seg_pos={0 0}, upload=354959]: Segment reached optimal threshold of 26 pieces.
Aug 22 22:53:30.301343489 (341h27m11.032611129s) [noise=true , address=81.171.14.70:4036 , piece_id=OTQRXXAW43EQPVOUO54E6EUPTUZLRPWMHWBV62OKMTUI5QZMDZVQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF
Aug 22 22:53:30.301530851 (341h27m11.032798481s) [noise=true , address=185.167.204.205:4033 , piece_id=ROIUSDQL7GNXUULS6VLF6OIPG6UJOJTNEYLS6THCFIOP3LTL2SBA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe): protocol: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection
Aug 22 22:53:30.301547272 (341h27m11.032814902s) [seg_pos={0 0}, upload=354959]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Aug 22 22:53:30.301638825 (341h27m11.032906455s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 22:53:30.301644756 (341h27m11.032912386s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 22:56:04.281070862 (341h29m45.012338492s) [upload=354959]: Done uploading segments...
Aug 22 22:56:04.281085750 (341h29m45.012353381s) [upload=354959]: Upload finished. err: metaclient: context deadline exceeded
Duration: 6.210701768s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....X.....................................................X] duration:
17.885385ms
FAIL (2025-08-22 23:16:12 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 23:16:12.834814859 (341h49m53.56608251s) [upload=355345]: Starting upload Aug 22 23:16:12.834855054 (341h49m53.566122675s) [upload=355345]: Done starting upload Aug 22 23:16:12.834971062 (341h49m53.566238682s) [upload=355345]: Uploading segments... Aug 22 23:16:12.835164355 (341h49m53.566431986s) [upload=355345]: Got next segment. Inline: false Aug 22 23:16:12.835197678 (341h49m53.566465298s) [upload=355345]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 23:16:12.835202087 (341h49m53.566469706s) [upload=355345]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 23:16:12.838521276 (341h49m53.569788906s) [upload=355345]: Next segment err: metaclient: Too Many Requests Aug 22 23:16:12.838537678 (341h49m53.569805297s) [upload=355345]: Done uploading segments... Aug 22 23:16:12.838546483 (341h49m53.569814104s) [upload=355345]: Upload finished. err: metaclient: Too Many Requests
Duration: 17.897157ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
5.969809946s
FAIL (2025-08-22 23:15:53 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
59]: Uploading piece...
Aug 22 22:53:29.611585477 (341h27m10.342853137s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612050902 (341h27m10.343318552s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612464942 (341h27m10.343732591s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612857369 (341h27m10.34412503s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613271678 (341h27m10.344539329s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613655671 (341h27m10.344923321s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614059881 (341h27m10.345327542s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614540405 (341h27m10.345808065s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614942673 (341h27m10.346210322s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.615322797 (341h27m10.346590508s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.618240035 (341h27m10.349507685s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:30.106040273 (341h27m10.837307893s) [upload=354959]: Next returned nil segment
Aug 22 22:53:30.106057475 (341h27m10.837325105s) [upload=354959]: Waiting for error group managing segments...
Aug 22 22:53:30.265188790 (341h27m10.99645643s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.265907802 (341h27m10.997175453s) [noise=true , address=81.171.14.70:4039 , piece_id=UGLARCJIGPJ5BN2PWYD4NM62Z74HLMBKRCCYEKFP2ZAZBGWSYIRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.266528711 (341h27m10.997796351s) [noise=true , address=81.171.14.70:4035 , piece_id=6M22EYTZY734SCUSTKUGF3PNJ2QJLKMA2MAZXV6VPOOM2W4EUUUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.267544280 (341h27m10.998811931s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.268723619 (341h27m10.99999126s) [noise=true , address=89.149.201.147:4015 , piece_id=5WP6YFYWCVWL7QRS2VCDJP576AHQ66NJW742XOW324DIIXMLSBEQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270432624 (341h27m11.001700254s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270515790 (341h27m11.001783431s) [noise=true , address=81.171.14.70:4025 , piece_id=3PV4YNDGP33PBZUHYWLXRSEE3QZO2ZFL2PCEXYSSEWGGWVTFRLPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.271054975 (341h27m11.002322595s) [noise=true , address=81.171.14.70:4031 , piece_id=O6BNM3FOD76GP5I3MJKNZXREQH7XRG7ZOHDNNXRD7HKTSABASTUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.273453727 (341h27m11.004721367s) [noise=true , address=81.171.14.70:4044 , piece_id=JAMFLVIXOT4KL2OPPZGQFLV35GUPBBRX6673QJMB6YDRBZFOGG7Q, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.274998804 (341h27m11.006266424s) [noise=true , address=185.167.204.205:4027 , piece_id=NDAULJLWJRAIVPPNHYKT3WJHG5JS2F6B7RLQQXFJOL3QBNPTADMA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277211505 (341h27m11.008479146s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277435196 (341h27m11.008702816s) [noise=true , address=185.167.204.206:4072 , piece_id=XYAPWQELW5EUKLR62OGEEQVBGNQUTS2J4CC4PLPNTEXP2SWNQRIA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279287400 (341h27m11.01055504s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279410051 (341h27m11.010677681s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280438876 (341h27m11.011706507s) [noise=true , address=185.167.204.206:4056 , piece_id=BQTKVXFXDWMZCV7UBQDMJTE6DII572Q3AJM3JCTW66AP6DIWY5MQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280910263 (341h27m11.012177893s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.281986407 (341h27m11.013254028s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282394265 (341h27m11.013666674s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282761165 (341h27m11.014028785s) [noise=true , address=185.167.204.206:4062 , piece_id=C6LI537WYQRJHUVBTDJCZK35KQHT5JBBLENH5WVGPDJFWCU3RTWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283174292 (341h27m11.014441911s) [noise=true , address=185.167.204.205:4023 , piece_id=YZXWFCP5WW4ARBUTA6XNWHU3KU5U23OMASCOFORJNL6T3UZQDGWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283847198 (341h27m11.015114838s) [noise=true , address=185.167.204.206:4063 , piece_id=E7N65C5KMWXYA67LJW4FLIWRNUP45QNS7OTUYK64UMW2AVWXT7IQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.285333653 (341h27m11.016601274s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.287128550 (341h27m11.01839617s) [noise=true , address=185.167.204.205:4030 , piece_id=V5B4VQCRBKXTTY4PJRVWV5C54HV2MX7PHC53UNKKP7Y3SJJGBARA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.292510313 (341h27m11.023777933s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.296039952 (341h27m11.027307572s) [noise=true , address=185.167.204.206:4068 , piece_id=5WUPBASDPHH7SGA3HLRLN3HMLMABMZTCO5YFUFVLT2FPC4DLFCPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301208034 (341h27m11.032475664s) [noise=true , address=81.171.14.70:4046 , piece_id=4YNKZGJQYOJEB3FFDIK6XALSTARBBMPYCE4GEWIQ5RQROFUHE6CA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301226198 (341h27m11.032493828s) [seg_pos={0 0}, upload=354959]: Segment reached optimal threshold of 26 pieces.
Aug 22 22:53:30.301343489 (341h27m11.032611129s) [noise=true , address=81.171.14.70:4036 , piece_id=OTQRXXAW43EQPVOUO54E6EUPTUZLRPWMHWBV62OKMTUI5QZMDZVQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF
Aug 22 22:53:30.301530851 (341h27m11.032798481s) [noise=true , address=185.167.204.205:4033 , piece_id=ROIUSDQL7GNXUULS6VLF6OIPG6UJOJTNEYLS6THCFIOP3LTL2SBA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe): protocol: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection
Aug 22 22:53:30.301547272 (341h27m11.032814902s) [seg_pos={0 0}, upload=354959]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Aug 22 22:53:30.301638825 (341h27m11.032906455s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 22:53:30.301644756 (341h27m11.032912386s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 22:56:04.281070862 (341h29m45.012338492s) [upload=354959]: Done uploading segments...
Aug 22 22:56:04.281085750 (341h29m45.012353381s) [upload=354959]: Upload finished. err: metaclient: context deadline exceeded
Duration: 5.969823983s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
1.13059992s
FAIL (2025-08-22 23:15:47 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 22 22:34:59.033856300 (341h8m39.76512395s) [upload=354636]: Starting upload
Aug 22 22:34:59.033926702 (341h8m39.765194352s) [upload=354636]: Done starting upload
Aug 22 22:34:59.034044734 (341h8m39.765312364s) [upload=354636]: Uploading segments...
Aug 22 22:34:59.034327877 (341h8m39.765595526s) [upload=354636]: Got next segment. Inline: false
Aug 22 22:34:59.034373542 (341h8m39.765641202s) [upload=354636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 22:34:59.034379112 (341h8m39.765646773s) [upload=354636]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 22:34:59.072021327 (341h8m39.803288978s) [seg_pos={0 0}, upload=354636]: Begin upload segment...
Aug 22 22:34:59.072095788 (341h8m39.803363438s) [seg_pos={0 0}, upload=354636]: Done begin upload segment.
Aug 22 22:34:59.072134821 (341h8m39.803402441s) [noise=true , address=77.90.31.21:4891 , piece_id=DIEBEFT4RJRT5DD7DX3ZWZXAQKJYQIXHKLCNGKKBXMR2CZ6TPRZQ, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.072156512 (341h8m39.803424162s) [noise=true , address=104.36.82.62:4428 , piece_id=C3XIJL5AALYYQBSLQSJ6XHXWMQSN7QDLEDAIPCR2MHQZ7D45UZWA, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.072571413 (341h8m39.803839032s) [noise=true , address=104.36.82.21:4490 , piece_id=DA2EPUXZUNWOV2HXV7D4Z2ORQNPNLNVBD6RRUTDQBP32DJBDFWEQ, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.072717918 (341h8m39.803985568s) [noise=true , address=104.36.82.20:4443 , piece_id=7EMN32OFJAFYTQHX5SGOYYXB7GWWYFGAUIPMGWWFU76YD3P5NAXQ, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.072992775 (341h8m39.804260405s) [noise=true , address=104.36.82.45:4940 , piece_id=JXPUZ3WMZ3PJ756IPGD6YC6H6G4QVKUY34UABF55HR2OW7CXS7IQ, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.073219260 (341h8m39.804486911s) [noise=true , address=77.90.31.12:4597 , piece_id=GDKOGFZV7V6JRCJIQYOAZSHZI7JEWM7KGY2II4VBSKFCRHHZMRMA, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.073336069 (341h8m39.804603699s) [noise=true , address=104.36.82.50:4019 , piece_id=VNPGVKDTIKZW6WTVKVXEMXDBKDIZMBEZJEMFXEBIGNVNYZMKAQ3Q, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.073688793 (341h8m39.804956413s) [noise=true , address=104.36.82.60:4355 , piece_id=ZWCBYSGDO4RFRVT5UEP64EQYNYQWH4EQT6PYLJEYEBYFIXRCIHKA, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.073751250 (341h8m39.80501891s) [noise=true , address=77.90.31.12:4599 , piece_id=HRXQ2B3TN3SBSFK6KU4UZ7LJ7UBSXJ723BVBYUBLALXHBS6GXAEQ, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.074013122 (341h8m39.805280753s) [noise=true , address=45.91.116.5:4326 , piece_id=WFXH6IWMIWGH36TO6DIJFTIQJ2AI33HJSSIIC5H7UE77SYJDVW3Q, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.074203350 (341h8m39.80547101s) [noise=true , address=104.36.82.4:4835 , piece_id=WX3MBWDC226S4VUREO5XHSXKXGIZMEHPWN4NC65H66SRFAIJFAAQ, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.074390803 (341h8m39.805658433s) [noise=true , address=45.91.116.11:4138 , piece_id=PJEO7TOUNJ6A4J5UB4NKWFNVHQOBAEHMMOAWYR7T3Q2RYO2M57FA, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.074638197 (341h8m39.805905848s) [noise=true , address=77.90.31.13:4632 , piece_id=YEFUHCV3FQOQNYZQIMEFFXG242BYJTCJGVB5CJXQR4KWCVZJ76TQ, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.074771618 (341h8m39.806039249s) [noise=true , address=77.90.31.17:4775 , piece_id=N4ANPYW5WHQCZD5VNEEFZGCT3F6M6TVSU5WOPFL7HPOOAMLJPO4Q, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.075079427 (341h8m39.806347077s) [noise=true , address=104.36.82.14:4246 , piece_id=QXQGAVDBMNZNRN5JV4AOH5T2LNO4CGADA4P47CLFMLT34IWBR6AA, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.075157013 (341h8m39.806424644s) [noise=true , address=45.91.116.7:4035 , piece_id=7PYA7C6UG6OWJGWWJLTAKFS6AA7RECOP3YX57AE4M6OQEQ3AS4TQ, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.075486041 (341h8m39.806753671s) [noise=true , address=77.90.31.16:4747 , piece_id=M6FEMTPY45DUFQ2ODW6VI72AXLEG7U3LUNFLL3XGA555D2GAZFJQ, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.075645802 (341h8m39.806913463s) [noise=true , address=79.127.220.97:4395 , piece_id=66DNAN6VMEHASHKE36FVPNKAHXVEYVJ75ZXI5X5SQ3RTK6AZJNQA, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.186106521 (341h8m39.917374162s) [upload=354636]: Next returned nil segment
Aug 22 22:34:59.186124867 (341h8m39.917392517s) [upload=354636]: Waiting for error group managing segments...
Aug 22 22:34:59.193176012 (341h8m39.924443632s) [noise=true , address=45.91.116.7:4035 , piece_id=7PYA7C6UG6OWJGWWJLTAKFS6AA7RECOP3YX57AE4M6OQEQ3AS4TQ, seg_pos={0 0}, upload=354636]: Done uploading piece. err: <nil>
Aug 22 22:34:59.195383533 (341h8m39.926651152s) [noise=true , address=77.90.31.17:4775 , piece_id=N4ANPYW5WHQCZD5VNEEFZGCT3F6M6TVSU5WOPFL7HPOOAMLJPO4Q, seg_pos={0 0}, upload=354636]: Done uploading piece. err: <nil>
Aug 22 22:34:59.195679699 (341h8m39.926947319s) [noise=true , address=45.91.116.11:4138 , piece_id=PJEO7TOUNJ6A4J5UB4NKWFNVHQOBAEHMMOAWYR7T3Q2RYO2M57FA, seg_pos={0 0}, upload=354636]: Done uploading piece. err: <nil>
Aug 22 22:34:59.199763787 (341h8m39.931031417s) [noise=true , address=104.36.82.21:4490 , piece_id=DA2EPUXZUNWOV2HXV7D4Z2ORQNPNLNVBD6RRUTDQBP32DJBDFWEQ, seg_pos={0 0}, upload=354636]: Done uploading piece. err: <nil>
Aug 22 22:34:59.200296990 (341h8m39.93156463s) [noise=true , address=104.36.82.60:4355 , piece_id=ZWCBYSGDO4RFRVT5UEP64EQYNYQWH4EQT6PYLJEYEBYFIXRCIHKA, seg_pos={0 0}, upload=354636]: Done uploading piece. err: <nil>
Aug 22 22:34:59.213479782 (341h8m39.944747412s) [noise=true , address=104.36.82.20:4443 , piece_id=7EMN32OFJAFYTQHX5SGOYYXB7GWWYFGAUIPMGWWFU76YD3P5NAXQ, seg_pos={0 0}, upload=354636]: Done uploading piece. err: <nil>
Aug 22 22:34:59.214005120 (341h8m39.94527276s) [noise=true , address=104.36.82.4:4835 , piece_id=WX3MBWDC226S4VUREO5XHSXKXGIZMEHPWN4NC65H66SRFAIJFAAQ, seg_pos={0 0}, upload=354636]: Done uploading piece. err: <nil>
Aug 22 22:34:59.219857762 (341h8m39.951125402s) [noise=true , address=77.90.31.12:4597 , piece_id=GDKOGFZV7V6JRCJIQYOAZSHZI7JEWM7KGY2II4VBSKFCRHHZMRMA, seg_pos={0 0}, upload=354636]: Done uploading piece. err: <nil>
Aug 22 22:34:59.224215696 (341h8m39.955483336s) [noise=true , address=104.36.82.62:4428 , piece_id=C3XIJL5AALYYQBSLQSJ6XHXWMQSN7QDLEDAIPCR2MHQZ7D45UZWA, seg_pos={0 0}, upload=354636]: Done uploading piece. err: <nil>
Aug 22 22:34:59.225304743 (341h8m39.956572363s) [noise=true , address=104.36.82.14:4246 , piece_id=QXQGAVDBMNZNRN5JV4AOH5T2LNO4CGADA4P47CLFMLT34IWBR6AA, seg_pos={0 0}, upload=354636]: Done uploading piece. err: <nil>
Aug 22 22:34:59.229087444 (341h8m39.960355064s) [noise=true , address=104.36.82.45:4940 , piece_id=JXPUZ3WMZ3PJ756IPGD6YC6H6G4QVKUY34UABF55HR2OW7CXS7IQ, seg_pos={0 0}, upload=354636]: Done uploading piece. err: <nil>
Aug 22 22:34:59.230502755 (341h8m39.961770375s) [noise=true , address=77.90.31.21:4891 , piece_id=DIEBEFT4RJRT5DD7DX3ZWZXAQKJYQIXHKLCNGKKBXMR2CZ6TPRZQ, seg_pos={0 0}, upload=354636]: Done uploading piece. err: <nil>
Aug 22 22:34:59.276370463 (341h8m40.007638103s) [noise=true , address=79.127.220.97:4395 , piece_id=66DNAN6VMEHASHKE36FVPNKAHXVEYVJ75ZXI5X5SQ3RTK6AZJNQA, seg_pos={0 0}, upload=354636]: Done uploading piece. err: <nil>
Aug 22 22:34:59.284841228 (341h8m40.016108847s) [noise=true , address=45.91.116.5:4326 , piece_id=WFXH6IWMIWGH36TO6DIJFTIQJ2AI33HJSSIIC5H7UE77SYJDVW3Q, seg_pos={0 0}, upload=354636]: Done uploading piece. err: <nil>
Aug 22 22:34:59.284863430 (341h8m40.016131049s) [seg_pos={0 0}, upload=354636]: Segment reached optimal threshold of 14 pieces.
Aug 22 22:34:59.284976603 (341h8m40.016244233s) [noise=true , address=104.36.82.50:4019 , piece_id=VNPGVKDTIKZW6WTVKVXEMXDBKDIZMBEZJEMFXEBIGNVNYZMKAQ3Q, seg_pos={0 0}, upload=354636]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ztmvXKmY6hicHZD7iejpcJCKFEhLwemtaYChAp8Po85TRQvGo): protocol: expected piece hash; context canceled; EOF
Aug 22 22:34:59.285125021 (341h8m40.016392641s) [noise=true , address=77.90.31.12:4599 , piece_id=HRXQ2B3TN3SBSFK6KU4UZ7LJ7UBSXJ723BVBYUBLALXHBS6GXAEQ, seg_pos={0 0}, upload=354636]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124cEnKBraQScM26K7Zc8Z3cqTvrD9fPyWzWYutYryfXqmXQ3rn): protocol: expected piece hash; context canceled; EOF
Aug 22 22:34:59.285190415 (341h8m40.016458045s) [noise=true , address=77.90.31.16:4747 , piece_id=M6FEMTPY45DUFQ2ODW6VI72AXLEG7U3LUNFLL3XGA555D2GAZFJQ, seg_pos={0 0}, upload=354636]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ERdBm3XPw4s7JHeMWsVniwcqnfMtP4ZX8sBVjri6dzZtq8AF2): protocol: expected piece hash; context canceled; EOF
Aug 22 22:34:59.285223937 (341h8m40.016491557s) [noise=true , address=77.90.31.13:4632 , piece_id=YEFUHCV3FQOQNYZQIMEFFXG242BYJTCJGVB5CJXQR4KWCVZJ76TQ, seg_pos={0 0}, upload=354636]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13iPed9zYrthvh36xo3k4gsqm4tz86iVkNvAr3wauuArQLquyS): protocol: rpc: dial tcp 77.90.31.13:4632: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 22:34:59.285241440 (341h8m40.01650907s) [seg_pos={0 0}, upload=354636]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 22:34:59.285315479 (341h8m40.016583099s) [upload=354636]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 22:34:59.285327071 (341h8m40.016594701s) [upload=354636]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 22:34:59.387267904 (341h8m40.118535534s) [upload=354636]: Done uploading segments...
Aug 22 22:34:59.387280017 (341h8m40.118547647s) [upload=354636]: Upload finished. err: <nil>
Duration: 1.130620428s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....................................X......X................] duration:
288.934429ms
FAIL (2025-08-22 23:15:36 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 22 23:04:34.193786424 (341h38m14.925054054s) [upload=355145]: Starting upload Aug 22 23:04:34.193855373 (341h38m14.925123003s) [upload=355145]: Done starting upload Aug 22 23:04:34.193917851 (341h38m14.925185481s) [upload=355145]: Uploading segments... Aug 22 23:04:34.193995587 (341h38m14.925263217s) [upload=355145]: Got next segment. Inline: true Aug 22 23:04:34.194002741 (341h38m14.925270371s) [upload=355145]: Waiting for error group managing segments... Aug 22 23:04:34.194052023 (341h38m14.925319653s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 23:04:34.194058906 (341h38m14.925326526s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 23:04:34.194063054 (341h38m14.925330684s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 23:04:34.545689514 (341h38m15.276957164s) [upload=355145]: Done uploading segments... Aug 22 23:04:34.545718478 (341h38m15.276986128s) [upload=355145]: Upload finished. err: <nil>
Duration: 288.953294ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
3.970834229s
FAIL (2025-08-22 23:15:20 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
59]: Uploading piece...
Aug 22 22:53:29.611585477 (341h27m10.342853137s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612050902 (341h27m10.343318552s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612464942 (341h27m10.343732591s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612857369 (341h27m10.34412503s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613271678 (341h27m10.344539329s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613655671 (341h27m10.344923321s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614059881 (341h27m10.345327542s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614540405 (341h27m10.345808065s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614942673 (341h27m10.346210322s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.615322797 (341h27m10.346590508s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.618240035 (341h27m10.349507685s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:30.106040273 (341h27m10.837307893s) [upload=354959]: Next returned nil segment
Aug 22 22:53:30.106057475 (341h27m10.837325105s) [upload=354959]: Waiting for error group managing segments...
Aug 22 22:53:30.265188790 (341h27m10.99645643s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.265907802 (341h27m10.997175453s) [noise=true , address=81.171.14.70:4039 , piece_id=UGLARCJIGPJ5BN2PWYD4NM62Z74HLMBKRCCYEKFP2ZAZBGWSYIRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.266528711 (341h27m10.997796351s) [noise=true , address=81.171.14.70:4035 , piece_id=6M22EYTZY734SCUSTKUGF3PNJ2QJLKMA2MAZXV6VPOOM2W4EUUUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.267544280 (341h27m10.998811931s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.268723619 (341h27m10.99999126s) [noise=true , address=89.149.201.147:4015 , piece_id=5WP6YFYWCVWL7QRS2VCDJP576AHQ66NJW742XOW324DIIXMLSBEQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270432624 (341h27m11.001700254s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270515790 (341h27m11.001783431s) [noise=true , address=81.171.14.70:4025 , piece_id=3PV4YNDGP33PBZUHYWLXRSEE3QZO2ZFL2PCEXYSSEWGGWVTFRLPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.271054975 (341h27m11.002322595s) [noise=true , address=81.171.14.70:4031 , piece_id=O6BNM3FOD76GP5I3MJKNZXREQH7XRG7ZOHDNNXRD7HKTSABASTUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.273453727 (341h27m11.004721367s) [noise=true , address=81.171.14.70:4044 , piece_id=JAMFLVIXOT4KL2OPPZGQFLV35GUPBBRX6673QJMB6YDRBZFOGG7Q, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.274998804 (341h27m11.006266424s) [noise=true , address=185.167.204.205:4027 , piece_id=NDAULJLWJRAIVPPNHYKT3WJHG5JS2F6B7RLQQXFJOL3QBNPTADMA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277211505 (341h27m11.008479146s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277435196 (341h27m11.008702816s) [noise=true , address=185.167.204.206:4072 , piece_id=XYAPWQELW5EUKLR62OGEEQVBGNQUTS2J4CC4PLPNTEXP2SWNQRIA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279287400 (341h27m11.01055504s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279410051 (341h27m11.010677681s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280438876 (341h27m11.011706507s) [noise=true , address=185.167.204.206:4056 , piece_id=BQTKVXFXDWMZCV7UBQDMJTE6DII572Q3AJM3JCTW66AP6DIWY5MQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280910263 (341h27m11.012177893s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.281986407 (341h27m11.013254028s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282394265 (341h27m11.013666674s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282761165 (341h27m11.014028785s) [noise=true , address=185.167.204.206:4062 , piece_id=C6LI537WYQRJHUVBTDJCZK35KQHT5JBBLENH5WVGPDJFWCU3RTWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283174292 (341h27m11.014441911s) [noise=true , address=185.167.204.205:4023 , piece_id=YZXWFCP5WW4ARBUTA6XNWHU3KU5U23OMASCOFORJNL6T3UZQDGWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283847198 (341h27m11.015114838s) [noise=true , address=185.167.204.206:4063 , piece_id=E7N65C5KMWXYA67LJW4FLIWRNUP45QNS7OTUYK64UMW2AVWXT7IQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.285333653 (341h27m11.016601274s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.287128550 (341h27m11.01839617s) [noise=true , address=185.167.204.205:4030 , piece_id=V5B4VQCRBKXTTY4PJRVWV5C54HV2MX7PHC53UNKKP7Y3SJJGBARA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.292510313 (341h27m11.023777933s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.296039952 (341h27m11.027307572s) [noise=true , address=185.167.204.206:4068 , piece_id=5WUPBASDPHH7SGA3HLRLN3HMLMABMZTCO5YFUFVLT2FPC4DLFCPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301208034 (341h27m11.032475664s) [noise=true , address=81.171.14.70:4046 , piece_id=4YNKZGJQYOJEB3FFDIK6XALSTARBBMPYCE4GEWIQ5RQROFUHE6CA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301226198 (341h27m11.032493828s) [seg_pos={0 0}, upload=354959]: Segment reached optimal threshold of 26 pieces.
Aug 22 22:53:30.301343489 (341h27m11.032611129s) [noise=true , address=81.171.14.70:4036 , piece_id=OTQRXXAW43EQPVOUO54E6EUPTUZLRPWMHWBV62OKMTUI5QZMDZVQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF
Aug 22 22:53:30.301530851 (341h27m11.032798481s) [noise=true , address=185.167.204.205:4033 , piece_id=ROIUSDQL7GNXUULS6VLF6OIPG6UJOJTNEYLS6THCFIOP3LTL2SBA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe): protocol: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection
Aug 22 22:53:30.301547272 (341h27m11.032814902s) [seg_pos={0 0}, upload=354959]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Aug 22 22:53:30.301638825 (341h27m11.032906455s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 22:53:30.301644756 (341h27m11.032912386s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 22:56:04.281070862 (341h29m45.012338492s) [upload=354959]: Done uploading segments...
Aug 22 22:56:04.281085750 (341h29m45.012353381s) [upload=354959]: Upload finished. err: metaclient: context deadline exceeded
Duration: 3.970855759s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....................................X......X...............] duration:
1.056650519s
FAIL (2025-08-22 23:14:53 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 22 23:04:34.193786424 (341h38m14.925054054s) [upload=355145]: Starting upload Aug 22 23:04:34.193855373 (341h38m14.925123003s) [upload=355145]: Done starting upload Aug 22 23:04:34.193917851 (341h38m14.925185481s) [upload=355145]: Uploading segments... Aug 22 23:04:34.193995587 (341h38m14.925263217s) [upload=355145]: Got next segment. Inline: true Aug 22 23:04:34.194002741 (341h38m14.925270371s) [upload=355145]: Waiting for error group managing segments... Aug 22 23:04:34.194052023 (341h38m14.925319653s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 23:04:34.194058906 (341h38m14.925326526s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 23:04:34.194063054 (341h38m14.925330684s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 23:04:34.545689514 (341h38m15.276957164s) [upload=355145]: Done uploading segments... Aug 22 23:04:34.545718478 (341h38m15.276986128s) [upload=355145]: Upload finished. err: <nil>
Duration: 1.056676837s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
457.667266ms
FAIL (2025-08-22 23:14:34 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 22 22:34:59.033856300 (341h8m39.76512395s) [upload=354636]: Starting upload
Aug 22 22:34:59.033926702 (341h8m39.765194352s) [upload=354636]: Done starting upload
Aug 22 22:34:59.034044734 (341h8m39.765312364s) [upload=354636]: Uploading segments...
Aug 22 22:34:59.034327877 (341h8m39.765595526s) [upload=354636]: Got next segment. Inline: false
Aug 22 22:34:59.034373542 (341h8m39.765641202s) [upload=354636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 22:34:59.034379112 (341h8m39.765646773s) [upload=354636]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 22:34:59.072021327 (341h8m39.803288978s) [seg_pos={0 0}, upload=354636]: Begin upload segment...
Aug 22 22:34:59.072095788 (341h8m39.803363438s) [seg_pos={0 0}, upload=354636]: Done begin upload segment.
Aug 22 22:34:59.072134821 (341h8m39.803402441s) [noise=true , address=77.90.31.21:4891 , piece_id=DIEBEFT4RJRT5DD7DX3ZWZXAQKJYQIXHKLCNGKKBXMR2CZ6TPRZQ, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.072156512 (341h8m39.803424162s) [noise=true , address=104.36.82.62:4428 , piece_id=C3XIJL5AALYYQBSLQSJ6XHXWMQSN7QDLEDAIPCR2MHQZ7D45UZWA, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.072571413 (341h8m39.803839032s) [noise=true , address=104.36.82.21:4490 , piece_id=DA2EPUXZUNWOV2HXV7D4Z2ORQNPNLNVBD6RRUTDQBP32DJBDFWEQ, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.072717918 (341h8m39.803985568s) [noise=true , address=104.36.82.20:4443 , piece_id=7EMN32OFJAFYTQHX5SGOYYXB7GWWYFGAUIPMGWWFU76YD3P5NAXQ, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.072992775 (341h8m39.804260405s) [noise=true , address=104.36.82.45:4940 , piece_id=JXPUZ3WMZ3PJ756IPGD6YC6H6G4QVKUY34UABF55HR2OW7CXS7IQ, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.073219260 (341h8m39.804486911s) [noise=true , address=77.90.31.12:4597 , piece_id=GDKOGFZV7V6JRCJIQYOAZSHZI7JEWM7KGY2II4VBSKFCRHHZMRMA, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.073336069 (341h8m39.804603699s) [noise=true , address=104.36.82.50:4019 , piece_id=VNPGVKDTIKZW6WTVKVXEMXDBKDIZMBEZJEMFXEBIGNVNYZMKAQ3Q, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.073688793 (341h8m39.804956413s) [noise=true , address=104.36.82.60:4355 , piece_id=ZWCBYSGDO4RFRVT5UEP64EQYNYQWH4EQT6PYLJEYEBYFIXRCIHKA, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.073751250 (341h8m39.80501891s) [noise=true , address=77.90.31.12:4599 , piece_id=HRXQ2B3TN3SBSFK6KU4UZ7LJ7UBSXJ723BVBYUBLALXHBS6GXAEQ, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.074013122 (341h8m39.805280753s) [noise=true , address=45.91.116.5:4326 , piece_id=WFXH6IWMIWGH36TO6DIJFTIQJ2AI33HJSSIIC5H7UE77SYJDVW3Q, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.074203350 (341h8m39.80547101s) [noise=true , address=104.36.82.4:4835 , piece_id=WX3MBWDC226S4VUREO5XHSXKXGIZMEHPWN4NC65H66SRFAIJFAAQ, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.074390803 (341h8m39.805658433s) [noise=true , address=45.91.116.11:4138 , piece_id=PJEO7TOUNJ6A4J5UB4NKWFNVHQOBAEHMMOAWYR7T3Q2RYO2M57FA, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.074638197 (341h8m39.805905848s) [noise=true , address=77.90.31.13:4632 , piece_id=YEFUHCV3FQOQNYZQIMEFFXG242BYJTCJGVB5CJXQR4KWCVZJ76TQ, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.074771618 (341h8m39.806039249s) [noise=true , address=77.90.31.17:4775 , piece_id=N4ANPYW5WHQCZD5VNEEFZGCT3F6M6TVSU5WOPFL7HPOOAMLJPO4Q, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.075079427 (341h8m39.806347077s) [noise=true , address=104.36.82.14:4246 , piece_id=QXQGAVDBMNZNRN5JV4AOH5T2LNO4CGADA4P47CLFMLT34IWBR6AA, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.075157013 (341h8m39.806424644s) [noise=true , address=45.91.116.7:4035 , piece_id=7PYA7C6UG6OWJGWWJLTAKFS6AA7RECOP3YX57AE4M6OQEQ3AS4TQ, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.075486041 (341h8m39.806753671s) [noise=true , address=77.90.31.16:4747 , piece_id=M6FEMTPY45DUFQ2ODW6VI72AXLEG7U3LUNFLL3XGA555D2GAZFJQ, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.075645802 (341h8m39.806913463s) [noise=true , address=79.127.220.97:4395 , piece_id=66DNAN6VMEHASHKE36FVPNKAHXVEYVJ75ZXI5X5SQ3RTK6AZJNQA, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.186106521 (341h8m39.917374162s) [upload=354636]: Next returned nil segment
Aug 22 22:34:59.186124867 (341h8m39.917392517s) [upload=354636]: Waiting for error group managing segments...
Aug 22 22:34:59.193176012 (341h8m39.924443632s) [noise=true , address=45.91.116.7:4035 , piece_id=7PYA7C6UG6OWJGWWJLTAKFS6AA7RECOP3YX57AE4M6OQEQ3AS4TQ, seg_pos={0 0}, upload=354636]: Done uploading piece. err: <nil>
Aug 22 22:34:59.195383533 (341h8m39.926651152s) [noise=true , address=77.90.31.17:4775 , piece_id=N4ANPYW5WHQCZD5VNEEFZGCT3F6M6TVSU5WOPFL7HPOOAMLJPO4Q, seg_pos={0 0}, upload=354636]: Done uploading piece. err: <nil>
Aug 22 22:34:59.195679699 (341h8m39.926947319s) [noise=true , address=45.91.116.11:4138 , piece_id=PJEO7TOUNJ6A4J5UB4NKWFNVHQOBAEHMMOAWYR7T3Q2RYO2M57FA, seg_pos={0 0}, upload=354636]: Done uploading piece. err: <nil>
Aug 22 22:34:59.199763787 (341h8m39.931031417s) [noise=true , address=104.36.82.21:4490 , piece_id=DA2EPUXZUNWOV2HXV7D4Z2ORQNPNLNVBD6RRUTDQBP32DJBDFWEQ, seg_pos={0 0}, upload=354636]: Done uploading piece. err: <nil>
Aug 22 22:34:59.200296990 (341h8m39.93156463s) [noise=true , address=104.36.82.60:4355 , piece_id=ZWCBYSGDO4RFRVT5UEP64EQYNYQWH4EQT6PYLJEYEBYFIXRCIHKA, seg_pos={0 0}, upload=354636]: Done uploading piece. err: <nil>
Aug 22 22:34:59.213479782 (341h8m39.944747412s) [noise=true , address=104.36.82.20:4443 , piece_id=7EMN32OFJAFYTQHX5SGOYYXB7GWWYFGAUIPMGWWFU76YD3P5NAXQ, seg_pos={0 0}, upload=354636]: Done uploading piece. err: <nil>
Aug 22 22:34:59.214005120 (341h8m39.94527276s) [noise=true , address=104.36.82.4:4835 , piece_id=WX3MBWDC226S4VUREO5XHSXKXGIZMEHPWN4NC65H66SRFAIJFAAQ, seg_pos={0 0}, upload=354636]: Done uploading piece. err: <nil>
Aug 22 22:34:59.219857762 (341h8m39.951125402s) [noise=true , address=77.90.31.12:4597 , piece_id=GDKOGFZV7V6JRCJIQYOAZSHZI7JEWM7KGY2II4VBSKFCRHHZMRMA, seg_pos={0 0}, upload=354636]: Done uploading piece. err: <nil>
Aug 22 22:34:59.224215696 (341h8m39.955483336s) [noise=true , address=104.36.82.62:4428 , piece_id=C3XIJL5AALYYQBSLQSJ6XHXWMQSN7QDLEDAIPCR2MHQZ7D45UZWA, seg_pos={0 0}, upload=354636]: Done uploading piece. err: <nil>
Aug 22 22:34:59.225304743 (341h8m39.956572363s) [noise=true , address=104.36.82.14:4246 , piece_id=QXQGAVDBMNZNRN5JV4AOH5T2LNO4CGADA4P47CLFMLT34IWBR6AA, seg_pos={0 0}, upload=354636]: Done uploading piece. err: <nil>
Aug 22 22:34:59.229087444 (341h8m39.960355064s) [noise=true , address=104.36.82.45:4940 , piece_id=JXPUZ3WMZ3PJ756IPGD6YC6H6G4QVKUY34UABF55HR2OW7CXS7IQ, seg_pos={0 0}, upload=354636]: Done uploading piece. err: <nil>
Aug 22 22:34:59.230502755 (341h8m39.961770375s) [noise=true , address=77.90.31.21:4891 , piece_id=DIEBEFT4RJRT5DD7DX3ZWZXAQKJYQIXHKLCNGKKBXMR2CZ6TPRZQ, seg_pos={0 0}, upload=354636]: Done uploading piece. err: <nil>
Aug 22 22:34:59.276370463 (341h8m40.007638103s) [noise=true , address=79.127.220.97:4395 , piece_id=66DNAN6VMEHASHKE36FVPNKAHXVEYVJ75ZXI5X5SQ3RTK6AZJNQA, seg_pos={0 0}, upload=354636]: Done uploading piece. err: <nil>
Aug 22 22:34:59.284841228 (341h8m40.016108847s) [noise=true , address=45.91.116.5:4326 , piece_id=WFXH6IWMIWGH36TO6DIJFTIQJ2AI33HJSSIIC5H7UE77SYJDVW3Q, seg_pos={0 0}, upload=354636]: Done uploading piece. err: <nil>
Aug 22 22:34:59.284863430 (341h8m40.016131049s) [seg_pos={0 0}, upload=354636]: Segment reached optimal threshold of 14 pieces.
Aug 22 22:34:59.284976603 (341h8m40.016244233s) [noise=true , address=104.36.82.50:4019 , piece_id=VNPGVKDTIKZW6WTVKVXEMXDBKDIZMBEZJEMFXEBIGNVNYZMKAQ3Q, seg_pos={0 0}, upload=354636]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ztmvXKmY6hicHZD7iejpcJCKFEhLwemtaYChAp8Po85TRQvGo): protocol: expected piece hash; context canceled; EOF
Aug 22 22:34:59.285125021 (341h8m40.016392641s) [noise=true , address=77.90.31.12:4599 , piece_id=HRXQ2B3TN3SBSFK6KU4UZ7LJ7UBSXJ723BVBYUBLALXHBS6GXAEQ, seg_pos={0 0}, upload=354636]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124cEnKBraQScM26K7Zc8Z3cqTvrD9fPyWzWYutYryfXqmXQ3rn): protocol: expected piece hash; context canceled; EOF
Aug 22 22:34:59.285190415 (341h8m40.016458045s) [noise=true , address=77.90.31.16:4747 , piece_id=M6FEMTPY45DUFQ2ODW6VI72AXLEG7U3LUNFLL3XGA555D2GAZFJQ, seg_pos={0 0}, upload=354636]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ERdBm3XPw4s7JHeMWsVniwcqnfMtP4ZX8sBVjri6dzZtq8AF2): protocol: expected piece hash; context canceled; EOF
Aug 22 22:34:59.285223937 (341h8m40.016491557s) [noise=true , address=77.90.31.13:4632 , piece_id=YEFUHCV3FQOQNYZQIMEFFXG242BYJTCJGVB5CJXQR4KWCVZJ76TQ, seg_pos={0 0}, upload=354636]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13iPed9zYrthvh36xo3k4gsqm4tz86iVkNvAr3wauuArQLquyS): protocol: rpc: dial tcp 77.90.31.13:4632: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 22:34:59.285241440 (341h8m40.01650907s) [seg_pos={0 0}, upload=354636]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 22:34:59.285315479 (341h8m40.016583099s) [upload=354636]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 22:34:59.285327071 (341h8m40.016594701s) [upload=354636]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 22:34:59.387267904 (341h8m40.118535534s) [upload=354636]: Done uploading segments...
Aug 22 22:34:59.387280017 (341h8m40.118547647s) [upload=354636]: Upload finished. err: <nil>
Duration: 457.70587ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......................................X......X..............] duration:
134.418217ms
FAIL (2025-08-22 23:14:25 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 22 23:04:34.193786424 (341h38m14.925054054s) [upload=355145]: Starting upload Aug 22 23:04:34.193855373 (341h38m14.925123003s) [upload=355145]: Done starting upload Aug 22 23:04:34.193917851 (341h38m14.925185481s) [upload=355145]: Uploading segments... Aug 22 23:04:34.193995587 (341h38m14.925263217s) [upload=355145]: Got next segment. Inline: true Aug 22 23:04:34.194002741 (341h38m14.925270371s) [upload=355145]: Waiting for error group managing segments... Aug 22 23:04:34.194052023 (341h38m14.925319653s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 23:04:34.194058906 (341h38m14.925326526s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 23:04:34.194063054 (341h38m14.925330684s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 23:04:34.545689514 (341h38m15.276957164s) [upload=355145]: Done uploading segments... Aug 22 23:04:34.545718478 (341h38m15.276986128s) [upload=355145]: Upload finished. err: <nil>
Duration: 134.449376ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
2.969733306s
FAIL (2025-08-22 23:14:11 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
59]: Uploading piece...
Aug 22 22:53:29.611585477 (341h27m10.342853137s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612050902 (341h27m10.343318552s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612464942 (341h27m10.343732591s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612857369 (341h27m10.34412503s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613271678 (341h27m10.344539329s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613655671 (341h27m10.344923321s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614059881 (341h27m10.345327542s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614540405 (341h27m10.345808065s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614942673 (341h27m10.346210322s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.615322797 (341h27m10.346590508s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.618240035 (341h27m10.349507685s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:30.106040273 (341h27m10.837307893s) [upload=354959]: Next returned nil segment
Aug 22 22:53:30.106057475 (341h27m10.837325105s) [upload=354959]: Waiting for error group managing segments...
Aug 22 22:53:30.265188790 (341h27m10.99645643s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.265907802 (341h27m10.997175453s) [noise=true , address=81.171.14.70:4039 , piece_id=UGLARCJIGPJ5BN2PWYD4NM62Z74HLMBKRCCYEKFP2ZAZBGWSYIRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.266528711 (341h27m10.997796351s) [noise=true , address=81.171.14.70:4035 , piece_id=6M22EYTZY734SCUSTKUGF3PNJ2QJLKMA2MAZXV6VPOOM2W4EUUUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.267544280 (341h27m10.998811931s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.268723619 (341h27m10.99999126s) [noise=true , address=89.149.201.147:4015 , piece_id=5WP6YFYWCVWL7QRS2VCDJP576AHQ66NJW742XOW324DIIXMLSBEQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270432624 (341h27m11.001700254s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270515790 (341h27m11.001783431s) [noise=true , address=81.171.14.70:4025 , piece_id=3PV4YNDGP33PBZUHYWLXRSEE3QZO2ZFL2PCEXYSSEWGGWVTFRLPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.271054975 (341h27m11.002322595s) [noise=true , address=81.171.14.70:4031 , piece_id=O6BNM3FOD76GP5I3MJKNZXREQH7XRG7ZOHDNNXRD7HKTSABASTUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.273453727 (341h27m11.004721367s) [noise=true , address=81.171.14.70:4044 , piece_id=JAMFLVIXOT4KL2OPPZGQFLV35GUPBBRX6673QJMB6YDRBZFOGG7Q, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.274998804 (341h27m11.006266424s) [noise=true , address=185.167.204.205:4027 , piece_id=NDAULJLWJRAIVPPNHYKT3WJHG5JS2F6B7RLQQXFJOL3QBNPTADMA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277211505 (341h27m11.008479146s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277435196 (341h27m11.008702816s) [noise=true , address=185.167.204.206:4072 , piece_id=XYAPWQELW5EUKLR62OGEEQVBGNQUTS2J4CC4PLPNTEXP2SWNQRIA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279287400 (341h27m11.01055504s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279410051 (341h27m11.010677681s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280438876 (341h27m11.011706507s) [noise=true , address=185.167.204.206:4056 , piece_id=BQTKVXFXDWMZCV7UBQDMJTE6DII572Q3AJM3JCTW66AP6DIWY5MQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280910263 (341h27m11.012177893s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.281986407 (341h27m11.013254028s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282394265 (341h27m11.013666674s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282761165 (341h27m11.014028785s) [noise=true , address=185.167.204.206:4062 , piece_id=C6LI537WYQRJHUVBTDJCZK35KQHT5JBBLENH5WVGPDJFWCU3RTWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283174292 (341h27m11.014441911s) [noise=true , address=185.167.204.205:4023 , piece_id=YZXWFCP5WW4ARBUTA6XNWHU3KU5U23OMASCOFORJNL6T3UZQDGWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283847198 (341h27m11.015114838s) [noise=true , address=185.167.204.206:4063 , piece_id=E7N65C5KMWXYA67LJW4FLIWRNUP45QNS7OTUYK64UMW2AVWXT7IQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.285333653 (341h27m11.016601274s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.287128550 (341h27m11.01839617s) [noise=true , address=185.167.204.205:4030 , piece_id=V5B4VQCRBKXTTY4PJRVWV5C54HV2MX7PHC53UNKKP7Y3SJJGBARA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.292510313 (341h27m11.023777933s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.296039952 (341h27m11.027307572s) [noise=true , address=185.167.204.206:4068 , piece_id=5WUPBASDPHH7SGA3HLRLN3HMLMABMZTCO5YFUFVLT2FPC4DLFCPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301208034 (341h27m11.032475664s) [noise=true , address=81.171.14.70:4046 , piece_id=4YNKZGJQYOJEB3FFDIK6XALSTARBBMPYCE4GEWIQ5RQROFUHE6CA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301226198 (341h27m11.032493828s) [seg_pos={0 0}, upload=354959]: Segment reached optimal threshold of 26 pieces.
Aug 22 22:53:30.301343489 (341h27m11.032611129s) [noise=true , address=81.171.14.70:4036 , piece_id=OTQRXXAW43EQPVOUO54E6EUPTUZLRPWMHWBV62OKMTUI5QZMDZVQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF
Aug 22 22:53:30.301530851 (341h27m11.032798481s) [noise=true , address=185.167.204.205:4033 , piece_id=ROIUSDQL7GNXUULS6VLF6OIPG6UJOJTNEYLS6THCFIOP3LTL2SBA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe): protocol: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection
Aug 22 22:53:30.301547272 (341h27m11.032814902s) [seg_pos={0 0}, upload=354959]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Aug 22 22:53:30.301638825 (341h27m11.032906455s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 22:53:30.301644756 (341h27m11.032912386s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 22:56:04.281070862 (341h29m45.012338492s) [upload=354959]: Done uploading segments...
Aug 22 22:56:04.281085750 (341h29m45.012353381s) [upload=354959]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.969766077s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......................................X......X.............] duration:
194.040027ms
FAIL (2025-08-22 23:14:06 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 22 23:04:34.193786424 (341h38m14.925054054s) [upload=355145]: Starting upload Aug 22 23:04:34.193855373 (341h38m14.925123003s) [upload=355145]: Done starting upload Aug 22 23:04:34.193917851 (341h38m14.925185481s) [upload=355145]: Uploading segments... Aug 22 23:04:34.193995587 (341h38m14.925263217s) [upload=355145]: Got next segment. Inline: true Aug 22 23:04:34.194002741 (341h38m14.925270371s) [upload=355145]: Waiting for error group managing segments... Aug 22 23:04:34.194052023 (341h38m14.925319653s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 23:04:34.194058906 (341h38m14.925326526s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 23:04:34.194063054 (341h38m14.925330684s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 23:04:34.545689514 (341h38m15.276957164s) [upload=355145]: Done uploading segments... Aug 22 23:04:34.545718478 (341h38m15.276986128s) [upload=355145]: Upload finished. err: <nil>
Duration: 194.062048ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
2.397339153s
FAIL (2025-08-22 23:13:43 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 22 22:34:59.033856300 (341h8m39.76512395s) [upload=354636]: Starting upload
Aug 22 22:34:59.033926702 (341h8m39.765194352s) [upload=354636]: Done starting upload
Aug 22 22:34:59.034044734 (341h8m39.765312364s) [upload=354636]: Uploading segments...
Aug 22 22:34:59.034327877 (341h8m39.765595526s) [upload=354636]: Got next segment. Inline: false
Aug 22 22:34:59.034373542 (341h8m39.765641202s) [upload=354636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 22:34:59.034379112 (341h8m39.765646773s) [upload=354636]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 22:34:59.072021327 (341h8m39.803288978s) [seg_pos={0 0}, upload=354636]: Begin upload segment...
Aug 22 22:34:59.072095788 (341h8m39.803363438s) [seg_pos={0 0}, upload=354636]: Done begin upload segment.
Aug 22 22:34:59.072134821 (341h8m39.803402441s) [noise=true , address=77.90.31.21:4891 , piece_id=DIEBEFT4RJRT5DD7DX3ZWZXAQKJYQIXHKLCNGKKBXMR2CZ6TPRZQ, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.072156512 (341h8m39.803424162s) [noise=true , address=104.36.82.62:4428 , piece_id=C3XIJL5AALYYQBSLQSJ6XHXWMQSN7QDLEDAIPCR2MHQZ7D45UZWA, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.072571413 (341h8m39.803839032s) [noise=true , address=104.36.82.21:4490 , piece_id=DA2EPUXZUNWOV2HXV7D4Z2ORQNPNLNVBD6RRUTDQBP32DJBDFWEQ, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.072717918 (341h8m39.803985568s) [noise=true , address=104.36.82.20:4443 , piece_id=7EMN32OFJAFYTQHX5SGOYYXB7GWWYFGAUIPMGWWFU76YD3P5NAXQ, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.072992775 (341h8m39.804260405s) [noise=true , address=104.36.82.45:4940 , piece_id=JXPUZ3WMZ3PJ756IPGD6YC6H6G4QVKUY34UABF55HR2OW7CXS7IQ, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.073219260 (341h8m39.804486911s) [noise=true , address=77.90.31.12:4597 , piece_id=GDKOGFZV7V6JRCJIQYOAZSHZI7JEWM7KGY2II4VBSKFCRHHZMRMA, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.073336069 (341h8m39.804603699s) [noise=true , address=104.36.82.50:4019 , piece_id=VNPGVKDTIKZW6WTVKVXEMXDBKDIZMBEZJEMFXEBIGNVNYZMKAQ3Q, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.073688793 (341h8m39.804956413s) [noise=true , address=104.36.82.60:4355 , piece_id=ZWCBYSGDO4RFRVT5UEP64EQYNYQWH4EQT6PYLJEYEBYFIXRCIHKA, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.073751250 (341h8m39.80501891s) [noise=true , address=77.90.31.12:4599 , piece_id=HRXQ2B3TN3SBSFK6KU4UZ7LJ7UBSXJ723BVBYUBLALXHBS6GXAEQ, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.074013122 (341h8m39.805280753s) [noise=true , address=45.91.116.5:4326 , piece_id=WFXH6IWMIWGH36TO6DIJFTIQJ2AI33HJSSIIC5H7UE77SYJDVW3Q, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.074203350 (341h8m39.80547101s) [noise=true , address=104.36.82.4:4835 , piece_id=WX3MBWDC226S4VUREO5XHSXKXGIZMEHPWN4NC65H66SRFAIJFAAQ, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.074390803 (341h8m39.805658433s) [noise=true , address=45.91.116.11:4138 , piece_id=PJEO7TOUNJ6A4J5UB4NKWFNVHQOBAEHMMOAWYR7T3Q2RYO2M57FA, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.074638197 (341h8m39.805905848s) [noise=true , address=77.90.31.13:4632 , piece_id=YEFUHCV3FQOQNYZQIMEFFXG242BYJTCJGVB5CJXQR4KWCVZJ76TQ, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.074771618 (341h8m39.806039249s) [noise=true , address=77.90.31.17:4775 , piece_id=N4ANPYW5WHQCZD5VNEEFZGCT3F6M6TVSU5WOPFL7HPOOAMLJPO4Q, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.075079427 (341h8m39.806347077s) [noise=true , address=104.36.82.14:4246 , piece_id=QXQGAVDBMNZNRN5JV4AOH5T2LNO4CGADA4P47CLFMLT34IWBR6AA, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.075157013 (341h8m39.806424644s) [noise=true , address=45.91.116.7:4035 , piece_id=7PYA7C6UG6OWJGWWJLTAKFS6AA7RECOP3YX57AE4M6OQEQ3AS4TQ, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.075486041 (341h8m39.806753671s) [noise=true , address=77.90.31.16:4747 , piece_id=M6FEMTPY45DUFQ2ODW6VI72AXLEG7U3LUNFLL3XGA555D2GAZFJQ, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.075645802 (341h8m39.806913463s) [noise=true , address=79.127.220.97:4395 , piece_id=66DNAN6VMEHASHKE36FVPNKAHXVEYVJ75ZXI5X5SQ3RTK6AZJNQA, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.186106521 (341h8m39.917374162s) [upload=354636]: Next returned nil segment
Aug 22 22:34:59.186124867 (341h8m39.917392517s) [upload=354636]: Waiting for error group managing segments...
Aug 22 22:34:59.193176012 (341h8m39.924443632s) [noise=true , address=45.91.116.7:4035 , piece_id=7PYA7C6UG6OWJGWWJLTAKFS6AA7RECOP3YX57AE4M6OQEQ3AS4TQ, seg_pos={0 0}, upload=354636]: Done uploading piece. err: <nil>
Aug 22 22:34:59.195383533 (341h8m39.926651152s) [noise=true , address=77.90.31.17:4775 , piece_id=N4ANPYW5WHQCZD5VNEEFZGCT3F6M6TVSU5WOPFL7HPOOAMLJPO4Q, seg_pos={0 0}, upload=354636]: Done uploading piece. err: <nil>
Aug 22 22:34:59.195679699 (341h8m39.926947319s) [noise=true , address=45.91.116.11:4138 , piece_id=PJEO7TOUNJ6A4J5UB4NKWFNVHQOBAEHMMOAWYR7T3Q2RYO2M57FA, seg_pos={0 0}, upload=354636]: Done uploading piece. err: <nil>
Aug 22 22:34:59.199763787 (341h8m39.931031417s) [noise=true , address=104.36.82.21:4490 , piece_id=DA2EPUXZUNWOV2HXV7D4Z2ORQNPNLNVBD6RRUTDQBP32DJBDFWEQ, seg_pos={0 0}, upload=354636]: Done uploading piece. err: <nil>
Aug 22 22:34:59.200296990 (341h8m39.93156463s) [noise=true , address=104.36.82.60:4355 , piece_id=ZWCBYSGDO4RFRVT5UEP64EQYNYQWH4EQT6PYLJEYEBYFIXRCIHKA, seg_pos={0 0}, upload=354636]: Done uploading piece. err: <nil>
Aug 22 22:34:59.213479782 (341h8m39.944747412s) [noise=true , address=104.36.82.20:4443 , piece_id=7EMN32OFJAFYTQHX5SGOYYXB7GWWYFGAUIPMGWWFU76YD3P5NAXQ, seg_pos={0 0}, upload=354636]: Done uploading piece. err: <nil>
Aug 22 22:34:59.214005120 (341h8m39.94527276s) [noise=true , address=104.36.82.4:4835 , piece_id=WX3MBWDC226S4VUREO5XHSXKXGIZMEHPWN4NC65H66SRFAIJFAAQ, seg_pos={0 0}, upload=354636]: Done uploading piece. err: <nil>
Aug 22 22:34:59.219857762 (341h8m39.951125402s) [noise=true , address=77.90.31.12:4597 , piece_id=GDKOGFZV7V6JRCJIQYOAZSHZI7JEWM7KGY2II4VBSKFCRHHZMRMA, seg_pos={0 0}, upload=354636]: Done uploading piece. err: <nil>
Aug 22 22:34:59.224215696 (341h8m39.955483336s) [noise=true , address=104.36.82.62:4428 , piece_id=C3XIJL5AALYYQBSLQSJ6XHXWMQSN7QDLEDAIPCR2MHQZ7D45UZWA, seg_pos={0 0}, upload=354636]: Done uploading piece. err: <nil>
Aug 22 22:34:59.225304743 (341h8m39.956572363s) [noise=true , address=104.36.82.14:4246 , piece_id=QXQGAVDBMNZNRN5JV4AOH5T2LNO4CGADA4P47CLFMLT34IWBR6AA, seg_pos={0 0}, upload=354636]: Done uploading piece. err: <nil>
Aug 22 22:34:59.229087444 (341h8m39.960355064s) [noise=true , address=104.36.82.45:4940 , piece_id=JXPUZ3WMZ3PJ756IPGD6YC6H6G4QVKUY34UABF55HR2OW7CXS7IQ, seg_pos={0 0}, upload=354636]: Done uploading piece. err: <nil>
Aug 22 22:34:59.230502755 (341h8m39.961770375s) [noise=true , address=77.90.31.21:4891 , piece_id=DIEBEFT4RJRT5DD7DX3ZWZXAQKJYQIXHKLCNGKKBXMR2CZ6TPRZQ, seg_pos={0 0}, upload=354636]: Done uploading piece. err: <nil>
Aug 22 22:34:59.276370463 (341h8m40.007638103s) [noise=true , address=79.127.220.97:4395 , piece_id=66DNAN6VMEHASHKE36FVPNKAHXVEYVJ75ZXI5X5SQ3RTK6AZJNQA, seg_pos={0 0}, upload=354636]: Done uploading piece. err: <nil>
Aug 22 22:34:59.284841228 (341h8m40.016108847s) [noise=true , address=45.91.116.5:4326 , piece_id=WFXH6IWMIWGH36TO6DIJFTIQJ2AI33HJSSIIC5H7UE77SYJDVW3Q, seg_pos={0 0}, upload=354636]: Done uploading piece. err: <nil>
Aug 22 22:34:59.284863430 (341h8m40.016131049s) [seg_pos={0 0}, upload=354636]: Segment reached optimal threshold of 14 pieces.
Aug 22 22:34:59.284976603 (341h8m40.016244233s) [noise=true , address=104.36.82.50:4019 , piece_id=VNPGVKDTIKZW6WTVKVXEMXDBKDIZMBEZJEMFXEBIGNVNYZMKAQ3Q, seg_pos={0 0}, upload=354636]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ztmvXKmY6hicHZD7iejpcJCKFEhLwemtaYChAp8Po85TRQvGo): protocol: expected piece hash; context canceled; EOF
Aug 22 22:34:59.285125021 (341h8m40.016392641s) [noise=true , address=77.90.31.12:4599 , piece_id=HRXQ2B3TN3SBSFK6KU4UZ7LJ7UBSXJ723BVBYUBLALXHBS6GXAEQ, seg_pos={0 0}, upload=354636]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124cEnKBraQScM26K7Zc8Z3cqTvrD9fPyWzWYutYryfXqmXQ3rn): protocol: expected piece hash; context canceled; EOF
Aug 22 22:34:59.285190415 (341h8m40.016458045s) [noise=true , address=77.90.31.16:4747 , piece_id=M6FEMTPY45DUFQ2ODW6VI72AXLEG7U3LUNFLL3XGA555D2GAZFJQ, seg_pos={0 0}, upload=354636]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ERdBm3XPw4s7JHeMWsVniwcqnfMtP4ZX8sBVjri6dzZtq8AF2): protocol: expected piece hash; context canceled; EOF
Aug 22 22:34:59.285223937 (341h8m40.016491557s) [noise=true , address=77.90.31.13:4632 , piece_id=YEFUHCV3FQOQNYZQIMEFFXG242BYJTCJGVB5CJXQR4KWCVZJ76TQ, seg_pos={0 0}, upload=354636]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13iPed9zYrthvh36xo3k4gsqm4tz86iVkNvAr3wauuArQLquyS): protocol: rpc: dial tcp 77.90.31.13:4632: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 22:34:59.285241440 (341h8m40.01650907s) [seg_pos={0 0}, upload=354636]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 22:34:59.285315479 (341h8m40.016583099s) [upload=354636]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 22:34:59.285327071 (341h8m40.016594701s) [upload=354636]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 22:34:59.387267904 (341h8m40.118535534s) [upload=354636]: Done uploading segments...
Aug 22 22:34:59.387280017 (341h8m40.118547647s) [upload=354636]: Upload finished. err: <nil>
Duration: 2.397363028s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
1.910036409s
FAIL (2025-08-22 23:13:21 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 22 22:34:59.033856300 (341h8m39.76512395s) [upload=354636]: Starting upload
Aug 22 22:34:59.033926702 (341h8m39.765194352s) [upload=354636]: Done starting upload
Aug 22 22:34:59.034044734 (341h8m39.765312364s) [upload=354636]: Uploading segments...
Aug 22 22:34:59.034327877 (341h8m39.765595526s) [upload=354636]: Got next segment. Inline: false
Aug 22 22:34:59.034373542 (341h8m39.765641202s) [upload=354636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 22:34:59.034379112 (341h8m39.765646773s) [upload=354636]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 22:34:59.072021327 (341h8m39.803288978s) [seg_pos={0 0}, upload=354636]: Begin upload segment...
Aug 22 22:34:59.072095788 (341h8m39.803363438s) [seg_pos={0 0}, upload=354636]: Done begin upload segment.
Aug 22 22:34:59.072134821 (341h8m39.803402441s) [noise=true , address=77.90.31.21:4891 , piece_id=DIEBEFT4RJRT5DD7DX3ZWZXAQKJYQIXHKLCNGKKBXMR2CZ6TPRZQ, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.072156512 (341h8m39.803424162s) [noise=true , address=104.36.82.62:4428 , piece_id=C3XIJL5AALYYQBSLQSJ6XHXWMQSN7QDLEDAIPCR2MHQZ7D45UZWA, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.072571413 (341h8m39.803839032s) [noise=true , address=104.36.82.21:4490 , piece_id=DA2EPUXZUNWOV2HXV7D4Z2ORQNPNLNVBD6RRUTDQBP32DJBDFWEQ, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.072717918 (341h8m39.803985568s) [noise=true , address=104.36.82.20:4443 , piece_id=7EMN32OFJAFYTQHX5SGOYYXB7GWWYFGAUIPMGWWFU76YD3P5NAXQ, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.072992775 (341h8m39.804260405s) [noise=true , address=104.36.82.45:4940 , piece_id=JXPUZ3WMZ3PJ756IPGD6YC6H6G4QVKUY34UABF55HR2OW7CXS7IQ, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.073219260 (341h8m39.804486911s) [noise=true , address=77.90.31.12:4597 , piece_id=GDKOGFZV7V6JRCJIQYOAZSHZI7JEWM7KGY2II4VBSKFCRHHZMRMA, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.073336069 (341h8m39.804603699s) [noise=true , address=104.36.82.50:4019 , piece_id=VNPGVKDTIKZW6WTVKVXEMXDBKDIZMBEZJEMFXEBIGNVNYZMKAQ3Q, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.073688793 (341h8m39.804956413s) [noise=true , address=104.36.82.60:4355 , piece_id=ZWCBYSGDO4RFRVT5UEP64EQYNYQWH4EQT6PYLJEYEBYFIXRCIHKA, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.073751250 (341h8m39.80501891s) [noise=true , address=77.90.31.12:4599 , piece_id=HRXQ2B3TN3SBSFK6KU4UZ7LJ7UBSXJ723BVBYUBLALXHBS6GXAEQ, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.074013122 (341h8m39.805280753s) [noise=true , address=45.91.116.5:4326 , piece_id=WFXH6IWMIWGH36TO6DIJFTIQJ2AI33HJSSIIC5H7UE77SYJDVW3Q, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.074203350 (341h8m39.80547101s) [noise=true , address=104.36.82.4:4835 , piece_id=WX3MBWDC226S4VUREO5XHSXKXGIZMEHPWN4NC65H66SRFAIJFAAQ, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.074390803 (341h8m39.805658433s) [noise=true , address=45.91.116.11:4138 , piece_id=PJEO7TOUNJ6A4J5UB4NKWFNVHQOBAEHMMOAWYR7T3Q2RYO2M57FA, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.074638197 (341h8m39.805905848s) [noise=true , address=77.90.31.13:4632 , piece_id=YEFUHCV3FQOQNYZQIMEFFXG242BYJTCJGVB5CJXQR4KWCVZJ76TQ, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.074771618 (341h8m39.806039249s) [noise=true , address=77.90.31.17:4775 , piece_id=N4ANPYW5WHQCZD5VNEEFZGCT3F6M6TVSU5WOPFL7HPOOAMLJPO4Q, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.075079427 (341h8m39.806347077s) [noise=true , address=104.36.82.14:4246 , piece_id=QXQGAVDBMNZNRN5JV4AOH5T2LNO4CGADA4P47CLFMLT34IWBR6AA, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.075157013 (341h8m39.806424644s) [noise=true , address=45.91.116.7:4035 , piece_id=7PYA7C6UG6OWJGWWJLTAKFS6AA7RECOP3YX57AE4M6OQEQ3AS4TQ, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.075486041 (341h8m39.806753671s) [noise=true , address=77.90.31.16:4747 , piece_id=M6FEMTPY45DUFQ2ODW6VI72AXLEG7U3LUNFLL3XGA555D2GAZFJQ, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.075645802 (341h8m39.806913463s) [noise=true , address=79.127.220.97:4395 , piece_id=66DNAN6VMEHASHKE36FVPNKAHXVEYVJ75ZXI5X5SQ3RTK6AZJNQA, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.186106521 (341h8m39.917374162s) [upload=354636]: Next returned nil segment
Aug 22 22:34:59.186124867 (341h8m39.917392517s) [upload=354636]: Waiting for error group managing segments...
Aug 22 22:34:59.193176012 (341h8m39.924443632s) [noise=true , address=45.91.116.7:4035 , piece_id=7PYA7C6UG6OWJGWWJLTAKFS6AA7RECOP3YX57AE4M6OQEQ3AS4TQ, seg_pos={0 0}, upload=354636]: Done uploading piece. err: <nil>
Aug 22 22:34:59.195383533 (341h8m39.926651152s) [noise=true , address=77.90.31.17:4775 , piece_id=N4ANPYW5WHQCZD5VNEEFZGCT3F6M6TVSU5WOPFL7HPOOAMLJPO4Q, seg_pos={0 0}, upload=354636]: Done uploading piece. err: <nil>
Aug 22 22:34:59.195679699 (341h8m39.926947319s) [noise=true , address=45.91.116.11:4138 , piece_id=PJEO7TOUNJ6A4J5UB4NKWFNVHQOBAEHMMOAWYR7T3Q2RYO2M57FA, seg_pos={0 0}, upload=354636]: Done uploading piece. err: <nil>
Aug 22 22:34:59.199763787 (341h8m39.931031417s) [noise=true , address=104.36.82.21:4490 , piece_id=DA2EPUXZUNWOV2HXV7D4Z2ORQNPNLNVBD6RRUTDQBP32DJBDFWEQ, seg_pos={0 0}, upload=354636]: Done uploading piece. err: <nil>
Aug 22 22:34:59.200296990 (341h8m39.93156463s) [noise=true , address=104.36.82.60:4355 , piece_id=ZWCBYSGDO4RFRVT5UEP64EQYNYQWH4EQT6PYLJEYEBYFIXRCIHKA, seg_pos={0 0}, upload=354636]: Done uploading piece. err: <nil>
Aug 22 22:34:59.213479782 (341h8m39.944747412s) [noise=true , address=104.36.82.20:4443 , piece_id=7EMN32OFJAFYTQHX5SGOYYXB7GWWYFGAUIPMGWWFU76YD3P5NAXQ, seg_pos={0 0}, upload=354636]: Done uploading piece. err: <nil>
Aug 22 22:34:59.214005120 (341h8m39.94527276s) [noise=true , address=104.36.82.4:4835 , piece_id=WX3MBWDC226S4VUREO5XHSXKXGIZMEHPWN4NC65H66SRFAIJFAAQ, seg_pos={0 0}, upload=354636]: Done uploading piece. err: <nil>
Aug 22 22:34:59.219857762 (341h8m39.951125402s) [noise=true , address=77.90.31.12:4597 , piece_id=GDKOGFZV7V6JRCJIQYOAZSHZI7JEWM7KGY2II4VBSKFCRHHZMRMA, seg_pos={0 0}, upload=354636]: Done uploading piece. err: <nil>
Aug 22 22:34:59.224215696 (341h8m39.955483336s) [noise=true , address=104.36.82.62:4428 , piece_id=C3XIJL5AALYYQBSLQSJ6XHXWMQSN7QDLEDAIPCR2MHQZ7D45UZWA, seg_pos={0 0}, upload=354636]: Done uploading piece. err: <nil>
Aug 22 22:34:59.225304743 (341h8m39.956572363s) [noise=true , address=104.36.82.14:4246 , piece_id=QXQGAVDBMNZNRN5JV4AOH5T2LNO4CGADA4P47CLFMLT34IWBR6AA, seg_pos={0 0}, upload=354636]: Done uploading piece. err: <nil>
Aug 22 22:34:59.229087444 (341h8m39.960355064s) [noise=true , address=104.36.82.45:4940 , piece_id=JXPUZ3WMZ3PJ756IPGD6YC6H6G4QVKUY34UABF55HR2OW7CXS7IQ, seg_pos={0 0}, upload=354636]: Done uploading piece. err: <nil>
Aug 22 22:34:59.230502755 (341h8m39.961770375s) [noise=true , address=77.90.31.21:4891 , piece_id=DIEBEFT4RJRT5DD7DX3ZWZXAQKJYQIXHKLCNGKKBXMR2CZ6TPRZQ, seg_pos={0 0}, upload=354636]: Done uploading piece. err: <nil>
Aug 22 22:34:59.276370463 (341h8m40.007638103s) [noise=true , address=79.127.220.97:4395 , piece_id=66DNAN6VMEHASHKE36FVPNKAHXVEYVJ75ZXI5X5SQ3RTK6AZJNQA, seg_pos={0 0}, upload=354636]: Done uploading piece. err: <nil>
Aug 22 22:34:59.284841228 (341h8m40.016108847s) [noise=true , address=45.91.116.5:4326 , piece_id=WFXH6IWMIWGH36TO6DIJFTIQJ2AI33HJSSIIC5H7UE77SYJDVW3Q, seg_pos={0 0}, upload=354636]: Done uploading piece. err: <nil>
Aug 22 22:34:59.284863430 (341h8m40.016131049s) [seg_pos={0 0}, upload=354636]: Segment reached optimal threshold of 14 pieces.
Aug 22 22:34:59.284976603 (341h8m40.016244233s) [noise=true , address=104.36.82.50:4019 , piece_id=VNPGVKDTIKZW6WTVKVXEMXDBKDIZMBEZJEMFXEBIGNVNYZMKAQ3Q, seg_pos={0 0}, upload=354636]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ztmvXKmY6hicHZD7iejpcJCKFEhLwemtaYChAp8Po85TRQvGo): protocol: expected piece hash; context canceled; EOF
Aug 22 22:34:59.285125021 (341h8m40.016392641s) [noise=true , address=77.90.31.12:4599 , piece_id=HRXQ2B3TN3SBSFK6KU4UZ7LJ7UBSXJ723BVBYUBLALXHBS6GXAEQ, seg_pos={0 0}, upload=354636]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124cEnKBraQScM26K7Zc8Z3cqTvrD9fPyWzWYutYryfXqmXQ3rn): protocol: expected piece hash; context canceled; EOF
Aug 22 22:34:59.285190415 (341h8m40.016458045s) [noise=true , address=77.90.31.16:4747 , piece_id=M6FEMTPY45DUFQ2ODW6VI72AXLEG7U3LUNFLL3XGA555D2GAZFJQ, seg_pos={0 0}, upload=354636]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ERdBm3XPw4s7JHeMWsVniwcqnfMtP4ZX8sBVjri6dzZtq8AF2): protocol: expected piece hash; context canceled; EOF
Aug 22 22:34:59.285223937 (341h8m40.016491557s) [noise=true , address=77.90.31.13:4632 , piece_id=YEFUHCV3FQOQNYZQIMEFFXG242BYJTCJGVB5CJXQR4KWCVZJ76TQ, seg_pos={0 0}, upload=354636]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13iPed9zYrthvh36xo3k4gsqm4tz86iVkNvAr3wauuArQLquyS): protocol: rpc: dial tcp 77.90.31.13:4632: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 22:34:59.285241440 (341h8m40.01650907s) [seg_pos={0 0}, upload=354636]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 22:34:59.285315479 (341h8m40.016583099s) [upload=354636]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 22:34:59.285327071 (341h8m40.016594701s) [upload=354636]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 22:34:59.387267904 (341h8m40.118535534s) [upload=354636]: Done uploading segments...
Aug 22 22:34:59.387280017 (341h8m40.118547647s) [upload=354636]: Upload finished. err: <nil>
Duration: 1.910061726s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
2.43609848s
FAIL (2025-08-22 23:13:11 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
59]: Uploading piece...
Aug 22 22:53:29.611585477 (341h27m10.342853137s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612050902 (341h27m10.343318552s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612464942 (341h27m10.343732591s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612857369 (341h27m10.34412503s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613271678 (341h27m10.344539329s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613655671 (341h27m10.344923321s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614059881 (341h27m10.345327542s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614540405 (341h27m10.345808065s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614942673 (341h27m10.346210322s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.615322797 (341h27m10.346590508s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.618240035 (341h27m10.349507685s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:30.106040273 (341h27m10.837307893s) [upload=354959]: Next returned nil segment
Aug 22 22:53:30.106057475 (341h27m10.837325105s) [upload=354959]: Waiting for error group managing segments...
Aug 22 22:53:30.265188790 (341h27m10.99645643s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.265907802 (341h27m10.997175453s) [noise=true , address=81.171.14.70:4039 , piece_id=UGLARCJIGPJ5BN2PWYD4NM62Z74HLMBKRCCYEKFP2ZAZBGWSYIRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.266528711 (341h27m10.997796351s) [noise=true , address=81.171.14.70:4035 , piece_id=6M22EYTZY734SCUSTKUGF3PNJ2QJLKMA2MAZXV6VPOOM2W4EUUUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.267544280 (341h27m10.998811931s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.268723619 (341h27m10.99999126s) [noise=true , address=89.149.201.147:4015 , piece_id=5WP6YFYWCVWL7QRS2VCDJP576AHQ66NJW742XOW324DIIXMLSBEQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270432624 (341h27m11.001700254s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270515790 (341h27m11.001783431s) [noise=true , address=81.171.14.70:4025 , piece_id=3PV4YNDGP33PBZUHYWLXRSEE3QZO2ZFL2PCEXYSSEWGGWVTFRLPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.271054975 (341h27m11.002322595s) [noise=true , address=81.171.14.70:4031 , piece_id=O6BNM3FOD76GP5I3MJKNZXREQH7XRG7ZOHDNNXRD7HKTSABASTUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.273453727 (341h27m11.004721367s) [noise=true , address=81.171.14.70:4044 , piece_id=JAMFLVIXOT4KL2OPPZGQFLV35GUPBBRX6673QJMB6YDRBZFOGG7Q, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.274998804 (341h27m11.006266424s) [noise=true , address=185.167.204.205:4027 , piece_id=NDAULJLWJRAIVPPNHYKT3WJHG5JS2F6B7RLQQXFJOL3QBNPTADMA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277211505 (341h27m11.008479146s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277435196 (341h27m11.008702816s) [noise=true , address=185.167.204.206:4072 , piece_id=XYAPWQELW5EUKLR62OGEEQVBGNQUTS2J4CC4PLPNTEXP2SWNQRIA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279287400 (341h27m11.01055504s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279410051 (341h27m11.010677681s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280438876 (341h27m11.011706507s) [noise=true , address=185.167.204.206:4056 , piece_id=BQTKVXFXDWMZCV7UBQDMJTE6DII572Q3AJM3JCTW66AP6DIWY5MQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280910263 (341h27m11.012177893s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.281986407 (341h27m11.013254028s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282394265 (341h27m11.013666674s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282761165 (341h27m11.014028785s) [noise=true , address=185.167.204.206:4062 , piece_id=C6LI537WYQRJHUVBTDJCZK35KQHT5JBBLENH5WVGPDJFWCU3RTWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283174292 (341h27m11.014441911s) [noise=true , address=185.167.204.205:4023 , piece_id=YZXWFCP5WW4ARBUTA6XNWHU3KU5U23OMASCOFORJNL6T3UZQDGWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283847198 (341h27m11.015114838s) [noise=true , address=185.167.204.206:4063 , piece_id=E7N65C5KMWXYA67LJW4FLIWRNUP45QNS7OTUYK64UMW2AVWXT7IQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.285333653 (341h27m11.016601274s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.287128550 (341h27m11.01839617s) [noise=true , address=185.167.204.205:4030 , piece_id=V5B4VQCRBKXTTY4PJRVWV5C54HV2MX7PHC53UNKKP7Y3SJJGBARA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.292510313 (341h27m11.023777933s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.296039952 (341h27m11.027307572s) [noise=true , address=185.167.204.206:4068 , piece_id=5WUPBASDPHH7SGA3HLRLN3HMLMABMZTCO5YFUFVLT2FPC4DLFCPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301208034 (341h27m11.032475664s) [noise=true , address=81.171.14.70:4046 , piece_id=4YNKZGJQYOJEB3FFDIK6XALSTARBBMPYCE4GEWIQ5RQROFUHE6CA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301226198 (341h27m11.032493828s) [seg_pos={0 0}, upload=354959]: Segment reached optimal threshold of 26 pieces.
Aug 22 22:53:30.301343489 (341h27m11.032611129s) [noise=true , address=81.171.14.70:4036 , piece_id=OTQRXXAW43EQPVOUO54E6EUPTUZLRPWMHWBV62OKMTUI5QZMDZVQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF
Aug 22 22:53:30.301530851 (341h27m11.032798481s) [noise=true , address=185.167.204.205:4033 , piece_id=ROIUSDQL7GNXUULS6VLF6OIPG6UJOJTNEYLS6THCFIOP3LTL2SBA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe): protocol: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection
Aug 22 22:53:30.301547272 (341h27m11.032814902s) [seg_pos={0 0}, upload=354959]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Aug 22 22:53:30.301638825 (341h27m11.032906455s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 22:53:30.301644756 (341h27m11.032912386s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 22:56:04.281070862 (341h29m45.012338492s) [upload=354959]: Done uploading segments...
Aug 22 22:56:04.281085750 (341h29m45.012353381s) [upload=354959]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.436115311s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........................................X......X............] duration:
1.187768721s
FAIL (2025-08-22 23:12:58 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 22 23:04:34.193786424 (341h38m14.925054054s) [upload=355145]: Starting upload Aug 22 23:04:34.193855373 (341h38m14.925123003s) [upload=355145]: Done starting upload Aug 22 23:04:34.193917851 (341h38m14.925185481s) [upload=355145]: Uploading segments... Aug 22 23:04:34.193995587 (341h38m14.925263217s) [upload=355145]: Got next segment. Inline: true Aug 22 23:04:34.194002741 (341h38m14.925270371s) [upload=355145]: Waiting for error group managing segments... Aug 22 23:04:34.194052023 (341h38m14.925319653s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 23:04:34.194058906 (341h38m14.925326526s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 23:04:34.194063054 (341h38m14.925330684s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 23:04:34.545689514 (341h38m15.276957164s) [upload=355145]: Done uploading segments... Aug 22 23:04:34.545718478 (341h38m15.276986128s) [upload=355145]: Upload finished. err: <nil>
Duration: 1.187789872s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
2.727484786s
FAIL (2025-08-22 23:12:48 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
59]: Uploading piece...
Aug 22 22:53:29.611585477 (341h27m10.342853137s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612050902 (341h27m10.343318552s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612464942 (341h27m10.343732591s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612857369 (341h27m10.34412503s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613271678 (341h27m10.344539329s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613655671 (341h27m10.344923321s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614059881 (341h27m10.345327542s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614540405 (341h27m10.345808065s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614942673 (341h27m10.346210322s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.615322797 (341h27m10.346590508s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.618240035 (341h27m10.349507685s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:30.106040273 (341h27m10.837307893s) [upload=354959]: Next returned nil segment
Aug 22 22:53:30.106057475 (341h27m10.837325105s) [upload=354959]: Waiting for error group managing segments...
Aug 22 22:53:30.265188790 (341h27m10.99645643s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.265907802 (341h27m10.997175453s) [noise=true , address=81.171.14.70:4039 , piece_id=UGLARCJIGPJ5BN2PWYD4NM62Z74HLMBKRCCYEKFP2ZAZBGWSYIRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.266528711 (341h27m10.997796351s) [noise=true , address=81.171.14.70:4035 , piece_id=6M22EYTZY734SCUSTKUGF3PNJ2QJLKMA2MAZXV6VPOOM2W4EUUUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.267544280 (341h27m10.998811931s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.268723619 (341h27m10.99999126s) [noise=true , address=89.149.201.147:4015 , piece_id=5WP6YFYWCVWL7QRS2VCDJP576AHQ66NJW742XOW324DIIXMLSBEQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270432624 (341h27m11.001700254s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270515790 (341h27m11.001783431s) [noise=true , address=81.171.14.70:4025 , piece_id=3PV4YNDGP33PBZUHYWLXRSEE3QZO2ZFL2PCEXYSSEWGGWVTFRLPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.271054975 (341h27m11.002322595s) [noise=true , address=81.171.14.70:4031 , piece_id=O6BNM3FOD76GP5I3MJKNZXREQH7XRG7ZOHDNNXRD7HKTSABASTUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.273453727 (341h27m11.004721367s) [noise=true , address=81.171.14.70:4044 , piece_id=JAMFLVIXOT4KL2OPPZGQFLV35GUPBBRX6673QJMB6YDRBZFOGG7Q, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.274998804 (341h27m11.006266424s) [noise=true , address=185.167.204.205:4027 , piece_id=NDAULJLWJRAIVPPNHYKT3WJHG5JS2F6B7RLQQXFJOL3QBNPTADMA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277211505 (341h27m11.008479146s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277435196 (341h27m11.008702816s) [noise=true , address=185.167.204.206:4072 , piece_id=XYAPWQELW5EUKLR62OGEEQVBGNQUTS2J4CC4PLPNTEXP2SWNQRIA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279287400 (341h27m11.01055504s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279410051 (341h27m11.010677681s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280438876 (341h27m11.011706507s) [noise=true , address=185.167.204.206:4056 , piece_id=BQTKVXFXDWMZCV7UBQDMJTE6DII572Q3AJM3JCTW66AP6DIWY5MQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280910263 (341h27m11.012177893s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.281986407 (341h27m11.013254028s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282394265 (341h27m11.013666674s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282761165 (341h27m11.014028785s) [noise=true , address=185.167.204.206:4062 , piece_id=C6LI537WYQRJHUVBTDJCZK35KQHT5JBBLENH5WVGPDJFWCU3RTWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283174292 (341h27m11.014441911s) [noise=true , address=185.167.204.205:4023 , piece_id=YZXWFCP5WW4ARBUTA6XNWHU3KU5U23OMASCOFORJNL6T3UZQDGWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283847198 (341h27m11.015114838s) [noise=true , address=185.167.204.206:4063 , piece_id=E7N65C5KMWXYA67LJW4FLIWRNUP45QNS7OTUYK64UMW2AVWXT7IQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.285333653 (341h27m11.016601274s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.287128550 (341h27m11.01839617s) [noise=true , address=185.167.204.205:4030 , piece_id=V5B4VQCRBKXTTY4PJRVWV5C54HV2MX7PHC53UNKKP7Y3SJJGBARA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.292510313 (341h27m11.023777933s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.296039952 (341h27m11.027307572s) [noise=true , address=185.167.204.206:4068 , piece_id=5WUPBASDPHH7SGA3HLRLN3HMLMABMZTCO5YFUFVLT2FPC4DLFCPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301208034 (341h27m11.032475664s) [noise=true , address=81.171.14.70:4046 , piece_id=4YNKZGJQYOJEB3FFDIK6XALSTARBBMPYCE4GEWIQ5RQROFUHE6CA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301226198 (341h27m11.032493828s) [seg_pos={0 0}, upload=354959]: Segment reached optimal threshold of 26 pieces.
Aug 22 22:53:30.301343489 (341h27m11.032611129s) [noise=true , address=81.171.14.70:4036 , piece_id=OTQRXXAW43EQPVOUO54E6EUPTUZLRPWMHWBV62OKMTUI5QZMDZVQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF
Aug 22 22:53:30.301530851 (341h27m11.032798481s) [noise=true , address=185.167.204.205:4033 , piece_id=ROIUSDQL7GNXUULS6VLF6OIPG6UJOJTNEYLS6THCFIOP3LTL2SBA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe): protocol: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection
Aug 22 22:53:30.301547272 (341h27m11.032814902s) [seg_pos={0 0}, upload=354959]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Aug 22 22:53:30.301638825 (341h27m11.032906455s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 22:53:30.301644756 (341h27m11.032912386s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 22:56:04.281070862 (341h29m45.012338492s) [upload=354959]: Done uploading segments...
Aug 22 22:56:04.281085750 (341h29m45.012353381s) [upload=354959]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.72751306s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........................................X......X...........] duration:
658.118889ms
FAIL (2025-08-22 23:12:23 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 22 23:04:34.193786424 (341h38m14.925054054s) [upload=355145]: Starting upload Aug 22 23:04:34.193855373 (341h38m14.925123003s) [upload=355145]: Done starting upload Aug 22 23:04:34.193917851 (341h38m14.925185481s) [upload=355145]: Uploading segments... Aug 22 23:04:34.193995587 (341h38m14.925263217s) [upload=355145]: Got next segment. Inline: true Aug 22 23:04:34.194002741 (341h38m14.925270371s) [upload=355145]: Waiting for error group managing segments... Aug 22 23:04:34.194052023 (341h38m14.925319653s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 23:04:34.194058906 (341h38m14.925326526s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 23:04:34.194063054 (341h38m14.925330684s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 23:04:34.545689514 (341h38m15.276957164s) [upload=355145]: Done uploading segments... Aug 22 23:04:34.545718478 (341h38m15.276986128s) [upload=355145]: Upload finished. err: <nil>
Duration: 658.138806ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
7.032094621s
FAIL (2025-08-22 23:12:13 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
59]: Uploading piece...
Aug 22 22:53:29.611585477 (341h27m10.342853137s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612050902 (341h27m10.343318552s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612464942 (341h27m10.343732591s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612857369 (341h27m10.34412503s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613271678 (341h27m10.344539329s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613655671 (341h27m10.344923321s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614059881 (341h27m10.345327542s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614540405 (341h27m10.345808065s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614942673 (341h27m10.346210322s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.615322797 (341h27m10.346590508s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.618240035 (341h27m10.349507685s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:30.106040273 (341h27m10.837307893s) [upload=354959]: Next returned nil segment
Aug 22 22:53:30.106057475 (341h27m10.837325105s) [upload=354959]: Waiting for error group managing segments...
Aug 22 22:53:30.265188790 (341h27m10.99645643s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.265907802 (341h27m10.997175453s) [noise=true , address=81.171.14.70:4039 , piece_id=UGLARCJIGPJ5BN2PWYD4NM62Z74HLMBKRCCYEKFP2ZAZBGWSYIRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.266528711 (341h27m10.997796351s) [noise=true , address=81.171.14.70:4035 , piece_id=6M22EYTZY734SCUSTKUGF3PNJ2QJLKMA2MAZXV6VPOOM2W4EUUUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.267544280 (341h27m10.998811931s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.268723619 (341h27m10.99999126s) [noise=true , address=89.149.201.147:4015 , piece_id=5WP6YFYWCVWL7QRS2VCDJP576AHQ66NJW742XOW324DIIXMLSBEQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270432624 (341h27m11.001700254s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270515790 (341h27m11.001783431s) [noise=true , address=81.171.14.70:4025 , piece_id=3PV4YNDGP33PBZUHYWLXRSEE3QZO2ZFL2PCEXYSSEWGGWVTFRLPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.271054975 (341h27m11.002322595s) [noise=true , address=81.171.14.70:4031 , piece_id=O6BNM3FOD76GP5I3MJKNZXREQH7XRG7ZOHDNNXRD7HKTSABASTUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.273453727 (341h27m11.004721367s) [noise=true , address=81.171.14.70:4044 , piece_id=JAMFLVIXOT4KL2OPPZGQFLV35GUPBBRX6673QJMB6YDRBZFOGG7Q, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.274998804 (341h27m11.006266424s) [noise=true , address=185.167.204.205:4027 , piece_id=NDAULJLWJRAIVPPNHYKT3WJHG5JS2F6B7RLQQXFJOL3QBNPTADMA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277211505 (341h27m11.008479146s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277435196 (341h27m11.008702816s) [noise=true , address=185.167.204.206:4072 , piece_id=XYAPWQELW5EUKLR62OGEEQVBGNQUTS2J4CC4PLPNTEXP2SWNQRIA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279287400 (341h27m11.01055504s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279410051 (341h27m11.010677681s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280438876 (341h27m11.011706507s) [noise=true , address=185.167.204.206:4056 , piece_id=BQTKVXFXDWMZCV7UBQDMJTE6DII572Q3AJM3JCTW66AP6DIWY5MQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280910263 (341h27m11.012177893s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.281986407 (341h27m11.013254028s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282394265 (341h27m11.013666674s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282761165 (341h27m11.014028785s) [noise=true , address=185.167.204.206:4062 , piece_id=C6LI537WYQRJHUVBTDJCZK35KQHT5JBBLENH5WVGPDJFWCU3RTWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283174292 (341h27m11.014441911s) [noise=true , address=185.167.204.205:4023 , piece_id=YZXWFCP5WW4ARBUTA6XNWHU3KU5U23OMASCOFORJNL6T3UZQDGWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283847198 (341h27m11.015114838s) [noise=true , address=185.167.204.206:4063 , piece_id=E7N65C5KMWXYA67LJW4FLIWRNUP45QNS7OTUYK64UMW2AVWXT7IQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.285333653 (341h27m11.016601274s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.287128550 (341h27m11.01839617s) [noise=true , address=185.167.204.205:4030 , piece_id=V5B4VQCRBKXTTY4PJRVWV5C54HV2MX7PHC53UNKKP7Y3SJJGBARA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.292510313 (341h27m11.023777933s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.296039952 (341h27m11.027307572s) [noise=true , address=185.167.204.206:4068 , piece_id=5WUPBASDPHH7SGA3HLRLN3HMLMABMZTCO5YFUFVLT2FPC4DLFCPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301208034 (341h27m11.032475664s) [noise=true , address=81.171.14.70:4046 , piece_id=4YNKZGJQYOJEB3FFDIK6XALSTARBBMPYCE4GEWIQ5RQROFUHE6CA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301226198 (341h27m11.032493828s) [seg_pos={0 0}, upload=354959]: Segment reached optimal threshold of 26 pieces.
Aug 22 22:53:30.301343489 (341h27m11.032611129s) [noise=true , address=81.171.14.70:4036 , piece_id=OTQRXXAW43EQPVOUO54E6EUPTUZLRPWMHWBV62OKMTUI5QZMDZVQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF
Aug 22 22:53:30.301530851 (341h27m11.032798481s) [noise=true , address=185.167.204.205:4033 , piece_id=ROIUSDQL7GNXUULS6VLF6OIPG6UJOJTNEYLS6THCFIOP3LTL2SBA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe): protocol: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection
Aug 22 22:53:30.301547272 (341h27m11.032814902s) [seg_pos={0 0}, upload=354959]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Aug 22 22:53:30.301638825 (341h27m11.032906455s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 22:53:30.301644756 (341h27m11.032912386s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 22:56:04.281070862 (341h29m45.012338492s) [upload=354959]: Done uploading segments...
Aug 22 22:56:04.281085750 (341h29m45.012353381s) [upload=354959]: Upload finished. err: metaclient: context deadline exceeded
Duration: 7.032117625s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
2.460731019s
FAIL (2025-08-22 23:12:10 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 22 22:34:59.033856300 (341h8m39.76512395s) [upload=354636]: Starting upload
Aug 22 22:34:59.033926702 (341h8m39.765194352s) [upload=354636]: Done starting upload
Aug 22 22:34:59.034044734 (341h8m39.765312364s) [upload=354636]: Uploading segments...
Aug 22 22:34:59.034327877 (341h8m39.765595526s) [upload=354636]: Got next segment. Inline: false
Aug 22 22:34:59.034373542 (341h8m39.765641202s) [upload=354636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 22:34:59.034379112 (341h8m39.765646773s) [upload=354636]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 22:34:59.072021327 (341h8m39.803288978s) [seg_pos={0 0}, upload=354636]: Begin upload segment...
Aug 22 22:34:59.072095788 (341h8m39.803363438s) [seg_pos={0 0}, upload=354636]: Done begin upload segment.
Aug 22 22:34:59.072134821 (341h8m39.803402441s) [noise=true , address=77.90.31.21:4891 , piece_id=DIEBEFT4RJRT5DD7DX3ZWZXAQKJYQIXHKLCNGKKBXMR2CZ6TPRZQ, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.072156512 (341h8m39.803424162s) [noise=true , address=104.36.82.62:4428 , piece_id=C3XIJL5AALYYQBSLQSJ6XHXWMQSN7QDLEDAIPCR2MHQZ7D45UZWA, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.072571413 (341h8m39.803839032s) [noise=true , address=104.36.82.21:4490 , piece_id=DA2EPUXZUNWOV2HXV7D4Z2ORQNPNLNVBD6RRUTDQBP32DJBDFWEQ, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.072717918 (341h8m39.803985568s) [noise=true , address=104.36.82.20:4443 , piece_id=7EMN32OFJAFYTQHX5SGOYYXB7GWWYFGAUIPMGWWFU76YD3P5NAXQ, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.072992775 (341h8m39.804260405s) [noise=true , address=104.36.82.45:4940 , piece_id=JXPUZ3WMZ3PJ756IPGD6YC6H6G4QVKUY34UABF55HR2OW7CXS7IQ, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.073219260 (341h8m39.804486911s) [noise=true , address=77.90.31.12:4597 , piece_id=GDKOGFZV7V6JRCJIQYOAZSHZI7JEWM7KGY2II4VBSKFCRHHZMRMA, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.073336069 (341h8m39.804603699s) [noise=true , address=104.36.82.50:4019 , piece_id=VNPGVKDTIKZW6WTVKVXEMXDBKDIZMBEZJEMFXEBIGNVNYZMKAQ3Q, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.073688793 (341h8m39.804956413s) [noise=true , address=104.36.82.60:4355 , piece_id=ZWCBYSGDO4RFRVT5UEP64EQYNYQWH4EQT6PYLJEYEBYFIXRCIHKA, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.073751250 (341h8m39.80501891s) [noise=true , address=77.90.31.12:4599 , piece_id=HRXQ2B3TN3SBSFK6KU4UZ7LJ7UBSXJ723BVBYUBLALXHBS6GXAEQ, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.074013122 (341h8m39.805280753s) [noise=true , address=45.91.116.5:4326 , piece_id=WFXH6IWMIWGH36TO6DIJFTIQJ2AI33HJSSIIC5H7UE77SYJDVW3Q, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.074203350 (341h8m39.80547101s) [noise=true , address=104.36.82.4:4835 , piece_id=WX3MBWDC226S4VUREO5XHSXKXGIZMEHPWN4NC65H66SRFAIJFAAQ, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.074390803 (341h8m39.805658433s) [noise=true , address=45.91.116.11:4138 , piece_id=PJEO7TOUNJ6A4J5UB4NKWFNVHQOBAEHMMOAWYR7T3Q2RYO2M57FA, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.074638197 (341h8m39.805905848s) [noise=true , address=77.90.31.13:4632 , piece_id=YEFUHCV3FQOQNYZQIMEFFXG242BYJTCJGVB5CJXQR4KWCVZJ76TQ, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.074771618 (341h8m39.806039249s) [noise=true , address=77.90.31.17:4775 , piece_id=N4ANPYW5WHQCZD5VNEEFZGCT3F6M6TVSU5WOPFL7HPOOAMLJPO4Q, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.075079427 (341h8m39.806347077s) [noise=true , address=104.36.82.14:4246 , piece_id=QXQGAVDBMNZNRN5JV4AOH5T2LNO4CGADA4P47CLFMLT34IWBR6AA, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.075157013 (341h8m39.806424644s) [noise=true , address=45.91.116.7:4035 , piece_id=7PYA7C6UG6OWJGWWJLTAKFS6AA7RECOP3YX57AE4M6OQEQ3AS4TQ, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.075486041 (341h8m39.806753671s) [noise=true , address=77.90.31.16:4747 , piece_id=M6FEMTPY45DUFQ2ODW6VI72AXLEG7U3LUNFLL3XGA555D2GAZFJQ, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.075645802 (341h8m39.806913463s) [noise=true , address=79.127.220.97:4395 , piece_id=66DNAN6VMEHASHKE36FVPNKAHXVEYVJ75ZXI5X5SQ3RTK6AZJNQA, seg_pos={0 0}, upload=354636]: Uploading piece...
Aug 22 22:34:59.186106521 (341h8m39.917374162s) [upload=354636]: Next returned nil segment
Aug 22 22:34:59.186124867 (341h8m39.917392517s) [upload=354636]: Waiting for error group managing segments...
Aug 22 22:34:59.193176012 (341h8m39.924443632s) [noise=true , address=45.91.116.7:4035 , piece_id=7PYA7C6UG6OWJGWWJLTAKFS6AA7RECOP3YX57AE4M6OQEQ3AS4TQ, seg_pos={0 0}, upload=354636]: Done uploading piece. err: <nil>
Aug 22 22:34:59.195383533 (341h8m39.926651152s) [noise=true , address=77.90.31.17:4775 , piece_id=N4ANPYW5WHQCZD5VNEEFZGCT3F6M6TVSU5WOPFL7HPOOAMLJPO4Q, seg_pos={0 0}, upload=354636]: Done uploading piece. err: <nil>
Aug 22 22:34:59.195679699 (341h8m39.926947319s) [noise=true , address=45.91.116.11:4138 , piece_id=PJEO7TOUNJ6A4J5UB4NKWFNVHQOBAEHMMOAWYR7T3Q2RYO2M57FA, seg_pos={0 0}, upload=354636]: Done uploading piece. err: <nil>
Aug 22 22:34:59.199763787 (341h8m39.931031417s) [noise=true , address=104.36.82.21:4490 , piece_id=DA2EPUXZUNWOV2HXV7D4Z2ORQNPNLNVBD6RRUTDQBP32DJBDFWEQ, seg_pos={0 0}, upload=354636]: Done uploading piece. err: <nil>
Aug 22 22:34:59.200296990 (341h8m39.93156463s) [noise=true , address=104.36.82.60:4355 , piece_id=ZWCBYSGDO4RFRVT5UEP64EQYNYQWH4EQT6PYLJEYEBYFIXRCIHKA, seg_pos={0 0}, upload=354636]: Done uploading piece. err: <nil>
Aug 22 22:34:59.213479782 (341h8m39.944747412s) [noise=true , address=104.36.82.20:4443 , piece_id=7EMN32OFJAFYTQHX5SGOYYXB7GWWYFGAUIPMGWWFU76YD3P5NAXQ, seg_pos={0 0}, upload=354636]: Done uploading piece. err: <nil>
Aug 22 22:34:59.214005120 (341h8m39.94527276s) [noise=true , address=104.36.82.4:4835 , piece_id=WX3MBWDC226S4VUREO5XHSXKXGIZMEHPWN4NC65H66SRFAIJFAAQ, seg_pos={0 0}, upload=354636]: Done uploading piece. err: <nil>
Aug 22 22:34:59.219857762 (341h8m39.951125402s) [noise=true , address=77.90.31.12:4597 , piece_id=GDKOGFZV7V6JRCJIQYOAZSHZI7JEWM7KGY2II4VBSKFCRHHZMRMA, seg_pos={0 0}, upload=354636]: Done uploading piece. err: <nil>
Aug 22 22:34:59.224215696 (341h8m39.955483336s) [noise=true , address=104.36.82.62:4428 , piece_id=C3XIJL5AALYYQBSLQSJ6XHXWMQSN7QDLEDAIPCR2MHQZ7D45UZWA, seg_pos={0 0}, upload=354636]: Done uploading piece. err: <nil>
Aug 22 22:34:59.225304743 (341h8m39.956572363s) [noise=true , address=104.36.82.14:4246 , piece_id=QXQGAVDBMNZNRN5JV4AOH5T2LNO4CGADA4P47CLFMLT34IWBR6AA, seg_pos={0 0}, upload=354636]: Done uploading piece. err: <nil>
Aug 22 22:34:59.229087444 (341h8m39.960355064s) [noise=true , address=104.36.82.45:4940 , piece_id=JXPUZ3WMZ3PJ756IPGD6YC6H6G4QVKUY34UABF55HR2OW7CXS7IQ, seg_pos={0 0}, upload=354636]: Done uploading piece. err: <nil>
Aug 22 22:34:59.230502755 (341h8m39.961770375s) [noise=true , address=77.90.31.21:4891 , piece_id=DIEBEFT4RJRT5DD7DX3ZWZXAQKJYQIXHKLCNGKKBXMR2CZ6TPRZQ, seg_pos={0 0}, upload=354636]: Done uploading piece. err: <nil>
Aug 22 22:34:59.276370463 (341h8m40.007638103s) [noise=true , address=79.127.220.97:4395 , piece_id=66DNAN6VMEHASHKE36FVPNKAHXVEYVJ75ZXI5X5SQ3RTK6AZJNQA, seg_pos={0 0}, upload=354636]: Done uploading piece. err: <nil>
Aug 22 22:34:59.284841228 (341h8m40.016108847s) [noise=true , address=45.91.116.5:4326 , piece_id=WFXH6IWMIWGH36TO6DIJFTIQJ2AI33HJSSIIC5H7UE77SYJDVW3Q, seg_pos={0 0}, upload=354636]: Done uploading piece. err: <nil>
Aug 22 22:34:59.284863430 (341h8m40.016131049s) [seg_pos={0 0}, upload=354636]: Segment reached optimal threshold of 14 pieces.
Aug 22 22:34:59.284976603 (341h8m40.016244233s) [noise=true , address=104.36.82.50:4019 , piece_id=VNPGVKDTIKZW6WTVKVXEMXDBKDIZMBEZJEMFXEBIGNVNYZMKAQ3Q, seg_pos={0 0}, upload=354636]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ztmvXKmY6hicHZD7iejpcJCKFEhLwemtaYChAp8Po85TRQvGo): protocol: expected piece hash; context canceled; EOF
Aug 22 22:34:59.285125021 (341h8m40.016392641s) [noise=true , address=77.90.31.12:4599 , piece_id=HRXQ2B3TN3SBSFK6KU4UZ7LJ7UBSXJ723BVBYUBLALXHBS6GXAEQ, seg_pos={0 0}, upload=354636]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124cEnKBraQScM26K7Zc8Z3cqTvrD9fPyWzWYutYryfXqmXQ3rn): protocol: expected piece hash; context canceled; EOF
Aug 22 22:34:59.285190415 (341h8m40.016458045s) [noise=true , address=77.90.31.16:4747 , piece_id=M6FEMTPY45DUFQ2ODW6VI72AXLEG7U3LUNFLL3XGA555D2GAZFJQ, seg_pos={0 0}, upload=354636]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ERdBm3XPw4s7JHeMWsVniwcqnfMtP4ZX8sBVjri6dzZtq8AF2): protocol: expected piece hash; context canceled; EOF
Aug 22 22:34:59.285223937 (341h8m40.016491557s) [noise=true , address=77.90.31.13:4632 , piece_id=YEFUHCV3FQOQNYZQIMEFFXG242BYJTCJGVB5CJXQR4KWCVZJ76TQ, seg_pos={0 0}, upload=354636]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13iPed9zYrthvh36xo3k4gsqm4tz86iVkNvAr3wauuArQLquyS): protocol: rpc: dial tcp 77.90.31.13:4632: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 22:34:59.285241440 (341h8m40.01650907s) [seg_pos={0 0}, upload=354636]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 22:34:59.285315479 (341h8m40.016583099s) [upload=354636]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 22:34:59.285327071 (341h8m40.016594701s) [upload=354636]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 22:34:59.387267904 (341h8m40.118535534s) [upload=354636]: Done uploading segments...
Aug 22 22:34:59.387280017 (341h8m40.118547647s) [upload=354636]: Upload finished. err: <nil>
Duration: 2.460748743s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|