Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
1.984313023s
FAIL (2025-08-22 23:36:02 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 23:16:12.834814859 (341h49m53.56608251s) [upload=355345]: Starting upload Aug 22 23:16:12.834855054 (341h49m53.566122675s) [upload=355345]: Done starting upload Aug 22 23:16:12.834971062 (341h49m53.566238682s) [upload=355345]: Uploading segments... Aug 22 23:16:12.835164355 (341h49m53.566431986s) [upload=355345]: Got next segment. Inline: false Aug 22 23:16:12.835197678 (341h49m53.566465298s) [upload=355345]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 23:16:12.835202087 (341h49m53.566469706s) [upload=355345]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 23:16:12.838521276 (341h49m53.569788906s) [upload=355345]: Next segment err: metaclient: Too Many Requests Aug 22 23:16:12.838537678 (341h49m53.569805297s) [upload=355345]: Done uploading segments... Aug 22 23:16:12.838546483 (341h49m53.569814104s) [upload=355345]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.984339492s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
1.724678778s
FAIL (2025-08-22 23:35:42 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 23:16:12.834814859 (341h49m53.56608251s) [upload=355345]: Starting upload Aug 22 23:16:12.834855054 (341h49m53.566122675s) [upload=355345]: Done starting upload Aug 22 23:16:12.834971062 (341h49m53.566238682s) [upload=355345]: Uploading segments... Aug 22 23:16:12.835164355 (341h49m53.566431986s) [upload=355345]: Got next segment. Inline: false Aug 22 23:16:12.835197678 (341h49m53.566465298s) [upload=355345]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 23:16:12.835202087 (341h49m53.566469706s) [upload=355345]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 23:16:12.838521276 (341h49m53.569788906s) [upload=355345]: Next segment err: metaclient: Too Many Requests Aug 22 23:16:12.838537678 (341h49m53.569805297s) [upload=355345]: Done uploading segments... Aug 22 23:16:12.838546483 (341h49m53.569814104s) [upload=355345]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.724701772s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
2.529743693s
FAIL (2025-08-22 23:35:32 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
59]: Uploading piece...
Aug 22 22:53:29.611585477 (341h27m10.342853137s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612050902 (341h27m10.343318552s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612464942 (341h27m10.343732591s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612857369 (341h27m10.34412503s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613271678 (341h27m10.344539329s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613655671 (341h27m10.344923321s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614059881 (341h27m10.345327542s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614540405 (341h27m10.345808065s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614942673 (341h27m10.346210322s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.615322797 (341h27m10.346590508s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.618240035 (341h27m10.349507685s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:30.106040273 (341h27m10.837307893s) [upload=354959]: Next returned nil segment
Aug 22 22:53:30.106057475 (341h27m10.837325105s) [upload=354959]: Waiting for error group managing segments...
Aug 22 22:53:30.265188790 (341h27m10.99645643s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.265907802 (341h27m10.997175453s) [noise=true , address=81.171.14.70:4039 , piece_id=UGLARCJIGPJ5BN2PWYD4NM62Z74HLMBKRCCYEKFP2ZAZBGWSYIRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.266528711 (341h27m10.997796351s) [noise=true , address=81.171.14.70:4035 , piece_id=6M22EYTZY734SCUSTKUGF3PNJ2QJLKMA2MAZXV6VPOOM2W4EUUUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.267544280 (341h27m10.998811931s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.268723619 (341h27m10.99999126s) [noise=true , address=89.149.201.147:4015 , piece_id=5WP6YFYWCVWL7QRS2VCDJP576AHQ66NJW742XOW324DIIXMLSBEQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270432624 (341h27m11.001700254s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270515790 (341h27m11.001783431s) [noise=true , address=81.171.14.70:4025 , piece_id=3PV4YNDGP33PBZUHYWLXRSEE3QZO2ZFL2PCEXYSSEWGGWVTFRLPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.271054975 (341h27m11.002322595s) [noise=true , address=81.171.14.70:4031 , piece_id=O6BNM3FOD76GP5I3MJKNZXREQH7XRG7ZOHDNNXRD7HKTSABASTUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.273453727 (341h27m11.004721367s) [noise=true , address=81.171.14.70:4044 , piece_id=JAMFLVIXOT4KL2OPPZGQFLV35GUPBBRX6673QJMB6YDRBZFOGG7Q, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.274998804 (341h27m11.006266424s) [noise=true , address=185.167.204.205:4027 , piece_id=NDAULJLWJRAIVPPNHYKT3WJHG5JS2F6B7RLQQXFJOL3QBNPTADMA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277211505 (341h27m11.008479146s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277435196 (341h27m11.008702816s) [noise=true , address=185.167.204.206:4072 , piece_id=XYAPWQELW5EUKLR62OGEEQVBGNQUTS2J4CC4PLPNTEXP2SWNQRIA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279287400 (341h27m11.01055504s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279410051 (341h27m11.010677681s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280438876 (341h27m11.011706507s) [noise=true , address=185.167.204.206:4056 , piece_id=BQTKVXFXDWMZCV7UBQDMJTE6DII572Q3AJM3JCTW66AP6DIWY5MQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280910263 (341h27m11.012177893s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.281986407 (341h27m11.013254028s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282394265 (341h27m11.013666674s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282761165 (341h27m11.014028785s) [noise=true , address=185.167.204.206:4062 , piece_id=C6LI537WYQRJHUVBTDJCZK35KQHT5JBBLENH5WVGPDJFWCU3RTWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283174292 (341h27m11.014441911s) [noise=true , address=185.167.204.205:4023 , piece_id=YZXWFCP5WW4ARBUTA6XNWHU3KU5U23OMASCOFORJNL6T3UZQDGWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283847198 (341h27m11.015114838s) [noise=true , address=185.167.204.206:4063 , piece_id=E7N65C5KMWXYA67LJW4FLIWRNUP45QNS7OTUYK64UMW2AVWXT7IQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.285333653 (341h27m11.016601274s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.287128550 (341h27m11.01839617s) [noise=true , address=185.167.204.205:4030 , piece_id=V5B4VQCRBKXTTY4PJRVWV5C54HV2MX7PHC53UNKKP7Y3SJJGBARA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.292510313 (341h27m11.023777933s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.296039952 (341h27m11.027307572s) [noise=true , address=185.167.204.206:4068 , piece_id=5WUPBASDPHH7SGA3HLRLN3HMLMABMZTCO5YFUFVLT2FPC4DLFCPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301208034 (341h27m11.032475664s) [noise=true , address=81.171.14.70:4046 , piece_id=4YNKZGJQYOJEB3FFDIK6XALSTARBBMPYCE4GEWIQ5RQROFUHE6CA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301226198 (341h27m11.032493828s) [seg_pos={0 0}, upload=354959]: Segment reached optimal threshold of 26 pieces.
Aug 22 22:53:30.301343489 (341h27m11.032611129s) [noise=true , address=81.171.14.70:4036 , piece_id=OTQRXXAW43EQPVOUO54E6EUPTUZLRPWMHWBV62OKMTUI5QZMDZVQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF
Aug 22 22:53:30.301530851 (341h27m11.032798481s) [noise=true , address=185.167.204.205:4033 , piece_id=ROIUSDQL7GNXUULS6VLF6OIPG6UJOJTNEYLS6THCFIOP3LTL2SBA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe): protocol: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection
Aug 22 22:53:30.301547272 (341h27m11.032814902s) [seg_pos={0 0}, upload=354959]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Aug 22 22:53:30.301638825 (341h27m11.032906455s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 22:53:30.301644756 (341h27m11.032912386s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 22:56:04.281070862 (341h29m45.012338492s) [upload=354959]: Done uploading segments...
Aug 22 22:56:04.281085750 (341h29m45.012353381s) [upload=354959]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.529780322s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [............X......X........................................] duration:
159.258977ms
FAIL (2025-08-22 23:35:19 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 22 23:04:34.193786424 (341h38m14.925054054s) [upload=355145]: Starting upload Aug 22 23:04:34.193855373 (341h38m14.925123003s) [upload=355145]: Done starting upload Aug 22 23:04:34.193917851 (341h38m14.925185481s) [upload=355145]: Uploading segments... Aug 22 23:04:34.193995587 (341h38m14.925263217s) [upload=355145]: Got next segment. Inline: true Aug 22 23:04:34.194002741 (341h38m14.925270371s) [upload=355145]: Waiting for error group managing segments... Aug 22 23:04:34.194052023 (341h38m14.925319653s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 23:04:34.194058906 (341h38m14.925326526s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 23:04:34.194063054 (341h38m14.925330684s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 23:04:34.545689514 (341h38m15.276957164s) [upload=355145]: Done uploading segments... Aug 22 23:04:34.545718478 (341h38m15.276986128s) [upload=355145]: Upload finished. err: <nil>
Duration: 159.273314ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
720.965089ms
FAIL (2025-08-22 23:34:50 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 23:16:12.834814859 (341h49m53.56608251s) [upload=355345]: Starting upload Aug 22 23:16:12.834855054 (341h49m53.566122675s) [upload=355345]: Done starting upload Aug 22 23:16:12.834971062 (341h49m53.566238682s) [upload=355345]: Uploading segments... Aug 22 23:16:12.835164355 (341h49m53.566431986s) [upload=355345]: Got next segment. Inline: false Aug 22 23:16:12.835197678 (341h49m53.566465298s) [upload=355345]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 23:16:12.835202087 (341h49m53.566469706s) [upload=355345]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 23:16:12.838521276 (341h49m53.569788906s) [upload=355345]: Next segment err: metaclient: Too Many Requests Aug 22 23:16:12.838537678 (341h49m53.569805297s) [upload=355345]: Done uploading segments... Aug 22 23:16:12.838546483 (341h49m53.569814104s) [upload=355345]: Upload finished. err: metaclient: Too Many Requests
Duration: 721.006065ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
2.800140587s
FAIL (2025-08-22 23:34:30 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
59]: Uploading piece...
Aug 22 22:53:29.611585477 (341h27m10.342853137s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612050902 (341h27m10.343318552s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612464942 (341h27m10.343732591s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612857369 (341h27m10.34412503s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613271678 (341h27m10.344539329s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613655671 (341h27m10.344923321s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614059881 (341h27m10.345327542s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614540405 (341h27m10.345808065s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614942673 (341h27m10.346210322s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.615322797 (341h27m10.346590508s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.618240035 (341h27m10.349507685s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:30.106040273 (341h27m10.837307893s) [upload=354959]: Next returned nil segment
Aug 22 22:53:30.106057475 (341h27m10.837325105s) [upload=354959]: Waiting for error group managing segments...
Aug 22 22:53:30.265188790 (341h27m10.99645643s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.265907802 (341h27m10.997175453s) [noise=true , address=81.171.14.70:4039 , piece_id=UGLARCJIGPJ5BN2PWYD4NM62Z74HLMBKRCCYEKFP2ZAZBGWSYIRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.266528711 (341h27m10.997796351s) [noise=true , address=81.171.14.70:4035 , piece_id=6M22EYTZY734SCUSTKUGF3PNJ2QJLKMA2MAZXV6VPOOM2W4EUUUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.267544280 (341h27m10.998811931s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.268723619 (341h27m10.99999126s) [noise=true , address=89.149.201.147:4015 , piece_id=5WP6YFYWCVWL7QRS2VCDJP576AHQ66NJW742XOW324DIIXMLSBEQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270432624 (341h27m11.001700254s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270515790 (341h27m11.001783431s) [noise=true , address=81.171.14.70:4025 , piece_id=3PV4YNDGP33PBZUHYWLXRSEE3QZO2ZFL2PCEXYSSEWGGWVTFRLPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.271054975 (341h27m11.002322595s) [noise=true , address=81.171.14.70:4031 , piece_id=O6BNM3FOD76GP5I3MJKNZXREQH7XRG7ZOHDNNXRD7HKTSABASTUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.273453727 (341h27m11.004721367s) [noise=true , address=81.171.14.70:4044 , piece_id=JAMFLVIXOT4KL2OPPZGQFLV35GUPBBRX6673QJMB6YDRBZFOGG7Q, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.274998804 (341h27m11.006266424s) [noise=true , address=185.167.204.205:4027 , piece_id=NDAULJLWJRAIVPPNHYKT3WJHG5JS2F6B7RLQQXFJOL3QBNPTADMA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277211505 (341h27m11.008479146s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277435196 (341h27m11.008702816s) [noise=true , address=185.167.204.206:4072 , piece_id=XYAPWQELW5EUKLR62OGEEQVBGNQUTS2J4CC4PLPNTEXP2SWNQRIA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279287400 (341h27m11.01055504s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279410051 (341h27m11.010677681s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280438876 (341h27m11.011706507s) [noise=true , address=185.167.204.206:4056 , piece_id=BQTKVXFXDWMZCV7UBQDMJTE6DII572Q3AJM3JCTW66AP6DIWY5MQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280910263 (341h27m11.012177893s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.281986407 (341h27m11.013254028s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282394265 (341h27m11.013666674s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282761165 (341h27m11.014028785s) [noise=true , address=185.167.204.206:4062 , piece_id=C6LI537WYQRJHUVBTDJCZK35KQHT5JBBLENH5WVGPDJFWCU3RTWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283174292 (341h27m11.014441911s) [noise=true , address=185.167.204.205:4023 , piece_id=YZXWFCP5WW4ARBUTA6XNWHU3KU5U23OMASCOFORJNL6T3UZQDGWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283847198 (341h27m11.015114838s) [noise=true , address=185.167.204.206:4063 , piece_id=E7N65C5KMWXYA67LJW4FLIWRNUP45QNS7OTUYK64UMW2AVWXT7IQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.285333653 (341h27m11.016601274s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.287128550 (341h27m11.01839617s) [noise=true , address=185.167.204.205:4030 , piece_id=V5B4VQCRBKXTTY4PJRVWV5C54HV2MX7PHC53UNKKP7Y3SJJGBARA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.292510313 (341h27m11.023777933s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.296039952 (341h27m11.027307572s) [noise=true , address=185.167.204.206:4068 , piece_id=5WUPBASDPHH7SGA3HLRLN3HMLMABMZTCO5YFUFVLT2FPC4DLFCPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301208034 (341h27m11.032475664s) [noise=true , address=81.171.14.70:4046 , piece_id=4YNKZGJQYOJEB3FFDIK6XALSTARBBMPYCE4GEWIQ5RQROFUHE6CA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301226198 (341h27m11.032493828s) [seg_pos={0 0}, upload=354959]: Segment reached optimal threshold of 26 pieces.
Aug 22 22:53:30.301343489 (341h27m11.032611129s) [noise=true , address=81.171.14.70:4036 , piece_id=OTQRXXAW43EQPVOUO54E6EUPTUZLRPWMHWBV62OKMTUI5QZMDZVQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF
Aug 22 22:53:30.301530851 (341h27m11.032798481s) [noise=true , address=185.167.204.205:4033 , piece_id=ROIUSDQL7GNXUULS6VLF6OIPG6UJOJTNEYLS6THCFIOP3LTL2SBA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe): protocol: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection
Aug 22 22:53:30.301547272 (341h27m11.032814902s) [seg_pos={0 0}, upload=354959]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Aug 22 22:53:30.301638825 (341h27m11.032906455s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 22:53:30.301644756 (341h27m11.032912386s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 22:56:04.281070862 (341h29m45.012338492s) [upload=354959]: Done uploading segments...
Aug 22 22:56:04.281085750 (341h29m45.012353381s) [upload=354959]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.800164411s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............X......X.......................................] duration:
189.635591ms
FAIL (2025-08-22 23:34:09 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 22 23:04:34.193786424 (341h38m14.925054054s) [upload=355145]: Starting upload Aug 22 23:04:34.193855373 (341h38m14.925123003s) [upload=355145]: Done starting upload Aug 22 23:04:34.193917851 (341h38m14.925185481s) [upload=355145]: Uploading segments... Aug 22 23:04:34.193995587 (341h38m14.925263217s) [upload=355145]: Got next segment. Inline: true Aug 22 23:04:34.194002741 (341h38m14.925270371s) [upload=355145]: Waiting for error group managing segments... Aug 22 23:04:34.194052023 (341h38m14.925319653s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 23:04:34.194058906 (341h38m14.925326526s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 23:04:34.194063054 (341h38m14.925330684s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 23:04:34.545689514 (341h38m15.276957164s) [upload=355145]: Done uploading segments... Aug 22 23:04:34.545718478 (341h38m15.276986128s) [upload=355145]: Upload finished. err: <nil>
Duration: 189.706173ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
1.836298612s
FAIL (2025-08-22 23:34:08 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 23:16:12.834814859 (341h49m53.56608251s) [upload=355345]: Starting upload Aug 22 23:16:12.834855054 (341h49m53.566122675s) [upload=355345]: Done starting upload Aug 22 23:16:12.834971062 (341h49m53.566238682s) [upload=355345]: Uploading segments... Aug 22 23:16:12.835164355 (341h49m53.566431986s) [upload=355345]: Got next segment. Inline: false Aug 22 23:16:12.835197678 (341h49m53.566465298s) [upload=355345]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 23:16:12.835202087 (341h49m53.566469706s) [upload=355345]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 23:16:12.838521276 (341h49m53.569788906s) [upload=355345]: Next segment err: metaclient: Too Many Requests Aug 22 23:16:12.838537678 (341h49m53.569805297s) [upload=355345]: Done uploading segments... Aug 22 23:16:12.838546483 (341h49m53.569814104s) [upload=355345]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.836330512s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
2.304181489s
FAIL (2025-08-22 23:34:07 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
59]: Uploading piece...
Aug 22 22:53:29.611585477 (341h27m10.342853137s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612050902 (341h27m10.343318552s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612464942 (341h27m10.343732591s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612857369 (341h27m10.34412503s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613271678 (341h27m10.344539329s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613655671 (341h27m10.344923321s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614059881 (341h27m10.345327542s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614540405 (341h27m10.345808065s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614942673 (341h27m10.346210322s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.615322797 (341h27m10.346590508s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.618240035 (341h27m10.349507685s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:30.106040273 (341h27m10.837307893s) [upload=354959]: Next returned nil segment
Aug 22 22:53:30.106057475 (341h27m10.837325105s) [upload=354959]: Waiting for error group managing segments...
Aug 22 22:53:30.265188790 (341h27m10.99645643s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.265907802 (341h27m10.997175453s) [noise=true , address=81.171.14.70:4039 , piece_id=UGLARCJIGPJ5BN2PWYD4NM62Z74HLMBKRCCYEKFP2ZAZBGWSYIRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.266528711 (341h27m10.997796351s) [noise=true , address=81.171.14.70:4035 , piece_id=6M22EYTZY734SCUSTKUGF3PNJ2QJLKMA2MAZXV6VPOOM2W4EUUUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.267544280 (341h27m10.998811931s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.268723619 (341h27m10.99999126s) [noise=true , address=89.149.201.147:4015 , piece_id=5WP6YFYWCVWL7QRS2VCDJP576AHQ66NJW742XOW324DIIXMLSBEQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270432624 (341h27m11.001700254s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270515790 (341h27m11.001783431s) [noise=true , address=81.171.14.70:4025 , piece_id=3PV4YNDGP33PBZUHYWLXRSEE3QZO2ZFL2PCEXYSSEWGGWVTFRLPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.271054975 (341h27m11.002322595s) [noise=true , address=81.171.14.70:4031 , piece_id=O6BNM3FOD76GP5I3MJKNZXREQH7XRG7ZOHDNNXRD7HKTSABASTUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.273453727 (341h27m11.004721367s) [noise=true , address=81.171.14.70:4044 , piece_id=JAMFLVIXOT4KL2OPPZGQFLV35GUPBBRX6673QJMB6YDRBZFOGG7Q, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.274998804 (341h27m11.006266424s) [noise=true , address=185.167.204.205:4027 , piece_id=NDAULJLWJRAIVPPNHYKT3WJHG5JS2F6B7RLQQXFJOL3QBNPTADMA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277211505 (341h27m11.008479146s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277435196 (341h27m11.008702816s) [noise=true , address=185.167.204.206:4072 , piece_id=XYAPWQELW5EUKLR62OGEEQVBGNQUTS2J4CC4PLPNTEXP2SWNQRIA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279287400 (341h27m11.01055504s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279410051 (341h27m11.010677681s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280438876 (341h27m11.011706507s) [noise=true , address=185.167.204.206:4056 , piece_id=BQTKVXFXDWMZCV7UBQDMJTE6DII572Q3AJM3JCTW66AP6DIWY5MQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280910263 (341h27m11.012177893s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.281986407 (341h27m11.013254028s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282394265 (341h27m11.013666674s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282761165 (341h27m11.014028785s) [noise=true , address=185.167.204.206:4062 , piece_id=C6LI537WYQRJHUVBTDJCZK35KQHT5JBBLENH5WVGPDJFWCU3RTWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283174292 (341h27m11.014441911s) [noise=true , address=185.167.204.205:4023 , piece_id=YZXWFCP5WW4ARBUTA6XNWHU3KU5U23OMASCOFORJNL6T3UZQDGWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283847198 (341h27m11.015114838s) [noise=true , address=185.167.204.206:4063 , piece_id=E7N65C5KMWXYA67LJW4FLIWRNUP45QNS7OTUYK64UMW2AVWXT7IQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.285333653 (341h27m11.016601274s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.287128550 (341h27m11.01839617s) [noise=true , address=185.167.204.205:4030 , piece_id=V5B4VQCRBKXTTY4PJRVWV5C54HV2MX7PHC53UNKKP7Y3SJJGBARA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.292510313 (341h27m11.023777933s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.296039952 (341h27m11.027307572s) [noise=true , address=185.167.204.206:4068 , piece_id=5WUPBASDPHH7SGA3HLRLN3HMLMABMZTCO5YFUFVLT2FPC4DLFCPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301208034 (341h27m11.032475664s) [noise=true , address=81.171.14.70:4046 , piece_id=4YNKZGJQYOJEB3FFDIK6XALSTARBBMPYCE4GEWIQ5RQROFUHE6CA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301226198 (341h27m11.032493828s) [seg_pos={0 0}, upload=354959]: Segment reached optimal threshold of 26 pieces.
Aug 22 22:53:30.301343489 (341h27m11.032611129s) [noise=true , address=81.171.14.70:4036 , piece_id=OTQRXXAW43EQPVOUO54E6EUPTUZLRPWMHWBV62OKMTUI5QZMDZVQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF
Aug 22 22:53:30.301530851 (341h27m11.032798481s) [noise=true , address=185.167.204.205:4033 , piece_id=ROIUSDQL7GNXUULS6VLF6OIPG6UJOJTNEYLS6THCFIOP3LTL2SBA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe): protocol: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection
Aug 22 22:53:30.301547272 (341h27m11.032814902s) [seg_pos={0 0}, upload=354959]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Aug 22 22:53:30.301638825 (341h27m11.032906455s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 22:53:30.301644756 (341h27m11.032912386s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 22:56:04.281070862 (341h29m45.012338492s) [upload=354959]: Done uploading segments...
Aug 22 22:56:04.281085750 (341h29m45.012353381s) [upload=354959]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.304200244s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
2.368244609s
FAIL (2025-08-22 23:33:51 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
59]: Uploading piece...
Aug 22 22:53:29.611585477 (341h27m10.342853137s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612050902 (341h27m10.343318552s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612464942 (341h27m10.343732591s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612857369 (341h27m10.34412503s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613271678 (341h27m10.344539329s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613655671 (341h27m10.344923321s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614059881 (341h27m10.345327542s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614540405 (341h27m10.345808065s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614942673 (341h27m10.346210322s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.615322797 (341h27m10.346590508s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.618240035 (341h27m10.349507685s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:30.106040273 (341h27m10.837307893s) [upload=354959]: Next returned nil segment
Aug 22 22:53:30.106057475 (341h27m10.837325105s) [upload=354959]: Waiting for error group managing segments...
Aug 22 22:53:30.265188790 (341h27m10.99645643s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.265907802 (341h27m10.997175453s) [noise=true , address=81.171.14.70:4039 , piece_id=UGLARCJIGPJ5BN2PWYD4NM62Z74HLMBKRCCYEKFP2ZAZBGWSYIRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.266528711 (341h27m10.997796351s) [noise=true , address=81.171.14.70:4035 , piece_id=6M22EYTZY734SCUSTKUGF3PNJ2QJLKMA2MAZXV6VPOOM2W4EUUUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.267544280 (341h27m10.998811931s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.268723619 (341h27m10.99999126s) [noise=true , address=89.149.201.147:4015 , piece_id=5WP6YFYWCVWL7QRS2VCDJP576AHQ66NJW742XOW324DIIXMLSBEQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270432624 (341h27m11.001700254s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270515790 (341h27m11.001783431s) [noise=true , address=81.171.14.70:4025 , piece_id=3PV4YNDGP33PBZUHYWLXRSEE3QZO2ZFL2PCEXYSSEWGGWVTFRLPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.271054975 (341h27m11.002322595s) [noise=true , address=81.171.14.70:4031 , piece_id=O6BNM3FOD76GP5I3MJKNZXREQH7XRG7ZOHDNNXRD7HKTSABASTUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.273453727 (341h27m11.004721367s) [noise=true , address=81.171.14.70:4044 , piece_id=JAMFLVIXOT4KL2OPPZGQFLV35GUPBBRX6673QJMB6YDRBZFOGG7Q, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.274998804 (341h27m11.006266424s) [noise=true , address=185.167.204.205:4027 , piece_id=NDAULJLWJRAIVPPNHYKT3WJHG5JS2F6B7RLQQXFJOL3QBNPTADMA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277211505 (341h27m11.008479146s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277435196 (341h27m11.008702816s) [noise=true , address=185.167.204.206:4072 , piece_id=XYAPWQELW5EUKLR62OGEEQVBGNQUTS2J4CC4PLPNTEXP2SWNQRIA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279287400 (341h27m11.01055504s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279410051 (341h27m11.010677681s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280438876 (341h27m11.011706507s) [noise=true , address=185.167.204.206:4056 , piece_id=BQTKVXFXDWMZCV7UBQDMJTE6DII572Q3AJM3JCTW66AP6DIWY5MQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280910263 (341h27m11.012177893s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.281986407 (341h27m11.013254028s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282394265 (341h27m11.013666674s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282761165 (341h27m11.014028785s) [noise=true , address=185.167.204.206:4062 , piece_id=C6LI537WYQRJHUVBTDJCZK35KQHT5JBBLENH5WVGPDJFWCU3RTWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283174292 (341h27m11.014441911s) [noise=true , address=185.167.204.205:4023 , piece_id=YZXWFCP5WW4ARBUTA6XNWHU3KU5U23OMASCOFORJNL6T3UZQDGWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283847198 (341h27m11.015114838s) [noise=true , address=185.167.204.206:4063 , piece_id=E7N65C5KMWXYA67LJW4FLIWRNUP45QNS7OTUYK64UMW2AVWXT7IQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.285333653 (341h27m11.016601274s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.287128550 (341h27m11.01839617s) [noise=true , address=185.167.204.205:4030 , piece_id=V5B4VQCRBKXTTY4PJRVWV5C54HV2MX7PHC53UNKKP7Y3SJJGBARA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.292510313 (341h27m11.023777933s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.296039952 (341h27m11.027307572s) [noise=true , address=185.167.204.206:4068 , piece_id=5WUPBASDPHH7SGA3HLRLN3HMLMABMZTCO5YFUFVLT2FPC4DLFCPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301208034 (341h27m11.032475664s) [noise=true , address=81.171.14.70:4046 , piece_id=4YNKZGJQYOJEB3FFDIK6XALSTARBBMPYCE4GEWIQ5RQROFUHE6CA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301226198 (341h27m11.032493828s) [seg_pos={0 0}, upload=354959]: Segment reached optimal threshold of 26 pieces.
Aug 22 22:53:30.301343489 (341h27m11.032611129s) [noise=true , address=81.171.14.70:4036 , piece_id=OTQRXXAW43EQPVOUO54E6EUPTUZLRPWMHWBV62OKMTUI5QZMDZVQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF
Aug 22 22:53:30.301530851 (341h27m11.032798481s) [noise=true , address=185.167.204.205:4033 , piece_id=ROIUSDQL7GNXUULS6VLF6OIPG6UJOJTNEYLS6THCFIOP3LTL2SBA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe): protocol: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection
Aug 22 22:53:30.301547272 (341h27m11.032814902s) [seg_pos={0 0}, upload=354959]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Aug 22 22:53:30.301638825 (341h27m11.032906455s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 22:53:30.301644756 (341h27m11.032912386s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 22:56:04.281070862 (341h29m45.012338492s) [upload=354959]: Done uploading segments...
Aug 22 22:56:04.281085750 (341h29m45.012353381s) [upload=354959]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.368266579s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
2.033171824s
FAIL (2025-08-22 23:33:24 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 23:16:12.834814859 (341h49m53.56608251s) [upload=355345]: Starting upload Aug 22 23:16:12.834855054 (341h49m53.566122675s) [upload=355345]: Done starting upload Aug 22 23:16:12.834971062 (341h49m53.566238682s) [upload=355345]: Uploading segments... Aug 22 23:16:12.835164355 (341h49m53.566431986s) [upload=355345]: Got next segment. Inline: false Aug 22 23:16:12.835197678 (341h49m53.566465298s) [upload=355345]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 23:16:12.835202087 (341h49m53.566469706s) [upload=355345]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 23:16:12.838521276 (341h49m53.569788906s) [upload=355345]: Next segment err: metaclient: Too Many Requests Aug 22 23:16:12.838537678 (341h49m53.569805297s) [upload=355345]: Done uploading segments... Aug 22 23:16:12.838546483 (341h49m53.569814104s) [upload=355345]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.033205808s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
2.198657583s
FAIL (2025-08-22 23:33:13 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
59]: Uploading piece...
Aug 22 22:53:29.611585477 (341h27m10.342853137s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612050902 (341h27m10.343318552s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612464942 (341h27m10.343732591s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612857369 (341h27m10.34412503s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613271678 (341h27m10.344539329s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613655671 (341h27m10.344923321s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614059881 (341h27m10.345327542s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614540405 (341h27m10.345808065s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614942673 (341h27m10.346210322s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.615322797 (341h27m10.346590508s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.618240035 (341h27m10.349507685s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:30.106040273 (341h27m10.837307893s) [upload=354959]: Next returned nil segment
Aug 22 22:53:30.106057475 (341h27m10.837325105s) [upload=354959]: Waiting for error group managing segments...
Aug 22 22:53:30.265188790 (341h27m10.99645643s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.265907802 (341h27m10.997175453s) [noise=true , address=81.171.14.70:4039 , piece_id=UGLARCJIGPJ5BN2PWYD4NM62Z74HLMBKRCCYEKFP2ZAZBGWSYIRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.266528711 (341h27m10.997796351s) [noise=true , address=81.171.14.70:4035 , piece_id=6M22EYTZY734SCUSTKUGF3PNJ2QJLKMA2MAZXV6VPOOM2W4EUUUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.267544280 (341h27m10.998811931s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.268723619 (341h27m10.99999126s) [noise=true , address=89.149.201.147:4015 , piece_id=5WP6YFYWCVWL7QRS2VCDJP576AHQ66NJW742XOW324DIIXMLSBEQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270432624 (341h27m11.001700254s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270515790 (341h27m11.001783431s) [noise=true , address=81.171.14.70:4025 , piece_id=3PV4YNDGP33PBZUHYWLXRSEE3QZO2ZFL2PCEXYSSEWGGWVTFRLPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.271054975 (341h27m11.002322595s) [noise=true , address=81.171.14.70:4031 , piece_id=O6BNM3FOD76GP5I3MJKNZXREQH7XRG7ZOHDNNXRD7HKTSABASTUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.273453727 (341h27m11.004721367s) [noise=true , address=81.171.14.70:4044 , piece_id=JAMFLVIXOT4KL2OPPZGQFLV35GUPBBRX6673QJMB6YDRBZFOGG7Q, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.274998804 (341h27m11.006266424s) [noise=true , address=185.167.204.205:4027 , piece_id=NDAULJLWJRAIVPPNHYKT3WJHG5JS2F6B7RLQQXFJOL3QBNPTADMA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277211505 (341h27m11.008479146s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277435196 (341h27m11.008702816s) [noise=true , address=185.167.204.206:4072 , piece_id=XYAPWQELW5EUKLR62OGEEQVBGNQUTS2J4CC4PLPNTEXP2SWNQRIA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279287400 (341h27m11.01055504s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279410051 (341h27m11.010677681s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280438876 (341h27m11.011706507s) [noise=true , address=185.167.204.206:4056 , piece_id=BQTKVXFXDWMZCV7UBQDMJTE6DII572Q3AJM3JCTW66AP6DIWY5MQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280910263 (341h27m11.012177893s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.281986407 (341h27m11.013254028s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282394265 (341h27m11.013666674s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282761165 (341h27m11.014028785s) [noise=true , address=185.167.204.206:4062 , piece_id=C6LI537WYQRJHUVBTDJCZK35KQHT5JBBLENH5WVGPDJFWCU3RTWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283174292 (341h27m11.014441911s) [noise=true , address=185.167.204.205:4023 , piece_id=YZXWFCP5WW4ARBUTA6XNWHU3KU5U23OMASCOFORJNL6T3UZQDGWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283847198 (341h27m11.015114838s) [noise=true , address=185.167.204.206:4063 , piece_id=E7N65C5KMWXYA67LJW4FLIWRNUP45QNS7OTUYK64UMW2AVWXT7IQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.285333653 (341h27m11.016601274s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.287128550 (341h27m11.01839617s) [noise=true , address=185.167.204.205:4030 , piece_id=V5B4VQCRBKXTTY4PJRVWV5C54HV2MX7PHC53UNKKP7Y3SJJGBARA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.292510313 (341h27m11.023777933s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.296039952 (341h27m11.027307572s) [noise=true , address=185.167.204.206:4068 , piece_id=5WUPBASDPHH7SGA3HLRLN3HMLMABMZTCO5YFUFVLT2FPC4DLFCPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301208034 (341h27m11.032475664s) [noise=true , address=81.171.14.70:4046 , piece_id=4YNKZGJQYOJEB3FFDIK6XALSTARBBMPYCE4GEWIQ5RQROFUHE6CA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301226198 (341h27m11.032493828s) [seg_pos={0 0}, upload=354959]: Segment reached optimal threshold of 26 pieces.
Aug 22 22:53:30.301343489 (341h27m11.032611129s) [noise=true , address=81.171.14.70:4036 , piece_id=OTQRXXAW43EQPVOUO54E6EUPTUZLRPWMHWBV62OKMTUI5QZMDZVQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF
Aug 22 22:53:30.301530851 (341h27m11.032798481s) [noise=true , address=185.167.204.205:4033 , piece_id=ROIUSDQL7GNXUULS6VLF6OIPG6UJOJTNEYLS6THCFIOP3LTL2SBA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe): protocol: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection
Aug 22 22:53:30.301547272 (341h27m11.032814902s) [seg_pos={0 0}, upload=354959]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Aug 22 22:53:30.301638825 (341h27m11.032906455s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 22:53:30.301644756 (341h27m11.032912386s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 22:56:04.281070862 (341h29m45.012338492s) [upload=354959]: Done uploading segments...
Aug 22 22:56:04.281085750 (341h29m45.012353381s) [upload=354959]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.198680095s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............X......X......................................] duration:
391.292813ms
FAIL (2025-08-22 23:32:57 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 22 23:04:34.193786424 (341h38m14.925054054s) [upload=355145]: Starting upload Aug 22 23:04:34.193855373 (341h38m14.925123003s) [upload=355145]: Done starting upload Aug 22 23:04:34.193917851 (341h38m14.925185481s) [upload=355145]: Uploading segments... Aug 22 23:04:34.193995587 (341h38m14.925263217s) [upload=355145]: Got next segment. Inline: true Aug 22 23:04:34.194002741 (341h38m14.925270371s) [upload=355145]: Waiting for error group managing segments... Aug 22 23:04:34.194052023 (341h38m14.925319653s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 23:04:34.194058906 (341h38m14.925326526s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 23:04:34.194063054 (341h38m14.925330684s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 23:04:34.545689514 (341h38m15.276957164s) [upload=355145]: Done uploading segments... Aug 22 23:04:34.545718478 (341h38m15.276986128s) [upload=355145]: Upload finished. err: <nil>
Duration: 391.31781ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
1.574654529s
FAIL (2025-08-22 23:32:51 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 23:16:12.834814859 (341h49m53.56608251s) [upload=355345]: Starting upload Aug 22 23:16:12.834855054 (341h49m53.566122675s) [upload=355345]: Done starting upload Aug 22 23:16:12.834971062 (341h49m53.566238682s) [upload=355345]: Uploading segments... Aug 22 23:16:12.835164355 (341h49m53.566431986s) [upload=355345]: Got next segment. Inline: false Aug 22 23:16:12.835197678 (341h49m53.566465298s) [upload=355345]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 23:16:12.835202087 (341h49m53.566469706s) [upload=355345]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 23:16:12.838521276 (341h49m53.569788906s) [upload=355345]: Next segment err: metaclient: Too Many Requests Aug 22 23:16:12.838537678 (341h49m53.569805297s) [upload=355345]: Done uploading segments... Aug 22 23:16:12.838546483 (341h49m53.569814104s) [upload=355345]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.574682202s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............X......X.....................................] duration:
210.615927ms
FAIL (2025-08-22 23:32:26 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 22 23:04:34.193786424 (341h38m14.925054054s) [upload=355145]: Starting upload Aug 22 23:04:34.193855373 (341h38m14.925123003s) [upload=355145]: Done starting upload Aug 22 23:04:34.193917851 (341h38m14.925185481s) [upload=355145]: Uploading segments... Aug 22 23:04:34.193995587 (341h38m14.925263217s) [upload=355145]: Got next segment. Inline: true Aug 22 23:04:34.194002741 (341h38m14.925270371s) [upload=355145]: Waiting for error group managing segments... Aug 22 23:04:34.194052023 (341h38m14.925319653s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 23:04:34.194058906 (341h38m14.925326526s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 23:04:34.194063054 (341h38m14.925330684s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 23:04:34.545689514 (341h38m15.276957164s) [upload=355145]: Done uploading segments... Aug 22 23:04:34.545718478 (341h38m15.276986128s) [upload=355145]: Upload finished. err: <nil>
Duration: 210.645011ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
2.456102455s
FAIL (2025-08-22 23:32:15 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 23:16:12.834814859 (341h49m53.56608251s) [upload=355345]: Starting upload Aug 22 23:16:12.834855054 (341h49m53.566122675s) [upload=355345]: Done starting upload Aug 22 23:16:12.834971062 (341h49m53.566238682s) [upload=355345]: Uploading segments... Aug 22 23:16:12.835164355 (341h49m53.566431986s) [upload=355345]: Got next segment. Inline: false Aug 22 23:16:12.835197678 (341h49m53.566465298s) [upload=355345]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 23:16:12.835202087 (341h49m53.566469706s) [upload=355345]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 23:16:12.838521276 (341h49m53.569788906s) [upload=355345]: Next segment err: metaclient: Too Many Requests Aug 22 23:16:12.838537678 (341h49m53.569805297s) [upload=355345]: Done uploading segments... Aug 22 23:16:12.838546483 (341h49m53.569814104s) [upload=355345]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.456128693s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [................X......X....................................] duration:
159.745189ms
FAIL (2025-08-22 23:32:09 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 22 23:04:34.193786424 (341h38m14.925054054s) [upload=355145]: Starting upload Aug 22 23:04:34.193855373 (341h38m14.925123003s) [upload=355145]: Done starting upload Aug 22 23:04:34.193917851 (341h38m14.925185481s) [upload=355145]: Uploading segments... Aug 22 23:04:34.193995587 (341h38m14.925263217s) [upload=355145]: Got next segment. Inline: true Aug 22 23:04:34.194002741 (341h38m14.925270371s) [upload=355145]: Waiting for error group managing segments... Aug 22 23:04:34.194052023 (341h38m14.925319653s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 23:04:34.194058906 (341h38m14.925326526s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 23:04:34.194063054 (341h38m14.925330684s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 23:04:34.545689514 (341h38m15.276957164s) [upload=355145]: Done uploading segments... Aug 22 23:04:34.545718478 (341h38m15.276986128s) [upload=355145]: Upload finished. err: <nil>
Duration: 159.768272ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
3.554408779s
FAIL (2025-08-22 23:32:06 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
59]: Uploading piece...
Aug 22 22:53:29.611585477 (341h27m10.342853137s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612050902 (341h27m10.343318552s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612464942 (341h27m10.343732591s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612857369 (341h27m10.34412503s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613271678 (341h27m10.344539329s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613655671 (341h27m10.344923321s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614059881 (341h27m10.345327542s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614540405 (341h27m10.345808065s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614942673 (341h27m10.346210322s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.615322797 (341h27m10.346590508s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.618240035 (341h27m10.349507685s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:30.106040273 (341h27m10.837307893s) [upload=354959]: Next returned nil segment
Aug 22 22:53:30.106057475 (341h27m10.837325105s) [upload=354959]: Waiting for error group managing segments...
Aug 22 22:53:30.265188790 (341h27m10.99645643s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.265907802 (341h27m10.997175453s) [noise=true , address=81.171.14.70:4039 , piece_id=UGLARCJIGPJ5BN2PWYD4NM62Z74HLMBKRCCYEKFP2ZAZBGWSYIRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.266528711 (341h27m10.997796351s) [noise=true , address=81.171.14.70:4035 , piece_id=6M22EYTZY734SCUSTKUGF3PNJ2QJLKMA2MAZXV6VPOOM2W4EUUUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.267544280 (341h27m10.998811931s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.268723619 (341h27m10.99999126s) [noise=true , address=89.149.201.147:4015 , piece_id=5WP6YFYWCVWL7QRS2VCDJP576AHQ66NJW742XOW324DIIXMLSBEQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270432624 (341h27m11.001700254s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270515790 (341h27m11.001783431s) [noise=true , address=81.171.14.70:4025 , piece_id=3PV4YNDGP33PBZUHYWLXRSEE3QZO2ZFL2PCEXYSSEWGGWVTFRLPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.271054975 (341h27m11.002322595s) [noise=true , address=81.171.14.70:4031 , piece_id=O6BNM3FOD76GP5I3MJKNZXREQH7XRG7ZOHDNNXRD7HKTSABASTUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.273453727 (341h27m11.004721367s) [noise=true , address=81.171.14.70:4044 , piece_id=JAMFLVIXOT4KL2OPPZGQFLV35GUPBBRX6673QJMB6YDRBZFOGG7Q, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.274998804 (341h27m11.006266424s) [noise=true , address=185.167.204.205:4027 , piece_id=NDAULJLWJRAIVPPNHYKT3WJHG5JS2F6B7RLQQXFJOL3QBNPTADMA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277211505 (341h27m11.008479146s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277435196 (341h27m11.008702816s) [noise=true , address=185.167.204.206:4072 , piece_id=XYAPWQELW5EUKLR62OGEEQVBGNQUTS2J4CC4PLPNTEXP2SWNQRIA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279287400 (341h27m11.01055504s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279410051 (341h27m11.010677681s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280438876 (341h27m11.011706507s) [noise=true , address=185.167.204.206:4056 , piece_id=BQTKVXFXDWMZCV7UBQDMJTE6DII572Q3AJM3JCTW66AP6DIWY5MQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280910263 (341h27m11.012177893s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.281986407 (341h27m11.013254028s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282394265 (341h27m11.013666674s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282761165 (341h27m11.014028785s) [noise=true , address=185.167.204.206:4062 , piece_id=C6LI537WYQRJHUVBTDJCZK35KQHT5JBBLENH5WVGPDJFWCU3RTWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283174292 (341h27m11.014441911s) [noise=true , address=185.167.204.205:4023 , piece_id=YZXWFCP5WW4ARBUTA6XNWHU3KU5U23OMASCOFORJNL6T3UZQDGWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283847198 (341h27m11.015114838s) [noise=true , address=185.167.204.206:4063 , piece_id=E7N65C5KMWXYA67LJW4FLIWRNUP45QNS7OTUYK64UMW2AVWXT7IQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.285333653 (341h27m11.016601274s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.287128550 (341h27m11.01839617s) [noise=true , address=185.167.204.205:4030 , piece_id=V5B4VQCRBKXTTY4PJRVWV5C54HV2MX7PHC53UNKKP7Y3SJJGBARA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.292510313 (341h27m11.023777933s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.296039952 (341h27m11.027307572s) [noise=true , address=185.167.204.206:4068 , piece_id=5WUPBASDPHH7SGA3HLRLN3HMLMABMZTCO5YFUFVLT2FPC4DLFCPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301208034 (341h27m11.032475664s) [noise=true , address=81.171.14.70:4046 , piece_id=4YNKZGJQYOJEB3FFDIK6XALSTARBBMPYCE4GEWIQ5RQROFUHE6CA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301226198 (341h27m11.032493828s) [seg_pos={0 0}, upload=354959]: Segment reached optimal threshold of 26 pieces.
Aug 22 22:53:30.301343489 (341h27m11.032611129s) [noise=true , address=81.171.14.70:4036 , piece_id=OTQRXXAW43EQPVOUO54E6EUPTUZLRPWMHWBV62OKMTUI5QZMDZVQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF
Aug 22 22:53:30.301530851 (341h27m11.032798481s) [noise=true , address=185.167.204.205:4033 , piece_id=ROIUSDQL7GNXUULS6VLF6OIPG6UJOJTNEYLS6THCFIOP3LTL2SBA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe): protocol: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection
Aug 22 22:53:30.301547272 (341h27m11.032814902s) [seg_pos={0 0}, upload=354959]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Aug 22 22:53:30.301638825 (341h27m11.032906455s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 22:53:30.301644756 (341h27m11.032912386s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 22:56:04.281070862 (341h29m45.012338492s) [upload=354959]: Done uploading segments...
Aug 22 22:56:04.281085750 (341h29m45.012353381s) [upload=354959]: Upload finished. err: metaclient: context deadline exceeded
Duration: 3.554430901s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
6.39584007s
FAIL (2025-08-22 23:31:46 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
59]: Uploading piece...
Aug 22 22:53:29.611585477 (341h27m10.342853137s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612050902 (341h27m10.343318552s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612464942 (341h27m10.343732591s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612857369 (341h27m10.34412503s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613271678 (341h27m10.344539329s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613655671 (341h27m10.344923321s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614059881 (341h27m10.345327542s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614540405 (341h27m10.345808065s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614942673 (341h27m10.346210322s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.615322797 (341h27m10.346590508s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.618240035 (341h27m10.349507685s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:30.106040273 (341h27m10.837307893s) [upload=354959]: Next returned nil segment
Aug 22 22:53:30.106057475 (341h27m10.837325105s) [upload=354959]: Waiting for error group managing segments...
Aug 22 22:53:30.265188790 (341h27m10.99645643s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.265907802 (341h27m10.997175453s) [noise=true , address=81.171.14.70:4039 , piece_id=UGLARCJIGPJ5BN2PWYD4NM62Z74HLMBKRCCYEKFP2ZAZBGWSYIRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.266528711 (341h27m10.997796351s) [noise=true , address=81.171.14.70:4035 , piece_id=6M22EYTZY734SCUSTKUGF3PNJ2QJLKMA2MAZXV6VPOOM2W4EUUUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.267544280 (341h27m10.998811931s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.268723619 (341h27m10.99999126s) [noise=true , address=89.149.201.147:4015 , piece_id=5WP6YFYWCVWL7QRS2VCDJP576AHQ66NJW742XOW324DIIXMLSBEQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270432624 (341h27m11.001700254s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270515790 (341h27m11.001783431s) [noise=true , address=81.171.14.70:4025 , piece_id=3PV4YNDGP33PBZUHYWLXRSEE3QZO2ZFL2PCEXYSSEWGGWVTFRLPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.271054975 (341h27m11.002322595s) [noise=true , address=81.171.14.70:4031 , piece_id=O6BNM3FOD76GP5I3MJKNZXREQH7XRG7ZOHDNNXRD7HKTSABASTUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.273453727 (341h27m11.004721367s) [noise=true , address=81.171.14.70:4044 , piece_id=JAMFLVIXOT4KL2OPPZGQFLV35GUPBBRX6673QJMB6YDRBZFOGG7Q, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.274998804 (341h27m11.006266424s) [noise=true , address=185.167.204.205:4027 , piece_id=NDAULJLWJRAIVPPNHYKT3WJHG5JS2F6B7RLQQXFJOL3QBNPTADMA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277211505 (341h27m11.008479146s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277435196 (341h27m11.008702816s) [noise=true , address=185.167.204.206:4072 , piece_id=XYAPWQELW5EUKLR62OGEEQVBGNQUTS2J4CC4PLPNTEXP2SWNQRIA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279287400 (341h27m11.01055504s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279410051 (341h27m11.010677681s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280438876 (341h27m11.011706507s) [noise=true , address=185.167.204.206:4056 , piece_id=BQTKVXFXDWMZCV7UBQDMJTE6DII572Q3AJM3JCTW66AP6DIWY5MQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280910263 (341h27m11.012177893s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.281986407 (341h27m11.013254028s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282394265 (341h27m11.013666674s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282761165 (341h27m11.014028785s) [noise=true , address=185.167.204.206:4062 , piece_id=C6LI537WYQRJHUVBTDJCZK35KQHT5JBBLENH5WVGPDJFWCU3RTWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283174292 (341h27m11.014441911s) [noise=true , address=185.167.204.205:4023 , piece_id=YZXWFCP5WW4ARBUTA6XNWHU3KU5U23OMASCOFORJNL6T3UZQDGWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283847198 (341h27m11.015114838s) [noise=true , address=185.167.204.206:4063 , piece_id=E7N65C5KMWXYA67LJW4FLIWRNUP45QNS7OTUYK64UMW2AVWXT7IQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.285333653 (341h27m11.016601274s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.287128550 (341h27m11.01839617s) [noise=true , address=185.167.204.205:4030 , piece_id=V5B4VQCRBKXTTY4PJRVWV5C54HV2MX7PHC53UNKKP7Y3SJJGBARA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.292510313 (341h27m11.023777933s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.296039952 (341h27m11.027307572s) [noise=true , address=185.167.204.206:4068 , piece_id=5WUPBASDPHH7SGA3HLRLN3HMLMABMZTCO5YFUFVLT2FPC4DLFCPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301208034 (341h27m11.032475664s) [noise=true , address=81.171.14.70:4046 , piece_id=4YNKZGJQYOJEB3FFDIK6XALSTARBBMPYCE4GEWIQ5RQROFUHE6CA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301226198 (341h27m11.032493828s) [seg_pos={0 0}, upload=354959]: Segment reached optimal threshold of 26 pieces.
Aug 22 22:53:30.301343489 (341h27m11.032611129s) [noise=true , address=81.171.14.70:4036 , piece_id=OTQRXXAW43EQPVOUO54E6EUPTUZLRPWMHWBV62OKMTUI5QZMDZVQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF
Aug 22 22:53:30.301530851 (341h27m11.032798481s) [noise=true , address=185.167.204.205:4033 , piece_id=ROIUSDQL7GNXUULS6VLF6OIPG6UJOJTNEYLS6THCFIOP3LTL2SBA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe): protocol: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection
Aug 22 22:53:30.301547272 (341h27m11.032814902s) [seg_pos={0 0}, upload=354959]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Aug 22 22:53:30.301638825 (341h27m11.032906455s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 22:53:30.301644756 (341h27m11.032912386s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 22:56:04.281070862 (341h29m45.012338492s) [upload=354959]: Done uploading segments...
Aug 22 22:56:04.281085750 (341h29m45.012353381s) [upload=354959]: Upload finished. err: metaclient: context deadline exceeded
Duration: 6.395856011s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
2.151911536s
FAIL (2025-08-22 23:31:12 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 23:16:12.834814859 (341h49m53.56608251s) [upload=355345]: Starting upload Aug 22 23:16:12.834855054 (341h49m53.566122675s) [upload=355345]: Done starting upload Aug 22 23:16:12.834971062 (341h49m53.566238682s) [upload=355345]: Uploading segments... Aug 22 23:16:12.835164355 (341h49m53.566431986s) [upload=355345]: Got next segment. Inline: false Aug 22 23:16:12.835197678 (341h49m53.566465298s) [upload=355345]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 23:16:12.835202087 (341h49m53.566469706s) [upload=355345]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 23:16:12.838521276 (341h49m53.569788906s) [upload=355345]: Next segment err: metaclient: Too Many Requests Aug 22 23:16:12.838537678 (341h49m53.569805297s) [upload=355345]: Done uploading segments... Aug 22 23:16:12.838546483 (341h49m53.569814104s) [upload=355345]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.151958954s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................X......X...................................] duration:
172.600779ms
FAIL (2025-08-22 23:31:03 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 22 23:04:34.193786424 (341h38m14.925054054s) [upload=355145]: Starting upload Aug 22 23:04:34.193855373 (341h38m14.925123003s) [upload=355145]: Done starting upload Aug 22 23:04:34.193917851 (341h38m14.925185481s) [upload=355145]: Uploading segments... Aug 22 23:04:34.193995587 (341h38m14.925263217s) [upload=355145]: Got next segment. Inline: true Aug 22 23:04:34.194002741 (341h38m14.925270371s) [upload=355145]: Waiting for error group managing segments... Aug 22 23:04:34.194052023 (341h38m14.925319653s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 23:04:34.194058906 (341h38m14.925326526s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 23:04:34.194063054 (341h38m14.925330684s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 23:04:34.545689514 (341h38m15.276957164s) [upload=355145]: Done uploading segments... Aug 22 23:04:34.545718478 (341h38m15.276986128s) [upload=355145]: Upload finished. err: <nil>
Duration: 172.625947ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
2.590778823s
FAIL (2025-08-22 23:30:55 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
59]: Uploading piece...
Aug 22 22:53:29.611585477 (341h27m10.342853137s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612050902 (341h27m10.343318552s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612464942 (341h27m10.343732591s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612857369 (341h27m10.34412503s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613271678 (341h27m10.344539329s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613655671 (341h27m10.344923321s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614059881 (341h27m10.345327542s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614540405 (341h27m10.345808065s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614942673 (341h27m10.346210322s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.615322797 (341h27m10.346590508s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.618240035 (341h27m10.349507685s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:30.106040273 (341h27m10.837307893s) [upload=354959]: Next returned nil segment
Aug 22 22:53:30.106057475 (341h27m10.837325105s) [upload=354959]: Waiting for error group managing segments...
Aug 22 22:53:30.265188790 (341h27m10.99645643s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.265907802 (341h27m10.997175453s) [noise=true , address=81.171.14.70:4039 , piece_id=UGLARCJIGPJ5BN2PWYD4NM62Z74HLMBKRCCYEKFP2ZAZBGWSYIRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.266528711 (341h27m10.997796351s) [noise=true , address=81.171.14.70:4035 , piece_id=6M22EYTZY734SCUSTKUGF3PNJ2QJLKMA2MAZXV6VPOOM2W4EUUUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.267544280 (341h27m10.998811931s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.268723619 (341h27m10.99999126s) [noise=true , address=89.149.201.147:4015 , piece_id=5WP6YFYWCVWL7QRS2VCDJP576AHQ66NJW742XOW324DIIXMLSBEQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270432624 (341h27m11.001700254s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270515790 (341h27m11.001783431s) [noise=true , address=81.171.14.70:4025 , piece_id=3PV4YNDGP33PBZUHYWLXRSEE3QZO2ZFL2PCEXYSSEWGGWVTFRLPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.271054975 (341h27m11.002322595s) [noise=true , address=81.171.14.70:4031 , piece_id=O6BNM3FOD76GP5I3MJKNZXREQH7XRG7ZOHDNNXRD7HKTSABASTUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.273453727 (341h27m11.004721367s) [noise=true , address=81.171.14.70:4044 , piece_id=JAMFLVIXOT4KL2OPPZGQFLV35GUPBBRX6673QJMB6YDRBZFOGG7Q, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.274998804 (341h27m11.006266424s) [noise=true , address=185.167.204.205:4027 , piece_id=NDAULJLWJRAIVPPNHYKT3WJHG5JS2F6B7RLQQXFJOL3QBNPTADMA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277211505 (341h27m11.008479146s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277435196 (341h27m11.008702816s) [noise=true , address=185.167.204.206:4072 , piece_id=XYAPWQELW5EUKLR62OGEEQVBGNQUTS2J4CC4PLPNTEXP2SWNQRIA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279287400 (341h27m11.01055504s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279410051 (341h27m11.010677681s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280438876 (341h27m11.011706507s) [noise=true , address=185.167.204.206:4056 , piece_id=BQTKVXFXDWMZCV7UBQDMJTE6DII572Q3AJM3JCTW66AP6DIWY5MQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280910263 (341h27m11.012177893s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.281986407 (341h27m11.013254028s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282394265 (341h27m11.013666674s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282761165 (341h27m11.014028785s) [noise=true , address=185.167.204.206:4062 , piece_id=C6LI537WYQRJHUVBTDJCZK35KQHT5JBBLENH5WVGPDJFWCU3RTWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283174292 (341h27m11.014441911s) [noise=true , address=185.167.204.205:4023 , piece_id=YZXWFCP5WW4ARBUTA6XNWHU3KU5U23OMASCOFORJNL6T3UZQDGWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283847198 (341h27m11.015114838s) [noise=true , address=185.167.204.206:4063 , piece_id=E7N65C5KMWXYA67LJW4FLIWRNUP45QNS7OTUYK64UMW2AVWXT7IQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.285333653 (341h27m11.016601274s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.287128550 (341h27m11.01839617s) [noise=true , address=185.167.204.205:4030 , piece_id=V5B4VQCRBKXTTY4PJRVWV5C54HV2MX7PHC53UNKKP7Y3SJJGBARA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.292510313 (341h27m11.023777933s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.296039952 (341h27m11.027307572s) [noise=true , address=185.167.204.206:4068 , piece_id=5WUPBASDPHH7SGA3HLRLN3HMLMABMZTCO5YFUFVLT2FPC4DLFCPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301208034 (341h27m11.032475664s) [noise=true , address=81.171.14.70:4046 , piece_id=4YNKZGJQYOJEB3FFDIK6XALSTARBBMPYCE4GEWIQ5RQROFUHE6CA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301226198 (341h27m11.032493828s) [seg_pos={0 0}, upload=354959]: Segment reached optimal threshold of 26 pieces.
Aug 22 22:53:30.301343489 (341h27m11.032611129s) [noise=true , address=81.171.14.70:4036 , piece_id=OTQRXXAW43EQPVOUO54E6EUPTUZLRPWMHWBV62OKMTUI5QZMDZVQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF
Aug 22 22:53:30.301530851 (341h27m11.032798481s) [noise=true , address=185.167.204.205:4033 , piece_id=ROIUSDQL7GNXUULS6VLF6OIPG6UJOJTNEYLS6THCFIOP3LTL2SBA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe): protocol: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection
Aug 22 22:53:30.301547272 (341h27m11.032814902s) [seg_pos={0 0}, upload=354959]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Aug 22 22:53:30.301638825 (341h27m11.032906455s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 22:53:30.301644756 (341h27m11.032912386s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 22:56:04.281070862 (341h29m45.012338492s) [upload=354959]: Done uploading segments...
Aug 22 22:56:04.281085750 (341h29m45.012353381s) [upload=354959]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.590801395s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
2.675593702s
FAIL (2025-08-22 23:30:38 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
59]: Uploading piece...
Aug 22 22:53:29.611585477 (341h27m10.342853137s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612050902 (341h27m10.343318552s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612464942 (341h27m10.343732591s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612857369 (341h27m10.34412503s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613271678 (341h27m10.344539329s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613655671 (341h27m10.344923321s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614059881 (341h27m10.345327542s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614540405 (341h27m10.345808065s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614942673 (341h27m10.346210322s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.615322797 (341h27m10.346590508s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.618240035 (341h27m10.349507685s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:30.106040273 (341h27m10.837307893s) [upload=354959]: Next returned nil segment
Aug 22 22:53:30.106057475 (341h27m10.837325105s) [upload=354959]: Waiting for error group managing segments...
Aug 22 22:53:30.265188790 (341h27m10.99645643s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.265907802 (341h27m10.997175453s) [noise=true , address=81.171.14.70:4039 , piece_id=UGLARCJIGPJ5BN2PWYD4NM62Z74HLMBKRCCYEKFP2ZAZBGWSYIRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.266528711 (341h27m10.997796351s) [noise=true , address=81.171.14.70:4035 , piece_id=6M22EYTZY734SCUSTKUGF3PNJ2QJLKMA2MAZXV6VPOOM2W4EUUUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.267544280 (341h27m10.998811931s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.268723619 (341h27m10.99999126s) [noise=true , address=89.149.201.147:4015 , piece_id=5WP6YFYWCVWL7QRS2VCDJP576AHQ66NJW742XOW324DIIXMLSBEQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270432624 (341h27m11.001700254s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270515790 (341h27m11.001783431s) [noise=true , address=81.171.14.70:4025 , piece_id=3PV4YNDGP33PBZUHYWLXRSEE3QZO2ZFL2PCEXYSSEWGGWVTFRLPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.271054975 (341h27m11.002322595s) [noise=true , address=81.171.14.70:4031 , piece_id=O6BNM3FOD76GP5I3MJKNZXREQH7XRG7ZOHDNNXRD7HKTSABASTUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.273453727 (341h27m11.004721367s) [noise=true , address=81.171.14.70:4044 , piece_id=JAMFLVIXOT4KL2OPPZGQFLV35GUPBBRX6673QJMB6YDRBZFOGG7Q, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.274998804 (341h27m11.006266424s) [noise=true , address=185.167.204.205:4027 , piece_id=NDAULJLWJRAIVPPNHYKT3WJHG5JS2F6B7RLQQXFJOL3QBNPTADMA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277211505 (341h27m11.008479146s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277435196 (341h27m11.008702816s) [noise=true , address=185.167.204.206:4072 , piece_id=XYAPWQELW5EUKLR62OGEEQVBGNQUTS2J4CC4PLPNTEXP2SWNQRIA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279287400 (341h27m11.01055504s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279410051 (341h27m11.010677681s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280438876 (341h27m11.011706507s) [noise=true , address=185.167.204.206:4056 , piece_id=BQTKVXFXDWMZCV7UBQDMJTE6DII572Q3AJM3JCTW66AP6DIWY5MQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280910263 (341h27m11.012177893s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.281986407 (341h27m11.013254028s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282394265 (341h27m11.013666674s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282761165 (341h27m11.014028785s) [noise=true , address=185.167.204.206:4062 , piece_id=C6LI537WYQRJHUVBTDJCZK35KQHT5JBBLENH5WVGPDJFWCU3RTWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283174292 (341h27m11.014441911s) [noise=true , address=185.167.204.205:4023 , piece_id=YZXWFCP5WW4ARBUTA6XNWHU3KU5U23OMASCOFORJNL6T3UZQDGWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283847198 (341h27m11.015114838s) [noise=true , address=185.167.204.206:4063 , piece_id=E7N65C5KMWXYA67LJW4FLIWRNUP45QNS7OTUYK64UMW2AVWXT7IQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.285333653 (341h27m11.016601274s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.287128550 (341h27m11.01839617s) [noise=true , address=185.167.204.205:4030 , piece_id=V5B4VQCRBKXTTY4PJRVWV5C54HV2MX7PHC53UNKKP7Y3SJJGBARA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.292510313 (341h27m11.023777933s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.296039952 (341h27m11.027307572s) [noise=true , address=185.167.204.206:4068 , piece_id=5WUPBASDPHH7SGA3HLRLN3HMLMABMZTCO5YFUFVLT2FPC4DLFCPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301208034 (341h27m11.032475664s) [noise=true , address=81.171.14.70:4046 , piece_id=4YNKZGJQYOJEB3FFDIK6XALSTARBBMPYCE4GEWIQ5RQROFUHE6CA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301226198 (341h27m11.032493828s) [seg_pos={0 0}, upload=354959]: Segment reached optimal threshold of 26 pieces.
Aug 22 22:53:30.301343489 (341h27m11.032611129s) [noise=true , address=81.171.14.70:4036 , piece_id=OTQRXXAW43EQPVOUO54E6EUPTUZLRPWMHWBV62OKMTUI5QZMDZVQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF
Aug 22 22:53:30.301530851 (341h27m11.032798481s) [noise=true , address=185.167.204.205:4033 , piece_id=ROIUSDQL7GNXUULS6VLF6OIPG6UJOJTNEYLS6THCFIOP3LTL2SBA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe): protocol: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection
Aug 22 22:53:30.301547272 (341h27m11.032814902s) [seg_pos={0 0}, upload=354959]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Aug 22 22:53:30.301638825 (341h27m11.032906455s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 22:53:30.301644756 (341h27m11.032912386s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 22:56:04.281070862 (341h29m45.012338492s) [upload=354959]: Done uploading segments...
Aug 22 22:56:04.281085750 (341h29m45.012353381s) [upload=354959]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.675624699s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
3.747575567s
FAIL (2025-08-22 23:30:23 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
59]: Uploading piece...
Aug 22 22:53:29.611585477 (341h27m10.342853137s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612050902 (341h27m10.343318552s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612464942 (341h27m10.343732591s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612857369 (341h27m10.34412503s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613271678 (341h27m10.344539329s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613655671 (341h27m10.344923321s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614059881 (341h27m10.345327542s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614540405 (341h27m10.345808065s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614942673 (341h27m10.346210322s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.615322797 (341h27m10.346590508s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.618240035 (341h27m10.349507685s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:30.106040273 (341h27m10.837307893s) [upload=354959]: Next returned nil segment
Aug 22 22:53:30.106057475 (341h27m10.837325105s) [upload=354959]: Waiting for error group managing segments...
Aug 22 22:53:30.265188790 (341h27m10.99645643s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.265907802 (341h27m10.997175453s) [noise=true , address=81.171.14.70:4039 , piece_id=UGLARCJIGPJ5BN2PWYD4NM62Z74HLMBKRCCYEKFP2ZAZBGWSYIRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.266528711 (341h27m10.997796351s) [noise=true , address=81.171.14.70:4035 , piece_id=6M22EYTZY734SCUSTKUGF3PNJ2QJLKMA2MAZXV6VPOOM2W4EUUUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.267544280 (341h27m10.998811931s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.268723619 (341h27m10.99999126s) [noise=true , address=89.149.201.147:4015 , piece_id=5WP6YFYWCVWL7QRS2VCDJP576AHQ66NJW742XOW324DIIXMLSBEQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270432624 (341h27m11.001700254s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270515790 (341h27m11.001783431s) [noise=true , address=81.171.14.70:4025 , piece_id=3PV4YNDGP33PBZUHYWLXRSEE3QZO2ZFL2PCEXYSSEWGGWVTFRLPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.271054975 (341h27m11.002322595s) [noise=true , address=81.171.14.70:4031 , piece_id=O6BNM3FOD76GP5I3MJKNZXREQH7XRG7ZOHDNNXRD7HKTSABASTUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.273453727 (341h27m11.004721367s) [noise=true , address=81.171.14.70:4044 , piece_id=JAMFLVIXOT4KL2OPPZGQFLV35GUPBBRX6673QJMB6YDRBZFOGG7Q, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.274998804 (341h27m11.006266424s) [noise=true , address=185.167.204.205:4027 , piece_id=NDAULJLWJRAIVPPNHYKT3WJHG5JS2F6B7RLQQXFJOL3QBNPTADMA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277211505 (341h27m11.008479146s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277435196 (341h27m11.008702816s) [noise=true , address=185.167.204.206:4072 , piece_id=XYAPWQELW5EUKLR62OGEEQVBGNQUTS2J4CC4PLPNTEXP2SWNQRIA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279287400 (341h27m11.01055504s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279410051 (341h27m11.010677681s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280438876 (341h27m11.011706507s) [noise=true , address=185.167.204.206:4056 , piece_id=BQTKVXFXDWMZCV7UBQDMJTE6DII572Q3AJM3JCTW66AP6DIWY5MQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280910263 (341h27m11.012177893s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.281986407 (341h27m11.013254028s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282394265 (341h27m11.013666674s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282761165 (341h27m11.014028785s) [noise=true , address=185.167.204.206:4062 , piece_id=C6LI537WYQRJHUVBTDJCZK35KQHT5JBBLENH5WVGPDJFWCU3RTWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283174292 (341h27m11.014441911s) [noise=true , address=185.167.204.205:4023 , piece_id=YZXWFCP5WW4ARBUTA6XNWHU3KU5U23OMASCOFORJNL6T3UZQDGWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283847198 (341h27m11.015114838s) [noise=true , address=185.167.204.206:4063 , piece_id=E7N65C5KMWXYA67LJW4FLIWRNUP45QNS7OTUYK64UMW2AVWXT7IQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.285333653 (341h27m11.016601274s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.287128550 (341h27m11.01839617s) [noise=true , address=185.167.204.205:4030 , piece_id=V5B4VQCRBKXTTY4PJRVWV5C54HV2MX7PHC53UNKKP7Y3SJJGBARA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.292510313 (341h27m11.023777933s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.296039952 (341h27m11.027307572s) [noise=true , address=185.167.204.206:4068 , piece_id=5WUPBASDPHH7SGA3HLRLN3HMLMABMZTCO5YFUFVLT2FPC4DLFCPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301208034 (341h27m11.032475664s) [noise=true , address=81.171.14.70:4046 , piece_id=4YNKZGJQYOJEB3FFDIK6XALSTARBBMPYCE4GEWIQ5RQROFUHE6CA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301226198 (341h27m11.032493828s) [seg_pos={0 0}, upload=354959]: Segment reached optimal threshold of 26 pieces.
Aug 22 22:53:30.301343489 (341h27m11.032611129s) [noise=true , address=81.171.14.70:4036 , piece_id=OTQRXXAW43EQPVOUO54E6EUPTUZLRPWMHWBV62OKMTUI5QZMDZVQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF
Aug 22 22:53:30.301530851 (341h27m11.032798481s) [noise=true , address=185.167.204.205:4033 , piece_id=ROIUSDQL7GNXUULS6VLF6OIPG6UJOJTNEYLS6THCFIOP3LTL2SBA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe): protocol: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection
Aug 22 22:53:30.301547272 (341h27m11.032814902s) [seg_pos={0 0}, upload=354959]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Aug 22 22:53:30.301638825 (341h27m11.032906455s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 22:53:30.301644756 (341h27m11.032912386s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 22:56:04.281070862 (341h29m45.012338492s) [upload=354959]: Done uploading segments...
Aug 22 22:56:04.281085750 (341h29m45.012353381s) [upload=354959]: Upload finished. err: metaclient: context deadline exceeded
Duration: 3.74761926s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
1.799159479s
FAIL (2025-08-22 23:30:12 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 23:16:12.834814859 (341h49m53.56608251s) [upload=355345]: Starting upload Aug 22 23:16:12.834855054 (341h49m53.566122675s) [upload=355345]: Done starting upload Aug 22 23:16:12.834971062 (341h49m53.566238682s) [upload=355345]: Uploading segments... Aug 22 23:16:12.835164355 (341h49m53.566431986s) [upload=355345]: Got next segment. Inline: false Aug 22 23:16:12.835197678 (341h49m53.566465298s) [upload=355345]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 23:16:12.835202087 (341h49m53.566469706s) [upload=355345]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 23:16:12.838521276 (341h49m53.569788906s) [upload=355345]: Next segment err: metaclient: Too Many Requests Aug 22 23:16:12.838537678 (341h49m53.569805297s) [upload=355345]: Done uploading segments... Aug 22 23:16:12.838546483 (341h49m53.569814104s) [upload=355345]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.799185699s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................X......X..................................] duration:
168.725616ms
FAIL (2025-08-22 23:29:58 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 22 23:04:34.193786424 (341h38m14.925054054s) [upload=355145]: Starting upload Aug 22 23:04:34.193855373 (341h38m14.925123003s) [upload=355145]: Done starting upload Aug 22 23:04:34.193917851 (341h38m14.925185481s) [upload=355145]: Uploading segments... Aug 22 23:04:34.193995587 (341h38m14.925263217s) [upload=355145]: Got next segment. Inline: true Aug 22 23:04:34.194002741 (341h38m14.925270371s) [upload=355145]: Waiting for error group managing segments... Aug 22 23:04:34.194052023 (341h38m14.925319653s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 23:04:34.194058906 (341h38m14.925326526s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 23:04:34.194063054 (341h38m14.925330684s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 23:04:34.545689514 (341h38m15.276957164s) [upload=355145]: Done uploading segments... Aug 22 23:04:34.545718478 (341h38m15.276986128s) [upload=355145]: Upload finished. err: <nil>
Duration: 168.748229ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...................X......X.................................] duration:
156.609488ms
FAIL (2025-08-22 23:29:26 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 22 23:04:34.193786424 (341h38m14.925054054s) [upload=355145]: Starting upload Aug 22 23:04:34.193855373 (341h38m14.925123003s) [upload=355145]: Done starting upload Aug 22 23:04:34.193917851 (341h38m14.925185481s) [upload=355145]: Uploading segments... Aug 22 23:04:34.193995587 (341h38m14.925263217s) [upload=355145]: Got next segment. Inline: true Aug 22 23:04:34.194002741 (341h38m14.925270371s) [upload=355145]: Waiting for error group managing segments... Aug 22 23:04:34.194052023 (341h38m14.925319653s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 23:04:34.194058906 (341h38m14.925326526s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 23:04:34.194063054 (341h38m14.925330684s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 23:04:34.545689514 (341h38m15.276957164s) [upload=355145]: Done uploading segments... Aug 22 23:04:34.545718478 (341h38m15.276986128s) [upload=355145]: Upload finished. err: <nil>
Duration: 156.632711ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
3.160445596s
FAIL (2025-08-22 23:29:19 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
59]: Uploading piece...
Aug 22 22:53:29.611585477 (341h27m10.342853137s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612050902 (341h27m10.343318552s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612464942 (341h27m10.343732591s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612857369 (341h27m10.34412503s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613271678 (341h27m10.344539329s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613655671 (341h27m10.344923321s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614059881 (341h27m10.345327542s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614540405 (341h27m10.345808065s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614942673 (341h27m10.346210322s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.615322797 (341h27m10.346590508s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.618240035 (341h27m10.349507685s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:30.106040273 (341h27m10.837307893s) [upload=354959]: Next returned nil segment
Aug 22 22:53:30.106057475 (341h27m10.837325105s) [upload=354959]: Waiting for error group managing segments...
Aug 22 22:53:30.265188790 (341h27m10.99645643s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.265907802 (341h27m10.997175453s) [noise=true , address=81.171.14.70:4039 , piece_id=UGLARCJIGPJ5BN2PWYD4NM62Z74HLMBKRCCYEKFP2ZAZBGWSYIRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.266528711 (341h27m10.997796351s) [noise=true , address=81.171.14.70:4035 , piece_id=6M22EYTZY734SCUSTKUGF3PNJ2QJLKMA2MAZXV6VPOOM2W4EUUUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.267544280 (341h27m10.998811931s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.268723619 (341h27m10.99999126s) [noise=true , address=89.149.201.147:4015 , piece_id=5WP6YFYWCVWL7QRS2VCDJP576AHQ66NJW742XOW324DIIXMLSBEQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270432624 (341h27m11.001700254s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270515790 (341h27m11.001783431s) [noise=true , address=81.171.14.70:4025 , piece_id=3PV4YNDGP33PBZUHYWLXRSEE3QZO2ZFL2PCEXYSSEWGGWVTFRLPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.271054975 (341h27m11.002322595s) [noise=true , address=81.171.14.70:4031 , piece_id=O6BNM3FOD76GP5I3MJKNZXREQH7XRG7ZOHDNNXRD7HKTSABASTUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.273453727 (341h27m11.004721367s) [noise=true , address=81.171.14.70:4044 , piece_id=JAMFLVIXOT4KL2OPPZGQFLV35GUPBBRX6673QJMB6YDRBZFOGG7Q, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.274998804 (341h27m11.006266424s) [noise=true , address=185.167.204.205:4027 , piece_id=NDAULJLWJRAIVPPNHYKT3WJHG5JS2F6B7RLQQXFJOL3QBNPTADMA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277211505 (341h27m11.008479146s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277435196 (341h27m11.008702816s) [noise=true , address=185.167.204.206:4072 , piece_id=XYAPWQELW5EUKLR62OGEEQVBGNQUTS2J4CC4PLPNTEXP2SWNQRIA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279287400 (341h27m11.01055504s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279410051 (341h27m11.010677681s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280438876 (341h27m11.011706507s) [noise=true , address=185.167.204.206:4056 , piece_id=BQTKVXFXDWMZCV7UBQDMJTE6DII572Q3AJM3JCTW66AP6DIWY5MQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280910263 (341h27m11.012177893s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.281986407 (341h27m11.013254028s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282394265 (341h27m11.013666674s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282761165 (341h27m11.014028785s) [noise=true , address=185.167.204.206:4062 , piece_id=C6LI537WYQRJHUVBTDJCZK35KQHT5JBBLENH5WVGPDJFWCU3RTWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283174292 (341h27m11.014441911s) [noise=true , address=185.167.204.205:4023 , piece_id=YZXWFCP5WW4ARBUTA6XNWHU3KU5U23OMASCOFORJNL6T3UZQDGWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283847198 (341h27m11.015114838s) [noise=true , address=185.167.204.206:4063 , piece_id=E7N65C5KMWXYA67LJW4FLIWRNUP45QNS7OTUYK64UMW2AVWXT7IQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.285333653 (341h27m11.016601274s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.287128550 (341h27m11.01839617s) [noise=true , address=185.167.204.205:4030 , piece_id=V5B4VQCRBKXTTY4PJRVWV5C54HV2MX7PHC53UNKKP7Y3SJJGBARA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.292510313 (341h27m11.023777933s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.296039952 (341h27m11.027307572s) [noise=true , address=185.167.204.206:4068 , piece_id=5WUPBASDPHH7SGA3HLRLN3HMLMABMZTCO5YFUFVLT2FPC4DLFCPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301208034 (341h27m11.032475664s) [noise=true , address=81.171.14.70:4046 , piece_id=4YNKZGJQYOJEB3FFDIK6XALSTARBBMPYCE4GEWIQ5RQROFUHE6CA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301226198 (341h27m11.032493828s) [seg_pos={0 0}, upload=354959]: Segment reached optimal threshold of 26 pieces.
Aug 22 22:53:30.301343489 (341h27m11.032611129s) [noise=true , address=81.171.14.70:4036 , piece_id=OTQRXXAW43EQPVOUO54E6EUPTUZLRPWMHWBV62OKMTUI5QZMDZVQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF
Aug 22 22:53:30.301530851 (341h27m11.032798481s) [noise=true , address=185.167.204.205:4033 , piece_id=ROIUSDQL7GNXUULS6VLF6OIPG6UJOJTNEYLS6THCFIOP3LTL2SBA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe): protocol: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection
Aug 22 22:53:30.301547272 (341h27m11.032814902s) [seg_pos={0 0}, upload=354959]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Aug 22 22:53:30.301638825 (341h27m11.032906455s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 22:53:30.301644756 (341h27m11.032912386s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 22:56:04.281070862 (341h29m45.012338492s) [upload=354959]: Done uploading segments...
Aug 22 22:56:04.281085750 (341h29m45.012353381s) [upload=354959]: Upload finished. err: metaclient: context deadline exceeded
Duration: 3.16046385s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
2.089434756s
FAIL (2025-08-22 23:29:18 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 23:16:12.834814859 (341h49m53.56608251s) [upload=355345]: Starting upload Aug 22 23:16:12.834855054 (341h49m53.566122675s) [upload=355345]: Done starting upload Aug 22 23:16:12.834971062 (341h49m53.566238682s) [upload=355345]: Uploading segments... Aug 22 23:16:12.835164355 (341h49m53.566431986s) [upload=355345]: Got next segment. Inline: false Aug 22 23:16:12.835197678 (341h49m53.566465298s) [upload=355345]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 23:16:12.835202087 (341h49m53.566469706s) [upload=355345]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 23:16:12.838521276 (341h49m53.569788906s) [upload=355345]: Next segment err: metaclient: Too Many Requests Aug 22 23:16:12.838537678 (341h49m53.569805297s) [upload=355345]: Done uploading segments... Aug 22 23:16:12.838546483 (341h49m53.569814104s) [upload=355345]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.089451198s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....................X......X................................] duration:
156.374024ms
FAIL (2025-08-22 23:28:36 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 22 23:04:34.193786424 (341h38m14.925054054s) [upload=355145]: Starting upload Aug 22 23:04:34.193855373 (341h38m14.925123003s) [upload=355145]: Done starting upload Aug 22 23:04:34.193917851 (341h38m14.925185481s) [upload=355145]: Uploading segments... Aug 22 23:04:34.193995587 (341h38m14.925263217s) [upload=355145]: Got next segment. Inline: true Aug 22 23:04:34.194002741 (341h38m14.925270371s) [upload=355145]: Waiting for error group managing segments... Aug 22 23:04:34.194052023 (341h38m14.925319653s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 23:04:34.194058906 (341h38m14.925326526s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 23:04:34.194063054 (341h38m14.925330684s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 23:04:34.545689514 (341h38m15.276957164s) [upload=355145]: Done uploading segments... Aug 22 23:04:34.545718478 (341h38m15.276986128s) [upload=355145]: Upload finished. err: <nil>
Duration: 156.390776ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
470.06192ms
FAIL (2025-08-22 23:28:30 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 23:16:12.834814859 (341h49m53.56608251s) [upload=355345]: Starting upload Aug 22 23:16:12.834855054 (341h49m53.566122675s) [upload=355345]: Done starting upload Aug 22 23:16:12.834971062 (341h49m53.566238682s) [upload=355345]: Uploading segments... Aug 22 23:16:12.835164355 (341h49m53.566431986s) [upload=355345]: Got next segment. Inline: false Aug 22 23:16:12.835197678 (341h49m53.566465298s) [upload=355345]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 23:16:12.835202087 (341h49m53.566469706s) [upload=355345]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 23:16:12.838521276 (341h49m53.569788906s) [upload=355345]: Next segment err: metaclient: Too Many Requests Aug 22 23:16:12.838537678 (341h49m53.569805297s) [upload=355345]: Done uploading segments... Aug 22 23:16:12.838546483 (341h49m53.569814104s) [upload=355345]: Upload finished. err: metaclient: Too Many Requests
Duration: 470.080816ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
6.985553331s
FAIL (2025-08-22 23:28:24 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
59]: Uploading piece...
Aug 22 22:53:29.611585477 (341h27m10.342853137s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612050902 (341h27m10.343318552s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612464942 (341h27m10.343732591s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612857369 (341h27m10.34412503s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613271678 (341h27m10.344539329s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613655671 (341h27m10.344923321s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614059881 (341h27m10.345327542s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614540405 (341h27m10.345808065s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614942673 (341h27m10.346210322s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.615322797 (341h27m10.346590508s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.618240035 (341h27m10.349507685s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:30.106040273 (341h27m10.837307893s) [upload=354959]: Next returned nil segment
Aug 22 22:53:30.106057475 (341h27m10.837325105s) [upload=354959]: Waiting for error group managing segments...
Aug 22 22:53:30.265188790 (341h27m10.99645643s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.265907802 (341h27m10.997175453s) [noise=true , address=81.171.14.70:4039 , piece_id=UGLARCJIGPJ5BN2PWYD4NM62Z74HLMBKRCCYEKFP2ZAZBGWSYIRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.266528711 (341h27m10.997796351s) [noise=true , address=81.171.14.70:4035 , piece_id=6M22EYTZY734SCUSTKUGF3PNJ2QJLKMA2MAZXV6VPOOM2W4EUUUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.267544280 (341h27m10.998811931s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.268723619 (341h27m10.99999126s) [noise=true , address=89.149.201.147:4015 , piece_id=5WP6YFYWCVWL7QRS2VCDJP576AHQ66NJW742XOW324DIIXMLSBEQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270432624 (341h27m11.001700254s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270515790 (341h27m11.001783431s) [noise=true , address=81.171.14.70:4025 , piece_id=3PV4YNDGP33PBZUHYWLXRSEE3QZO2ZFL2PCEXYSSEWGGWVTFRLPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.271054975 (341h27m11.002322595s) [noise=true , address=81.171.14.70:4031 , piece_id=O6BNM3FOD76GP5I3MJKNZXREQH7XRG7ZOHDNNXRD7HKTSABASTUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.273453727 (341h27m11.004721367s) [noise=true , address=81.171.14.70:4044 , piece_id=JAMFLVIXOT4KL2OPPZGQFLV35GUPBBRX6673QJMB6YDRBZFOGG7Q, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.274998804 (341h27m11.006266424s) [noise=true , address=185.167.204.205:4027 , piece_id=NDAULJLWJRAIVPPNHYKT3WJHG5JS2F6B7RLQQXFJOL3QBNPTADMA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277211505 (341h27m11.008479146s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277435196 (341h27m11.008702816s) [noise=true , address=185.167.204.206:4072 , piece_id=XYAPWQELW5EUKLR62OGEEQVBGNQUTS2J4CC4PLPNTEXP2SWNQRIA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279287400 (341h27m11.01055504s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279410051 (341h27m11.010677681s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280438876 (341h27m11.011706507s) [noise=true , address=185.167.204.206:4056 , piece_id=BQTKVXFXDWMZCV7UBQDMJTE6DII572Q3AJM3JCTW66AP6DIWY5MQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280910263 (341h27m11.012177893s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.281986407 (341h27m11.013254028s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282394265 (341h27m11.013666674s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282761165 (341h27m11.014028785s) [noise=true , address=185.167.204.206:4062 , piece_id=C6LI537WYQRJHUVBTDJCZK35KQHT5JBBLENH5WVGPDJFWCU3RTWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283174292 (341h27m11.014441911s) [noise=true , address=185.167.204.205:4023 , piece_id=YZXWFCP5WW4ARBUTA6XNWHU3KU5U23OMASCOFORJNL6T3UZQDGWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283847198 (341h27m11.015114838s) [noise=true , address=185.167.204.206:4063 , piece_id=E7N65C5KMWXYA67LJW4FLIWRNUP45QNS7OTUYK64UMW2AVWXT7IQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.285333653 (341h27m11.016601274s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.287128550 (341h27m11.01839617s) [noise=true , address=185.167.204.205:4030 , piece_id=V5B4VQCRBKXTTY4PJRVWV5C54HV2MX7PHC53UNKKP7Y3SJJGBARA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.292510313 (341h27m11.023777933s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.296039952 (341h27m11.027307572s) [noise=true , address=185.167.204.206:4068 , piece_id=5WUPBASDPHH7SGA3HLRLN3HMLMABMZTCO5YFUFVLT2FPC4DLFCPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301208034 (341h27m11.032475664s) [noise=true , address=81.171.14.70:4046 , piece_id=4YNKZGJQYOJEB3FFDIK6XALSTARBBMPYCE4GEWIQ5RQROFUHE6CA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301226198 (341h27m11.032493828s) [seg_pos={0 0}, upload=354959]: Segment reached optimal threshold of 26 pieces.
Aug 22 22:53:30.301343489 (341h27m11.032611129s) [noise=true , address=81.171.14.70:4036 , piece_id=OTQRXXAW43EQPVOUO54E6EUPTUZLRPWMHWBV62OKMTUI5QZMDZVQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF
Aug 22 22:53:30.301530851 (341h27m11.032798481s) [noise=true , address=185.167.204.205:4033 , piece_id=ROIUSDQL7GNXUULS6VLF6OIPG6UJOJTNEYLS6THCFIOP3LTL2SBA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe): protocol: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection
Aug 22 22:53:30.301547272 (341h27m11.032814902s) [seg_pos={0 0}, upload=354959]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Aug 22 22:53:30.301638825 (341h27m11.032906455s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 22:53:30.301644756 (341h27m11.032912386s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 22:56:04.281070862 (341h29m45.012338492s) [upload=354959]: Done uploading segments...
Aug 22 22:56:04.281085750 (341h29m45.012353381s) [upload=354959]: Upload finished. err: metaclient: context deadline exceeded
Duration: 6.985575625s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....................X......X...............................] duration:
360.810119ms
FAIL (2025-08-22 23:27:49 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 22 23:04:34.193786424 (341h38m14.925054054s) [upload=355145]: Starting upload Aug 22 23:04:34.193855373 (341h38m14.925123003s) [upload=355145]: Done starting upload Aug 22 23:04:34.193917851 (341h38m14.925185481s) [upload=355145]: Uploading segments... Aug 22 23:04:34.193995587 (341h38m14.925263217s) [upload=355145]: Got next segment. Inline: true Aug 22 23:04:34.194002741 (341h38m14.925270371s) [upload=355145]: Waiting for error group managing segments... Aug 22 23:04:34.194052023 (341h38m14.925319653s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 23:04:34.194058906 (341h38m14.925326526s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 23:04:34.194063054 (341h38m14.925330684s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 23:04:34.545689514 (341h38m15.276957164s) [upload=355145]: Done uploading segments... Aug 22 23:04:34.545718478 (341h38m15.276986128s) [upload=355145]: Upload finished. err: <nil>
Duration: 360.830377ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
2.827013585s
FAIL (2025-08-22 23:27:45 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 23:16:12.834814859 (341h49m53.56608251s) [upload=355345]: Starting upload Aug 22 23:16:12.834855054 (341h49m53.566122675s) [upload=355345]: Done starting upload Aug 22 23:16:12.834971062 (341h49m53.566238682s) [upload=355345]: Uploading segments... Aug 22 23:16:12.835164355 (341h49m53.566431986s) [upload=355345]: Got next segment. Inline: false Aug 22 23:16:12.835197678 (341h49m53.566465298s) [upload=355345]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 23:16:12.835202087 (341h49m53.566469706s) [upload=355345]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 23:16:12.838521276 (341h49m53.569788906s) [upload=355345]: Next segment err: metaclient: Too Many Requests Aug 22 23:16:12.838537678 (341h49m53.569805297s) [upload=355345]: Done uploading segments... Aug 22 23:16:12.838546483 (341h49m53.569814104s) [upload=355345]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.827034475s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
3.096683322s
FAIL (2025-08-22 23:27:42 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
59]: Uploading piece...
Aug 22 22:53:29.611585477 (341h27m10.342853137s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612050902 (341h27m10.343318552s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612464942 (341h27m10.343732591s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612857369 (341h27m10.34412503s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613271678 (341h27m10.344539329s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613655671 (341h27m10.344923321s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614059881 (341h27m10.345327542s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614540405 (341h27m10.345808065s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614942673 (341h27m10.346210322s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.615322797 (341h27m10.346590508s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.618240035 (341h27m10.349507685s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:30.106040273 (341h27m10.837307893s) [upload=354959]: Next returned nil segment
Aug 22 22:53:30.106057475 (341h27m10.837325105s) [upload=354959]: Waiting for error group managing segments...
Aug 22 22:53:30.265188790 (341h27m10.99645643s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.265907802 (341h27m10.997175453s) [noise=true , address=81.171.14.70:4039 , piece_id=UGLARCJIGPJ5BN2PWYD4NM62Z74HLMBKRCCYEKFP2ZAZBGWSYIRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.266528711 (341h27m10.997796351s) [noise=true , address=81.171.14.70:4035 , piece_id=6M22EYTZY734SCUSTKUGF3PNJ2QJLKMA2MAZXV6VPOOM2W4EUUUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.267544280 (341h27m10.998811931s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.268723619 (341h27m10.99999126s) [noise=true , address=89.149.201.147:4015 , piece_id=5WP6YFYWCVWL7QRS2VCDJP576AHQ66NJW742XOW324DIIXMLSBEQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270432624 (341h27m11.001700254s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270515790 (341h27m11.001783431s) [noise=true , address=81.171.14.70:4025 , piece_id=3PV4YNDGP33PBZUHYWLXRSEE3QZO2ZFL2PCEXYSSEWGGWVTFRLPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.271054975 (341h27m11.002322595s) [noise=true , address=81.171.14.70:4031 , piece_id=O6BNM3FOD76GP5I3MJKNZXREQH7XRG7ZOHDNNXRD7HKTSABASTUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.273453727 (341h27m11.004721367s) [noise=true , address=81.171.14.70:4044 , piece_id=JAMFLVIXOT4KL2OPPZGQFLV35GUPBBRX6673QJMB6YDRBZFOGG7Q, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.274998804 (341h27m11.006266424s) [noise=true , address=185.167.204.205:4027 , piece_id=NDAULJLWJRAIVPPNHYKT3WJHG5JS2F6B7RLQQXFJOL3QBNPTADMA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277211505 (341h27m11.008479146s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277435196 (341h27m11.008702816s) [noise=true , address=185.167.204.206:4072 , piece_id=XYAPWQELW5EUKLR62OGEEQVBGNQUTS2J4CC4PLPNTEXP2SWNQRIA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279287400 (341h27m11.01055504s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279410051 (341h27m11.010677681s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280438876 (341h27m11.011706507s) [noise=true , address=185.167.204.206:4056 , piece_id=BQTKVXFXDWMZCV7UBQDMJTE6DII572Q3AJM3JCTW66AP6DIWY5MQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280910263 (341h27m11.012177893s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.281986407 (341h27m11.013254028s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282394265 (341h27m11.013666674s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282761165 (341h27m11.014028785s) [noise=true , address=185.167.204.206:4062 , piece_id=C6LI537WYQRJHUVBTDJCZK35KQHT5JBBLENH5WVGPDJFWCU3RTWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283174292 (341h27m11.014441911s) [noise=true , address=185.167.204.205:4023 , piece_id=YZXWFCP5WW4ARBUTA6XNWHU3KU5U23OMASCOFORJNL6T3UZQDGWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283847198 (341h27m11.015114838s) [noise=true , address=185.167.204.206:4063 , piece_id=E7N65C5KMWXYA67LJW4FLIWRNUP45QNS7OTUYK64UMW2AVWXT7IQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.285333653 (341h27m11.016601274s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.287128550 (341h27m11.01839617s) [noise=true , address=185.167.204.205:4030 , piece_id=V5B4VQCRBKXTTY4PJRVWV5C54HV2MX7PHC53UNKKP7Y3SJJGBARA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.292510313 (341h27m11.023777933s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.296039952 (341h27m11.027307572s) [noise=true , address=185.167.204.206:4068 , piece_id=5WUPBASDPHH7SGA3HLRLN3HMLMABMZTCO5YFUFVLT2FPC4DLFCPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301208034 (341h27m11.032475664s) [noise=true , address=81.171.14.70:4046 , piece_id=4YNKZGJQYOJEB3FFDIK6XALSTARBBMPYCE4GEWIQ5RQROFUHE6CA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301226198 (341h27m11.032493828s) [seg_pos={0 0}, upload=354959]: Segment reached optimal threshold of 26 pieces.
Aug 22 22:53:30.301343489 (341h27m11.032611129s) [noise=true , address=81.171.14.70:4036 , piece_id=OTQRXXAW43EQPVOUO54E6EUPTUZLRPWMHWBV62OKMTUI5QZMDZVQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF
Aug 22 22:53:30.301530851 (341h27m11.032798481s) [noise=true , address=185.167.204.205:4033 , piece_id=ROIUSDQL7GNXUULS6VLF6OIPG6UJOJTNEYLS6THCFIOP3LTL2SBA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe): protocol: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection
Aug 22 22:53:30.301547272 (341h27m11.032814902s) [seg_pos={0 0}, upload=354959]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Aug 22 22:53:30.301638825 (341h27m11.032906455s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 22:53:30.301644756 (341h27m11.032912386s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 22:56:04.281070862 (341h29m45.012338492s) [upload=354959]: Done uploading segments...
Aug 22 22:56:04.281085750 (341h29m45.012353381s) [upload=354959]: Upload finished. err: metaclient: context deadline exceeded
Duration: 3.096705213s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
2.607460552s
FAIL (2025-08-22 23:27:20 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 23:16:12.834814859 (341h49m53.56608251s) [upload=355345]: Starting upload Aug 22 23:16:12.834855054 (341h49m53.566122675s) [upload=355345]: Done starting upload Aug 22 23:16:12.834971062 (341h49m53.566238682s) [upload=355345]: Uploading segments... Aug 22 23:16:12.835164355 (341h49m53.566431986s) [upload=355345]: Got next segment. Inline: false Aug 22 23:16:12.835197678 (341h49m53.566465298s) [upload=355345]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 23:16:12.835202087 (341h49m53.566469706s) [upload=355345]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 23:16:12.838521276 (341h49m53.569788906s) [upload=355345]: Next segment err: metaclient: Too Many Requests Aug 22 23:16:12.838537678 (341h49m53.569805297s) [upload=355345]: Done uploading segments... Aug 22 23:16:12.838546483 (341h49m53.569814104s) [upload=355345]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.607482224s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......................X......X..............................] duration:
158.077146ms
FAIL (2025-08-22 23:26:56 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 22 23:04:34.193786424 (341h38m14.925054054s) [upload=355145]: Starting upload Aug 22 23:04:34.193855373 (341h38m14.925123003s) [upload=355145]: Done starting upload Aug 22 23:04:34.193917851 (341h38m14.925185481s) [upload=355145]: Uploading segments... Aug 22 23:04:34.193995587 (341h38m14.925263217s) [upload=355145]: Got next segment. Inline: true Aug 22 23:04:34.194002741 (341h38m14.925270371s) [upload=355145]: Waiting for error group managing segments... Aug 22 23:04:34.194052023 (341h38m14.925319653s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 23:04:34.194058906 (341h38m14.925326526s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 23:04:34.194063054 (341h38m14.925330684s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 23:04:34.545689514 (341h38m15.276957164s) [upload=355145]: Done uploading segments... Aug 22 23:04:34.545718478 (341h38m15.276986128s) [upload=355145]: Upload finished. err: <nil>
Duration: 158.093326ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
6.96096687s
FAIL (2025-08-22 23:26:55 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
59]: Uploading piece...
Aug 22 22:53:29.611585477 (341h27m10.342853137s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612050902 (341h27m10.343318552s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612464942 (341h27m10.343732591s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612857369 (341h27m10.34412503s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613271678 (341h27m10.344539329s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613655671 (341h27m10.344923321s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614059881 (341h27m10.345327542s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614540405 (341h27m10.345808065s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614942673 (341h27m10.346210322s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.615322797 (341h27m10.346590508s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.618240035 (341h27m10.349507685s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:30.106040273 (341h27m10.837307893s) [upload=354959]: Next returned nil segment
Aug 22 22:53:30.106057475 (341h27m10.837325105s) [upload=354959]: Waiting for error group managing segments...
Aug 22 22:53:30.265188790 (341h27m10.99645643s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.265907802 (341h27m10.997175453s) [noise=true , address=81.171.14.70:4039 , piece_id=UGLARCJIGPJ5BN2PWYD4NM62Z74HLMBKRCCYEKFP2ZAZBGWSYIRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.266528711 (341h27m10.997796351s) [noise=true , address=81.171.14.70:4035 , piece_id=6M22EYTZY734SCUSTKUGF3PNJ2QJLKMA2MAZXV6VPOOM2W4EUUUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.267544280 (341h27m10.998811931s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.268723619 (341h27m10.99999126s) [noise=true , address=89.149.201.147:4015 , piece_id=5WP6YFYWCVWL7QRS2VCDJP576AHQ66NJW742XOW324DIIXMLSBEQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270432624 (341h27m11.001700254s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270515790 (341h27m11.001783431s) [noise=true , address=81.171.14.70:4025 , piece_id=3PV4YNDGP33PBZUHYWLXRSEE3QZO2ZFL2PCEXYSSEWGGWVTFRLPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.271054975 (341h27m11.002322595s) [noise=true , address=81.171.14.70:4031 , piece_id=O6BNM3FOD76GP5I3MJKNZXREQH7XRG7ZOHDNNXRD7HKTSABASTUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.273453727 (341h27m11.004721367s) [noise=true , address=81.171.14.70:4044 , piece_id=JAMFLVIXOT4KL2OPPZGQFLV35GUPBBRX6673QJMB6YDRBZFOGG7Q, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.274998804 (341h27m11.006266424s) [noise=true , address=185.167.204.205:4027 , piece_id=NDAULJLWJRAIVPPNHYKT3WJHG5JS2F6B7RLQQXFJOL3QBNPTADMA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277211505 (341h27m11.008479146s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277435196 (341h27m11.008702816s) [noise=true , address=185.167.204.206:4072 , piece_id=XYAPWQELW5EUKLR62OGEEQVBGNQUTS2J4CC4PLPNTEXP2SWNQRIA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279287400 (341h27m11.01055504s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279410051 (341h27m11.010677681s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280438876 (341h27m11.011706507s) [noise=true , address=185.167.204.206:4056 , piece_id=BQTKVXFXDWMZCV7UBQDMJTE6DII572Q3AJM3JCTW66AP6DIWY5MQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280910263 (341h27m11.012177893s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.281986407 (341h27m11.013254028s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282394265 (341h27m11.013666674s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282761165 (341h27m11.014028785s) [noise=true , address=185.167.204.206:4062 , piece_id=C6LI537WYQRJHUVBTDJCZK35KQHT5JBBLENH5WVGPDJFWCU3RTWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283174292 (341h27m11.014441911s) [noise=true , address=185.167.204.205:4023 , piece_id=YZXWFCP5WW4ARBUTA6XNWHU3KU5U23OMASCOFORJNL6T3UZQDGWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283847198 (341h27m11.015114838s) [noise=true , address=185.167.204.206:4063 , piece_id=E7N65C5KMWXYA67LJW4FLIWRNUP45QNS7OTUYK64UMW2AVWXT7IQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.285333653 (341h27m11.016601274s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.287128550 (341h27m11.01839617s) [noise=true , address=185.167.204.205:4030 , piece_id=V5B4VQCRBKXTTY4PJRVWV5C54HV2MX7PHC53UNKKP7Y3SJJGBARA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.292510313 (341h27m11.023777933s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.296039952 (341h27m11.027307572s) [noise=true , address=185.167.204.206:4068 , piece_id=5WUPBASDPHH7SGA3HLRLN3HMLMABMZTCO5YFUFVLT2FPC4DLFCPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301208034 (341h27m11.032475664s) [noise=true , address=81.171.14.70:4046 , piece_id=4YNKZGJQYOJEB3FFDIK6XALSTARBBMPYCE4GEWIQ5RQROFUHE6CA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301226198 (341h27m11.032493828s) [seg_pos={0 0}, upload=354959]: Segment reached optimal threshold of 26 pieces.
Aug 22 22:53:30.301343489 (341h27m11.032611129s) [noise=true , address=81.171.14.70:4036 , piece_id=OTQRXXAW43EQPVOUO54E6EUPTUZLRPWMHWBV62OKMTUI5QZMDZVQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF
Aug 22 22:53:30.301530851 (341h27m11.032798481s) [noise=true , address=185.167.204.205:4033 , piece_id=ROIUSDQL7GNXUULS6VLF6OIPG6UJOJTNEYLS6THCFIOP3LTL2SBA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe): protocol: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection
Aug 22 22:53:30.301547272 (341h27m11.032814902s) [seg_pos={0 0}, upload=354959]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Aug 22 22:53:30.301638825 (341h27m11.032906455s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 22:53:30.301644756 (341h27m11.032912386s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 22:56:04.281070862 (341h29m45.012338492s) [upload=354959]: Done uploading segments...
Aug 22 22:56:04.281085750 (341h29m45.012353381s) [upload=354959]: Upload finished. err: metaclient: context deadline exceeded
Duration: 6.960993942s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......................X......X.............................] duration:
162.690615ms
FAIL (2025-08-22 23:26:29 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 22 23:04:34.193786424 (341h38m14.925054054s) [upload=355145]: Starting upload Aug 22 23:04:34.193855373 (341h38m14.925123003s) [upload=355145]: Done starting upload Aug 22 23:04:34.193917851 (341h38m14.925185481s) [upload=355145]: Uploading segments... Aug 22 23:04:34.193995587 (341h38m14.925263217s) [upload=355145]: Got next segment. Inline: true Aug 22 23:04:34.194002741 (341h38m14.925270371s) [upload=355145]: Waiting for error group managing segments... Aug 22 23:04:34.194052023 (341h38m14.925319653s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 23:04:34.194058906 (341h38m14.925326526s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 23:04:34.194063054 (341h38m14.925330684s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 23:04:34.545689514 (341h38m15.276957164s) [upload=355145]: Done uploading segments... Aug 22 23:04:34.545718478 (341h38m15.276986128s) [upload=355145]: Upload finished. err: <nil>
Duration: 162.717806ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
1.323091427s
FAIL (2025-08-22 23:26:04 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 23:16:12.834814859 (341h49m53.56608251s) [upload=355345]: Starting upload Aug 22 23:16:12.834855054 (341h49m53.566122675s) [upload=355345]: Done starting upload Aug 22 23:16:12.834971062 (341h49m53.566238682s) [upload=355345]: Uploading segments... Aug 22 23:16:12.835164355 (341h49m53.566431986s) [upload=355345]: Got next segment. Inline: false Aug 22 23:16:12.835197678 (341h49m53.566465298s) [upload=355345]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 23:16:12.835202087 (341h49m53.566469706s) [upload=355345]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 23:16:12.838521276 (341h49m53.569788906s) [upload=355345]: Next segment err: metaclient: Too Many Requests Aug 22 23:16:12.838537678 (341h49m53.569805297s) [upload=355345]: Done uploading segments... Aug 22 23:16:12.838546483 (341h49m53.569814104s) [upload=355345]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.323110223s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
3.217909467s
FAIL (2025-08-22 23:25:58 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
59]: Uploading piece...
Aug 22 22:53:29.611585477 (341h27m10.342853137s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612050902 (341h27m10.343318552s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612464942 (341h27m10.343732591s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612857369 (341h27m10.34412503s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613271678 (341h27m10.344539329s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613655671 (341h27m10.344923321s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614059881 (341h27m10.345327542s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614540405 (341h27m10.345808065s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614942673 (341h27m10.346210322s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.615322797 (341h27m10.346590508s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.618240035 (341h27m10.349507685s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:30.106040273 (341h27m10.837307893s) [upload=354959]: Next returned nil segment
Aug 22 22:53:30.106057475 (341h27m10.837325105s) [upload=354959]: Waiting for error group managing segments...
Aug 22 22:53:30.265188790 (341h27m10.99645643s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.265907802 (341h27m10.997175453s) [noise=true , address=81.171.14.70:4039 , piece_id=UGLARCJIGPJ5BN2PWYD4NM62Z74HLMBKRCCYEKFP2ZAZBGWSYIRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.266528711 (341h27m10.997796351s) [noise=true , address=81.171.14.70:4035 , piece_id=6M22EYTZY734SCUSTKUGF3PNJ2QJLKMA2MAZXV6VPOOM2W4EUUUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.267544280 (341h27m10.998811931s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.268723619 (341h27m10.99999126s) [noise=true , address=89.149.201.147:4015 , piece_id=5WP6YFYWCVWL7QRS2VCDJP576AHQ66NJW742XOW324DIIXMLSBEQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270432624 (341h27m11.001700254s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270515790 (341h27m11.001783431s) [noise=true , address=81.171.14.70:4025 , piece_id=3PV4YNDGP33PBZUHYWLXRSEE3QZO2ZFL2PCEXYSSEWGGWVTFRLPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.271054975 (341h27m11.002322595s) [noise=true , address=81.171.14.70:4031 , piece_id=O6BNM3FOD76GP5I3MJKNZXREQH7XRG7ZOHDNNXRD7HKTSABASTUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.273453727 (341h27m11.004721367s) [noise=true , address=81.171.14.70:4044 , piece_id=JAMFLVIXOT4KL2OPPZGQFLV35GUPBBRX6673QJMB6YDRBZFOGG7Q, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.274998804 (341h27m11.006266424s) [noise=true , address=185.167.204.205:4027 , piece_id=NDAULJLWJRAIVPPNHYKT3WJHG5JS2F6B7RLQQXFJOL3QBNPTADMA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277211505 (341h27m11.008479146s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277435196 (341h27m11.008702816s) [noise=true , address=185.167.204.206:4072 , piece_id=XYAPWQELW5EUKLR62OGEEQVBGNQUTS2J4CC4PLPNTEXP2SWNQRIA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279287400 (341h27m11.01055504s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279410051 (341h27m11.010677681s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280438876 (341h27m11.011706507s) [noise=true , address=185.167.204.206:4056 , piece_id=BQTKVXFXDWMZCV7UBQDMJTE6DII572Q3AJM3JCTW66AP6DIWY5MQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280910263 (341h27m11.012177893s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.281986407 (341h27m11.013254028s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282394265 (341h27m11.013666674s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282761165 (341h27m11.014028785s) [noise=true , address=185.167.204.206:4062 , piece_id=C6LI537WYQRJHUVBTDJCZK35KQHT5JBBLENH5WVGPDJFWCU3RTWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283174292 (341h27m11.014441911s) [noise=true , address=185.167.204.205:4023 , piece_id=YZXWFCP5WW4ARBUTA6XNWHU3KU5U23OMASCOFORJNL6T3UZQDGWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283847198 (341h27m11.015114838s) [noise=true , address=185.167.204.206:4063 , piece_id=E7N65C5KMWXYA67LJW4FLIWRNUP45QNS7OTUYK64UMW2AVWXT7IQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.285333653 (341h27m11.016601274s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.287128550 (341h27m11.01839617s) [noise=true , address=185.167.204.205:4030 , piece_id=V5B4VQCRBKXTTY4PJRVWV5C54HV2MX7PHC53UNKKP7Y3SJJGBARA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.292510313 (341h27m11.023777933s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.296039952 (341h27m11.027307572s) [noise=true , address=185.167.204.206:4068 , piece_id=5WUPBASDPHH7SGA3HLRLN3HMLMABMZTCO5YFUFVLT2FPC4DLFCPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301208034 (341h27m11.032475664s) [noise=true , address=81.171.14.70:4046 , piece_id=4YNKZGJQYOJEB3FFDIK6XALSTARBBMPYCE4GEWIQ5RQROFUHE6CA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301226198 (341h27m11.032493828s) [seg_pos={0 0}, upload=354959]: Segment reached optimal threshold of 26 pieces.
Aug 22 22:53:30.301343489 (341h27m11.032611129s) [noise=true , address=81.171.14.70:4036 , piece_id=OTQRXXAW43EQPVOUO54E6EUPTUZLRPWMHWBV62OKMTUI5QZMDZVQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF
Aug 22 22:53:30.301530851 (341h27m11.032798481s) [noise=true , address=185.167.204.205:4033 , piece_id=ROIUSDQL7GNXUULS6VLF6OIPG6UJOJTNEYLS6THCFIOP3LTL2SBA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe): protocol: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection
Aug 22 22:53:30.301547272 (341h27m11.032814902s) [seg_pos={0 0}, upload=354959]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Aug 22 22:53:30.301638825 (341h27m11.032906455s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 22:53:30.301644756 (341h27m11.032912386s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 22:56:04.281070862 (341h29m45.012338492s) [upload=354959]: Done uploading segments...
Aug 22 22:56:04.281085750 (341h29m45.012353381s) [upload=354959]: Upload finished. err: metaclient: context deadline exceeded
Duration: 3.217934865s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........................X......X............................] duration:
147.2347ms
FAIL (2025-08-22 23:25:37 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 22 23:04:34.193786424 (341h38m14.925054054s) [upload=355145]: Starting upload Aug 22 23:04:34.193855373 (341h38m14.925123003s) [upload=355145]: Done starting upload Aug 22 23:04:34.193917851 (341h38m14.925185481s) [upload=355145]: Uploading segments... Aug 22 23:04:34.193995587 (341h38m14.925263217s) [upload=355145]: Got next segment. Inline: true Aug 22 23:04:34.194002741 (341h38m14.925270371s) [upload=355145]: Waiting for error group managing segments... Aug 22 23:04:34.194052023 (341h38m14.925319653s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 23:04:34.194058906 (341h38m14.925326526s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 23:04:34.194063054 (341h38m14.925330684s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 23:04:34.545689514 (341h38m15.276957164s) [upload=355145]: Done uploading segments... Aug 22 23:04:34.545718478 (341h38m15.276986128s) [upload=355145]: Upload finished. err: <nil>
Duration: 147.257944ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
1.68433129s
FAIL (2025-08-22 23:25:16 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 23:16:12.834814859 (341h49m53.56608251s) [upload=355345]: Starting upload Aug 22 23:16:12.834855054 (341h49m53.566122675s) [upload=355345]: Done starting upload Aug 22 23:16:12.834971062 (341h49m53.566238682s) [upload=355345]: Uploading segments... Aug 22 23:16:12.835164355 (341h49m53.566431986s) [upload=355345]: Got next segment. Inline: false Aug 22 23:16:12.835197678 (341h49m53.566465298s) [upload=355345]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 23:16:12.835202087 (341h49m53.566469706s) [upload=355345]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 23:16:12.838521276 (341h49m53.569788906s) [upload=355345]: Next segment err: metaclient: Too Many Requests Aug 22 23:16:12.838537678 (341h49m53.569805297s) [upload=355345]: Done uploading segments... Aug 22 23:16:12.838546483 (341h49m53.569814104s) [upload=355345]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.684371746s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
2.847413863s
FAIL (2025-08-22 23:25:11 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
59]: Uploading piece...
Aug 22 22:53:29.611585477 (341h27m10.342853137s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612050902 (341h27m10.343318552s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612464942 (341h27m10.343732591s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612857369 (341h27m10.34412503s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613271678 (341h27m10.344539329s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613655671 (341h27m10.344923321s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614059881 (341h27m10.345327542s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614540405 (341h27m10.345808065s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614942673 (341h27m10.346210322s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.615322797 (341h27m10.346590508s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.618240035 (341h27m10.349507685s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:30.106040273 (341h27m10.837307893s) [upload=354959]: Next returned nil segment
Aug 22 22:53:30.106057475 (341h27m10.837325105s) [upload=354959]: Waiting for error group managing segments...
Aug 22 22:53:30.265188790 (341h27m10.99645643s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.265907802 (341h27m10.997175453s) [noise=true , address=81.171.14.70:4039 , piece_id=UGLARCJIGPJ5BN2PWYD4NM62Z74HLMBKRCCYEKFP2ZAZBGWSYIRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.266528711 (341h27m10.997796351s) [noise=true , address=81.171.14.70:4035 , piece_id=6M22EYTZY734SCUSTKUGF3PNJ2QJLKMA2MAZXV6VPOOM2W4EUUUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.267544280 (341h27m10.998811931s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.268723619 (341h27m10.99999126s) [noise=true , address=89.149.201.147:4015 , piece_id=5WP6YFYWCVWL7QRS2VCDJP576AHQ66NJW742XOW324DIIXMLSBEQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270432624 (341h27m11.001700254s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270515790 (341h27m11.001783431s) [noise=true , address=81.171.14.70:4025 , piece_id=3PV4YNDGP33PBZUHYWLXRSEE3QZO2ZFL2PCEXYSSEWGGWVTFRLPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.271054975 (341h27m11.002322595s) [noise=true , address=81.171.14.70:4031 , piece_id=O6BNM3FOD76GP5I3MJKNZXREQH7XRG7ZOHDNNXRD7HKTSABASTUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.273453727 (341h27m11.004721367s) [noise=true , address=81.171.14.70:4044 , piece_id=JAMFLVIXOT4KL2OPPZGQFLV35GUPBBRX6673QJMB6YDRBZFOGG7Q, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.274998804 (341h27m11.006266424s) [noise=true , address=185.167.204.205:4027 , piece_id=NDAULJLWJRAIVPPNHYKT3WJHG5JS2F6B7RLQQXFJOL3QBNPTADMA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277211505 (341h27m11.008479146s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277435196 (341h27m11.008702816s) [noise=true , address=185.167.204.206:4072 , piece_id=XYAPWQELW5EUKLR62OGEEQVBGNQUTS2J4CC4PLPNTEXP2SWNQRIA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279287400 (341h27m11.01055504s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279410051 (341h27m11.010677681s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280438876 (341h27m11.011706507s) [noise=true , address=185.167.204.206:4056 , piece_id=BQTKVXFXDWMZCV7UBQDMJTE6DII572Q3AJM3JCTW66AP6DIWY5MQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280910263 (341h27m11.012177893s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.281986407 (341h27m11.013254028s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282394265 (341h27m11.013666674s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282761165 (341h27m11.014028785s) [noise=true , address=185.167.204.206:4062 , piece_id=C6LI537WYQRJHUVBTDJCZK35KQHT5JBBLENH5WVGPDJFWCU3RTWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283174292 (341h27m11.014441911s) [noise=true , address=185.167.204.205:4023 , piece_id=YZXWFCP5WW4ARBUTA6XNWHU3KU5U23OMASCOFORJNL6T3UZQDGWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283847198 (341h27m11.015114838s) [noise=true , address=185.167.204.206:4063 , piece_id=E7N65C5KMWXYA67LJW4FLIWRNUP45QNS7OTUYK64UMW2AVWXT7IQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.285333653 (341h27m11.016601274s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.287128550 (341h27m11.01839617s) [noise=true , address=185.167.204.205:4030 , piece_id=V5B4VQCRBKXTTY4PJRVWV5C54HV2MX7PHC53UNKKP7Y3SJJGBARA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.292510313 (341h27m11.023777933s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.296039952 (341h27m11.027307572s) [noise=true , address=185.167.204.206:4068 , piece_id=5WUPBASDPHH7SGA3HLRLN3HMLMABMZTCO5YFUFVLT2FPC4DLFCPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301208034 (341h27m11.032475664s) [noise=true , address=81.171.14.70:4046 , piece_id=4YNKZGJQYOJEB3FFDIK6XALSTARBBMPYCE4GEWIQ5RQROFUHE6CA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301226198 (341h27m11.032493828s) [seg_pos={0 0}, upload=354959]: Segment reached optimal threshold of 26 pieces.
Aug 22 22:53:30.301343489 (341h27m11.032611129s) [noise=true , address=81.171.14.70:4036 , piece_id=OTQRXXAW43EQPVOUO54E6EUPTUZLRPWMHWBV62OKMTUI5QZMDZVQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF
Aug 22 22:53:30.301530851 (341h27m11.032798481s) [noise=true , address=185.167.204.205:4033 , piece_id=ROIUSDQL7GNXUULS6VLF6OIPG6UJOJTNEYLS6THCFIOP3LTL2SBA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe): protocol: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection
Aug 22 22:53:30.301547272 (341h27m11.032814902s) [seg_pos={0 0}, upload=354959]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Aug 22 22:53:30.301638825 (341h27m11.032906455s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 22:53:30.301644756 (341h27m11.032912386s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 22:56:04.281070862 (341h29m45.012338492s) [upload=354959]: Done uploading segments...
Aug 22 22:56:04.281085750 (341h29m45.012353381s) [upload=354959]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.847440062s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........................X......X...........................] duration:
324.80116ms
FAIL (2025-08-22 23:24:56 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 22 23:04:34.193786424 (341h38m14.925054054s) [upload=355145]: Starting upload Aug 22 23:04:34.193855373 (341h38m14.925123003s) [upload=355145]: Done starting upload Aug 22 23:04:34.193917851 (341h38m14.925185481s) [upload=355145]: Uploading segments... Aug 22 23:04:34.193995587 (341h38m14.925263217s) [upload=355145]: Got next segment. Inline: true Aug 22 23:04:34.194002741 (341h38m14.925270371s) [upload=355145]: Waiting for error group managing segments... Aug 22 23:04:34.194052023 (341h38m14.925319653s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 23:04:34.194058906 (341h38m14.925326526s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 23:04:34.194063054 (341h38m14.925330684s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 23:04:34.545689514 (341h38m15.276957164s) [upload=355145]: Done uploading segments... Aug 22 23:04:34.545718478 (341h38m15.276986128s) [upload=355145]: Upload finished. err: <nil>
Duration: 324.82288ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
2.64963611s
FAIL (2025-08-22 23:24:51 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 23:16:12.834814859 (341h49m53.56608251s) [upload=355345]: Starting upload Aug 22 23:16:12.834855054 (341h49m53.566122675s) [upload=355345]: Done starting upload Aug 22 23:16:12.834971062 (341h49m53.566238682s) [upload=355345]: Uploading segments... Aug 22 23:16:12.835164355 (341h49m53.566431986s) [upload=355345]: Got next segment. Inline: false Aug 22 23:16:12.835197678 (341h49m53.566465298s) [upload=355345]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 23:16:12.835202087 (341h49m53.566469706s) [upload=355345]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 23:16:12.838521276 (341h49m53.569788906s) [upload=355345]: Next segment err: metaclient: Too Many Requests Aug 22 23:16:12.838537678 (341h49m53.569805297s) [upload=355345]: Done uploading segments... Aug 22 23:16:12.838546483 (341h49m53.569814104s) [upload=355345]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.649664765s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
3.804851362s
FAIL (2025-08-22 23:24:18 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
59]: Uploading piece...
Aug 22 22:53:29.611585477 (341h27m10.342853137s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612050902 (341h27m10.343318552s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612464942 (341h27m10.343732591s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.612857369 (341h27m10.34412503s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613271678 (341h27m10.344539329s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.613655671 (341h27m10.344923321s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614059881 (341h27m10.345327542s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614540405 (341h27m10.345808065s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.614942673 (341h27m10.346210322s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.615322797 (341h27m10.346590508s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:29.618240035 (341h27m10.349507685s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Uploading piece...
Aug 22 22:53:30.106040273 (341h27m10.837307893s) [upload=354959]: Next returned nil segment
Aug 22 22:53:30.106057475 (341h27m10.837325105s) [upload=354959]: Waiting for error group managing segments...
Aug 22 22:53:30.265188790 (341h27m10.99645643s) [noise=true , address=89.149.201.147:4014 , piece_id=HH6LWHGKFYM2XLQSVTFJ27XNATXX7DAYW5NRKPFLQP2ZF3T5EZKQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.265907802 (341h27m10.997175453s) [noise=true , address=81.171.14.70:4039 , piece_id=UGLARCJIGPJ5BN2PWYD4NM62Z74HLMBKRCCYEKFP2ZAZBGWSYIRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.266528711 (341h27m10.997796351s) [noise=true , address=81.171.14.70:4035 , piece_id=6M22EYTZY734SCUSTKUGF3PNJ2QJLKMA2MAZXV6VPOOM2W4EUUUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.267544280 (341h27m10.998811931s) [noise=true , address=89.149.201.147:4007 , piece_id=UVRSUCJMX7LPLYXZ5YMRSXHEE56DQJZG3SAHJT4YR2DQT3G6PSAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.268723619 (341h27m10.99999126s) [noise=true , address=89.149.201.147:4015 , piece_id=5WP6YFYWCVWL7QRS2VCDJP576AHQ66NJW742XOW324DIIXMLSBEQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270432624 (341h27m11.001700254s) [noise=true , address=81.171.14.70:4037 , piece_id=47CAE4KVY5N66X3SIB6QPEH4GQTYVTCLUDIRKAW5G4YUWX2TGZHA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.270515790 (341h27m11.001783431s) [noise=true , address=81.171.14.70:4025 , piece_id=3PV4YNDGP33PBZUHYWLXRSEE3QZO2ZFL2PCEXYSSEWGGWVTFRLPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.271054975 (341h27m11.002322595s) [noise=true , address=81.171.14.70:4031 , piece_id=O6BNM3FOD76GP5I3MJKNZXREQH7XRG7ZOHDNNXRD7HKTSABASTUA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.273453727 (341h27m11.004721367s) [noise=true , address=81.171.14.70:4044 , piece_id=JAMFLVIXOT4KL2OPPZGQFLV35GUPBBRX6673QJMB6YDRBZFOGG7Q, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.274998804 (341h27m11.006266424s) [noise=true , address=185.167.204.205:4027 , piece_id=NDAULJLWJRAIVPPNHYKT3WJHG5JS2F6B7RLQQXFJOL3QBNPTADMA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277211505 (341h27m11.008479146s) [noise=true , address=89.149.201.147:4022 , piece_id=WAQKYINQAKOLJA4EY32BPJH2MR33OLSKMA4ANUPRUCL7BWE7NPAA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.277435196 (341h27m11.008702816s) [noise=true , address=185.167.204.206:4072 , piece_id=XYAPWQELW5EUKLR62OGEEQVBGNQUTS2J4CC4PLPNTEXP2SWNQRIA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279287400 (341h27m11.01055504s) [noise=true , address=81.171.14.70:4038 , piece_id=7ZFRGJDWXT47KBKO6ZKAYFXDCXSGPPNRINIUAJERWESXB2M4U5DA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.279410051 (341h27m11.010677681s) [noise=true , address=185.167.204.206:4065 , piece_id=WXMP4Z2YLXTVQAABSR2I26OBWFNELNFLLILA5KHXKTWMSY7OFDWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280438876 (341h27m11.011706507s) [noise=true , address=185.167.204.206:4056 , piece_id=BQTKVXFXDWMZCV7UBQDMJTE6DII572Q3AJM3JCTW66AP6DIWY5MQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.280910263 (341h27m11.012177893s) [noise=true , address=185.167.204.205:4003 , piece_id=EGTTMY4UQGEVRYW3IQKHHUV2T3QCSAMI45YOCN4WSDRZQ6YDUAOA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.281986407 (341h27m11.013254028s) [noise=true , address=185.167.204.206:4054 , piece_id=TEQ2CFFXBUJDYOBDJYMM5KBGOIWSWMEAAPCJZRXCHSJBJIOMKBXQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282394265 (341h27m11.013666674s) [noise=true , address=185.167.204.205:4029 , piece_id=TKYATWBAPAOPCUVGSRRJFGTEFA3BHVNSDZLKAZUPHOHPIIY7EHRQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.282761165 (341h27m11.014028785s) [noise=true , address=185.167.204.206:4062 , piece_id=C6LI537WYQRJHUVBTDJCZK35KQHT5JBBLENH5WVGPDJFWCU3RTWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283174292 (341h27m11.014441911s) [noise=true , address=185.167.204.205:4023 , piece_id=YZXWFCP5WW4ARBUTA6XNWHU3KU5U23OMASCOFORJNL6T3UZQDGWA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.283847198 (341h27m11.015114838s) [noise=true , address=185.167.204.206:4063 , piece_id=E7N65C5KMWXYA67LJW4FLIWRNUP45QNS7OTUYK64UMW2AVWXT7IQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.285333653 (341h27m11.016601274s) [noise=true , address=185.167.204.205:4021 , piece_id=2J7CXJACBWN5XODY2RQQHNLJ7EKK7U4D4HBKNMS57D3FEM7QXS6A, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.287128550 (341h27m11.01839617s) [noise=true , address=185.167.204.205:4030 , piece_id=V5B4VQCRBKXTTY4PJRVWV5C54HV2MX7PHC53UNKKP7Y3SJJGBARA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.292510313 (341h27m11.023777933s) [noise=true , address=81.171.14.70:4034 , piece_id=AZIOZR4QP62PRACK6VS6YASXDPRUJXWMNJQHHJY5FMXLMUWTMYLA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.296039952 (341h27m11.027307572s) [noise=true , address=185.167.204.206:4068 , piece_id=5WUPBASDPHH7SGA3HLRLN3HMLMABMZTCO5YFUFVLT2FPC4DLFCPQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301208034 (341h27m11.032475664s) [noise=true , address=81.171.14.70:4046 , piece_id=4YNKZGJQYOJEB3FFDIK6XALSTARBBMPYCE4GEWIQ5RQROFUHE6CA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: <nil>
Aug 22 22:53:30.301226198 (341h27m11.032493828s) [seg_pos={0 0}, upload=354959]: Segment reached optimal threshold of 26 pieces.
Aug 22 22:53:30.301343489 (341h27m11.032611129s) [noise=true , address=81.171.14.70:4036 , piece_id=OTQRXXAW43EQPVOUO54E6EUPTUZLRPWMHWBV62OKMTUI5QZMDZVQ, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF
Aug 22 22:53:30.301530851 (341h27m11.032798481s) [noise=true , address=185.167.204.205:4033 , piece_id=ROIUSDQL7GNXUULS6VLF6OIPG6UJOJTNEYLS6THCFIOP3LTL2SBA, seg_pos={0 0}, upload=354959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe): protocol: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:46916->185.167.204.205:4033: use of closed network connection
Aug 22 22:53:30.301547272 (341h27m11.032814902s) [seg_pos={0 0}, upload=354959]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Aug 22 22:53:30.301638825 (341h27m11.032906455s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 22:53:30.301644756 (341h27m11.032912386s) [upload=354959]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 22:56:04.281070862 (341h29m45.012338492s) [upload=354959]: Done uploading segments...
Aug 22 22:56:04.281085750 (341h29m45.012353381s) [upload=354959]: Upload finished. err: metaclient: context deadline exceeded
Duration: 3.804962069s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
2.068348082s
FAIL (2025-08-22 23:24:05 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 23:16:12.834814859 (341h49m53.56608251s) [upload=355345]: Starting upload Aug 22 23:16:12.834855054 (341h49m53.566122675s) [upload=355345]: Done starting upload Aug 22 23:16:12.834971062 (341h49m53.566238682s) [upload=355345]: Uploading segments... Aug 22 23:16:12.835164355 (341h49m53.566431986s) [upload=355345]: Got next segment. Inline: false Aug 22 23:16:12.835197678 (341h49m53.566465298s) [upload=355345]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 23:16:12.835202087 (341h49m53.566469706s) [upload=355345]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 23:16:12.838521276 (341h49m53.569788906s) [upload=355345]: Next segment err: metaclient: Too Many Requests Aug 22 23:16:12.838537678 (341h49m53.569805297s) [upload=355345]: Done uploading segments... Aug 22 23:16:12.838546483 (341h49m53.569814104s) [upload=355345]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.068362539s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........................X......X..........................] duration:
258.654053ms
FAIL (2025-08-22 23:24:04 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 22 23:04:34.193786424 (341h38m14.925054054s) [upload=355145]: Starting upload Aug 22 23:04:34.193855373 (341h38m14.925123003s) [upload=355145]: Done starting upload Aug 22 23:04:34.193917851 (341h38m14.925185481s) [upload=355145]: Uploading segments... Aug 22 23:04:34.193995587 (341h38m14.925263217s) [upload=355145]: Got next segment. Inline: true Aug 22 23:04:34.194002741 (341h38m14.925270371s) [upload=355145]: Waiting for error group managing segments... Aug 22 23:04:34.194052023 (341h38m14.925319653s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 23:04:34.194058906 (341h38m14.925326526s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 23:04:34.194063054 (341h38m14.925330684s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 23:04:34.545689514 (341h38m15.276957164s) [upload=355145]: Done uploading segments... Aug 22 23:04:34.545718478 (341h38m15.276986128s) [upload=355145]: Upload finished. err: <nil>
Duration: 258.682327ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........................X......X.........................] duration:
171.564782ms
FAIL (2025-08-22 23:23:34 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 22 23:04:34.193786424 (341h38m14.925054054s) [upload=355145]: Starting upload Aug 22 23:04:34.193855373 (341h38m14.925123003s) [upload=355145]: Done starting upload Aug 22 23:04:34.193917851 (341h38m14.925185481s) [upload=355145]: Uploading segments... Aug 22 23:04:34.193995587 (341h38m14.925263217s) [upload=355145]: Got next segment. Inline: true Aug 22 23:04:34.194002741 (341h38m14.925270371s) [upload=355145]: Waiting for error group managing segments... Aug 22 23:04:34.194052023 (341h38m14.925319653s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 23:04:34.194058906 (341h38m14.925326526s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 23:04:34.194063054 (341h38m14.925330684s) [upload=355145]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 23:04:34.545689514 (341h38m15.276957164s) [upload=355145]: Done uploading segments... Aug 22 23:04:34.545718478 (341h38m15.276986128s) [upload=355145]: Upload finished. err: <nil>
Duration: 171.593496ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|