Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [......................................X.X...................] duration:
878.350794ms trace:
https://jaeger.dev.storj.io/trace/7d6ac2d67d77a8e
FAIL (2026-01-07 03:45:11 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 878.368078ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
2.096625063s trace:
https://jaeger.dev.storj.io/trace/3334419549ef794f
FAIL (2026-01-07 03:44:58 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
IRJ4NH7GCOQTJIGUXUZQHCEOSZ3AQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.867845507 (780h0m43.565413814s) [noise=true , address=81.171.14.70:4047 , piece_id=EJCUGN3SK5QJ2SJ4EJOQKFPRZ2MNWRU7YZGOION2FU6ZQB6MSGRA, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.868202545 (780h0m43.565770861s) [noise=true , address=81.171.14.70:4036 , piece_id=BBQ4LDGVSFMW4KNTJ7YG6OETOZG7QLIRJBTKLDPNDSNZBF4AT4HA, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.868539164 (780h0m43.56610748s) [noise=true , address=185.167.204.206:4057 , piece_id=UXKGFAX7BMQPCWS3EHT4NQIZPMWW5AADKCVJ3KCLZFFKNGLNIH5Q, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.868880141 (780h0m43.566448457s) [noise=true , address=81.171.14.70:4041 , piece_id=Y27EBWJKXYPD2JGGQP4FD3P54IGGMRVSHGZM3PDEQP34EDDNBIUQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.869236226 (780h0m43.566804532s) [noise=true , address=185.167.204.205:4009 , piece_id=EBCMNZL5AWY66QYIQME5COVCE2RDTFIANF6H5ZGQKMM4W6XZ2RSQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.869590868 (780h0m43.567159185s) [noise=true , address=89.149.201.147:4004 , piece_id=CNSJZVRROO57Z6JFSKAJXTIXJM5CW7LNFKUPARQYOODK62ZME25Q, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.869924462 (780h0m43.567492768s) [noise=true , address=185.167.204.206:4071 , piece_id=GI6IB5RH5RZDG6KATWRTN4VDFAT7M3DYE66JO5ILGBIPAHPCONPQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.870992627 (780h0m43.568560933s) [noise=true , address=185.167.204.205:4030 , piece_id=YYMDFRK6X7D264Z7FYECUT4H5GAQ52LW4FHX2JQ3GVL46EYCQPLA, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.872209531 (780h0m43.569777847s) [noise=true , address=81.171.14.70:4048 , piece_id=7JSD5BZR67JKHAWSE2A4J77C4WRGUTVT7AQSJUISM4YYNN2K2WJQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.873573488 (780h0m43.571141804s) [noise=true , address=81.171.14.70:4044 , piece_id=CXZP7YIMWPFFADSZD5GKUNSL4MDF7LCJ6AYKQO7JXQEAJBIZ2R4Q, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:56.325091724 (780h0m44.02266004s) [upload=686174]: Next returned nil segment
Jan 7 03:29:56.325102373 (780h0m44.022670689s) [upload=686174]: Waiting for error group managing segments...
Jan 7 03:29:56.507974282 (780h0m44.205542619s) [noise=true , address=81.171.14.70:4044 , piece_id=CXZP7YIMWPFFADSZD5GKUNSL4MDF7LCJ6AYKQO7JXQEAJBIZ2R4Q, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.510831971 (780h0m44.208400287s) [noise=true , address=185.167.204.206:4071 , piece_id=GI6IB5RH5RZDG6KATWRTN4VDFAT7M3DYE66JO5ILGBIPAHPCONPQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.512703608 (780h0m44.210271953s) [noise=true , address=185.167.204.206:4037 , piece_id=I5OOGCTL3M6AHE42FBJKXGDVOBU6G2Y4EJQWJ6HVIWDH42C25XXA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.513105689 (780h0m44.210673995s) [noise=true , address=185.167.204.206:4057 , piece_id=UXKGFAX7BMQPCWS3EHT4NQIZPMWW5AADKCVJ3KCLZFFKNGLNIH5Q, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.513837716 (780h0m44.211406052s) [noise=true , address=81.171.14.70:4048 , piece_id=7JSD5BZR67JKHAWSE2A4J77C4WRGUTVT7AQSJUISM4YYNN2K2WJQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.515147433 (780h0m44.212715769s) [noise=true , address=185.167.204.206:4068 , piece_id=YHS7B5DPLDAWU5VW4KPCCDSNZDLRHFVHP7EKRMOBRPKW7TEL3UJA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.516520046 (780h0m44.214088353s) [noise=true , address=185.167.204.206:4066 , piece_id=2CDD52BAQY47RQUCZKAQC2OBDCQA27PPY5Z726XARCV5FTHNHIDQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.516901610 (780h0m44.214469926s) [noise=true , address=185.167.204.206:4069 , piece_id=UE65STV44JVSAFQOGLTUYHI2L6IA75VPZ4BC4BS7JLK7TQ5KAVPA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.518187532 (780h0m44.215755867s) [noise=true , address=185.167.204.205:4015 , piece_id=TQL7XYTFFJ4NIYQVWVGPS5RT5R5OHEEYGAO7YYRONMRUFQNYWRMQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.518735856 (780h0m44.216304172s) [noise=true , address=89.149.201.147:4004 , piece_id=CNSJZVRROO57Z6JFSKAJXTIXJM5CW7LNFKUPARQYOODK62ZME25Q, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.520802537 (780h0m44.218370873s) [noise=true , address=81.171.14.70:4034 , piece_id=SY7EK3RNJNBL5YS4T4R6FBNIXAQB7VGRL4RDGGPJGW7OEUCJK6JA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.524619928 (780h0m44.222188274s) [noise=true , address=81.171.14.70:4047 , piece_id=EJCUGN3SK5QJ2SJ4EJOQKFPRZ2MNWRU7YZGOION2FU6ZQB6MSGRA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.530089416 (780h0m44.227657722s) [noise=true , address=185.167.204.206:4041 , piece_id=2VTQW5MDL6RWCTFV5KCWBYR56KGKVQHZREL5VUKCAWBEVFJSOKYA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.538532469 (780h0m44.236100804s) [noise=true , address=185.167.204.206:4053 , piece_id=GJOCKGE3V35P6MXVDVXX5VY75VLWLOWCY4DVHF2XQW2FUYOU3WBA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.539346680 (780h0m44.236915017s) [noise=true , address=185.167.204.205:4014 , piece_id=RIGBC2O4ARGFCPLEOOLEEP2DWDK3HTWQLDFDRJARLHBVLUQTHZKQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.540129662 (780h0m44.237697999s) [noise=true , address=185.167.204.206:4067 , piece_id=XEGSGVREIWRNLDP5DFLFOSTQNH2TSAIN4OYYRAFQX5BCYFHBRR2Q, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.541661795 (780h0m44.239230111s) [noise=true , address=81.171.14.70:4036 , piece_id=BBQ4LDGVSFMW4KNTJ7YG6OETOZG7QLIRJBTKLDPNDSNZBF4AT4HA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.549338997 (780h0m44.246907333s) [noise=true , address=185.167.204.205:4025 , piece_id=XDTBNB7H465JRLCV3MRB2KOGWJDT3QYCL7QUSW3ZMI2NXMDRKIRA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.554852136 (780h0m44.252420442s) [noise=true , address=185.167.204.205:4027 , piece_id=W7UY6AP6OUFEUDM4IFO6OHC6QQ35ARGW3DRXWFWZYYUZCIOFGAAA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.560151646 (780h0m44.257719952s) [noise=true , address=81.171.14.70:4041 , piece_id=Y27EBWJKXYPD2JGGQP4FD3P54IGGMRVSHGZM3PDEQP34EDDNBIUQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.560310303 (780h0m44.257878639s) [noise=true , address=89.149.201.147:4019 , piece_id=EBHVXES5VC6CENU26CB5WFNRKWHBXBOQ3ANBAF5Y5AL2WHOKSMZA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.560718114 (780h0m44.258286421s) [noise=true , address=185.167.204.205:4009 , piece_id=EBCMNZL5AWY66QYIQME5COVCE2RDTFIANF6H5ZGQKMM4W6XZ2RSQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.562226592 (780h0m44.259794909s) [noise=true , address=185.167.204.205:4004 , piece_id=TN3VC6E4IP5HYHUCEFVXPSPUXAVGMU4IN2BP5VOYGBX4OZRZEDQA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.563539496 (780h0m44.261107832s) [noise=true , address=81.171.14.70:4033 , piece_id=UUCMKUWY2FRDIYNURUHONEOAKORNRRVEMNNNPKQ5MIPLBLEEC6IA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.572914018 (780h0m44.270482324s) [noise=true , address=185.167.204.205:4030 , piece_id=YYMDFRK6X7D264Z7FYECUT4H5GAQ52LW4FHX2JQ3GVL46EYCQPLA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.572975022 (780h0m44.270543369s) [noise=true , address=89.149.201.147:4018 , piece_id=H53SNMW7IPSPSHZJMJ2QVQMWJGLTHLK75A7FTSULPI2KRIREFWTQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.572990171 (780h0m44.270558507s) [seg_pos={0 0}, upload=686174]: Segment reached optimal threshold of 26 pieces.
Jan 7 03:29:56.573318433 (780h0m44.270886829s) [noise=true , address=185.167.204.206:4056 , piece_id=HEJV4MAFEP47TPNEES4WCH3BAVXFOICZQHCVITMAF2ITRXNO5TMA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: expected piece hash; context canceled; EOF
Jan 7 03:29:56.573341336 (780h0m44.270909723s) [noise=true , address=185.167.204.206:4056 , piece_id=HEJV4MAFEP47TPNEES4WCH3BAVXFOICZQHCVITMAF2ITRXNO5TMA, seg_pos={0 0}, upload=686174]: Long tail cancellation due to optimal threshold
Jan 7 03:29:56.573376612 (780h0m44.270944959s) [noise=true , address=185.167.204.205:4005 , piece_id=63Y7QNGHR4J4TIQJCUFULL5IRJ4NH7GCOQTJIGUXUZQHCEOSZ3AQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12B18LegNdvxjRqBgwnFB4Aig1nt5URm9Au7bWXsfbBPyCnterM): protocol: expected piece hash; context canceled; EOF
Jan 7 03:29:56.573415235 (780h0m44.270983571s) [noise=true , address=185.167.204.205:4005 , piece_id=63Y7QNGHR4J4TIQJCUFULL5IRJ4NH7GCOQTJIGUXUZQHCEOSZ3AQ, seg_pos={0 0}, upload=686174]: Long tail cancellation due to optimal threshold
Jan 7 03:29:56.573445671 (780h0m44.271014007s) [seg_pos={0 0}, upload=686174]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 7 03:29:56.573614446 (780h0m44.271182782s) [upload=686174]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 7 03:29:56.573626158 (780h0m44.271194495s) [upload=686174]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 7 03:29:56.727636981 (780h0m44.425205288s) [upload=686174]: Done uploading segments...
Jan 7 03:29:56.727651439 (780h0m44.425219744s) [upload=686174]: Upload finished. err: <nil>
Duration: 2.096650058s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
4 out of 60 is failed (threshold=3) [..................................XX.XX.....................] duration:
2.720019827s trace:
https://jaeger.dev.storj.io/trace/5a0e658196b93032
FAIL (2026-01-07 03:44:46 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 2.720042429s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......................................X.X..................] duration:
878.146241ms trace:
https://jaeger.dev.storj.io/trace/7d6ac2d67d77a8e
FAIL (2026-01-07 03:44:43 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 878.167982ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
2.152316361s trace:
https://jaeger.dev.storj.io/trace/3334419549ef794f
FAIL (2026-01-07 03:44:31 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
IRJ4NH7GCOQTJIGUXUZQHCEOSZ3AQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.867845507 (780h0m43.565413814s) [noise=true , address=81.171.14.70:4047 , piece_id=EJCUGN3SK5QJ2SJ4EJOQKFPRZ2MNWRU7YZGOION2FU6ZQB6MSGRA, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.868202545 (780h0m43.565770861s) [noise=true , address=81.171.14.70:4036 , piece_id=BBQ4LDGVSFMW4KNTJ7YG6OETOZG7QLIRJBTKLDPNDSNZBF4AT4HA, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.868539164 (780h0m43.56610748s) [noise=true , address=185.167.204.206:4057 , piece_id=UXKGFAX7BMQPCWS3EHT4NQIZPMWW5AADKCVJ3KCLZFFKNGLNIH5Q, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.868880141 (780h0m43.566448457s) [noise=true , address=81.171.14.70:4041 , piece_id=Y27EBWJKXYPD2JGGQP4FD3P54IGGMRVSHGZM3PDEQP34EDDNBIUQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.869236226 (780h0m43.566804532s) [noise=true , address=185.167.204.205:4009 , piece_id=EBCMNZL5AWY66QYIQME5COVCE2RDTFIANF6H5ZGQKMM4W6XZ2RSQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.869590868 (780h0m43.567159185s) [noise=true , address=89.149.201.147:4004 , piece_id=CNSJZVRROO57Z6JFSKAJXTIXJM5CW7LNFKUPARQYOODK62ZME25Q, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.869924462 (780h0m43.567492768s) [noise=true , address=185.167.204.206:4071 , piece_id=GI6IB5RH5RZDG6KATWRTN4VDFAT7M3DYE66JO5ILGBIPAHPCONPQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.870992627 (780h0m43.568560933s) [noise=true , address=185.167.204.205:4030 , piece_id=YYMDFRK6X7D264Z7FYECUT4H5GAQ52LW4FHX2JQ3GVL46EYCQPLA, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.872209531 (780h0m43.569777847s) [noise=true , address=81.171.14.70:4048 , piece_id=7JSD5BZR67JKHAWSE2A4J77C4WRGUTVT7AQSJUISM4YYNN2K2WJQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.873573488 (780h0m43.571141804s) [noise=true , address=81.171.14.70:4044 , piece_id=CXZP7YIMWPFFADSZD5GKUNSL4MDF7LCJ6AYKQO7JXQEAJBIZ2R4Q, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:56.325091724 (780h0m44.02266004s) [upload=686174]: Next returned nil segment
Jan 7 03:29:56.325102373 (780h0m44.022670689s) [upload=686174]: Waiting for error group managing segments...
Jan 7 03:29:56.507974282 (780h0m44.205542619s) [noise=true , address=81.171.14.70:4044 , piece_id=CXZP7YIMWPFFADSZD5GKUNSL4MDF7LCJ6AYKQO7JXQEAJBIZ2R4Q, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.510831971 (780h0m44.208400287s) [noise=true , address=185.167.204.206:4071 , piece_id=GI6IB5RH5RZDG6KATWRTN4VDFAT7M3DYE66JO5ILGBIPAHPCONPQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.512703608 (780h0m44.210271953s) [noise=true , address=185.167.204.206:4037 , piece_id=I5OOGCTL3M6AHE42FBJKXGDVOBU6G2Y4EJQWJ6HVIWDH42C25XXA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.513105689 (780h0m44.210673995s) [noise=true , address=185.167.204.206:4057 , piece_id=UXKGFAX7BMQPCWS3EHT4NQIZPMWW5AADKCVJ3KCLZFFKNGLNIH5Q, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.513837716 (780h0m44.211406052s) [noise=true , address=81.171.14.70:4048 , piece_id=7JSD5BZR67JKHAWSE2A4J77C4WRGUTVT7AQSJUISM4YYNN2K2WJQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.515147433 (780h0m44.212715769s) [noise=true , address=185.167.204.206:4068 , piece_id=YHS7B5DPLDAWU5VW4KPCCDSNZDLRHFVHP7EKRMOBRPKW7TEL3UJA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.516520046 (780h0m44.214088353s) [noise=true , address=185.167.204.206:4066 , piece_id=2CDD52BAQY47RQUCZKAQC2OBDCQA27PPY5Z726XARCV5FTHNHIDQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.516901610 (780h0m44.214469926s) [noise=true , address=185.167.204.206:4069 , piece_id=UE65STV44JVSAFQOGLTUYHI2L6IA75VPZ4BC4BS7JLK7TQ5KAVPA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.518187532 (780h0m44.215755867s) [noise=true , address=185.167.204.205:4015 , piece_id=TQL7XYTFFJ4NIYQVWVGPS5RT5R5OHEEYGAO7YYRONMRUFQNYWRMQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.518735856 (780h0m44.216304172s) [noise=true , address=89.149.201.147:4004 , piece_id=CNSJZVRROO57Z6JFSKAJXTIXJM5CW7LNFKUPARQYOODK62ZME25Q, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.520802537 (780h0m44.218370873s) [noise=true , address=81.171.14.70:4034 , piece_id=SY7EK3RNJNBL5YS4T4R6FBNIXAQB7VGRL4RDGGPJGW7OEUCJK6JA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.524619928 (780h0m44.222188274s) [noise=true , address=81.171.14.70:4047 , piece_id=EJCUGN3SK5QJ2SJ4EJOQKFPRZ2MNWRU7YZGOION2FU6ZQB6MSGRA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.530089416 (780h0m44.227657722s) [noise=true , address=185.167.204.206:4041 , piece_id=2VTQW5MDL6RWCTFV5KCWBYR56KGKVQHZREL5VUKCAWBEVFJSOKYA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.538532469 (780h0m44.236100804s) [noise=true , address=185.167.204.206:4053 , piece_id=GJOCKGE3V35P6MXVDVXX5VY75VLWLOWCY4DVHF2XQW2FUYOU3WBA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.539346680 (780h0m44.236915017s) [noise=true , address=185.167.204.205:4014 , piece_id=RIGBC2O4ARGFCPLEOOLEEP2DWDK3HTWQLDFDRJARLHBVLUQTHZKQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.540129662 (780h0m44.237697999s) [noise=true , address=185.167.204.206:4067 , piece_id=XEGSGVREIWRNLDP5DFLFOSTQNH2TSAIN4OYYRAFQX5BCYFHBRR2Q, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.541661795 (780h0m44.239230111s) [noise=true , address=81.171.14.70:4036 , piece_id=BBQ4LDGVSFMW4KNTJ7YG6OETOZG7QLIRJBTKLDPNDSNZBF4AT4HA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.549338997 (780h0m44.246907333s) [noise=true , address=185.167.204.205:4025 , piece_id=XDTBNB7H465JRLCV3MRB2KOGWJDT3QYCL7QUSW3ZMI2NXMDRKIRA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.554852136 (780h0m44.252420442s) [noise=true , address=185.167.204.205:4027 , piece_id=W7UY6AP6OUFEUDM4IFO6OHC6QQ35ARGW3DRXWFWZYYUZCIOFGAAA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.560151646 (780h0m44.257719952s) [noise=true , address=81.171.14.70:4041 , piece_id=Y27EBWJKXYPD2JGGQP4FD3P54IGGMRVSHGZM3PDEQP34EDDNBIUQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.560310303 (780h0m44.257878639s) [noise=true , address=89.149.201.147:4019 , piece_id=EBHVXES5VC6CENU26CB5WFNRKWHBXBOQ3ANBAF5Y5AL2WHOKSMZA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.560718114 (780h0m44.258286421s) [noise=true , address=185.167.204.205:4009 , piece_id=EBCMNZL5AWY66QYIQME5COVCE2RDTFIANF6H5ZGQKMM4W6XZ2RSQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.562226592 (780h0m44.259794909s) [noise=true , address=185.167.204.205:4004 , piece_id=TN3VC6E4IP5HYHUCEFVXPSPUXAVGMU4IN2BP5VOYGBX4OZRZEDQA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.563539496 (780h0m44.261107832s) [noise=true , address=81.171.14.70:4033 , piece_id=UUCMKUWY2FRDIYNURUHONEOAKORNRRVEMNNNPKQ5MIPLBLEEC6IA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.572914018 (780h0m44.270482324s) [noise=true , address=185.167.204.205:4030 , piece_id=YYMDFRK6X7D264Z7FYECUT4H5GAQ52LW4FHX2JQ3GVL46EYCQPLA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.572975022 (780h0m44.270543369s) [noise=true , address=89.149.201.147:4018 , piece_id=H53SNMW7IPSPSHZJMJ2QVQMWJGLTHLK75A7FTSULPI2KRIREFWTQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.572990171 (780h0m44.270558507s) [seg_pos={0 0}, upload=686174]: Segment reached optimal threshold of 26 pieces.
Jan 7 03:29:56.573318433 (780h0m44.270886829s) [noise=true , address=185.167.204.206:4056 , piece_id=HEJV4MAFEP47TPNEES4WCH3BAVXFOICZQHCVITMAF2ITRXNO5TMA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: expected piece hash; context canceled; EOF
Jan 7 03:29:56.573341336 (780h0m44.270909723s) [noise=true , address=185.167.204.206:4056 , piece_id=HEJV4MAFEP47TPNEES4WCH3BAVXFOICZQHCVITMAF2ITRXNO5TMA, seg_pos={0 0}, upload=686174]: Long tail cancellation due to optimal threshold
Jan 7 03:29:56.573376612 (780h0m44.270944959s) [noise=true , address=185.167.204.205:4005 , piece_id=63Y7QNGHR4J4TIQJCUFULL5IRJ4NH7GCOQTJIGUXUZQHCEOSZ3AQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12B18LegNdvxjRqBgwnFB4Aig1nt5URm9Au7bWXsfbBPyCnterM): protocol: expected piece hash; context canceled; EOF
Jan 7 03:29:56.573415235 (780h0m44.270983571s) [noise=true , address=185.167.204.205:4005 , piece_id=63Y7QNGHR4J4TIQJCUFULL5IRJ4NH7GCOQTJIGUXUZQHCEOSZ3AQ, seg_pos={0 0}, upload=686174]: Long tail cancellation due to optimal threshold
Jan 7 03:29:56.573445671 (780h0m44.271014007s) [seg_pos={0 0}, upload=686174]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 7 03:29:56.573614446 (780h0m44.271182782s) [upload=686174]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 7 03:29:56.573626158 (780h0m44.271194495s) [upload=686174]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 7 03:29:56.727636981 (780h0m44.425205288s) [upload=686174]: Done uploading segments...
Jan 7 03:29:56.727651439 (780h0m44.425219744s) [upload=686174]: Upload finished. err: <nil>
Duration: 2.152332612s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [........................................X.X.................] duration:
1.007839643s trace:
https://jaeger.dev.storj.io/trace/7d6ac2d67d77a8e
FAIL (2026-01-07 03:44:28 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 1.007890076s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
2.108208862s trace:
https://jaeger.dev.storj.io/trace/3334419549ef794f
FAIL (2026-01-07 03:44:09 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
IRJ4NH7GCOQTJIGUXUZQHCEOSZ3AQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.867845507 (780h0m43.565413814s) [noise=true , address=81.171.14.70:4047 , piece_id=EJCUGN3SK5QJ2SJ4EJOQKFPRZ2MNWRU7YZGOION2FU6ZQB6MSGRA, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.868202545 (780h0m43.565770861s) [noise=true , address=81.171.14.70:4036 , piece_id=BBQ4LDGVSFMW4KNTJ7YG6OETOZG7QLIRJBTKLDPNDSNZBF4AT4HA, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.868539164 (780h0m43.56610748s) [noise=true , address=185.167.204.206:4057 , piece_id=UXKGFAX7BMQPCWS3EHT4NQIZPMWW5AADKCVJ3KCLZFFKNGLNIH5Q, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.868880141 (780h0m43.566448457s) [noise=true , address=81.171.14.70:4041 , piece_id=Y27EBWJKXYPD2JGGQP4FD3P54IGGMRVSHGZM3PDEQP34EDDNBIUQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.869236226 (780h0m43.566804532s) [noise=true , address=185.167.204.205:4009 , piece_id=EBCMNZL5AWY66QYIQME5COVCE2RDTFIANF6H5ZGQKMM4W6XZ2RSQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.869590868 (780h0m43.567159185s) [noise=true , address=89.149.201.147:4004 , piece_id=CNSJZVRROO57Z6JFSKAJXTIXJM5CW7LNFKUPARQYOODK62ZME25Q, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.869924462 (780h0m43.567492768s) [noise=true , address=185.167.204.206:4071 , piece_id=GI6IB5RH5RZDG6KATWRTN4VDFAT7M3DYE66JO5ILGBIPAHPCONPQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.870992627 (780h0m43.568560933s) [noise=true , address=185.167.204.205:4030 , piece_id=YYMDFRK6X7D264Z7FYECUT4H5GAQ52LW4FHX2JQ3GVL46EYCQPLA, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.872209531 (780h0m43.569777847s) [noise=true , address=81.171.14.70:4048 , piece_id=7JSD5BZR67JKHAWSE2A4J77C4WRGUTVT7AQSJUISM4YYNN2K2WJQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.873573488 (780h0m43.571141804s) [noise=true , address=81.171.14.70:4044 , piece_id=CXZP7YIMWPFFADSZD5GKUNSL4MDF7LCJ6AYKQO7JXQEAJBIZ2R4Q, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:56.325091724 (780h0m44.02266004s) [upload=686174]: Next returned nil segment
Jan 7 03:29:56.325102373 (780h0m44.022670689s) [upload=686174]: Waiting for error group managing segments...
Jan 7 03:29:56.507974282 (780h0m44.205542619s) [noise=true , address=81.171.14.70:4044 , piece_id=CXZP7YIMWPFFADSZD5GKUNSL4MDF7LCJ6AYKQO7JXQEAJBIZ2R4Q, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.510831971 (780h0m44.208400287s) [noise=true , address=185.167.204.206:4071 , piece_id=GI6IB5RH5RZDG6KATWRTN4VDFAT7M3DYE66JO5ILGBIPAHPCONPQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.512703608 (780h0m44.210271953s) [noise=true , address=185.167.204.206:4037 , piece_id=I5OOGCTL3M6AHE42FBJKXGDVOBU6G2Y4EJQWJ6HVIWDH42C25XXA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.513105689 (780h0m44.210673995s) [noise=true , address=185.167.204.206:4057 , piece_id=UXKGFAX7BMQPCWS3EHT4NQIZPMWW5AADKCVJ3KCLZFFKNGLNIH5Q, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.513837716 (780h0m44.211406052s) [noise=true , address=81.171.14.70:4048 , piece_id=7JSD5BZR67JKHAWSE2A4J77C4WRGUTVT7AQSJUISM4YYNN2K2WJQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.515147433 (780h0m44.212715769s) [noise=true , address=185.167.204.206:4068 , piece_id=YHS7B5DPLDAWU5VW4KPCCDSNZDLRHFVHP7EKRMOBRPKW7TEL3UJA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.516520046 (780h0m44.214088353s) [noise=true , address=185.167.204.206:4066 , piece_id=2CDD52BAQY47RQUCZKAQC2OBDCQA27PPY5Z726XARCV5FTHNHIDQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.516901610 (780h0m44.214469926s) [noise=true , address=185.167.204.206:4069 , piece_id=UE65STV44JVSAFQOGLTUYHI2L6IA75VPZ4BC4BS7JLK7TQ5KAVPA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.518187532 (780h0m44.215755867s) [noise=true , address=185.167.204.205:4015 , piece_id=TQL7XYTFFJ4NIYQVWVGPS5RT5R5OHEEYGAO7YYRONMRUFQNYWRMQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.518735856 (780h0m44.216304172s) [noise=true , address=89.149.201.147:4004 , piece_id=CNSJZVRROO57Z6JFSKAJXTIXJM5CW7LNFKUPARQYOODK62ZME25Q, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.520802537 (780h0m44.218370873s) [noise=true , address=81.171.14.70:4034 , piece_id=SY7EK3RNJNBL5YS4T4R6FBNIXAQB7VGRL4RDGGPJGW7OEUCJK6JA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.524619928 (780h0m44.222188274s) [noise=true , address=81.171.14.70:4047 , piece_id=EJCUGN3SK5QJ2SJ4EJOQKFPRZ2MNWRU7YZGOION2FU6ZQB6MSGRA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.530089416 (780h0m44.227657722s) [noise=true , address=185.167.204.206:4041 , piece_id=2VTQW5MDL6RWCTFV5KCWBYR56KGKVQHZREL5VUKCAWBEVFJSOKYA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.538532469 (780h0m44.236100804s) [noise=true , address=185.167.204.206:4053 , piece_id=GJOCKGE3V35P6MXVDVXX5VY75VLWLOWCY4DVHF2XQW2FUYOU3WBA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.539346680 (780h0m44.236915017s) [noise=true , address=185.167.204.205:4014 , piece_id=RIGBC2O4ARGFCPLEOOLEEP2DWDK3HTWQLDFDRJARLHBVLUQTHZKQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.540129662 (780h0m44.237697999s) [noise=true , address=185.167.204.206:4067 , piece_id=XEGSGVREIWRNLDP5DFLFOSTQNH2TSAIN4OYYRAFQX5BCYFHBRR2Q, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.541661795 (780h0m44.239230111s) [noise=true , address=81.171.14.70:4036 , piece_id=BBQ4LDGVSFMW4KNTJ7YG6OETOZG7QLIRJBTKLDPNDSNZBF4AT4HA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.549338997 (780h0m44.246907333s) [noise=true , address=185.167.204.205:4025 , piece_id=XDTBNB7H465JRLCV3MRB2KOGWJDT3QYCL7QUSW3ZMI2NXMDRKIRA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.554852136 (780h0m44.252420442s) [noise=true , address=185.167.204.205:4027 , piece_id=W7UY6AP6OUFEUDM4IFO6OHC6QQ35ARGW3DRXWFWZYYUZCIOFGAAA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.560151646 (780h0m44.257719952s) [noise=true , address=81.171.14.70:4041 , piece_id=Y27EBWJKXYPD2JGGQP4FD3P54IGGMRVSHGZM3PDEQP34EDDNBIUQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.560310303 (780h0m44.257878639s) [noise=true , address=89.149.201.147:4019 , piece_id=EBHVXES5VC6CENU26CB5WFNRKWHBXBOQ3ANBAF5Y5AL2WHOKSMZA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.560718114 (780h0m44.258286421s) [noise=true , address=185.167.204.205:4009 , piece_id=EBCMNZL5AWY66QYIQME5COVCE2RDTFIANF6H5ZGQKMM4W6XZ2RSQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.562226592 (780h0m44.259794909s) [noise=true , address=185.167.204.205:4004 , piece_id=TN3VC6E4IP5HYHUCEFVXPSPUXAVGMU4IN2BP5VOYGBX4OZRZEDQA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.563539496 (780h0m44.261107832s) [noise=true , address=81.171.14.70:4033 , piece_id=UUCMKUWY2FRDIYNURUHONEOAKORNRRVEMNNNPKQ5MIPLBLEEC6IA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.572914018 (780h0m44.270482324s) [noise=true , address=185.167.204.205:4030 , piece_id=YYMDFRK6X7D264Z7FYECUT4H5GAQ52LW4FHX2JQ3GVL46EYCQPLA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.572975022 (780h0m44.270543369s) [noise=true , address=89.149.201.147:4018 , piece_id=H53SNMW7IPSPSHZJMJ2QVQMWJGLTHLK75A7FTSULPI2KRIREFWTQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.572990171 (780h0m44.270558507s) [seg_pos={0 0}, upload=686174]: Segment reached optimal threshold of 26 pieces.
Jan 7 03:29:56.573318433 (780h0m44.270886829s) [noise=true , address=185.167.204.206:4056 , piece_id=HEJV4MAFEP47TPNEES4WCH3BAVXFOICZQHCVITMAF2ITRXNO5TMA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: expected piece hash; context canceled; EOF
Jan 7 03:29:56.573341336 (780h0m44.270909723s) [noise=true , address=185.167.204.206:4056 , piece_id=HEJV4MAFEP47TPNEES4WCH3BAVXFOICZQHCVITMAF2ITRXNO5TMA, seg_pos={0 0}, upload=686174]: Long tail cancellation due to optimal threshold
Jan 7 03:29:56.573376612 (780h0m44.270944959s) [noise=true , address=185.167.204.205:4005 , piece_id=63Y7QNGHR4J4TIQJCUFULL5IRJ4NH7GCOQTJIGUXUZQHCEOSZ3AQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12B18LegNdvxjRqBgwnFB4Aig1nt5URm9Au7bWXsfbBPyCnterM): protocol: expected piece hash; context canceled; EOF
Jan 7 03:29:56.573415235 (780h0m44.270983571s) [noise=true , address=185.167.204.205:4005 , piece_id=63Y7QNGHR4J4TIQJCUFULL5IRJ4NH7GCOQTJIGUXUZQHCEOSZ3AQ, seg_pos={0 0}, upload=686174]: Long tail cancellation due to optimal threshold
Jan 7 03:29:56.573445671 (780h0m44.271014007s) [seg_pos={0 0}, upload=686174]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 7 03:29:56.573614446 (780h0m44.271182782s) [upload=686174]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 7 03:29:56.573626158 (780h0m44.271194495s) [upload=686174]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 7 03:29:56.727636981 (780h0m44.425205288s) [upload=686174]: Done uploading segments...
Jan 7 03:29:56.727651439 (780h0m44.425219744s) [upload=686174]: Upload finished. err: <nil>
Duration: 2.108225313s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........................................X.X................] duration:
842.433164ms trace:
https://jaeger.dev.storj.io/trace/7d6ac2d67d77a8e
FAIL (2026-01-07 03:44:09 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 842.449484ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........................................X.X...............] duration:
883.305551ms trace:
https://jaeger.dev.storj.io/trace/7d6ac2d67d77a8e
FAIL (2026-01-07 03:43:52 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 883.32121ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
4 out of 60 is failed (threshold=3) [...................................XX.XX....................] duration:
3.150225931s trace:
https://jaeger.dev.storj.io/trace/5a0e658196b93032
FAIL (2026-01-07 03:43:45 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 3.150248182s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........................................X.X..............] duration:
848.145549ms trace:
https://jaeger.dev.storj.io/trace/7d6ac2d67d77a8e
FAIL (2026-01-07 03:43:21 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 848.163643ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
4 out of 60 is failed (threshold=3) [....................................XX.XX...................] duration:
2.888627306s trace:
https://jaeger.dev.storj.io/trace/5a0e658196b93032
FAIL (2026-01-07 03:43:16 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 2.888642544s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
2.101868607s trace:
https://jaeger.dev.storj.io/trace/3334419549ef794f
FAIL (2026-01-07 03:43:11 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
IRJ4NH7GCOQTJIGUXUZQHCEOSZ3AQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.867845507 (780h0m43.565413814s) [noise=true , address=81.171.14.70:4047 , piece_id=EJCUGN3SK5QJ2SJ4EJOQKFPRZ2MNWRU7YZGOION2FU6ZQB6MSGRA, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.868202545 (780h0m43.565770861s) [noise=true , address=81.171.14.70:4036 , piece_id=BBQ4LDGVSFMW4KNTJ7YG6OETOZG7QLIRJBTKLDPNDSNZBF4AT4HA, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.868539164 (780h0m43.56610748s) [noise=true , address=185.167.204.206:4057 , piece_id=UXKGFAX7BMQPCWS3EHT4NQIZPMWW5AADKCVJ3KCLZFFKNGLNIH5Q, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.868880141 (780h0m43.566448457s) [noise=true , address=81.171.14.70:4041 , piece_id=Y27EBWJKXYPD2JGGQP4FD3P54IGGMRVSHGZM3PDEQP34EDDNBIUQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.869236226 (780h0m43.566804532s) [noise=true , address=185.167.204.205:4009 , piece_id=EBCMNZL5AWY66QYIQME5COVCE2RDTFIANF6H5ZGQKMM4W6XZ2RSQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.869590868 (780h0m43.567159185s) [noise=true , address=89.149.201.147:4004 , piece_id=CNSJZVRROO57Z6JFSKAJXTIXJM5CW7LNFKUPARQYOODK62ZME25Q, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.869924462 (780h0m43.567492768s) [noise=true , address=185.167.204.206:4071 , piece_id=GI6IB5RH5RZDG6KATWRTN4VDFAT7M3DYE66JO5ILGBIPAHPCONPQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.870992627 (780h0m43.568560933s) [noise=true , address=185.167.204.205:4030 , piece_id=YYMDFRK6X7D264Z7FYECUT4H5GAQ52LW4FHX2JQ3GVL46EYCQPLA, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.872209531 (780h0m43.569777847s) [noise=true , address=81.171.14.70:4048 , piece_id=7JSD5BZR67JKHAWSE2A4J77C4WRGUTVT7AQSJUISM4YYNN2K2WJQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.873573488 (780h0m43.571141804s) [noise=true , address=81.171.14.70:4044 , piece_id=CXZP7YIMWPFFADSZD5GKUNSL4MDF7LCJ6AYKQO7JXQEAJBIZ2R4Q, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:56.325091724 (780h0m44.02266004s) [upload=686174]: Next returned nil segment
Jan 7 03:29:56.325102373 (780h0m44.022670689s) [upload=686174]: Waiting for error group managing segments...
Jan 7 03:29:56.507974282 (780h0m44.205542619s) [noise=true , address=81.171.14.70:4044 , piece_id=CXZP7YIMWPFFADSZD5GKUNSL4MDF7LCJ6AYKQO7JXQEAJBIZ2R4Q, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.510831971 (780h0m44.208400287s) [noise=true , address=185.167.204.206:4071 , piece_id=GI6IB5RH5RZDG6KATWRTN4VDFAT7M3DYE66JO5ILGBIPAHPCONPQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.512703608 (780h0m44.210271953s) [noise=true , address=185.167.204.206:4037 , piece_id=I5OOGCTL3M6AHE42FBJKXGDVOBU6G2Y4EJQWJ6HVIWDH42C25XXA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.513105689 (780h0m44.210673995s) [noise=true , address=185.167.204.206:4057 , piece_id=UXKGFAX7BMQPCWS3EHT4NQIZPMWW5AADKCVJ3KCLZFFKNGLNIH5Q, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.513837716 (780h0m44.211406052s) [noise=true , address=81.171.14.70:4048 , piece_id=7JSD5BZR67JKHAWSE2A4J77C4WRGUTVT7AQSJUISM4YYNN2K2WJQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.515147433 (780h0m44.212715769s) [noise=true , address=185.167.204.206:4068 , piece_id=YHS7B5DPLDAWU5VW4KPCCDSNZDLRHFVHP7EKRMOBRPKW7TEL3UJA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.516520046 (780h0m44.214088353s) [noise=true , address=185.167.204.206:4066 , piece_id=2CDD52BAQY47RQUCZKAQC2OBDCQA27PPY5Z726XARCV5FTHNHIDQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.516901610 (780h0m44.214469926s) [noise=true , address=185.167.204.206:4069 , piece_id=UE65STV44JVSAFQOGLTUYHI2L6IA75VPZ4BC4BS7JLK7TQ5KAVPA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.518187532 (780h0m44.215755867s) [noise=true , address=185.167.204.205:4015 , piece_id=TQL7XYTFFJ4NIYQVWVGPS5RT5R5OHEEYGAO7YYRONMRUFQNYWRMQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.518735856 (780h0m44.216304172s) [noise=true , address=89.149.201.147:4004 , piece_id=CNSJZVRROO57Z6JFSKAJXTIXJM5CW7LNFKUPARQYOODK62ZME25Q, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.520802537 (780h0m44.218370873s) [noise=true , address=81.171.14.70:4034 , piece_id=SY7EK3RNJNBL5YS4T4R6FBNIXAQB7VGRL4RDGGPJGW7OEUCJK6JA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.524619928 (780h0m44.222188274s) [noise=true , address=81.171.14.70:4047 , piece_id=EJCUGN3SK5QJ2SJ4EJOQKFPRZ2MNWRU7YZGOION2FU6ZQB6MSGRA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.530089416 (780h0m44.227657722s) [noise=true , address=185.167.204.206:4041 , piece_id=2VTQW5MDL6RWCTFV5KCWBYR56KGKVQHZREL5VUKCAWBEVFJSOKYA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.538532469 (780h0m44.236100804s) [noise=true , address=185.167.204.206:4053 , piece_id=GJOCKGE3V35P6MXVDVXX5VY75VLWLOWCY4DVHF2XQW2FUYOU3WBA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.539346680 (780h0m44.236915017s) [noise=true , address=185.167.204.205:4014 , piece_id=RIGBC2O4ARGFCPLEOOLEEP2DWDK3HTWQLDFDRJARLHBVLUQTHZKQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.540129662 (780h0m44.237697999s) [noise=true , address=185.167.204.206:4067 , piece_id=XEGSGVREIWRNLDP5DFLFOSTQNH2TSAIN4OYYRAFQX5BCYFHBRR2Q, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.541661795 (780h0m44.239230111s) [noise=true , address=81.171.14.70:4036 , piece_id=BBQ4LDGVSFMW4KNTJ7YG6OETOZG7QLIRJBTKLDPNDSNZBF4AT4HA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.549338997 (780h0m44.246907333s) [noise=true , address=185.167.204.205:4025 , piece_id=XDTBNB7H465JRLCV3MRB2KOGWJDT3QYCL7QUSW3ZMI2NXMDRKIRA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.554852136 (780h0m44.252420442s) [noise=true , address=185.167.204.205:4027 , piece_id=W7UY6AP6OUFEUDM4IFO6OHC6QQ35ARGW3DRXWFWZYYUZCIOFGAAA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.560151646 (780h0m44.257719952s) [noise=true , address=81.171.14.70:4041 , piece_id=Y27EBWJKXYPD2JGGQP4FD3P54IGGMRVSHGZM3PDEQP34EDDNBIUQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.560310303 (780h0m44.257878639s) [noise=true , address=89.149.201.147:4019 , piece_id=EBHVXES5VC6CENU26CB5WFNRKWHBXBOQ3ANBAF5Y5AL2WHOKSMZA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.560718114 (780h0m44.258286421s) [noise=true , address=185.167.204.205:4009 , piece_id=EBCMNZL5AWY66QYIQME5COVCE2RDTFIANF6H5ZGQKMM4W6XZ2RSQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.562226592 (780h0m44.259794909s) [noise=true , address=185.167.204.205:4004 , piece_id=TN3VC6E4IP5HYHUCEFVXPSPUXAVGMU4IN2BP5VOYGBX4OZRZEDQA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.563539496 (780h0m44.261107832s) [noise=true , address=81.171.14.70:4033 , piece_id=UUCMKUWY2FRDIYNURUHONEOAKORNRRVEMNNNPKQ5MIPLBLEEC6IA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.572914018 (780h0m44.270482324s) [noise=true , address=185.167.204.205:4030 , piece_id=YYMDFRK6X7D264Z7FYECUT4H5GAQ52LW4FHX2JQ3GVL46EYCQPLA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.572975022 (780h0m44.270543369s) [noise=true , address=89.149.201.147:4018 , piece_id=H53SNMW7IPSPSHZJMJ2QVQMWJGLTHLK75A7FTSULPI2KRIREFWTQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.572990171 (780h0m44.270558507s) [seg_pos={0 0}, upload=686174]: Segment reached optimal threshold of 26 pieces.
Jan 7 03:29:56.573318433 (780h0m44.270886829s) [noise=true , address=185.167.204.206:4056 , piece_id=HEJV4MAFEP47TPNEES4WCH3BAVXFOICZQHCVITMAF2ITRXNO5TMA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: expected piece hash; context canceled; EOF
Jan 7 03:29:56.573341336 (780h0m44.270909723s) [noise=true , address=185.167.204.206:4056 , piece_id=HEJV4MAFEP47TPNEES4WCH3BAVXFOICZQHCVITMAF2ITRXNO5TMA, seg_pos={0 0}, upload=686174]: Long tail cancellation due to optimal threshold
Jan 7 03:29:56.573376612 (780h0m44.270944959s) [noise=true , address=185.167.204.205:4005 , piece_id=63Y7QNGHR4J4TIQJCUFULL5IRJ4NH7GCOQTJIGUXUZQHCEOSZ3AQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12B18LegNdvxjRqBgwnFB4Aig1nt5URm9Au7bWXsfbBPyCnterM): protocol: expected piece hash; context canceled; EOF
Jan 7 03:29:56.573415235 (780h0m44.270983571s) [noise=true , address=185.167.204.205:4005 , piece_id=63Y7QNGHR4J4TIQJCUFULL5IRJ4NH7GCOQTJIGUXUZQHCEOSZ3AQ, seg_pos={0 0}, upload=686174]: Long tail cancellation due to optimal threshold
Jan 7 03:29:56.573445671 (780h0m44.271014007s) [seg_pos={0 0}, upload=686174]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 7 03:29:56.573614446 (780h0m44.271182782s) [upload=686174]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 7 03:29:56.573626158 (780h0m44.271194495s) [upload=686174]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 7 03:29:56.727636981 (780h0m44.425205288s) [upload=686174]: Done uploading segments...
Jan 7 03:29:56.727651439 (780h0m44.425219744s) [upload=686174]: Upload finished. err: <nil>
Duration: 2.101885739s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
4 out of 60 is failed (threshold=3) [.....................................XX.XX..................] duration:
2.640795426s trace:
https://jaeger.dev.storj.io/trace/5a0e658196b93032
FAIL (2026-01-07 03:42:32 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 2.640817567s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
2.197000676s trace:
https://jaeger.dev.storj.io/trace/3334419549ef794f
FAIL (2026-01-07 03:42:22 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
IRJ4NH7GCOQTJIGUXUZQHCEOSZ3AQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.867845507 (780h0m43.565413814s) [noise=true , address=81.171.14.70:4047 , piece_id=EJCUGN3SK5QJ2SJ4EJOQKFPRZ2MNWRU7YZGOION2FU6ZQB6MSGRA, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.868202545 (780h0m43.565770861s) [noise=true , address=81.171.14.70:4036 , piece_id=BBQ4LDGVSFMW4KNTJ7YG6OETOZG7QLIRJBTKLDPNDSNZBF4AT4HA, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.868539164 (780h0m43.56610748s) [noise=true , address=185.167.204.206:4057 , piece_id=UXKGFAX7BMQPCWS3EHT4NQIZPMWW5AADKCVJ3KCLZFFKNGLNIH5Q, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.868880141 (780h0m43.566448457s) [noise=true , address=81.171.14.70:4041 , piece_id=Y27EBWJKXYPD2JGGQP4FD3P54IGGMRVSHGZM3PDEQP34EDDNBIUQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.869236226 (780h0m43.566804532s) [noise=true , address=185.167.204.205:4009 , piece_id=EBCMNZL5AWY66QYIQME5COVCE2RDTFIANF6H5ZGQKMM4W6XZ2RSQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.869590868 (780h0m43.567159185s) [noise=true , address=89.149.201.147:4004 , piece_id=CNSJZVRROO57Z6JFSKAJXTIXJM5CW7LNFKUPARQYOODK62ZME25Q, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.869924462 (780h0m43.567492768s) [noise=true , address=185.167.204.206:4071 , piece_id=GI6IB5RH5RZDG6KATWRTN4VDFAT7M3DYE66JO5ILGBIPAHPCONPQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.870992627 (780h0m43.568560933s) [noise=true , address=185.167.204.205:4030 , piece_id=YYMDFRK6X7D264Z7FYECUT4H5GAQ52LW4FHX2JQ3GVL46EYCQPLA, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.872209531 (780h0m43.569777847s) [noise=true , address=81.171.14.70:4048 , piece_id=7JSD5BZR67JKHAWSE2A4J77C4WRGUTVT7AQSJUISM4YYNN2K2WJQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.873573488 (780h0m43.571141804s) [noise=true , address=81.171.14.70:4044 , piece_id=CXZP7YIMWPFFADSZD5GKUNSL4MDF7LCJ6AYKQO7JXQEAJBIZ2R4Q, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:56.325091724 (780h0m44.02266004s) [upload=686174]: Next returned nil segment
Jan 7 03:29:56.325102373 (780h0m44.022670689s) [upload=686174]: Waiting for error group managing segments...
Jan 7 03:29:56.507974282 (780h0m44.205542619s) [noise=true , address=81.171.14.70:4044 , piece_id=CXZP7YIMWPFFADSZD5GKUNSL4MDF7LCJ6AYKQO7JXQEAJBIZ2R4Q, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.510831971 (780h0m44.208400287s) [noise=true , address=185.167.204.206:4071 , piece_id=GI6IB5RH5RZDG6KATWRTN4VDFAT7M3DYE66JO5ILGBIPAHPCONPQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.512703608 (780h0m44.210271953s) [noise=true , address=185.167.204.206:4037 , piece_id=I5OOGCTL3M6AHE42FBJKXGDVOBU6G2Y4EJQWJ6HVIWDH42C25XXA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.513105689 (780h0m44.210673995s) [noise=true , address=185.167.204.206:4057 , piece_id=UXKGFAX7BMQPCWS3EHT4NQIZPMWW5AADKCVJ3KCLZFFKNGLNIH5Q, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.513837716 (780h0m44.211406052s) [noise=true , address=81.171.14.70:4048 , piece_id=7JSD5BZR67JKHAWSE2A4J77C4WRGUTVT7AQSJUISM4YYNN2K2WJQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.515147433 (780h0m44.212715769s) [noise=true , address=185.167.204.206:4068 , piece_id=YHS7B5DPLDAWU5VW4KPCCDSNZDLRHFVHP7EKRMOBRPKW7TEL3UJA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.516520046 (780h0m44.214088353s) [noise=true , address=185.167.204.206:4066 , piece_id=2CDD52BAQY47RQUCZKAQC2OBDCQA27PPY5Z726XARCV5FTHNHIDQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.516901610 (780h0m44.214469926s) [noise=true , address=185.167.204.206:4069 , piece_id=UE65STV44JVSAFQOGLTUYHI2L6IA75VPZ4BC4BS7JLK7TQ5KAVPA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.518187532 (780h0m44.215755867s) [noise=true , address=185.167.204.205:4015 , piece_id=TQL7XYTFFJ4NIYQVWVGPS5RT5R5OHEEYGAO7YYRONMRUFQNYWRMQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.518735856 (780h0m44.216304172s) [noise=true , address=89.149.201.147:4004 , piece_id=CNSJZVRROO57Z6JFSKAJXTIXJM5CW7LNFKUPARQYOODK62ZME25Q, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.520802537 (780h0m44.218370873s) [noise=true , address=81.171.14.70:4034 , piece_id=SY7EK3RNJNBL5YS4T4R6FBNIXAQB7VGRL4RDGGPJGW7OEUCJK6JA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.524619928 (780h0m44.222188274s) [noise=true , address=81.171.14.70:4047 , piece_id=EJCUGN3SK5QJ2SJ4EJOQKFPRZ2MNWRU7YZGOION2FU6ZQB6MSGRA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.530089416 (780h0m44.227657722s) [noise=true , address=185.167.204.206:4041 , piece_id=2VTQW5MDL6RWCTFV5KCWBYR56KGKVQHZREL5VUKCAWBEVFJSOKYA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.538532469 (780h0m44.236100804s) [noise=true , address=185.167.204.206:4053 , piece_id=GJOCKGE3V35P6MXVDVXX5VY75VLWLOWCY4DVHF2XQW2FUYOU3WBA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.539346680 (780h0m44.236915017s) [noise=true , address=185.167.204.205:4014 , piece_id=RIGBC2O4ARGFCPLEOOLEEP2DWDK3HTWQLDFDRJARLHBVLUQTHZKQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.540129662 (780h0m44.237697999s) [noise=true , address=185.167.204.206:4067 , piece_id=XEGSGVREIWRNLDP5DFLFOSTQNH2TSAIN4OYYRAFQX5BCYFHBRR2Q, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.541661795 (780h0m44.239230111s) [noise=true , address=81.171.14.70:4036 , piece_id=BBQ4LDGVSFMW4KNTJ7YG6OETOZG7QLIRJBTKLDPNDSNZBF4AT4HA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.549338997 (780h0m44.246907333s) [noise=true , address=185.167.204.205:4025 , piece_id=XDTBNB7H465JRLCV3MRB2KOGWJDT3QYCL7QUSW3ZMI2NXMDRKIRA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.554852136 (780h0m44.252420442s) [noise=true , address=185.167.204.205:4027 , piece_id=W7UY6AP6OUFEUDM4IFO6OHC6QQ35ARGW3DRXWFWZYYUZCIOFGAAA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.560151646 (780h0m44.257719952s) [noise=true , address=81.171.14.70:4041 , piece_id=Y27EBWJKXYPD2JGGQP4FD3P54IGGMRVSHGZM3PDEQP34EDDNBIUQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.560310303 (780h0m44.257878639s) [noise=true , address=89.149.201.147:4019 , piece_id=EBHVXES5VC6CENU26CB5WFNRKWHBXBOQ3ANBAF5Y5AL2WHOKSMZA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.560718114 (780h0m44.258286421s) [noise=true , address=185.167.204.205:4009 , piece_id=EBCMNZL5AWY66QYIQME5COVCE2RDTFIANF6H5ZGQKMM4W6XZ2RSQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.562226592 (780h0m44.259794909s) [noise=true , address=185.167.204.205:4004 , piece_id=TN3VC6E4IP5HYHUCEFVXPSPUXAVGMU4IN2BP5VOYGBX4OZRZEDQA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.563539496 (780h0m44.261107832s) [noise=true , address=81.171.14.70:4033 , piece_id=UUCMKUWY2FRDIYNURUHONEOAKORNRRVEMNNNPKQ5MIPLBLEEC6IA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.572914018 (780h0m44.270482324s) [noise=true , address=185.167.204.205:4030 , piece_id=YYMDFRK6X7D264Z7FYECUT4H5GAQ52LW4FHX2JQ3GVL46EYCQPLA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.572975022 (780h0m44.270543369s) [noise=true , address=89.149.201.147:4018 , piece_id=H53SNMW7IPSPSHZJMJ2QVQMWJGLTHLK75A7FTSULPI2KRIREFWTQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.572990171 (780h0m44.270558507s) [seg_pos={0 0}, upload=686174]: Segment reached optimal threshold of 26 pieces.
Jan 7 03:29:56.573318433 (780h0m44.270886829s) [noise=true , address=185.167.204.206:4056 , piece_id=HEJV4MAFEP47TPNEES4WCH3BAVXFOICZQHCVITMAF2ITRXNO5TMA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: expected piece hash; context canceled; EOF
Jan 7 03:29:56.573341336 (780h0m44.270909723s) [noise=true , address=185.167.204.206:4056 , piece_id=HEJV4MAFEP47TPNEES4WCH3BAVXFOICZQHCVITMAF2ITRXNO5TMA, seg_pos={0 0}, upload=686174]: Long tail cancellation due to optimal threshold
Jan 7 03:29:56.573376612 (780h0m44.270944959s) [noise=true , address=185.167.204.205:4005 , piece_id=63Y7QNGHR4J4TIQJCUFULL5IRJ4NH7GCOQTJIGUXUZQHCEOSZ3AQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12B18LegNdvxjRqBgwnFB4Aig1nt5URm9Au7bWXsfbBPyCnterM): protocol: expected piece hash; context canceled; EOF
Jan 7 03:29:56.573415235 (780h0m44.270983571s) [noise=true , address=185.167.204.205:4005 , piece_id=63Y7QNGHR4J4TIQJCUFULL5IRJ4NH7GCOQTJIGUXUZQHCEOSZ3AQ, seg_pos={0 0}, upload=686174]: Long tail cancellation due to optimal threshold
Jan 7 03:29:56.573445671 (780h0m44.271014007s) [seg_pos={0 0}, upload=686174]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 7 03:29:56.573614446 (780h0m44.271182782s) [upload=686174]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 7 03:29:56.573626158 (780h0m44.271194495s) [upload=686174]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 7 03:29:56.727636981 (780h0m44.425205288s) [upload=686174]: Done uploading segments...
Jan 7 03:29:56.727651439 (780h0m44.425219744s) [upload=686174]: Upload finished. err: <nil>
Duration: 2.197018439s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [............................................X.X.............] duration:
833.759953ms trace:
https://jaeger.dev.storj.io/trace/7d6ac2d67d77a8e
FAIL (2026-01-07 03:42:15 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 833.780232ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
4 out of 60 is failed (threshold=3) [......................................XX.XX.................] duration:
2.566823807s trace:
https://jaeger.dev.storj.io/trace/5a0e658196b93032
FAIL (2026-01-07 03:42:09 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 2.566841169s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............................................X.X............] duration:
892.722424ms trace:
https://jaeger.dev.storj.io/trace/7d6ac2d67d77a8e
FAIL (2026-01-07 03:41:48 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 892.747689ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
2.262786905s trace:
https://jaeger.dev.storj.io/trace/3334419549ef794f
FAIL (2026-01-07 03:41:18 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
IRJ4NH7GCOQTJIGUXUZQHCEOSZ3AQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.867845507 (780h0m43.565413814s) [noise=true , address=81.171.14.70:4047 , piece_id=EJCUGN3SK5QJ2SJ4EJOQKFPRZ2MNWRU7YZGOION2FU6ZQB6MSGRA, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.868202545 (780h0m43.565770861s) [noise=true , address=81.171.14.70:4036 , piece_id=BBQ4LDGVSFMW4KNTJ7YG6OETOZG7QLIRJBTKLDPNDSNZBF4AT4HA, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.868539164 (780h0m43.56610748s) [noise=true , address=185.167.204.206:4057 , piece_id=UXKGFAX7BMQPCWS3EHT4NQIZPMWW5AADKCVJ3KCLZFFKNGLNIH5Q, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.868880141 (780h0m43.566448457s) [noise=true , address=81.171.14.70:4041 , piece_id=Y27EBWJKXYPD2JGGQP4FD3P54IGGMRVSHGZM3PDEQP34EDDNBIUQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.869236226 (780h0m43.566804532s) [noise=true , address=185.167.204.205:4009 , piece_id=EBCMNZL5AWY66QYIQME5COVCE2RDTFIANF6H5ZGQKMM4W6XZ2RSQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.869590868 (780h0m43.567159185s) [noise=true , address=89.149.201.147:4004 , piece_id=CNSJZVRROO57Z6JFSKAJXTIXJM5CW7LNFKUPARQYOODK62ZME25Q, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.869924462 (780h0m43.567492768s) [noise=true , address=185.167.204.206:4071 , piece_id=GI6IB5RH5RZDG6KATWRTN4VDFAT7M3DYE66JO5ILGBIPAHPCONPQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.870992627 (780h0m43.568560933s) [noise=true , address=185.167.204.205:4030 , piece_id=YYMDFRK6X7D264Z7FYECUT4H5GAQ52LW4FHX2JQ3GVL46EYCQPLA, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.872209531 (780h0m43.569777847s) [noise=true , address=81.171.14.70:4048 , piece_id=7JSD5BZR67JKHAWSE2A4J77C4WRGUTVT7AQSJUISM4YYNN2K2WJQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.873573488 (780h0m43.571141804s) [noise=true , address=81.171.14.70:4044 , piece_id=CXZP7YIMWPFFADSZD5GKUNSL4MDF7LCJ6AYKQO7JXQEAJBIZ2R4Q, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:56.325091724 (780h0m44.02266004s) [upload=686174]: Next returned nil segment
Jan 7 03:29:56.325102373 (780h0m44.022670689s) [upload=686174]: Waiting for error group managing segments...
Jan 7 03:29:56.507974282 (780h0m44.205542619s) [noise=true , address=81.171.14.70:4044 , piece_id=CXZP7YIMWPFFADSZD5GKUNSL4MDF7LCJ6AYKQO7JXQEAJBIZ2R4Q, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.510831971 (780h0m44.208400287s) [noise=true , address=185.167.204.206:4071 , piece_id=GI6IB5RH5RZDG6KATWRTN4VDFAT7M3DYE66JO5ILGBIPAHPCONPQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.512703608 (780h0m44.210271953s) [noise=true , address=185.167.204.206:4037 , piece_id=I5OOGCTL3M6AHE42FBJKXGDVOBU6G2Y4EJQWJ6HVIWDH42C25XXA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.513105689 (780h0m44.210673995s) [noise=true , address=185.167.204.206:4057 , piece_id=UXKGFAX7BMQPCWS3EHT4NQIZPMWW5AADKCVJ3KCLZFFKNGLNIH5Q, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.513837716 (780h0m44.211406052s) [noise=true , address=81.171.14.70:4048 , piece_id=7JSD5BZR67JKHAWSE2A4J77C4WRGUTVT7AQSJUISM4YYNN2K2WJQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.515147433 (780h0m44.212715769s) [noise=true , address=185.167.204.206:4068 , piece_id=YHS7B5DPLDAWU5VW4KPCCDSNZDLRHFVHP7EKRMOBRPKW7TEL3UJA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.516520046 (780h0m44.214088353s) [noise=true , address=185.167.204.206:4066 , piece_id=2CDD52BAQY47RQUCZKAQC2OBDCQA27PPY5Z726XARCV5FTHNHIDQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.516901610 (780h0m44.214469926s) [noise=true , address=185.167.204.206:4069 , piece_id=UE65STV44JVSAFQOGLTUYHI2L6IA75VPZ4BC4BS7JLK7TQ5KAVPA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.518187532 (780h0m44.215755867s) [noise=true , address=185.167.204.205:4015 , piece_id=TQL7XYTFFJ4NIYQVWVGPS5RT5R5OHEEYGAO7YYRONMRUFQNYWRMQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.518735856 (780h0m44.216304172s) [noise=true , address=89.149.201.147:4004 , piece_id=CNSJZVRROO57Z6JFSKAJXTIXJM5CW7LNFKUPARQYOODK62ZME25Q, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.520802537 (780h0m44.218370873s) [noise=true , address=81.171.14.70:4034 , piece_id=SY7EK3RNJNBL5YS4T4R6FBNIXAQB7VGRL4RDGGPJGW7OEUCJK6JA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.524619928 (780h0m44.222188274s) [noise=true , address=81.171.14.70:4047 , piece_id=EJCUGN3SK5QJ2SJ4EJOQKFPRZ2MNWRU7YZGOION2FU6ZQB6MSGRA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.530089416 (780h0m44.227657722s) [noise=true , address=185.167.204.206:4041 , piece_id=2VTQW5MDL6RWCTFV5KCWBYR56KGKVQHZREL5VUKCAWBEVFJSOKYA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.538532469 (780h0m44.236100804s) [noise=true , address=185.167.204.206:4053 , piece_id=GJOCKGE3V35P6MXVDVXX5VY75VLWLOWCY4DVHF2XQW2FUYOU3WBA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.539346680 (780h0m44.236915017s) [noise=true , address=185.167.204.205:4014 , piece_id=RIGBC2O4ARGFCPLEOOLEEP2DWDK3HTWQLDFDRJARLHBVLUQTHZKQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.540129662 (780h0m44.237697999s) [noise=true , address=185.167.204.206:4067 , piece_id=XEGSGVREIWRNLDP5DFLFOSTQNH2TSAIN4OYYRAFQX5BCYFHBRR2Q, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.541661795 (780h0m44.239230111s) [noise=true , address=81.171.14.70:4036 , piece_id=BBQ4LDGVSFMW4KNTJ7YG6OETOZG7QLIRJBTKLDPNDSNZBF4AT4HA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.549338997 (780h0m44.246907333s) [noise=true , address=185.167.204.205:4025 , piece_id=XDTBNB7H465JRLCV3MRB2KOGWJDT3QYCL7QUSW3ZMI2NXMDRKIRA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.554852136 (780h0m44.252420442s) [noise=true , address=185.167.204.205:4027 , piece_id=W7UY6AP6OUFEUDM4IFO6OHC6QQ35ARGW3DRXWFWZYYUZCIOFGAAA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.560151646 (780h0m44.257719952s) [noise=true , address=81.171.14.70:4041 , piece_id=Y27EBWJKXYPD2JGGQP4FD3P54IGGMRVSHGZM3PDEQP34EDDNBIUQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.560310303 (780h0m44.257878639s) [noise=true , address=89.149.201.147:4019 , piece_id=EBHVXES5VC6CENU26CB5WFNRKWHBXBOQ3ANBAF5Y5AL2WHOKSMZA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.560718114 (780h0m44.258286421s) [noise=true , address=185.167.204.205:4009 , piece_id=EBCMNZL5AWY66QYIQME5COVCE2RDTFIANF6H5ZGQKMM4W6XZ2RSQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.562226592 (780h0m44.259794909s) [noise=true , address=185.167.204.205:4004 , piece_id=TN3VC6E4IP5HYHUCEFVXPSPUXAVGMU4IN2BP5VOYGBX4OZRZEDQA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.563539496 (780h0m44.261107832s) [noise=true , address=81.171.14.70:4033 , piece_id=UUCMKUWY2FRDIYNURUHONEOAKORNRRVEMNNNPKQ5MIPLBLEEC6IA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.572914018 (780h0m44.270482324s) [noise=true , address=185.167.204.205:4030 , piece_id=YYMDFRK6X7D264Z7FYECUT4H5GAQ52LW4FHX2JQ3GVL46EYCQPLA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.572975022 (780h0m44.270543369s) [noise=true , address=89.149.201.147:4018 , piece_id=H53SNMW7IPSPSHZJMJ2QVQMWJGLTHLK75A7FTSULPI2KRIREFWTQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.572990171 (780h0m44.270558507s) [seg_pos={0 0}, upload=686174]: Segment reached optimal threshold of 26 pieces.
Jan 7 03:29:56.573318433 (780h0m44.270886829s) [noise=true , address=185.167.204.206:4056 , piece_id=HEJV4MAFEP47TPNEES4WCH3BAVXFOICZQHCVITMAF2ITRXNO5TMA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: expected piece hash; context canceled; EOF
Jan 7 03:29:56.573341336 (780h0m44.270909723s) [noise=true , address=185.167.204.206:4056 , piece_id=HEJV4MAFEP47TPNEES4WCH3BAVXFOICZQHCVITMAF2ITRXNO5TMA, seg_pos={0 0}, upload=686174]: Long tail cancellation due to optimal threshold
Jan 7 03:29:56.573376612 (780h0m44.270944959s) [noise=true , address=185.167.204.205:4005 , piece_id=63Y7QNGHR4J4TIQJCUFULL5IRJ4NH7GCOQTJIGUXUZQHCEOSZ3AQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12B18LegNdvxjRqBgwnFB4Aig1nt5URm9Au7bWXsfbBPyCnterM): protocol: expected piece hash; context canceled; EOF
Jan 7 03:29:56.573415235 (780h0m44.270983571s) [noise=true , address=185.167.204.205:4005 , piece_id=63Y7QNGHR4J4TIQJCUFULL5IRJ4NH7GCOQTJIGUXUZQHCEOSZ3AQ, seg_pos={0 0}, upload=686174]: Long tail cancellation due to optimal threshold
Jan 7 03:29:56.573445671 (780h0m44.271014007s) [seg_pos={0 0}, upload=686174]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 7 03:29:56.573614446 (780h0m44.271182782s) [upload=686174]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 7 03:29:56.573626158 (780h0m44.271194495s) [upload=686174]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 7 03:29:56.727636981 (780h0m44.425205288s) [upload=686174]: Done uploading segments...
Jan 7 03:29:56.727651439 (780h0m44.425219744s) [upload=686174]: Upload finished. err: <nil>
Duration: 2.262804808s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
4 out of 60 is failed (threshold=3) [.......................................XX.XX................] duration:
2.697110657s trace:
https://jaeger.dev.storj.io/trace/5a0e658196b93032
FAIL (2026-01-07 03:41:07 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 2.697176251s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............................................X.X...........] duration:
920.007425ms trace:
https://jaeger.dev.storj.io/trace/7d6ac2d67d77a8e
FAIL (2026-01-07 03:40:35 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 920.030908ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
2.588742213s trace:
https://jaeger.dev.storj.io/trace/3334419549ef794f
FAIL (2026-01-07 03:40:17 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
IRJ4NH7GCOQTJIGUXUZQHCEOSZ3AQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.867845507 (780h0m43.565413814s) [noise=true , address=81.171.14.70:4047 , piece_id=EJCUGN3SK5QJ2SJ4EJOQKFPRZ2MNWRU7YZGOION2FU6ZQB6MSGRA, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.868202545 (780h0m43.565770861s) [noise=true , address=81.171.14.70:4036 , piece_id=BBQ4LDGVSFMW4KNTJ7YG6OETOZG7QLIRJBTKLDPNDSNZBF4AT4HA, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.868539164 (780h0m43.56610748s) [noise=true , address=185.167.204.206:4057 , piece_id=UXKGFAX7BMQPCWS3EHT4NQIZPMWW5AADKCVJ3KCLZFFKNGLNIH5Q, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.868880141 (780h0m43.566448457s) [noise=true , address=81.171.14.70:4041 , piece_id=Y27EBWJKXYPD2JGGQP4FD3P54IGGMRVSHGZM3PDEQP34EDDNBIUQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.869236226 (780h0m43.566804532s) [noise=true , address=185.167.204.205:4009 , piece_id=EBCMNZL5AWY66QYIQME5COVCE2RDTFIANF6H5ZGQKMM4W6XZ2RSQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.869590868 (780h0m43.567159185s) [noise=true , address=89.149.201.147:4004 , piece_id=CNSJZVRROO57Z6JFSKAJXTIXJM5CW7LNFKUPARQYOODK62ZME25Q, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.869924462 (780h0m43.567492768s) [noise=true , address=185.167.204.206:4071 , piece_id=GI6IB5RH5RZDG6KATWRTN4VDFAT7M3DYE66JO5ILGBIPAHPCONPQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.870992627 (780h0m43.568560933s) [noise=true , address=185.167.204.205:4030 , piece_id=YYMDFRK6X7D264Z7FYECUT4H5GAQ52LW4FHX2JQ3GVL46EYCQPLA, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.872209531 (780h0m43.569777847s) [noise=true , address=81.171.14.70:4048 , piece_id=7JSD5BZR67JKHAWSE2A4J77C4WRGUTVT7AQSJUISM4YYNN2K2WJQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.873573488 (780h0m43.571141804s) [noise=true , address=81.171.14.70:4044 , piece_id=CXZP7YIMWPFFADSZD5GKUNSL4MDF7LCJ6AYKQO7JXQEAJBIZ2R4Q, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:56.325091724 (780h0m44.02266004s) [upload=686174]: Next returned nil segment
Jan 7 03:29:56.325102373 (780h0m44.022670689s) [upload=686174]: Waiting for error group managing segments...
Jan 7 03:29:56.507974282 (780h0m44.205542619s) [noise=true , address=81.171.14.70:4044 , piece_id=CXZP7YIMWPFFADSZD5GKUNSL4MDF7LCJ6AYKQO7JXQEAJBIZ2R4Q, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.510831971 (780h0m44.208400287s) [noise=true , address=185.167.204.206:4071 , piece_id=GI6IB5RH5RZDG6KATWRTN4VDFAT7M3DYE66JO5ILGBIPAHPCONPQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.512703608 (780h0m44.210271953s) [noise=true , address=185.167.204.206:4037 , piece_id=I5OOGCTL3M6AHE42FBJKXGDVOBU6G2Y4EJQWJ6HVIWDH42C25XXA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.513105689 (780h0m44.210673995s) [noise=true , address=185.167.204.206:4057 , piece_id=UXKGFAX7BMQPCWS3EHT4NQIZPMWW5AADKCVJ3KCLZFFKNGLNIH5Q, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.513837716 (780h0m44.211406052s) [noise=true , address=81.171.14.70:4048 , piece_id=7JSD5BZR67JKHAWSE2A4J77C4WRGUTVT7AQSJUISM4YYNN2K2WJQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.515147433 (780h0m44.212715769s) [noise=true , address=185.167.204.206:4068 , piece_id=YHS7B5DPLDAWU5VW4KPCCDSNZDLRHFVHP7EKRMOBRPKW7TEL3UJA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.516520046 (780h0m44.214088353s) [noise=true , address=185.167.204.206:4066 , piece_id=2CDD52BAQY47RQUCZKAQC2OBDCQA27PPY5Z726XARCV5FTHNHIDQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.516901610 (780h0m44.214469926s) [noise=true , address=185.167.204.206:4069 , piece_id=UE65STV44JVSAFQOGLTUYHI2L6IA75VPZ4BC4BS7JLK7TQ5KAVPA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.518187532 (780h0m44.215755867s) [noise=true , address=185.167.204.205:4015 , piece_id=TQL7XYTFFJ4NIYQVWVGPS5RT5R5OHEEYGAO7YYRONMRUFQNYWRMQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.518735856 (780h0m44.216304172s) [noise=true , address=89.149.201.147:4004 , piece_id=CNSJZVRROO57Z6JFSKAJXTIXJM5CW7LNFKUPARQYOODK62ZME25Q, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.520802537 (780h0m44.218370873s) [noise=true , address=81.171.14.70:4034 , piece_id=SY7EK3RNJNBL5YS4T4R6FBNIXAQB7VGRL4RDGGPJGW7OEUCJK6JA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.524619928 (780h0m44.222188274s) [noise=true , address=81.171.14.70:4047 , piece_id=EJCUGN3SK5QJ2SJ4EJOQKFPRZ2MNWRU7YZGOION2FU6ZQB6MSGRA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.530089416 (780h0m44.227657722s) [noise=true , address=185.167.204.206:4041 , piece_id=2VTQW5MDL6RWCTFV5KCWBYR56KGKVQHZREL5VUKCAWBEVFJSOKYA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.538532469 (780h0m44.236100804s) [noise=true , address=185.167.204.206:4053 , piece_id=GJOCKGE3V35P6MXVDVXX5VY75VLWLOWCY4DVHF2XQW2FUYOU3WBA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.539346680 (780h0m44.236915017s) [noise=true , address=185.167.204.205:4014 , piece_id=RIGBC2O4ARGFCPLEOOLEEP2DWDK3HTWQLDFDRJARLHBVLUQTHZKQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.540129662 (780h0m44.237697999s) [noise=true , address=185.167.204.206:4067 , piece_id=XEGSGVREIWRNLDP5DFLFOSTQNH2TSAIN4OYYRAFQX5BCYFHBRR2Q, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.541661795 (780h0m44.239230111s) [noise=true , address=81.171.14.70:4036 , piece_id=BBQ4LDGVSFMW4KNTJ7YG6OETOZG7QLIRJBTKLDPNDSNZBF4AT4HA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.549338997 (780h0m44.246907333s) [noise=true , address=185.167.204.205:4025 , piece_id=XDTBNB7H465JRLCV3MRB2KOGWJDT3QYCL7QUSW3ZMI2NXMDRKIRA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.554852136 (780h0m44.252420442s) [noise=true , address=185.167.204.205:4027 , piece_id=W7UY6AP6OUFEUDM4IFO6OHC6QQ35ARGW3DRXWFWZYYUZCIOFGAAA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.560151646 (780h0m44.257719952s) [noise=true , address=81.171.14.70:4041 , piece_id=Y27EBWJKXYPD2JGGQP4FD3P54IGGMRVSHGZM3PDEQP34EDDNBIUQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.560310303 (780h0m44.257878639s) [noise=true , address=89.149.201.147:4019 , piece_id=EBHVXES5VC6CENU26CB5WFNRKWHBXBOQ3ANBAF5Y5AL2WHOKSMZA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.560718114 (780h0m44.258286421s) [noise=true , address=185.167.204.205:4009 , piece_id=EBCMNZL5AWY66QYIQME5COVCE2RDTFIANF6H5ZGQKMM4W6XZ2RSQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.562226592 (780h0m44.259794909s) [noise=true , address=185.167.204.205:4004 , piece_id=TN3VC6E4IP5HYHUCEFVXPSPUXAVGMU4IN2BP5VOYGBX4OZRZEDQA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.563539496 (780h0m44.261107832s) [noise=true , address=81.171.14.70:4033 , piece_id=UUCMKUWY2FRDIYNURUHONEOAKORNRRVEMNNNPKQ5MIPLBLEEC6IA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.572914018 (780h0m44.270482324s) [noise=true , address=185.167.204.205:4030 , piece_id=YYMDFRK6X7D264Z7FYECUT4H5GAQ52LW4FHX2JQ3GVL46EYCQPLA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.572975022 (780h0m44.270543369s) [noise=true , address=89.149.201.147:4018 , piece_id=H53SNMW7IPSPSHZJMJ2QVQMWJGLTHLK75A7FTSULPI2KRIREFWTQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.572990171 (780h0m44.270558507s) [seg_pos={0 0}, upload=686174]: Segment reached optimal threshold of 26 pieces.
Jan 7 03:29:56.573318433 (780h0m44.270886829s) [noise=true , address=185.167.204.206:4056 , piece_id=HEJV4MAFEP47TPNEES4WCH3BAVXFOICZQHCVITMAF2ITRXNO5TMA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: expected piece hash; context canceled; EOF
Jan 7 03:29:56.573341336 (780h0m44.270909723s) [noise=true , address=185.167.204.206:4056 , piece_id=HEJV4MAFEP47TPNEES4WCH3BAVXFOICZQHCVITMAF2ITRXNO5TMA, seg_pos={0 0}, upload=686174]: Long tail cancellation due to optimal threshold
Jan 7 03:29:56.573376612 (780h0m44.270944959s) [noise=true , address=185.167.204.205:4005 , piece_id=63Y7QNGHR4J4TIQJCUFULL5IRJ4NH7GCOQTJIGUXUZQHCEOSZ3AQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12B18LegNdvxjRqBgwnFB4Aig1nt5URm9Au7bWXsfbBPyCnterM): protocol: expected piece hash; context canceled; EOF
Jan 7 03:29:56.573415235 (780h0m44.270983571s) [noise=true , address=185.167.204.205:4005 , piece_id=63Y7QNGHR4J4TIQJCUFULL5IRJ4NH7GCOQTJIGUXUZQHCEOSZ3AQ, seg_pos={0 0}, upload=686174]: Long tail cancellation due to optimal threshold
Jan 7 03:29:56.573445671 (780h0m44.271014007s) [seg_pos={0 0}, upload=686174]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 7 03:29:56.573614446 (780h0m44.271182782s) [upload=686174]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 7 03:29:56.573626158 (780h0m44.271194495s) [upload=686174]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 7 03:29:56.727636981 (780h0m44.425205288s) [upload=686174]: Done uploading segments...
Jan 7 03:29:56.727651439 (780h0m44.425219744s) [upload=686174]: Upload finished. err: <nil>
Duration: 2.588755919s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
4 out of 60 is failed (threshold=3) [........................................XX.XX...............] duration:
2.64140797s trace:
https://jaeger.dev.storj.io/trace/5a0e658196b93032
FAIL (2026-01-07 03:40:10 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 2.641432284s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............................................X.X..........] duration:
856.065943ms trace:
https://jaeger.dev.storj.io/trace/7d6ac2d67d77a8e
FAIL (2026-01-07 03:39:57 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 856.083055ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
4 out of 60 is failed (threshold=3) [.........................................XX.XX..............] duration:
2.738829363s trace:
https://jaeger.dev.storj.io/trace/5a0e658196b93032
FAIL (2026-01-07 03:39:49 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 2.738849711s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
2.097868014s trace:
https://jaeger.dev.storj.io/trace/3334419549ef794f
FAIL (2026-01-07 03:39:45 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
IRJ4NH7GCOQTJIGUXUZQHCEOSZ3AQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.867845507 (780h0m43.565413814s) [noise=true , address=81.171.14.70:4047 , piece_id=EJCUGN3SK5QJ2SJ4EJOQKFPRZ2MNWRU7YZGOION2FU6ZQB6MSGRA, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.868202545 (780h0m43.565770861s) [noise=true , address=81.171.14.70:4036 , piece_id=BBQ4LDGVSFMW4KNTJ7YG6OETOZG7QLIRJBTKLDPNDSNZBF4AT4HA, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.868539164 (780h0m43.56610748s) [noise=true , address=185.167.204.206:4057 , piece_id=UXKGFAX7BMQPCWS3EHT4NQIZPMWW5AADKCVJ3KCLZFFKNGLNIH5Q, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.868880141 (780h0m43.566448457s) [noise=true , address=81.171.14.70:4041 , piece_id=Y27EBWJKXYPD2JGGQP4FD3P54IGGMRVSHGZM3PDEQP34EDDNBIUQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.869236226 (780h0m43.566804532s) [noise=true , address=185.167.204.205:4009 , piece_id=EBCMNZL5AWY66QYIQME5COVCE2RDTFIANF6H5ZGQKMM4W6XZ2RSQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.869590868 (780h0m43.567159185s) [noise=true , address=89.149.201.147:4004 , piece_id=CNSJZVRROO57Z6JFSKAJXTIXJM5CW7LNFKUPARQYOODK62ZME25Q, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.869924462 (780h0m43.567492768s) [noise=true , address=185.167.204.206:4071 , piece_id=GI6IB5RH5RZDG6KATWRTN4VDFAT7M3DYE66JO5ILGBIPAHPCONPQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.870992627 (780h0m43.568560933s) [noise=true , address=185.167.204.205:4030 , piece_id=YYMDFRK6X7D264Z7FYECUT4H5GAQ52LW4FHX2JQ3GVL46EYCQPLA, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.872209531 (780h0m43.569777847s) [noise=true , address=81.171.14.70:4048 , piece_id=7JSD5BZR67JKHAWSE2A4J77C4WRGUTVT7AQSJUISM4YYNN2K2WJQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.873573488 (780h0m43.571141804s) [noise=true , address=81.171.14.70:4044 , piece_id=CXZP7YIMWPFFADSZD5GKUNSL4MDF7LCJ6AYKQO7JXQEAJBIZ2R4Q, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:56.325091724 (780h0m44.02266004s) [upload=686174]: Next returned nil segment
Jan 7 03:29:56.325102373 (780h0m44.022670689s) [upload=686174]: Waiting for error group managing segments...
Jan 7 03:29:56.507974282 (780h0m44.205542619s) [noise=true , address=81.171.14.70:4044 , piece_id=CXZP7YIMWPFFADSZD5GKUNSL4MDF7LCJ6AYKQO7JXQEAJBIZ2R4Q, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.510831971 (780h0m44.208400287s) [noise=true , address=185.167.204.206:4071 , piece_id=GI6IB5RH5RZDG6KATWRTN4VDFAT7M3DYE66JO5ILGBIPAHPCONPQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.512703608 (780h0m44.210271953s) [noise=true , address=185.167.204.206:4037 , piece_id=I5OOGCTL3M6AHE42FBJKXGDVOBU6G2Y4EJQWJ6HVIWDH42C25XXA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.513105689 (780h0m44.210673995s) [noise=true , address=185.167.204.206:4057 , piece_id=UXKGFAX7BMQPCWS3EHT4NQIZPMWW5AADKCVJ3KCLZFFKNGLNIH5Q, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.513837716 (780h0m44.211406052s) [noise=true , address=81.171.14.70:4048 , piece_id=7JSD5BZR67JKHAWSE2A4J77C4WRGUTVT7AQSJUISM4YYNN2K2WJQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.515147433 (780h0m44.212715769s) [noise=true , address=185.167.204.206:4068 , piece_id=YHS7B5DPLDAWU5VW4KPCCDSNZDLRHFVHP7EKRMOBRPKW7TEL3UJA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.516520046 (780h0m44.214088353s) [noise=true , address=185.167.204.206:4066 , piece_id=2CDD52BAQY47RQUCZKAQC2OBDCQA27PPY5Z726XARCV5FTHNHIDQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.516901610 (780h0m44.214469926s) [noise=true , address=185.167.204.206:4069 , piece_id=UE65STV44JVSAFQOGLTUYHI2L6IA75VPZ4BC4BS7JLK7TQ5KAVPA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.518187532 (780h0m44.215755867s) [noise=true , address=185.167.204.205:4015 , piece_id=TQL7XYTFFJ4NIYQVWVGPS5RT5R5OHEEYGAO7YYRONMRUFQNYWRMQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.518735856 (780h0m44.216304172s) [noise=true , address=89.149.201.147:4004 , piece_id=CNSJZVRROO57Z6JFSKAJXTIXJM5CW7LNFKUPARQYOODK62ZME25Q, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.520802537 (780h0m44.218370873s) [noise=true , address=81.171.14.70:4034 , piece_id=SY7EK3RNJNBL5YS4T4R6FBNIXAQB7VGRL4RDGGPJGW7OEUCJK6JA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.524619928 (780h0m44.222188274s) [noise=true , address=81.171.14.70:4047 , piece_id=EJCUGN3SK5QJ2SJ4EJOQKFPRZ2MNWRU7YZGOION2FU6ZQB6MSGRA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.530089416 (780h0m44.227657722s) [noise=true , address=185.167.204.206:4041 , piece_id=2VTQW5MDL6RWCTFV5KCWBYR56KGKVQHZREL5VUKCAWBEVFJSOKYA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.538532469 (780h0m44.236100804s) [noise=true , address=185.167.204.206:4053 , piece_id=GJOCKGE3V35P6MXVDVXX5VY75VLWLOWCY4DVHF2XQW2FUYOU3WBA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.539346680 (780h0m44.236915017s) [noise=true , address=185.167.204.205:4014 , piece_id=RIGBC2O4ARGFCPLEOOLEEP2DWDK3HTWQLDFDRJARLHBVLUQTHZKQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.540129662 (780h0m44.237697999s) [noise=true , address=185.167.204.206:4067 , piece_id=XEGSGVREIWRNLDP5DFLFOSTQNH2TSAIN4OYYRAFQX5BCYFHBRR2Q, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.541661795 (780h0m44.239230111s) [noise=true , address=81.171.14.70:4036 , piece_id=BBQ4LDGVSFMW4KNTJ7YG6OETOZG7QLIRJBTKLDPNDSNZBF4AT4HA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.549338997 (780h0m44.246907333s) [noise=true , address=185.167.204.205:4025 , piece_id=XDTBNB7H465JRLCV3MRB2KOGWJDT3QYCL7QUSW3ZMI2NXMDRKIRA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.554852136 (780h0m44.252420442s) [noise=true , address=185.167.204.205:4027 , piece_id=W7UY6AP6OUFEUDM4IFO6OHC6QQ35ARGW3DRXWFWZYYUZCIOFGAAA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.560151646 (780h0m44.257719952s) [noise=true , address=81.171.14.70:4041 , piece_id=Y27EBWJKXYPD2JGGQP4FD3P54IGGMRVSHGZM3PDEQP34EDDNBIUQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.560310303 (780h0m44.257878639s) [noise=true , address=89.149.201.147:4019 , piece_id=EBHVXES5VC6CENU26CB5WFNRKWHBXBOQ3ANBAF5Y5AL2WHOKSMZA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.560718114 (780h0m44.258286421s) [noise=true , address=185.167.204.205:4009 , piece_id=EBCMNZL5AWY66QYIQME5COVCE2RDTFIANF6H5ZGQKMM4W6XZ2RSQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.562226592 (780h0m44.259794909s) [noise=true , address=185.167.204.205:4004 , piece_id=TN3VC6E4IP5HYHUCEFVXPSPUXAVGMU4IN2BP5VOYGBX4OZRZEDQA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.563539496 (780h0m44.261107832s) [noise=true , address=81.171.14.70:4033 , piece_id=UUCMKUWY2FRDIYNURUHONEOAKORNRRVEMNNNPKQ5MIPLBLEEC6IA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.572914018 (780h0m44.270482324s) [noise=true , address=185.167.204.205:4030 , piece_id=YYMDFRK6X7D264Z7FYECUT4H5GAQ52LW4FHX2JQ3GVL46EYCQPLA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.572975022 (780h0m44.270543369s) [noise=true , address=89.149.201.147:4018 , piece_id=H53SNMW7IPSPSHZJMJ2QVQMWJGLTHLK75A7FTSULPI2KRIREFWTQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.572990171 (780h0m44.270558507s) [seg_pos={0 0}, upload=686174]: Segment reached optimal threshold of 26 pieces.
Jan 7 03:29:56.573318433 (780h0m44.270886829s) [noise=true , address=185.167.204.206:4056 , piece_id=HEJV4MAFEP47TPNEES4WCH3BAVXFOICZQHCVITMAF2ITRXNO5TMA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: expected piece hash; context canceled; EOF
Jan 7 03:29:56.573341336 (780h0m44.270909723s) [noise=true , address=185.167.204.206:4056 , piece_id=HEJV4MAFEP47TPNEES4WCH3BAVXFOICZQHCVITMAF2ITRXNO5TMA, seg_pos={0 0}, upload=686174]: Long tail cancellation due to optimal threshold
Jan 7 03:29:56.573376612 (780h0m44.270944959s) [noise=true , address=185.167.204.205:4005 , piece_id=63Y7QNGHR4J4TIQJCUFULL5IRJ4NH7GCOQTJIGUXUZQHCEOSZ3AQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12B18LegNdvxjRqBgwnFB4Aig1nt5URm9Au7bWXsfbBPyCnterM): protocol: expected piece hash; context canceled; EOF
Jan 7 03:29:56.573415235 (780h0m44.270983571s) [noise=true , address=185.167.204.205:4005 , piece_id=63Y7QNGHR4J4TIQJCUFULL5IRJ4NH7GCOQTJIGUXUZQHCEOSZ3AQ, seg_pos={0 0}, upload=686174]: Long tail cancellation due to optimal threshold
Jan 7 03:29:56.573445671 (780h0m44.271014007s) [seg_pos={0 0}, upload=686174]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 7 03:29:56.573614446 (780h0m44.271182782s) [upload=686174]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 7 03:29:56.573626158 (780h0m44.271194495s) [upload=686174]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 7 03:29:56.727636981 (780h0m44.425205288s) [upload=686174]: Done uploading segments...
Jan 7 03:29:56.727651439 (780h0m44.425219744s) [upload=686174]: Upload finished. err: <nil>
Duration: 2.097885647s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [................................................X.X.........] duration:
870.801662ms trace:
https://jaeger.dev.storj.io/trace/7d6ac2d67d77a8e
FAIL (2026-01-07 03:39:33 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 870.837818ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
2.196649149s trace:
https://jaeger.dev.storj.io/trace/3334419549ef794f
FAIL (2026-01-07 03:39:27 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
IRJ4NH7GCOQTJIGUXUZQHCEOSZ3AQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.867845507 (780h0m43.565413814s) [noise=true , address=81.171.14.70:4047 , piece_id=EJCUGN3SK5QJ2SJ4EJOQKFPRZ2MNWRU7YZGOION2FU6ZQB6MSGRA, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.868202545 (780h0m43.565770861s) [noise=true , address=81.171.14.70:4036 , piece_id=BBQ4LDGVSFMW4KNTJ7YG6OETOZG7QLIRJBTKLDPNDSNZBF4AT4HA, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.868539164 (780h0m43.56610748s) [noise=true , address=185.167.204.206:4057 , piece_id=UXKGFAX7BMQPCWS3EHT4NQIZPMWW5AADKCVJ3KCLZFFKNGLNIH5Q, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.868880141 (780h0m43.566448457s) [noise=true , address=81.171.14.70:4041 , piece_id=Y27EBWJKXYPD2JGGQP4FD3P54IGGMRVSHGZM3PDEQP34EDDNBIUQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.869236226 (780h0m43.566804532s) [noise=true , address=185.167.204.205:4009 , piece_id=EBCMNZL5AWY66QYIQME5COVCE2RDTFIANF6H5ZGQKMM4W6XZ2RSQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.869590868 (780h0m43.567159185s) [noise=true , address=89.149.201.147:4004 , piece_id=CNSJZVRROO57Z6JFSKAJXTIXJM5CW7LNFKUPARQYOODK62ZME25Q, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.869924462 (780h0m43.567492768s) [noise=true , address=185.167.204.206:4071 , piece_id=GI6IB5RH5RZDG6KATWRTN4VDFAT7M3DYE66JO5ILGBIPAHPCONPQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.870992627 (780h0m43.568560933s) [noise=true , address=185.167.204.205:4030 , piece_id=YYMDFRK6X7D264Z7FYECUT4H5GAQ52LW4FHX2JQ3GVL46EYCQPLA, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.872209531 (780h0m43.569777847s) [noise=true , address=81.171.14.70:4048 , piece_id=7JSD5BZR67JKHAWSE2A4J77C4WRGUTVT7AQSJUISM4YYNN2K2WJQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.873573488 (780h0m43.571141804s) [noise=true , address=81.171.14.70:4044 , piece_id=CXZP7YIMWPFFADSZD5GKUNSL4MDF7LCJ6AYKQO7JXQEAJBIZ2R4Q, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:56.325091724 (780h0m44.02266004s) [upload=686174]: Next returned nil segment
Jan 7 03:29:56.325102373 (780h0m44.022670689s) [upload=686174]: Waiting for error group managing segments...
Jan 7 03:29:56.507974282 (780h0m44.205542619s) [noise=true , address=81.171.14.70:4044 , piece_id=CXZP7YIMWPFFADSZD5GKUNSL4MDF7LCJ6AYKQO7JXQEAJBIZ2R4Q, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.510831971 (780h0m44.208400287s) [noise=true , address=185.167.204.206:4071 , piece_id=GI6IB5RH5RZDG6KATWRTN4VDFAT7M3DYE66JO5ILGBIPAHPCONPQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.512703608 (780h0m44.210271953s) [noise=true , address=185.167.204.206:4037 , piece_id=I5OOGCTL3M6AHE42FBJKXGDVOBU6G2Y4EJQWJ6HVIWDH42C25XXA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.513105689 (780h0m44.210673995s) [noise=true , address=185.167.204.206:4057 , piece_id=UXKGFAX7BMQPCWS3EHT4NQIZPMWW5AADKCVJ3KCLZFFKNGLNIH5Q, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.513837716 (780h0m44.211406052s) [noise=true , address=81.171.14.70:4048 , piece_id=7JSD5BZR67JKHAWSE2A4J77C4WRGUTVT7AQSJUISM4YYNN2K2WJQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.515147433 (780h0m44.212715769s) [noise=true , address=185.167.204.206:4068 , piece_id=YHS7B5DPLDAWU5VW4KPCCDSNZDLRHFVHP7EKRMOBRPKW7TEL3UJA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.516520046 (780h0m44.214088353s) [noise=true , address=185.167.204.206:4066 , piece_id=2CDD52BAQY47RQUCZKAQC2OBDCQA27PPY5Z726XARCV5FTHNHIDQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.516901610 (780h0m44.214469926s) [noise=true , address=185.167.204.206:4069 , piece_id=UE65STV44JVSAFQOGLTUYHI2L6IA75VPZ4BC4BS7JLK7TQ5KAVPA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.518187532 (780h0m44.215755867s) [noise=true , address=185.167.204.205:4015 , piece_id=TQL7XYTFFJ4NIYQVWVGPS5RT5R5OHEEYGAO7YYRONMRUFQNYWRMQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.518735856 (780h0m44.216304172s) [noise=true , address=89.149.201.147:4004 , piece_id=CNSJZVRROO57Z6JFSKAJXTIXJM5CW7LNFKUPARQYOODK62ZME25Q, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.520802537 (780h0m44.218370873s) [noise=true , address=81.171.14.70:4034 , piece_id=SY7EK3RNJNBL5YS4T4R6FBNIXAQB7VGRL4RDGGPJGW7OEUCJK6JA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.524619928 (780h0m44.222188274s) [noise=true , address=81.171.14.70:4047 , piece_id=EJCUGN3SK5QJ2SJ4EJOQKFPRZ2MNWRU7YZGOION2FU6ZQB6MSGRA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.530089416 (780h0m44.227657722s) [noise=true , address=185.167.204.206:4041 , piece_id=2VTQW5MDL6RWCTFV5KCWBYR56KGKVQHZREL5VUKCAWBEVFJSOKYA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.538532469 (780h0m44.236100804s) [noise=true , address=185.167.204.206:4053 , piece_id=GJOCKGE3V35P6MXVDVXX5VY75VLWLOWCY4DVHF2XQW2FUYOU3WBA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.539346680 (780h0m44.236915017s) [noise=true , address=185.167.204.205:4014 , piece_id=RIGBC2O4ARGFCPLEOOLEEP2DWDK3HTWQLDFDRJARLHBVLUQTHZKQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.540129662 (780h0m44.237697999s) [noise=true , address=185.167.204.206:4067 , piece_id=XEGSGVREIWRNLDP5DFLFOSTQNH2TSAIN4OYYRAFQX5BCYFHBRR2Q, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.541661795 (780h0m44.239230111s) [noise=true , address=81.171.14.70:4036 , piece_id=BBQ4LDGVSFMW4KNTJ7YG6OETOZG7QLIRJBTKLDPNDSNZBF4AT4HA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.549338997 (780h0m44.246907333s) [noise=true , address=185.167.204.205:4025 , piece_id=XDTBNB7H465JRLCV3MRB2KOGWJDT3QYCL7QUSW3ZMI2NXMDRKIRA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.554852136 (780h0m44.252420442s) [noise=true , address=185.167.204.205:4027 , piece_id=W7UY6AP6OUFEUDM4IFO6OHC6QQ35ARGW3DRXWFWZYYUZCIOFGAAA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.560151646 (780h0m44.257719952s) [noise=true , address=81.171.14.70:4041 , piece_id=Y27EBWJKXYPD2JGGQP4FD3P54IGGMRVSHGZM3PDEQP34EDDNBIUQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.560310303 (780h0m44.257878639s) [noise=true , address=89.149.201.147:4019 , piece_id=EBHVXES5VC6CENU26CB5WFNRKWHBXBOQ3ANBAF5Y5AL2WHOKSMZA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.560718114 (780h0m44.258286421s) [noise=true , address=185.167.204.205:4009 , piece_id=EBCMNZL5AWY66QYIQME5COVCE2RDTFIANF6H5ZGQKMM4W6XZ2RSQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.562226592 (780h0m44.259794909s) [noise=true , address=185.167.204.205:4004 , piece_id=TN3VC6E4IP5HYHUCEFVXPSPUXAVGMU4IN2BP5VOYGBX4OZRZEDQA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.563539496 (780h0m44.261107832s) [noise=true , address=81.171.14.70:4033 , piece_id=UUCMKUWY2FRDIYNURUHONEOAKORNRRVEMNNNPKQ5MIPLBLEEC6IA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.572914018 (780h0m44.270482324s) [noise=true , address=185.167.204.205:4030 , piece_id=YYMDFRK6X7D264Z7FYECUT4H5GAQ52LW4FHX2JQ3GVL46EYCQPLA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.572975022 (780h0m44.270543369s) [noise=true , address=89.149.201.147:4018 , piece_id=H53SNMW7IPSPSHZJMJ2QVQMWJGLTHLK75A7FTSULPI2KRIREFWTQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.572990171 (780h0m44.270558507s) [seg_pos={0 0}, upload=686174]: Segment reached optimal threshold of 26 pieces.
Jan 7 03:29:56.573318433 (780h0m44.270886829s) [noise=true , address=185.167.204.206:4056 , piece_id=HEJV4MAFEP47TPNEES4WCH3BAVXFOICZQHCVITMAF2ITRXNO5TMA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: expected piece hash; context canceled; EOF
Jan 7 03:29:56.573341336 (780h0m44.270909723s) [noise=true , address=185.167.204.206:4056 , piece_id=HEJV4MAFEP47TPNEES4WCH3BAVXFOICZQHCVITMAF2ITRXNO5TMA, seg_pos={0 0}, upload=686174]: Long tail cancellation due to optimal threshold
Jan 7 03:29:56.573376612 (780h0m44.270944959s) [noise=true , address=185.167.204.205:4005 , piece_id=63Y7QNGHR4J4TIQJCUFULL5IRJ4NH7GCOQTJIGUXUZQHCEOSZ3AQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12B18LegNdvxjRqBgwnFB4Aig1nt5URm9Au7bWXsfbBPyCnterM): protocol: expected piece hash; context canceled; EOF
Jan 7 03:29:56.573415235 (780h0m44.270983571s) [noise=true , address=185.167.204.205:4005 , piece_id=63Y7QNGHR4J4TIQJCUFULL5IRJ4NH7GCOQTJIGUXUZQHCEOSZ3AQ, seg_pos={0 0}, upload=686174]: Long tail cancellation due to optimal threshold
Jan 7 03:29:56.573445671 (780h0m44.271014007s) [seg_pos={0 0}, upload=686174]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 7 03:29:56.573614446 (780h0m44.271182782s) [upload=686174]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 7 03:29:56.573626158 (780h0m44.271194495s) [upload=686174]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 7 03:29:56.727636981 (780h0m44.425205288s) [upload=686174]: Done uploading segments...
Jan 7 03:29:56.727651439 (780h0m44.425219744s) [upload=686174]: Upload finished. err: <nil>
Duration: 2.196662655s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
4 out of 60 is failed (threshold=3) [..........................................XX.XX.............] duration:
2.516298596s trace:
https://jaeger.dev.storj.io/trace/5a0e658196b93032
FAIL (2026-01-07 03:39:17 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 2.516325605s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
2.557260189s trace:
https://jaeger.dev.storj.io/trace/3334419549ef794f
FAIL (2026-01-07 03:39:09 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
IRJ4NH7GCOQTJIGUXUZQHCEOSZ3AQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.867845507 (780h0m43.565413814s) [noise=true , address=81.171.14.70:4047 , piece_id=EJCUGN3SK5QJ2SJ4EJOQKFPRZ2MNWRU7YZGOION2FU6ZQB6MSGRA, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.868202545 (780h0m43.565770861s) [noise=true , address=81.171.14.70:4036 , piece_id=BBQ4LDGVSFMW4KNTJ7YG6OETOZG7QLIRJBTKLDPNDSNZBF4AT4HA, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.868539164 (780h0m43.56610748s) [noise=true , address=185.167.204.206:4057 , piece_id=UXKGFAX7BMQPCWS3EHT4NQIZPMWW5AADKCVJ3KCLZFFKNGLNIH5Q, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.868880141 (780h0m43.566448457s) [noise=true , address=81.171.14.70:4041 , piece_id=Y27EBWJKXYPD2JGGQP4FD3P54IGGMRVSHGZM3PDEQP34EDDNBIUQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.869236226 (780h0m43.566804532s) [noise=true , address=185.167.204.205:4009 , piece_id=EBCMNZL5AWY66QYIQME5COVCE2RDTFIANF6H5ZGQKMM4W6XZ2RSQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.869590868 (780h0m43.567159185s) [noise=true , address=89.149.201.147:4004 , piece_id=CNSJZVRROO57Z6JFSKAJXTIXJM5CW7LNFKUPARQYOODK62ZME25Q, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.869924462 (780h0m43.567492768s) [noise=true , address=185.167.204.206:4071 , piece_id=GI6IB5RH5RZDG6KATWRTN4VDFAT7M3DYE66JO5ILGBIPAHPCONPQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.870992627 (780h0m43.568560933s) [noise=true , address=185.167.204.205:4030 , piece_id=YYMDFRK6X7D264Z7FYECUT4H5GAQ52LW4FHX2JQ3GVL46EYCQPLA, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.872209531 (780h0m43.569777847s) [noise=true , address=81.171.14.70:4048 , piece_id=7JSD5BZR67JKHAWSE2A4J77C4WRGUTVT7AQSJUISM4YYNN2K2WJQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.873573488 (780h0m43.571141804s) [noise=true , address=81.171.14.70:4044 , piece_id=CXZP7YIMWPFFADSZD5GKUNSL4MDF7LCJ6AYKQO7JXQEAJBIZ2R4Q, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:56.325091724 (780h0m44.02266004s) [upload=686174]: Next returned nil segment
Jan 7 03:29:56.325102373 (780h0m44.022670689s) [upload=686174]: Waiting for error group managing segments...
Jan 7 03:29:56.507974282 (780h0m44.205542619s) [noise=true , address=81.171.14.70:4044 , piece_id=CXZP7YIMWPFFADSZD5GKUNSL4MDF7LCJ6AYKQO7JXQEAJBIZ2R4Q, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.510831971 (780h0m44.208400287s) [noise=true , address=185.167.204.206:4071 , piece_id=GI6IB5RH5RZDG6KATWRTN4VDFAT7M3DYE66JO5ILGBIPAHPCONPQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.512703608 (780h0m44.210271953s) [noise=true , address=185.167.204.206:4037 , piece_id=I5OOGCTL3M6AHE42FBJKXGDVOBU6G2Y4EJQWJ6HVIWDH42C25XXA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.513105689 (780h0m44.210673995s) [noise=true , address=185.167.204.206:4057 , piece_id=UXKGFAX7BMQPCWS3EHT4NQIZPMWW5AADKCVJ3KCLZFFKNGLNIH5Q, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.513837716 (780h0m44.211406052s) [noise=true , address=81.171.14.70:4048 , piece_id=7JSD5BZR67JKHAWSE2A4J77C4WRGUTVT7AQSJUISM4YYNN2K2WJQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.515147433 (780h0m44.212715769s) [noise=true , address=185.167.204.206:4068 , piece_id=YHS7B5DPLDAWU5VW4KPCCDSNZDLRHFVHP7EKRMOBRPKW7TEL3UJA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.516520046 (780h0m44.214088353s) [noise=true , address=185.167.204.206:4066 , piece_id=2CDD52BAQY47RQUCZKAQC2OBDCQA27PPY5Z726XARCV5FTHNHIDQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.516901610 (780h0m44.214469926s) [noise=true , address=185.167.204.206:4069 , piece_id=UE65STV44JVSAFQOGLTUYHI2L6IA75VPZ4BC4BS7JLK7TQ5KAVPA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.518187532 (780h0m44.215755867s) [noise=true , address=185.167.204.205:4015 , piece_id=TQL7XYTFFJ4NIYQVWVGPS5RT5R5OHEEYGAO7YYRONMRUFQNYWRMQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.518735856 (780h0m44.216304172s) [noise=true , address=89.149.201.147:4004 , piece_id=CNSJZVRROO57Z6JFSKAJXTIXJM5CW7LNFKUPARQYOODK62ZME25Q, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.520802537 (780h0m44.218370873s) [noise=true , address=81.171.14.70:4034 , piece_id=SY7EK3RNJNBL5YS4T4R6FBNIXAQB7VGRL4RDGGPJGW7OEUCJK6JA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.524619928 (780h0m44.222188274s) [noise=true , address=81.171.14.70:4047 , piece_id=EJCUGN3SK5QJ2SJ4EJOQKFPRZ2MNWRU7YZGOION2FU6ZQB6MSGRA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.530089416 (780h0m44.227657722s) [noise=true , address=185.167.204.206:4041 , piece_id=2VTQW5MDL6RWCTFV5KCWBYR56KGKVQHZREL5VUKCAWBEVFJSOKYA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.538532469 (780h0m44.236100804s) [noise=true , address=185.167.204.206:4053 , piece_id=GJOCKGE3V35P6MXVDVXX5VY75VLWLOWCY4DVHF2XQW2FUYOU3WBA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.539346680 (780h0m44.236915017s) [noise=true , address=185.167.204.205:4014 , piece_id=RIGBC2O4ARGFCPLEOOLEEP2DWDK3HTWQLDFDRJARLHBVLUQTHZKQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.540129662 (780h0m44.237697999s) [noise=true , address=185.167.204.206:4067 , piece_id=XEGSGVREIWRNLDP5DFLFOSTQNH2TSAIN4OYYRAFQX5BCYFHBRR2Q, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.541661795 (780h0m44.239230111s) [noise=true , address=81.171.14.70:4036 , piece_id=BBQ4LDGVSFMW4KNTJ7YG6OETOZG7QLIRJBTKLDPNDSNZBF4AT4HA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.549338997 (780h0m44.246907333s) [noise=true , address=185.167.204.205:4025 , piece_id=XDTBNB7H465JRLCV3MRB2KOGWJDT3QYCL7QUSW3ZMI2NXMDRKIRA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.554852136 (780h0m44.252420442s) [noise=true , address=185.167.204.205:4027 , piece_id=W7UY6AP6OUFEUDM4IFO6OHC6QQ35ARGW3DRXWFWZYYUZCIOFGAAA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.560151646 (780h0m44.257719952s) [noise=true , address=81.171.14.70:4041 , piece_id=Y27EBWJKXYPD2JGGQP4FD3P54IGGMRVSHGZM3PDEQP34EDDNBIUQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.560310303 (780h0m44.257878639s) [noise=true , address=89.149.201.147:4019 , piece_id=EBHVXES5VC6CENU26CB5WFNRKWHBXBOQ3ANBAF5Y5AL2WHOKSMZA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.560718114 (780h0m44.258286421s) [noise=true , address=185.167.204.205:4009 , piece_id=EBCMNZL5AWY66QYIQME5COVCE2RDTFIANF6H5ZGQKMM4W6XZ2RSQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.562226592 (780h0m44.259794909s) [noise=true , address=185.167.204.205:4004 , piece_id=TN3VC6E4IP5HYHUCEFVXPSPUXAVGMU4IN2BP5VOYGBX4OZRZEDQA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.563539496 (780h0m44.261107832s) [noise=true , address=81.171.14.70:4033 , piece_id=UUCMKUWY2FRDIYNURUHONEOAKORNRRVEMNNNPKQ5MIPLBLEEC6IA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.572914018 (780h0m44.270482324s) [noise=true , address=185.167.204.205:4030 , piece_id=YYMDFRK6X7D264Z7FYECUT4H5GAQ52LW4FHX2JQ3GVL46EYCQPLA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.572975022 (780h0m44.270543369s) [noise=true , address=89.149.201.147:4018 , piece_id=H53SNMW7IPSPSHZJMJ2QVQMWJGLTHLK75A7FTSULPI2KRIREFWTQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.572990171 (780h0m44.270558507s) [seg_pos={0 0}, upload=686174]: Segment reached optimal threshold of 26 pieces.
Jan 7 03:29:56.573318433 (780h0m44.270886829s) [noise=true , address=185.167.204.206:4056 , piece_id=HEJV4MAFEP47TPNEES4WCH3BAVXFOICZQHCVITMAF2ITRXNO5TMA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: expected piece hash; context canceled; EOF
Jan 7 03:29:56.573341336 (780h0m44.270909723s) [noise=true , address=185.167.204.206:4056 , piece_id=HEJV4MAFEP47TPNEES4WCH3BAVXFOICZQHCVITMAF2ITRXNO5TMA, seg_pos={0 0}, upload=686174]: Long tail cancellation due to optimal threshold
Jan 7 03:29:56.573376612 (780h0m44.270944959s) [noise=true , address=185.167.204.205:4005 , piece_id=63Y7QNGHR4J4TIQJCUFULL5IRJ4NH7GCOQTJIGUXUZQHCEOSZ3AQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12B18LegNdvxjRqBgwnFB4Aig1nt5URm9Au7bWXsfbBPyCnterM): protocol: expected piece hash; context canceled; EOF
Jan 7 03:29:56.573415235 (780h0m44.270983571s) [noise=true , address=185.167.204.205:4005 , piece_id=63Y7QNGHR4J4TIQJCUFULL5IRJ4NH7GCOQTJIGUXUZQHCEOSZ3AQ, seg_pos={0 0}, upload=686174]: Long tail cancellation due to optimal threshold
Jan 7 03:29:56.573445671 (780h0m44.271014007s) [seg_pos={0 0}, upload=686174]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 7 03:29:56.573614446 (780h0m44.271182782s) [upload=686174]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 7 03:29:56.573626158 (780h0m44.271194495s) [upload=686174]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 7 03:29:56.727636981 (780h0m44.425205288s) [upload=686174]: Done uploading segments...
Jan 7 03:29:56.727651439 (780h0m44.425219744s) [upload=686174]: Upload finished. err: <nil>
Duration: 2.557285045s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................................................X.X........] duration:
840.820291ms trace:
https://jaeger.dev.storj.io/trace/7d6ac2d67d77a8e
FAIL (2026-01-07 03:38:55 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 840.842864ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
4 out of 60 is failed (threshold=3) [...........................................XX.XX............] duration:
2.495848473s trace:
https://jaeger.dev.storj.io/trace/5a0e658196b93032
FAIL (2026-01-07 03:38:19 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 2.495865775s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................................................X.X.......] duration:
866.668881ms trace:
https://jaeger.dev.storj.io/trace/7d6ac2d67d77a8e
FAIL (2026-01-07 03:38:16 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 866.689329ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
2.225403557s trace:
https://jaeger.dev.storj.io/trace/3334419549ef794f
FAIL (2026-01-07 03:38:13 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
IRJ4NH7GCOQTJIGUXUZQHCEOSZ3AQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.867845507 (780h0m43.565413814s) [noise=true , address=81.171.14.70:4047 , piece_id=EJCUGN3SK5QJ2SJ4EJOQKFPRZ2MNWRU7YZGOION2FU6ZQB6MSGRA, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.868202545 (780h0m43.565770861s) [noise=true , address=81.171.14.70:4036 , piece_id=BBQ4LDGVSFMW4KNTJ7YG6OETOZG7QLIRJBTKLDPNDSNZBF4AT4HA, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.868539164 (780h0m43.56610748s) [noise=true , address=185.167.204.206:4057 , piece_id=UXKGFAX7BMQPCWS3EHT4NQIZPMWW5AADKCVJ3KCLZFFKNGLNIH5Q, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.868880141 (780h0m43.566448457s) [noise=true , address=81.171.14.70:4041 , piece_id=Y27EBWJKXYPD2JGGQP4FD3P54IGGMRVSHGZM3PDEQP34EDDNBIUQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.869236226 (780h0m43.566804532s) [noise=true , address=185.167.204.205:4009 , piece_id=EBCMNZL5AWY66QYIQME5COVCE2RDTFIANF6H5ZGQKMM4W6XZ2RSQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.869590868 (780h0m43.567159185s) [noise=true , address=89.149.201.147:4004 , piece_id=CNSJZVRROO57Z6JFSKAJXTIXJM5CW7LNFKUPARQYOODK62ZME25Q, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.869924462 (780h0m43.567492768s) [noise=true , address=185.167.204.206:4071 , piece_id=GI6IB5RH5RZDG6KATWRTN4VDFAT7M3DYE66JO5ILGBIPAHPCONPQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.870992627 (780h0m43.568560933s) [noise=true , address=185.167.204.205:4030 , piece_id=YYMDFRK6X7D264Z7FYECUT4H5GAQ52LW4FHX2JQ3GVL46EYCQPLA, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.872209531 (780h0m43.569777847s) [noise=true , address=81.171.14.70:4048 , piece_id=7JSD5BZR67JKHAWSE2A4J77C4WRGUTVT7AQSJUISM4YYNN2K2WJQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.873573488 (780h0m43.571141804s) [noise=true , address=81.171.14.70:4044 , piece_id=CXZP7YIMWPFFADSZD5GKUNSL4MDF7LCJ6AYKQO7JXQEAJBIZ2R4Q, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:56.325091724 (780h0m44.02266004s) [upload=686174]: Next returned nil segment
Jan 7 03:29:56.325102373 (780h0m44.022670689s) [upload=686174]: Waiting for error group managing segments...
Jan 7 03:29:56.507974282 (780h0m44.205542619s) [noise=true , address=81.171.14.70:4044 , piece_id=CXZP7YIMWPFFADSZD5GKUNSL4MDF7LCJ6AYKQO7JXQEAJBIZ2R4Q, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.510831971 (780h0m44.208400287s) [noise=true , address=185.167.204.206:4071 , piece_id=GI6IB5RH5RZDG6KATWRTN4VDFAT7M3DYE66JO5ILGBIPAHPCONPQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.512703608 (780h0m44.210271953s) [noise=true , address=185.167.204.206:4037 , piece_id=I5OOGCTL3M6AHE42FBJKXGDVOBU6G2Y4EJQWJ6HVIWDH42C25XXA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.513105689 (780h0m44.210673995s) [noise=true , address=185.167.204.206:4057 , piece_id=UXKGFAX7BMQPCWS3EHT4NQIZPMWW5AADKCVJ3KCLZFFKNGLNIH5Q, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.513837716 (780h0m44.211406052s) [noise=true , address=81.171.14.70:4048 , piece_id=7JSD5BZR67JKHAWSE2A4J77C4WRGUTVT7AQSJUISM4YYNN2K2WJQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.515147433 (780h0m44.212715769s) [noise=true , address=185.167.204.206:4068 , piece_id=YHS7B5DPLDAWU5VW4KPCCDSNZDLRHFVHP7EKRMOBRPKW7TEL3UJA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.516520046 (780h0m44.214088353s) [noise=true , address=185.167.204.206:4066 , piece_id=2CDD52BAQY47RQUCZKAQC2OBDCQA27PPY5Z726XARCV5FTHNHIDQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.516901610 (780h0m44.214469926s) [noise=true , address=185.167.204.206:4069 , piece_id=UE65STV44JVSAFQOGLTUYHI2L6IA75VPZ4BC4BS7JLK7TQ5KAVPA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.518187532 (780h0m44.215755867s) [noise=true , address=185.167.204.205:4015 , piece_id=TQL7XYTFFJ4NIYQVWVGPS5RT5R5OHEEYGAO7YYRONMRUFQNYWRMQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.518735856 (780h0m44.216304172s) [noise=true , address=89.149.201.147:4004 , piece_id=CNSJZVRROO57Z6JFSKAJXTIXJM5CW7LNFKUPARQYOODK62ZME25Q, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.520802537 (780h0m44.218370873s) [noise=true , address=81.171.14.70:4034 , piece_id=SY7EK3RNJNBL5YS4T4R6FBNIXAQB7VGRL4RDGGPJGW7OEUCJK6JA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.524619928 (780h0m44.222188274s) [noise=true , address=81.171.14.70:4047 , piece_id=EJCUGN3SK5QJ2SJ4EJOQKFPRZ2MNWRU7YZGOION2FU6ZQB6MSGRA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.530089416 (780h0m44.227657722s) [noise=true , address=185.167.204.206:4041 , piece_id=2VTQW5MDL6RWCTFV5KCWBYR56KGKVQHZREL5VUKCAWBEVFJSOKYA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.538532469 (780h0m44.236100804s) [noise=true , address=185.167.204.206:4053 , piece_id=GJOCKGE3V35P6MXVDVXX5VY75VLWLOWCY4DVHF2XQW2FUYOU3WBA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.539346680 (780h0m44.236915017s) [noise=true , address=185.167.204.205:4014 , piece_id=RIGBC2O4ARGFCPLEOOLEEP2DWDK3HTWQLDFDRJARLHBVLUQTHZKQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.540129662 (780h0m44.237697999s) [noise=true , address=185.167.204.206:4067 , piece_id=XEGSGVREIWRNLDP5DFLFOSTQNH2TSAIN4OYYRAFQX5BCYFHBRR2Q, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.541661795 (780h0m44.239230111s) [noise=true , address=81.171.14.70:4036 , piece_id=BBQ4LDGVSFMW4KNTJ7YG6OETOZG7QLIRJBTKLDPNDSNZBF4AT4HA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.549338997 (780h0m44.246907333s) [noise=true , address=185.167.204.205:4025 , piece_id=XDTBNB7H465JRLCV3MRB2KOGWJDT3QYCL7QUSW3ZMI2NXMDRKIRA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.554852136 (780h0m44.252420442s) [noise=true , address=185.167.204.205:4027 , piece_id=W7UY6AP6OUFEUDM4IFO6OHC6QQ35ARGW3DRXWFWZYYUZCIOFGAAA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.560151646 (780h0m44.257719952s) [noise=true , address=81.171.14.70:4041 , piece_id=Y27EBWJKXYPD2JGGQP4FD3P54IGGMRVSHGZM3PDEQP34EDDNBIUQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.560310303 (780h0m44.257878639s) [noise=true , address=89.149.201.147:4019 , piece_id=EBHVXES5VC6CENU26CB5WFNRKWHBXBOQ3ANBAF5Y5AL2WHOKSMZA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.560718114 (780h0m44.258286421s) [noise=true , address=185.167.204.205:4009 , piece_id=EBCMNZL5AWY66QYIQME5COVCE2RDTFIANF6H5ZGQKMM4W6XZ2RSQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.562226592 (780h0m44.259794909s) [noise=true , address=185.167.204.205:4004 , piece_id=TN3VC6E4IP5HYHUCEFVXPSPUXAVGMU4IN2BP5VOYGBX4OZRZEDQA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.563539496 (780h0m44.261107832s) [noise=true , address=81.171.14.70:4033 , piece_id=UUCMKUWY2FRDIYNURUHONEOAKORNRRVEMNNNPKQ5MIPLBLEEC6IA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.572914018 (780h0m44.270482324s) [noise=true , address=185.167.204.205:4030 , piece_id=YYMDFRK6X7D264Z7FYECUT4H5GAQ52LW4FHX2JQ3GVL46EYCQPLA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.572975022 (780h0m44.270543369s) [noise=true , address=89.149.201.147:4018 , piece_id=H53SNMW7IPSPSHZJMJ2QVQMWJGLTHLK75A7FTSULPI2KRIREFWTQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.572990171 (780h0m44.270558507s) [seg_pos={0 0}, upload=686174]: Segment reached optimal threshold of 26 pieces.
Jan 7 03:29:56.573318433 (780h0m44.270886829s) [noise=true , address=185.167.204.206:4056 , piece_id=HEJV4MAFEP47TPNEES4WCH3BAVXFOICZQHCVITMAF2ITRXNO5TMA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: expected piece hash; context canceled; EOF
Jan 7 03:29:56.573341336 (780h0m44.270909723s) [noise=true , address=185.167.204.206:4056 , piece_id=HEJV4MAFEP47TPNEES4WCH3BAVXFOICZQHCVITMAF2ITRXNO5TMA, seg_pos={0 0}, upload=686174]: Long tail cancellation due to optimal threshold
Jan 7 03:29:56.573376612 (780h0m44.270944959s) [noise=true , address=185.167.204.205:4005 , piece_id=63Y7QNGHR4J4TIQJCUFULL5IRJ4NH7GCOQTJIGUXUZQHCEOSZ3AQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12B18LegNdvxjRqBgwnFB4Aig1nt5URm9Au7bWXsfbBPyCnterM): protocol: expected piece hash; context canceled; EOF
Jan 7 03:29:56.573415235 (780h0m44.270983571s) [noise=true , address=185.167.204.205:4005 , piece_id=63Y7QNGHR4J4TIQJCUFULL5IRJ4NH7GCOQTJIGUXUZQHCEOSZ3AQ, seg_pos={0 0}, upload=686174]: Long tail cancellation due to optimal threshold
Jan 7 03:29:56.573445671 (780h0m44.271014007s) [seg_pos={0 0}, upload=686174]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 7 03:29:56.573614446 (780h0m44.271182782s) [upload=686174]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 7 03:29:56.573626158 (780h0m44.271194495s) [upload=686174]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 7 03:29:56.727636981 (780h0m44.425205288s) [upload=686174]: Done uploading segments...
Jan 7 03:29:56.727651439 (780h0m44.425219744s) [upload=686174]: Upload finished. err: <nil>
Duration: 2.225431229s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
2.117690163s trace:
https://jaeger.dev.storj.io/trace/3334419549ef794f
FAIL (2026-01-07 03:37:42 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
IRJ4NH7GCOQTJIGUXUZQHCEOSZ3AQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.867845507 (780h0m43.565413814s) [noise=true , address=81.171.14.70:4047 , piece_id=EJCUGN3SK5QJ2SJ4EJOQKFPRZ2MNWRU7YZGOION2FU6ZQB6MSGRA, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.868202545 (780h0m43.565770861s) [noise=true , address=81.171.14.70:4036 , piece_id=BBQ4LDGVSFMW4KNTJ7YG6OETOZG7QLIRJBTKLDPNDSNZBF4AT4HA, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.868539164 (780h0m43.56610748s) [noise=true , address=185.167.204.206:4057 , piece_id=UXKGFAX7BMQPCWS3EHT4NQIZPMWW5AADKCVJ3KCLZFFKNGLNIH5Q, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.868880141 (780h0m43.566448457s) [noise=true , address=81.171.14.70:4041 , piece_id=Y27EBWJKXYPD2JGGQP4FD3P54IGGMRVSHGZM3PDEQP34EDDNBIUQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.869236226 (780h0m43.566804532s) [noise=true , address=185.167.204.205:4009 , piece_id=EBCMNZL5AWY66QYIQME5COVCE2RDTFIANF6H5ZGQKMM4W6XZ2RSQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.869590868 (780h0m43.567159185s) [noise=true , address=89.149.201.147:4004 , piece_id=CNSJZVRROO57Z6JFSKAJXTIXJM5CW7LNFKUPARQYOODK62ZME25Q, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.869924462 (780h0m43.567492768s) [noise=true , address=185.167.204.206:4071 , piece_id=GI6IB5RH5RZDG6KATWRTN4VDFAT7M3DYE66JO5ILGBIPAHPCONPQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.870992627 (780h0m43.568560933s) [noise=true , address=185.167.204.205:4030 , piece_id=YYMDFRK6X7D264Z7FYECUT4H5GAQ52LW4FHX2JQ3GVL46EYCQPLA, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.872209531 (780h0m43.569777847s) [noise=true , address=81.171.14.70:4048 , piece_id=7JSD5BZR67JKHAWSE2A4J77C4WRGUTVT7AQSJUISM4YYNN2K2WJQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.873573488 (780h0m43.571141804s) [noise=true , address=81.171.14.70:4044 , piece_id=CXZP7YIMWPFFADSZD5GKUNSL4MDF7LCJ6AYKQO7JXQEAJBIZ2R4Q, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:56.325091724 (780h0m44.02266004s) [upload=686174]: Next returned nil segment
Jan 7 03:29:56.325102373 (780h0m44.022670689s) [upload=686174]: Waiting for error group managing segments...
Jan 7 03:29:56.507974282 (780h0m44.205542619s) [noise=true , address=81.171.14.70:4044 , piece_id=CXZP7YIMWPFFADSZD5GKUNSL4MDF7LCJ6AYKQO7JXQEAJBIZ2R4Q, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.510831971 (780h0m44.208400287s) [noise=true , address=185.167.204.206:4071 , piece_id=GI6IB5RH5RZDG6KATWRTN4VDFAT7M3DYE66JO5ILGBIPAHPCONPQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.512703608 (780h0m44.210271953s) [noise=true , address=185.167.204.206:4037 , piece_id=I5OOGCTL3M6AHE42FBJKXGDVOBU6G2Y4EJQWJ6HVIWDH42C25XXA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.513105689 (780h0m44.210673995s) [noise=true , address=185.167.204.206:4057 , piece_id=UXKGFAX7BMQPCWS3EHT4NQIZPMWW5AADKCVJ3KCLZFFKNGLNIH5Q, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.513837716 (780h0m44.211406052s) [noise=true , address=81.171.14.70:4048 , piece_id=7JSD5BZR67JKHAWSE2A4J77C4WRGUTVT7AQSJUISM4YYNN2K2WJQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.515147433 (780h0m44.212715769s) [noise=true , address=185.167.204.206:4068 , piece_id=YHS7B5DPLDAWU5VW4KPCCDSNZDLRHFVHP7EKRMOBRPKW7TEL3UJA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.516520046 (780h0m44.214088353s) [noise=true , address=185.167.204.206:4066 , piece_id=2CDD52BAQY47RQUCZKAQC2OBDCQA27PPY5Z726XARCV5FTHNHIDQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.516901610 (780h0m44.214469926s) [noise=true , address=185.167.204.206:4069 , piece_id=UE65STV44JVSAFQOGLTUYHI2L6IA75VPZ4BC4BS7JLK7TQ5KAVPA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.518187532 (780h0m44.215755867s) [noise=true , address=185.167.204.205:4015 , piece_id=TQL7XYTFFJ4NIYQVWVGPS5RT5R5OHEEYGAO7YYRONMRUFQNYWRMQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.518735856 (780h0m44.216304172s) [noise=true , address=89.149.201.147:4004 , piece_id=CNSJZVRROO57Z6JFSKAJXTIXJM5CW7LNFKUPARQYOODK62ZME25Q, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.520802537 (780h0m44.218370873s) [noise=true , address=81.171.14.70:4034 , piece_id=SY7EK3RNJNBL5YS4T4R6FBNIXAQB7VGRL4RDGGPJGW7OEUCJK6JA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.524619928 (780h0m44.222188274s) [noise=true , address=81.171.14.70:4047 , piece_id=EJCUGN3SK5QJ2SJ4EJOQKFPRZ2MNWRU7YZGOION2FU6ZQB6MSGRA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.530089416 (780h0m44.227657722s) [noise=true , address=185.167.204.206:4041 , piece_id=2VTQW5MDL6RWCTFV5KCWBYR56KGKVQHZREL5VUKCAWBEVFJSOKYA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.538532469 (780h0m44.236100804s) [noise=true , address=185.167.204.206:4053 , piece_id=GJOCKGE3V35P6MXVDVXX5VY75VLWLOWCY4DVHF2XQW2FUYOU3WBA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.539346680 (780h0m44.236915017s) [noise=true , address=185.167.204.205:4014 , piece_id=RIGBC2O4ARGFCPLEOOLEEP2DWDK3HTWQLDFDRJARLHBVLUQTHZKQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.540129662 (780h0m44.237697999s) [noise=true , address=185.167.204.206:4067 , piece_id=XEGSGVREIWRNLDP5DFLFOSTQNH2TSAIN4OYYRAFQX5BCYFHBRR2Q, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.541661795 (780h0m44.239230111s) [noise=true , address=81.171.14.70:4036 , piece_id=BBQ4LDGVSFMW4KNTJ7YG6OETOZG7QLIRJBTKLDPNDSNZBF4AT4HA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.549338997 (780h0m44.246907333s) [noise=true , address=185.167.204.205:4025 , piece_id=XDTBNB7H465JRLCV3MRB2KOGWJDT3QYCL7QUSW3ZMI2NXMDRKIRA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.554852136 (780h0m44.252420442s) [noise=true , address=185.167.204.205:4027 , piece_id=W7UY6AP6OUFEUDM4IFO6OHC6QQ35ARGW3DRXWFWZYYUZCIOFGAAA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.560151646 (780h0m44.257719952s) [noise=true , address=81.171.14.70:4041 , piece_id=Y27EBWJKXYPD2JGGQP4FD3P54IGGMRVSHGZM3PDEQP34EDDNBIUQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.560310303 (780h0m44.257878639s) [noise=true , address=89.149.201.147:4019 , piece_id=EBHVXES5VC6CENU26CB5WFNRKWHBXBOQ3ANBAF5Y5AL2WHOKSMZA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.560718114 (780h0m44.258286421s) [noise=true , address=185.167.204.205:4009 , piece_id=EBCMNZL5AWY66QYIQME5COVCE2RDTFIANF6H5ZGQKMM4W6XZ2RSQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.562226592 (780h0m44.259794909s) [noise=true , address=185.167.204.205:4004 , piece_id=TN3VC6E4IP5HYHUCEFVXPSPUXAVGMU4IN2BP5VOYGBX4OZRZEDQA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.563539496 (780h0m44.261107832s) [noise=true , address=81.171.14.70:4033 , piece_id=UUCMKUWY2FRDIYNURUHONEOAKORNRRVEMNNNPKQ5MIPLBLEEC6IA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.572914018 (780h0m44.270482324s) [noise=true , address=185.167.204.205:4030 , piece_id=YYMDFRK6X7D264Z7FYECUT4H5GAQ52LW4FHX2JQ3GVL46EYCQPLA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.572975022 (780h0m44.270543369s) [noise=true , address=89.149.201.147:4018 , piece_id=H53SNMW7IPSPSHZJMJ2QVQMWJGLTHLK75A7FTSULPI2KRIREFWTQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.572990171 (780h0m44.270558507s) [seg_pos={0 0}, upload=686174]: Segment reached optimal threshold of 26 pieces.
Jan 7 03:29:56.573318433 (780h0m44.270886829s) [noise=true , address=185.167.204.206:4056 , piece_id=HEJV4MAFEP47TPNEES4WCH3BAVXFOICZQHCVITMAF2ITRXNO5TMA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: expected piece hash; context canceled; EOF
Jan 7 03:29:56.573341336 (780h0m44.270909723s) [noise=true , address=185.167.204.206:4056 , piece_id=HEJV4MAFEP47TPNEES4WCH3BAVXFOICZQHCVITMAF2ITRXNO5TMA, seg_pos={0 0}, upload=686174]: Long tail cancellation due to optimal threshold
Jan 7 03:29:56.573376612 (780h0m44.270944959s) [noise=true , address=185.167.204.205:4005 , piece_id=63Y7QNGHR4J4TIQJCUFULL5IRJ4NH7GCOQTJIGUXUZQHCEOSZ3AQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12B18LegNdvxjRqBgwnFB4Aig1nt5URm9Au7bWXsfbBPyCnterM): protocol: expected piece hash; context canceled; EOF
Jan 7 03:29:56.573415235 (780h0m44.270983571s) [noise=true , address=185.167.204.205:4005 , piece_id=63Y7QNGHR4J4TIQJCUFULL5IRJ4NH7GCOQTJIGUXUZQHCEOSZ3AQ, seg_pos={0 0}, upload=686174]: Long tail cancellation due to optimal threshold
Jan 7 03:29:56.573445671 (780h0m44.271014007s) [seg_pos={0 0}, upload=686174]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 7 03:29:56.573614446 (780h0m44.271182782s) [upload=686174]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 7 03:29:56.573626158 (780h0m44.271194495s) [upload=686174]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 7 03:29:56.727636981 (780h0m44.425205288s) [upload=686174]: Done uploading segments...
Jan 7 03:29:56.727651439 (780h0m44.425219744s) [upload=686174]: Upload finished. err: <nil>
Duration: 2.117711233s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
4 out of 60 is failed (threshold=3) [............................................XX.XX...........] duration:
2.59096377s trace:
https://jaeger.dev.storj.io/trace/5a0e658196b93032
FAIL (2026-01-07 03:37:34 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 2.59098523s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [...................................................X.X......] duration:
849.063903ms trace:
https://jaeger.dev.storj.io/trace/7d6ac2d67d77a8e
FAIL (2026-01-07 03:37:28 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 849.094671ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
2.20307276s trace:
https://jaeger.dev.storj.io/trace/3334419549ef794f
FAIL (2026-01-07 03:37:26 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
IRJ4NH7GCOQTJIGUXUZQHCEOSZ3AQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.867845507 (780h0m43.565413814s) [noise=true , address=81.171.14.70:4047 , piece_id=EJCUGN3SK5QJ2SJ4EJOQKFPRZ2MNWRU7YZGOION2FU6ZQB6MSGRA, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.868202545 (780h0m43.565770861s) [noise=true , address=81.171.14.70:4036 , piece_id=BBQ4LDGVSFMW4KNTJ7YG6OETOZG7QLIRJBTKLDPNDSNZBF4AT4HA, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.868539164 (780h0m43.56610748s) [noise=true , address=185.167.204.206:4057 , piece_id=UXKGFAX7BMQPCWS3EHT4NQIZPMWW5AADKCVJ3KCLZFFKNGLNIH5Q, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.868880141 (780h0m43.566448457s) [noise=true , address=81.171.14.70:4041 , piece_id=Y27EBWJKXYPD2JGGQP4FD3P54IGGMRVSHGZM3PDEQP34EDDNBIUQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.869236226 (780h0m43.566804532s) [noise=true , address=185.167.204.205:4009 , piece_id=EBCMNZL5AWY66QYIQME5COVCE2RDTFIANF6H5ZGQKMM4W6XZ2RSQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.869590868 (780h0m43.567159185s) [noise=true , address=89.149.201.147:4004 , piece_id=CNSJZVRROO57Z6JFSKAJXTIXJM5CW7LNFKUPARQYOODK62ZME25Q, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.869924462 (780h0m43.567492768s) [noise=true , address=185.167.204.206:4071 , piece_id=GI6IB5RH5RZDG6KATWRTN4VDFAT7M3DYE66JO5ILGBIPAHPCONPQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.870992627 (780h0m43.568560933s) [noise=true , address=185.167.204.205:4030 , piece_id=YYMDFRK6X7D264Z7FYECUT4H5GAQ52LW4FHX2JQ3GVL46EYCQPLA, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.872209531 (780h0m43.569777847s) [noise=true , address=81.171.14.70:4048 , piece_id=7JSD5BZR67JKHAWSE2A4J77C4WRGUTVT7AQSJUISM4YYNN2K2WJQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.873573488 (780h0m43.571141804s) [noise=true , address=81.171.14.70:4044 , piece_id=CXZP7YIMWPFFADSZD5GKUNSL4MDF7LCJ6AYKQO7JXQEAJBIZ2R4Q, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:56.325091724 (780h0m44.02266004s) [upload=686174]: Next returned nil segment
Jan 7 03:29:56.325102373 (780h0m44.022670689s) [upload=686174]: Waiting for error group managing segments...
Jan 7 03:29:56.507974282 (780h0m44.205542619s) [noise=true , address=81.171.14.70:4044 , piece_id=CXZP7YIMWPFFADSZD5GKUNSL4MDF7LCJ6AYKQO7JXQEAJBIZ2R4Q, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.510831971 (780h0m44.208400287s) [noise=true , address=185.167.204.206:4071 , piece_id=GI6IB5RH5RZDG6KATWRTN4VDFAT7M3DYE66JO5ILGBIPAHPCONPQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.512703608 (780h0m44.210271953s) [noise=true , address=185.167.204.206:4037 , piece_id=I5OOGCTL3M6AHE42FBJKXGDVOBU6G2Y4EJQWJ6HVIWDH42C25XXA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.513105689 (780h0m44.210673995s) [noise=true , address=185.167.204.206:4057 , piece_id=UXKGFAX7BMQPCWS3EHT4NQIZPMWW5AADKCVJ3KCLZFFKNGLNIH5Q, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.513837716 (780h0m44.211406052s) [noise=true , address=81.171.14.70:4048 , piece_id=7JSD5BZR67JKHAWSE2A4J77C4WRGUTVT7AQSJUISM4YYNN2K2WJQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.515147433 (780h0m44.212715769s) [noise=true , address=185.167.204.206:4068 , piece_id=YHS7B5DPLDAWU5VW4KPCCDSNZDLRHFVHP7EKRMOBRPKW7TEL3UJA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.516520046 (780h0m44.214088353s) [noise=true , address=185.167.204.206:4066 , piece_id=2CDD52BAQY47RQUCZKAQC2OBDCQA27PPY5Z726XARCV5FTHNHIDQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.516901610 (780h0m44.214469926s) [noise=true , address=185.167.204.206:4069 , piece_id=UE65STV44JVSAFQOGLTUYHI2L6IA75VPZ4BC4BS7JLK7TQ5KAVPA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.518187532 (780h0m44.215755867s) [noise=true , address=185.167.204.205:4015 , piece_id=TQL7XYTFFJ4NIYQVWVGPS5RT5R5OHEEYGAO7YYRONMRUFQNYWRMQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.518735856 (780h0m44.216304172s) [noise=true , address=89.149.201.147:4004 , piece_id=CNSJZVRROO57Z6JFSKAJXTIXJM5CW7LNFKUPARQYOODK62ZME25Q, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.520802537 (780h0m44.218370873s) [noise=true , address=81.171.14.70:4034 , piece_id=SY7EK3RNJNBL5YS4T4R6FBNIXAQB7VGRL4RDGGPJGW7OEUCJK6JA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.524619928 (780h0m44.222188274s) [noise=true , address=81.171.14.70:4047 , piece_id=EJCUGN3SK5QJ2SJ4EJOQKFPRZ2MNWRU7YZGOION2FU6ZQB6MSGRA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.530089416 (780h0m44.227657722s) [noise=true , address=185.167.204.206:4041 , piece_id=2VTQW5MDL6RWCTFV5KCWBYR56KGKVQHZREL5VUKCAWBEVFJSOKYA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.538532469 (780h0m44.236100804s) [noise=true , address=185.167.204.206:4053 , piece_id=GJOCKGE3V35P6MXVDVXX5VY75VLWLOWCY4DVHF2XQW2FUYOU3WBA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.539346680 (780h0m44.236915017s) [noise=true , address=185.167.204.205:4014 , piece_id=RIGBC2O4ARGFCPLEOOLEEP2DWDK3HTWQLDFDRJARLHBVLUQTHZKQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.540129662 (780h0m44.237697999s) [noise=true , address=185.167.204.206:4067 , piece_id=XEGSGVREIWRNLDP5DFLFOSTQNH2TSAIN4OYYRAFQX5BCYFHBRR2Q, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.541661795 (780h0m44.239230111s) [noise=true , address=81.171.14.70:4036 , piece_id=BBQ4LDGVSFMW4KNTJ7YG6OETOZG7QLIRJBTKLDPNDSNZBF4AT4HA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.549338997 (780h0m44.246907333s) [noise=true , address=185.167.204.205:4025 , piece_id=XDTBNB7H465JRLCV3MRB2KOGWJDT3QYCL7QUSW3ZMI2NXMDRKIRA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.554852136 (780h0m44.252420442s) [noise=true , address=185.167.204.205:4027 , piece_id=W7UY6AP6OUFEUDM4IFO6OHC6QQ35ARGW3DRXWFWZYYUZCIOFGAAA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.560151646 (780h0m44.257719952s) [noise=true , address=81.171.14.70:4041 , piece_id=Y27EBWJKXYPD2JGGQP4FD3P54IGGMRVSHGZM3PDEQP34EDDNBIUQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.560310303 (780h0m44.257878639s) [noise=true , address=89.149.201.147:4019 , piece_id=EBHVXES5VC6CENU26CB5WFNRKWHBXBOQ3ANBAF5Y5AL2WHOKSMZA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.560718114 (780h0m44.258286421s) [noise=true , address=185.167.204.205:4009 , piece_id=EBCMNZL5AWY66QYIQME5COVCE2RDTFIANF6H5ZGQKMM4W6XZ2RSQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.562226592 (780h0m44.259794909s) [noise=true , address=185.167.204.205:4004 , piece_id=TN3VC6E4IP5HYHUCEFVXPSPUXAVGMU4IN2BP5VOYGBX4OZRZEDQA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.563539496 (780h0m44.261107832s) [noise=true , address=81.171.14.70:4033 , piece_id=UUCMKUWY2FRDIYNURUHONEOAKORNRRVEMNNNPKQ5MIPLBLEEC6IA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.572914018 (780h0m44.270482324s) [noise=true , address=185.167.204.205:4030 , piece_id=YYMDFRK6X7D264Z7FYECUT4H5GAQ52LW4FHX2JQ3GVL46EYCQPLA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.572975022 (780h0m44.270543369s) [noise=true , address=89.149.201.147:4018 , piece_id=H53SNMW7IPSPSHZJMJ2QVQMWJGLTHLK75A7FTSULPI2KRIREFWTQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.572990171 (780h0m44.270558507s) [seg_pos={0 0}, upload=686174]: Segment reached optimal threshold of 26 pieces.
Jan 7 03:29:56.573318433 (780h0m44.270886829s) [noise=true , address=185.167.204.206:4056 , piece_id=HEJV4MAFEP47TPNEES4WCH3BAVXFOICZQHCVITMAF2ITRXNO5TMA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: expected piece hash; context canceled; EOF
Jan 7 03:29:56.573341336 (780h0m44.270909723s) [noise=true , address=185.167.204.206:4056 , piece_id=HEJV4MAFEP47TPNEES4WCH3BAVXFOICZQHCVITMAF2ITRXNO5TMA, seg_pos={0 0}, upload=686174]: Long tail cancellation due to optimal threshold
Jan 7 03:29:56.573376612 (780h0m44.270944959s) [noise=true , address=185.167.204.205:4005 , piece_id=63Y7QNGHR4J4TIQJCUFULL5IRJ4NH7GCOQTJIGUXUZQHCEOSZ3AQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12B18LegNdvxjRqBgwnFB4Aig1nt5URm9Au7bWXsfbBPyCnterM): protocol: expected piece hash; context canceled; EOF
Jan 7 03:29:56.573415235 (780h0m44.270983571s) [noise=true , address=185.167.204.205:4005 , piece_id=63Y7QNGHR4J4TIQJCUFULL5IRJ4NH7GCOQTJIGUXUZQHCEOSZ3AQ, seg_pos={0 0}, upload=686174]: Long tail cancellation due to optimal threshold
Jan 7 03:29:56.573445671 (780h0m44.271014007s) [seg_pos={0 0}, upload=686174]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 7 03:29:56.573614446 (780h0m44.271182782s) [upload=686174]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 7 03:29:56.573626158 (780h0m44.271194495s) [upload=686174]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 7 03:29:56.727636981 (780h0m44.425205288s) [upload=686174]: Done uploading segments...
Jan 7 03:29:56.727651439 (780h0m44.425219744s) [upload=686174]: Upload finished. err: <nil>
Duration: 2.203090212s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
2.207706908s trace:
https://jaeger.dev.storj.io/trace/3334419549ef794f
FAIL (2026-01-07 03:37:06 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
IRJ4NH7GCOQTJIGUXUZQHCEOSZ3AQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.867845507 (780h0m43.565413814s) [noise=true , address=81.171.14.70:4047 , piece_id=EJCUGN3SK5QJ2SJ4EJOQKFPRZ2MNWRU7YZGOION2FU6ZQB6MSGRA, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.868202545 (780h0m43.565770861s) [noise=true , address=81.171.14.70:4036 , piece_id=BBQ4LDGVSFMW4KNTJ7YG6OETOZG7QLIRJBTKLDPNDSNZBF4AT4HA, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.868539164 (780h0m43.56610748s) [noise=true , address=185.167.204.206:4057 , piece_id=UXKGFAX7BMQPCWS3EHT4NQIZPMWW5AADKCVJ3KCLZFFKNGLNIH5Q, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.868880141 (780h0m43.566448457s) [noise=true , address=81.171.14.70:4041 , piece_id=Y27EBWJKXYPD2JGGQP4FD3P54IGGMRVSHGZM3PDEQP34EDDNBIUQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.869236226 (780h0m43.566804532s) [noise=true , address=185.167.204.205:4009 , piece_id=EBCMNZL5AWY66QYIQME5COVCE2RDTFIANF6H5ZGQKMM4W6XZ2RSQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.869590868 (780h0m43.567159185s) [noise=true , address=89.149.201.147:4004 , piece_id=CNSJZVRROO57Z6JFSKAJXTIXJM5CW7LNFKUPARQYOODK62ZME25Q, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.869924462 (780h0m43.567492768s) [noise=true , address=185.167.204.206:4071 , piece_id=GI6IB5RH5RZDG6KATWRTN4VDFAT7M3DYE66JO5ILGBIPAHPCONPQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.870992627 (780h0m43.568560933s) [noise=true , address=185.167.204.205:4030 , piece_id=YYMDFRK6X7D264Z7FYECUT4H5GAQ52LW4FHX2JQ3GVL46EYCQPLA, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.872209531 (780h0m43.569777847s) [noise=true , address=81.171.14.70:4048 , piece_id=7JSD5BZR67JKHAWSE2A4J77C4WRGUTVT7AQSJUISM4YYNN2K2WJQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.873573488 (780h0m43.571141804s) [noise=true , address=81.171.14.70:4044 , piece_id=CXZP7YIMWPFFADSZD5GKUNSL4MDF7LCJ6AYKQO7JXQEAJBIZ2R4Q, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:56.325091724 (780h0m44.02266004s) [upload=686174]: Next returned nil segment
Jan 7 03:29:56.325102373 (780h0m44.022670689s) [upload=686174]: Waiting for error group managing segments...
Jan 7 03:29:56.507974282 (780h0m44.205542619s) [noise=true , address=81.171.14.70:4044 , piece_id=CXZP7YIMWPFFADSZD5GKUNSL4MDF7LCJ6AYKQO7JXQEAJBIZ2R4Q, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.510831971 (780h0m44.208400287s) [noise=true , address=185.167.204.206:4071 , piece_id=GI6IB5RH5RZDG6KATWRTN4VDFAT7M3DYE66JO5ILGBIPAHPCONPQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.512703608 (780h0m44.210271953s) [noise=true , address=185.167.204.206:4037 , piece_id=I5OOGCTL3M6AHE42FBJKXGDVOBU6G2Y4EJQWJ6HVIWDH42C25XXA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.513105689 (780h0m44.210673995s) [noise=true , address=185.167.204.206:4057 , piece_id=UXKGFAX7BMQPCWS3EHT4NQIZPMWW5AADKCVJ3KCLZFFKNGLNIH5Q, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.513837716 (780h0m44.211406052s) [noise=true , address=81.171.14.70:4048 , piece_id=7JSD5BZR67JKHAWSE2A4J77C4WRGUTVT7AQSJUISM4YYNN2K2WJQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.515147433 (780h0m44.212715769s) [noise=true , address=185.167.204.206:4068 , piece_id=YHS7B5DPLDAWU5VW4KPCCDSNZDLRHFVHP7EKRMOBRPKW7TEL3UJA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.516520046 (780h0m44.214088353s) [noise=true , address=185.167.204.206:4066 , piece_id=2CDD52BAQY47RQUCZKAQC2OBDCQA27PPY5Z726XARCV5FTHNHIDQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.516901610 (780h0m44.214469926s) [noise=true , address=185.167.204.206:4069 , piece_id=UE65STV44JVSAFQOGLTUYHI2L6IA75VPZ4BC4BS7JLK7TQ5KAVPA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.518187532 (780h0m44.215755867s) [noise=true , address=185.167.204.205:4015 , piece_id=TQL7XYTFFJ4NIYQVWVGPS5RT5R5OHEEYGAO7YYRONMRUFQNYWRMQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.518735856 (780h0m44.216304172s) [noise=true , address=89.149.201.147:4004 , piece_id=CNSJZVRROO57Z6JFSKAJXTIXJM5CW7LNFKUPARQYOODK62ZME25Q, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.520802537 (780h0m44.218370873s) [noise=true , address=81.171.14.70:4034 , piece_id=SY7EK3RNJNBL5YS4T4R6FBNIXAQB7VGRL4RDGGPJGW7OEUCJK6JA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.524619928 (780h0m44.222188274s) [noise=true , address=81.171.14.70:4047 , piece_id=EJCUGN3SK5QJ2SJ4EJOQKFPRZ2MNWRU7YZGOION2FU6ZQB6MSGRA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.530089416 (780h0m44.227657722s) [noise=true , address=185.167.204.206:4041 , piece_id=2VTQW5MDL6RWCTFV5KCWBYR56KGKVQHZREL5VUKCAWBEVFJSOKYA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.538532469 (780h0m44.236100804s) [noise=true , address=185.167.204.206:4053 , piece_id=GJOCKGE3V35P6MXVDVXX5VY75VLWLOWCY4DVHF2XQW2FUYOU3WBA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.539346680 (780h0m44.236915017s) [noise=true , address=185.167.204.205:4014 , piece_id=RIGBC2O4ARGFCPLEOOLEEP2DWDK3HTWQLDFDRJARLHBVLUQTHZKQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.540129662 (780h0m44.237697999s) [noise=true , address=185.167.204.206:4067 , piece_id=XEGSGVREIWRNLDP5DFLFOSTQNH2TSAIN4OYYRAFQX5BCYFHBRR2Q, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.541661795 (780h0m44.239230111s) [noise=true , address=81.171.14.70:4036 , piece_id=BBQ4LDGVSFMW4KNTJ7YG6OETOZG7QLIRJBTKLDPNDSNZBF4AT4HA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.549338997 (780h0m44.246907333s) [noise=true , address=185.167.204.205:4025 , piece_id=XDTBNB7H465JRLCV3MRB2KOGWJDT3QYCL7QUSW3ZMI2NXMDRKIRA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.554852136 (780h0m44.252420442s) [noise=true , address=185.167.204.205:4027 , piece_id=W7UY6AP6OUFEUDM4IFO6OHC6QQ35ARGW3DRXWFWZYYUZCIOFGAAA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.560151646 (780h0m44.257719952s) [noise=true , address=81.171.14.70:4041 , piece_id=Y27EBWJKXYPD2JGGQP4FD3P54IGGMRVSHGZM3PDEQP34EDDNBIUQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.560310303 (780h0m44.257878639s) [noise=true , address=89.149.201.147:4019 , piece_id=EBHVXES5VC6CENU26CB5WFNRKWHBXBOQ3ANBAF5Y5AL2WHOKSMZA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.560718114 (780h0m44.258286421s) [noise=true , address=185.167.204.205:4009 , piece_id=EBCMNZL5AWY66QYIQME5COVCE2RDTFIANF6H5ZGQKMM4W6XZ2RSQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.562226592 (780h0m44.259794909s) [noise=true , address=185.167.204.205:4004 , piece_id=TN3VC6E4IP5HYHUCEFVXPSPUXAVGMU4IN2BP5VOYGBX4OZRZEDQA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.563539496 (780h0m44.261107832s) [noise=true , address=81.171.14.70:4033 , piece_id=UUCMKUWY2FRDIYNURUHONEOAKORNRRVEMNNNPKQ5MIPLBLEEC6IA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.572914018 (780h0m44.270482324s) [noise=true , address=185.167.204.205:4030 , piece_id=YYMDFRK6X7D264Z7FYECUT4H5GAQ52LW4FHX2JQ3GVL46EYCQPLA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.572975022 (780h0m44.270543369s) [noise=true , address=89.149.201.147:4018 , piece_id=H53SNMW7IPSPSHZJMJ2QVQMWJGLTHLK75A7FTSULPI2KRIREFWTQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.572990171 (780h0m44.270558507s) [seg_pos={0 0}, upload=686174]: Segment reached optimal threshold of 26 pieces.
Jan 7 03:29:56.573318433 (780h0m44.270886829s) [noise=true , address=185.167.204.206:4056 , piece_id=HEJV4MAFEP47TPNEES4WCH3BAVXFOICZQHCVITMAF2ITRXNO5TMA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: expected piece hash; context canceled; EOF
Jan 7 03:29:56.573341336 (780h0m44.270909723s) [noise=true , address=185.167.204.206:4056 , piece_id=HEJV4MAFEP47TPNEES4WCH3BAVXFOICZQHCVITMAF2ITRXNO5TMA, seg_pos={0 0}, upload=686174]: Long tail cancellation due to optimal threshold
Jan 7 03:29:56.573376612 (780h0m44.270944959s) [noise=true , address=185.167.204.205:4005 , piece_id=63Y7QNGHR4J4TIQJCUFULL5IRJ4NH7GCOQTJIGUXUZQHCEOSZ3AQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12B18LegNdvxjRqBgwnFB4Aig1nt5URm9Au7bWXsfbBPyCnterM): protocol: expected piece hash; context canceled; EOF
Jan 7 03:29:56.573415235 (780h0m44.270983571s) [noise=true , address=185.167.204.205:4005 , piece_id=63Y7QNGHR4J4TIQJCUFULL5IRJ4NH7GCOQTJIGUXUZQHCEOSZ3AQ, seg_pos={0 0}, upload=686174]: Long tail cancellation due to optimal threshold
Jan 7 03:29:56.573445671 (780h0m44.271014007s) [seg_pos={0 0}, upload=686174]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 7 03:29:56.573614446 (780h0m44.271182782s) [upload=686174]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 7 03:29:56.573626158 (780h0m44.271194495s) [upload=686174]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 7 03:29:56.727636981 (780h0m44.425205288s) [upload=686174]: Done uploading segments...
Jan 7 03:29:56.727651439 (780h0m44.425219744s) [upload=686174]: Upload finished. err: <nil>
Duration: 2.207725984s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
2.196536491s trace:
https://jaeger.dev.storj.io/trace/3334419549ef794f
FAIL (2026-01-07 03:36:31 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
IRJ4NH7GCOQTJIGUXUZQHCEOSZ3AQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.867845507 (780h0m43.565413814s) [noise=true , address=81.171.14.70:4047 , piece_id=EJCUGN3SK5QJ2SJ4EJOQKFPRZ2MNWRU7YZGOION2FU6ZQB6MSGRA, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.868202545 (780h0m43.565770861s) [noise=true , address=81.171.14.70:4036 , piece_id=BBQ4LDGVSFMW4KNTJ7YG6OETOZG7QLIRJBTKLDPNDSNZBF4AT4HA, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.868539164 (780h0m43.56610748s) [noise=true , address=185.167.204.206:4057 , piece_id=UXKGFAX7BMQPCWS3EHT4NQIZPMWW5AADKCVJ3KCLZFFKNGLNIH5Q, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.868880141 (780h0m43.566448457s) [noise=true , address=81.171.14.70:4041 , piece_id=Y27EBWJKXYPD2JGGQP4FD3P54IGGMRVSHGZM3PDEQP34EDDNBIUQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.869236226 (780h0m43.566804532s) [noise=true , address=185.167.204.205:4009 , piece_id=EBCMNZL5AWY66QYIQME5COVCE2RDTFIANF6H5ZGQKMM4W6XZ2RSQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.869590868 (780h0m43.567159185s) [noise=true , address=89.149.201.147:4004 , piece_id=CNSJZVRROO57Z6JFSKAJXTIXJM5CW7LNFKUPARQYOODK62ZME25Q, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.869924462 (780h0m43.567492768s) [noise=true , address=185.167.204.206:4071 , piece_id=GI6IB5RH5RZDG6KATWRTN4VDFAT7M3DYE66JO5ILGBIPAHPCONPQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.870992627 (780h0m43.568560933s) [noise=true , address=185.167.204.205:4030 , piece_id=YYMDFRK6X7D264Z7FYECUT4H5GAQ52LW4FHX2JQ3GVL46EYCQPLA, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.872209531 (780h0m43.569777847s) [noise=true , address=81.171.14.70:4048 , piece_id=7JSD5BZR67JKHAWSE2A4J77C4WRGUTVT7AQSJUISM4YYNN2K2WJQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.873573488 (780h0m43.571141804s) [noise=true , address=81.171.14.70:4044 , piece_id=CXZP7YIMWPFFADSZD5GKUNSL4MDF7LCJ6AYKQO7JXQEAJBIZ2R4Q, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:56.325091724 (780h0m44.02266004s) [upload=686174]: Next returned nil segment
Jan 7 03:29:56.325102373 (780h0m44.022670689s) [upload=686174]: Waiting for error group managing segments...
Jan 7 03:29:56.507974282 (780h0m44.205542619s) [noise=true , address=81.171.14.70:4044 , piece_id=CXZP7YIMWPFFADSZD5GKUNSL4MDF7LCJ6AYKQO7JXQEAJBIZ2R4Q, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.510831971 (780h0m44.208400287s) [noise=true , address=185.167.204.206:4071 , piece_id=GI6IB5RH5RZDG6KATWRTN4VDFAT7M3DYE66JO5ILGBIPAHPCONPQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.512703608 (780h0m44.210271953s) [noise=true , address=185.167.204.206:4037 , piece_id=I5OOGCTL3M6AHE42FBJKXGDVOBU6G2Y4EJQWJ6HVIWDH42C25XXA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.513105689 (780h0m44.210673995s) [noise=true , address=185.167.204.206:4057 , piece_id=UXKGFAX7BMQPCWS3EHT4NQIZPMWW5AADKCVJ3KCLZFFKNGLNIH5Q, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.513837716 (780h0m44.211406052s) [noise=true , address=81.171.14.70:4048 , piece_id=7JSD5BZR67JKHAWSE2A4J77C4WRGUTVT7AQSJUISM4YYNN2K2WJQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.515147433 (780h0m44.212715769s) [noise=true , address=185.167.204.206:4068 , piece_id=YHS7B5DPLDAWU5VW4KPCCDSNZDLRHFVHP7EKRMOBRPKW7TEL3UJA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.516520046 (780h0m44.214088353s) [noise=true , address=185.167.204.206:4066 , piece_id=2CDD52BAQY47RQUCZKAQC2OBDCQA27PPY5Z726XARCV5FTHNHIDQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.516901610 (780h0m44.214469926s) [noise=true , address=185.167.204.206:4069 , piece_id=UE65STV44JVSAFQOGLTUYHI2L6IA75VPZ4BC4BS7JLK7TQ5KAVPA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.518187532 (780h0m44.215755867s) [noise=true , address=185.167.204.205:4015 , piece_id=TQL7XYTFFJ4NIYQVWVGPS5RT5R5OHEEYGAO7YYRONMRUFQNYWRMQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.518735856 (780h0m44.216304172s) [noise=true , address=89.149.201.147:4004 , piece_id=CNSJZVRROO57Z6JFSKAJXTIXJM5CW7LNFKUPARQYOODK62ZME25Q, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.520802537 (780h0m44.218370873s) [noise=true , address=81.171.14.70:4034 , piece_id=SY7EK3RNJNBL5YS4T4R6FBNIXAQB7VGRL4RDGGPJGW7OEUCJK6JA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.524619928 (780h0m44.222188274s) [noise=true , address=81.171.14.70:4047 , piece_id=EJCUGN3SK5QJ2SJ4EJOQKFPRZ2MNWRU7YZGOION2FU6ZQB6MSGRA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.530089416 (780h0m44.227657722s) [noise=true , address=185.167.204.206:4041 , piece_id=2VTQW5MDL6RWCTFV5KCWBYR56KGKVQHZREL5VUKCAWBEVFJSOKYA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.538532469 (780h0m44.236100804s) [noise=true , address=185.167.204.206:4053 , piece_id=GJOCKGE3V35P6MXVDVXX5VY75VLWLOWCY4DVHF2XQW2FUYOU3WBA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.539346680 (780h0m44.236915017s) [noise=true , address=185.167.204.205:4014 , piece_id=RIGBC2O4ARGFCPLEOOLEEP2DWDK3HTWQLDFDRJARLHBVLUQTHZKQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.540129662 (780h0m44.237697999s) [noise=true , address=185.167.204.206:4067 , piece_id=XEGSGVREIWRNLDP5DFLFOSTQNH2TSAIN4OYYRAFQX5BCYFHBRR2Q, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.541661795 (780h0m44.239230111s) [noise=true , address=81.171.14.70:4036 , piece_id=BBQ4LDGVSFMW4KNTJ7YG6OETOZG7QLIRJBTKLDPNDSNZBF4AT4HA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.549338997 (780h0m44.246907333s) [noise=true , address=185.167.204.205:4025 , piece_id=XDTBNB7H465JRLCV3MRB2KOGWJDT3QYCL7QUSW3ZMI2NXMDRKIRA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.554852136 (780h0m44.252420442s) [noise=true , address=185.167.204.205:4027 , piece_id=W7UY6AP6OUFEUDM4IFO6OHC6QQ35ARGW3DRXWFWZYYUZCIOFGAAA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.560151646 (780h0m44.257719952s) [noise=true , address=81.171.14.70:4041 , piece_id=Y27EBWJKXYPD2JGGQP4FD3P54IGGMRVSHGZM3PDEQP34EDDNBIUQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.560310303 (780h0m44.257878639s) [noise=true , address=89.149.201.147:4019 , piece_id=EBHVXES5VC6CENU26CB5WFNRKWHBXBOQ3ANBAF5Y5AL2WHOKSMZA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.560718114 (780h0m44.258286421s) [noise=true , address=185.167.204.205:4009 , piece_id=EBCMNZL5AWY66QYIQME5COVCE2RDTFIANF6H5ZGQKMM4W6XZ2RSQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.562226592 (780h0m44.259794909s) [noise=true , address=185.167.204.205:4004 , piece_id=TN3VC6E4IP5HYHUCEFVXPSPUXAVGMU4IN2BP5VOYGBX4OZRZEDQA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.563539496 (780h0m44.261107832s) [noise=true , address=81.171.14.70:4033 , piece_id=UUCMKUWY2FRDIYNURUHONEOAKORNRRVEMNNNPKQ5MIPLBLEEC6IA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.572914018 (780h0m44.270482324s) [noise=true , address=185.167.204.205:4030 , piece_id=YYMDFRK6X7D264Z7FYECUT4H5GAQ52LW4FHX2JQ3GVL46EYCQPLA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.572975022 (780h0m44.270543369s) [noise=true , address=89.149.201.147:4018 , piece_id=H53SNMW7IPSPSHZJMJ2QVQMWJGLTHLK75A7FTSULPI2KRIREFWTQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.572990171 (780h0m44.270558507s) [seg_pos={0 0}, upload=686174]: Segment reached optimal threshold of 26 pieces.
Jan 7 03:29:56.573318433 (780h0m44.270886829s) [noise=true , address=185.167.204.206:4056 , piece_id=HEJV4MAFEP47TPNEES4WCH3BAVXFOICZQHCVITMAF2ITRXNO5TMA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: expected piece hash; context canceled; EOF
Jan 7 03:29:56.573341336 (780h0m44.270909723s) [noise=true , address=185.167.204.206:4056 , piece_id=HEJV4MAFEP47TPNEES4WCH3BAVXFOICZQHCVITMAF2ITRXNO5TMA, seg_pos={0 0}, upload=686174]: Long tail cancellation due to optimal threshold
Jan 7 03:29:56.573376612 (780h0m44.270944959s) [noise=true , address=185.167.204.205:4005 , piece_id=63Y7QNGHR4J4TIQJCUFULL5IRJ4NH7GCOQTJIGUXUZQHCEOSZ3AQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12B18LegNdvxjRqBgwnFB4Aig1nt5URm9Au7bWXsfbBPyCnterM): protocol: expected piece hash; context canceled; EOF
Jan 7 03:29:56.573415235 (780h0m44.270983571s) [noise=true , address=185.167.204.205:4005 , piece_id=63Y7QNGHR4J4TIQJCUFULL5IRJ4NH7GCOQTJIGUXUZQHCEOSZ3AQ, seg_pos={0 0}, upload=686174]: Long tail cancellation due to optimal threshold
Jan 7 03:29:56.573445671 (780h0m44.271014007s) [seg_pos={0 0}, upload=686174]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 7 03:29:56.573614446 (780h0m44.271182782s) [upload=686174]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 7 03:29:56.573626158 (780h0m44.271194495s) [upload=686174]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 7 03:29:56.727636981 (780h0m44.425205288s) [upload=686174]: Done uploading segments...
Jan 7 03:29:56.727651439 (780h0m44.425219744s) [upload=686174]: Upload finished. err: <nil>
Duration: 2.196558713s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [....................................................X.X.....] duration:
822.399219ms trace:
https://jaeger.dev.storj.io/trace/7d6ac2d67d77a8e
FAIL (2026-01-07 03:36:27 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 822.414698ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
4 out of 60 is failed (threshold=3) [.............................................XX.XX..........] duration:
2.636821911s trace:
https://jaeger.dev.storj.io/trace/5a0e658196b93032
FAIL (2026-01-07 03:36:26 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 2.63684182s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....................................................X.X....] duration:
853.690167ms trace:
https://jaeger.dev.storj.io/trace/7d6ac2d67d77a8e
FAIL (2026-01-07 03:35:33 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 853.713571ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
2.308530827s trace:
https://jaeger.dev.storj.io/trace/3334419549ef794f
FAIL (2026-01-07 03:35:19 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
IRJ4NH7GCOQTJIGUXUZQHCEOSZ3AQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.867845507 (780h0m43.565413814s) [noise=true , address=81.171.14.70:4047 , piece_id=EJCUGN3SK5QJ2SJ4EJOQKFPRZ2MNWRU7YZGOION2FU6ZQB6MSGRA, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.868202545 (780h0m43.565770861s) [noise=true , address=81.171.14.70:4036 , piece_id=BBQ4LDGVSFMW4KNTJ7YG6OETOZG7QLIRJBTKLDPNDSNZBF4AT4HA, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.868539164 (780h0m43.56610748s) [noise=true , address=185.167.204.206:4057 , piece_id=UXKGFAX7BMQPCWS3EHT4NQIZPMWW5AADKCVJ3KCLZFFKNGLNIH5Q, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.868880141 (780h0m43.566448457s) [noise=true , address=81.171.14.70:4041 , piece_id=Y27EBWJKXYPD2JGGQP4FD3P54IGGMRVSHGZM3PDEQP34EDDNBIUQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.869236226 (780h0m43.566804532s) [noise=true , address=185.167.204.205:4009 , piece_id=EBCMNZL5AWY66QYIQME5COVCE2RDTFIANF6H5ZGQKMM4W6XZ2RSQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.869590868 (780h0m43.567159185s) [noise=true , address=89.149.201.147:4004 , piece_id=CNSJZVRROO57Z6JFSKAJXTIXJM5CW7LNFKUPARQYOODK62ZME25Q, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.869924462 (780h0m43.567492768s) [noise=true , address=185.167.204.206:4071 , piece_id=GI6IB5RH5RZDG6KATWRTN4VDFAT7M3DYE66JO5ILGBIPAHPCONPQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.870992627 (780h0m43.568560933s) [noise=true , address=185.167.204.205:4030 , piece_id=YYMDFRK6X7D264Z7FYECUT4H5GAQ52LW4FHX2JQ3GVL46EYCQPLA, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.872209531 (780h0m43.569777847s) [noise=true , address=81.171.14.70:4048 , piece_id=7JSD5BZR67JKHAWSE2A4J77C4WRGUTVT7AQSJUISM4YYNN2K2WJQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.873573488 (780h0m43.571141804s) [noise=true , address=81.171.14.70:4044 , piece_id=CXZP7YIMWPFFADSZD5GKUNSL4MDF7LCJ6AYKQO7JXQEAJBIZ2R4Q, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:56.325091724 (780h0m44.02266004s) [upload=686174]: Next returned nil segment
Jan 7 03:29:56.325102373 (780h0m44.022670689s) [upload=686174]: Waiting for error group managing segments...
Jan 7 03:29:56.507974282 (780h0m44.205542619s) [noise=true , address=81.171.14.70:4044 , piece_id=CXZP7YIMWPFFADSZD5GKUNSL4MDF7LCJ6AYKQO7JXQEAJBIZ2R4Q, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.510831971 (780h0m44.208400287s) [noise=true , address=185.167.204.206:4071 , piece_id=GI6IB5RH5RZDG6KATWRTN4VDFAT7M3DYE66JO5ILGBIPAHPCONPQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.512703608 (780h0m44.210271953s) [noise=true , address=185.167.204.206:4037 , piece_id=I5OOGCTL3M6AHE42FBJKXGDVOBU6G2Y4EJQWJ6HVIWDH42C25XXA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.513105689 (780h0m44.210673995s) [noise=true , address=185.167.204.206:4057 , piece_id=UXKGFAX7BMQPCWS3EHT4NQIZPMWW5AADKCVJ3KCLZFFKNGLNIH5Q, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.513837716 (780h0m44.211406052s) [noise=true , address=81.171.14.70:4048 , piece_id=7JSD5BZR67JKHAWSE2A4J77C4WRGUTVT7AQSJUISM4YYNN2K2WJQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.515147433 (780h0m44.212715769s) [noise=true , address=185.167.204.206:4068 , piece_id=YHS7B5DPLDAWU5VW4KPCCDSNZDLRHFVHP7EKRMOBRPKW7TEL3UJA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.516520046 (780h0m44.214088353s) [noise=true , address=185.167.204.206:4066 , piece_id=2CDD52BAQY47RQUCZKAQC2OBDCQA27PPY5Z726XARCV5FTHNHIDQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.516901610 (780h0m44.214469926s) [noise=true , address=185.167.204.206:4069 , piece_id=UE65STV44JVSAFQOGLTUYHI2L6IA75VPZ4BC4BS7JLK7TQ5KAVPA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.518187532 (780h0m44.215755867s) [noise=true , address=185.167.204.205:4015 , piece_id=TQL7XYTFFJ4NIYQVWVGPS5RT5R5OHEEYGAO7YYRONMRUFQNYWRMQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.518735856 (780h0m44.216304172s) [noise=true , address=89.149.201.147:4004 , piece_id=CNSJZVRROO57Z6JFSKAJXTIXJM5CW7LNFKUPARQYOODK62ZME25Q, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.520802537 (780h0m44.218370873s) [noise=true , address=81.171.14.70:4034 , piece_id=SY7EK3RNJNBL5YS4T4R6FBNIXAQB7VGRL4RDGGPJGW7OEUCJK6JA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.524619928 (780h0m44.222188274s) [noise=true , address=81.171.14.70:4047 , piece_id=EJCUGN3SK5QJ2SJ4EJOQKFPRZ2MNWRU7YZGOION2FU6ZQB6MSGRA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.530089416 (780h0m44.227657722s) [noise=true , address=185.167.204.206:4041 , piece_id=2VTQW5MDL6RWCTFV5KCWBYR56KGKVQHZREL5VUKCAWBEVFJSOKYA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.538532469 (780h0m44.236100804s) [noise=true , address=185.167.204.206:4053 , piece_id=GJOCKGE3V35P6MXVDVXX5VY75VLWLOWCY4DVHF2XQW2FUYOU3WBA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.539346680 (780h0m44.236915017s) [noise=true , address=185.167.204.205:4014 , piece_id=RIGBC2O4ARGFCPLEOOLEEP2DWDK3HTWQLDFDRJARLHBVLUQTHZKQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.540129662 (780h0m44.237697999s) [noise=true , address=185.167.204.206:4067 , piece_id=XEGSGVREIWRNLDP5DFLFOSTQNH2TSAIN4OYYRAFQX5BCYFHBRR2Q, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.541661795 (780h0m44.239230111s) [noise=true , address=81.171.14.70:4036 , piece_id=BBQ4LDGVSFMW4KNTJ7YG6OETOZG7QLIRJBTKLDPNDSNZBF4AT4HA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.549338997 (780h0m44.246907333s) [noise=true , address=185.167.204.205:4025 , piece_id=XDTBNB7H465JRLCV3MRB2KOGWJDT3QYCL7QUSW3ZMI2NXMDRKIRA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.554852136 (780h0m44.252420442s) [noise=true , address=185.167.204.205:4027 , piece_id=W7UY6AP6OUFEUDM4IFO6OHC6QQ35ARGW3DRXWFWZYYUZCIOFGAAA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.560151646 (780h0m44.257719952s) [noise=true , address=81.171.14.70:4041 , piece_id=Y27EBWJKXYPD2JGGQP4FD3P54IGGMRVSHGZM3PDEQP34EDDNBIUQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.560310303 (780h0m44.257878639s) [noise=true , address=89.149.201.147:4019 , piece_id=EBHVXES5VC6CENU26CB5WFNRKWHBXBOQ3ANBAF5Y5AL2WHOKSMZA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.560718114 (780h0m44.258286421s) [noise=true , address=185.167.204.205:4009 , piece_id=EBCMNZL5AWY66QYIQME5COVCE2RDTFIANF6H5ZGQKMM4W6XZ2RSQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.562226592 (780h0m44.259794909s) [noise=true , address=185.167.204.205:4004 , piece_id=TN3VC6E4IP5HYHUCEFVXPSPUXAVGMU4IN2BP5VOYGBX4OZRZEDQA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.563539496 (780h0m44.261107832s) [noise=true , address=81.171.14.70:4033 , piece_id=UUCMKUWY2FRDIYNURUHONEOAKORNRRVEMNNNPKQ5MIPLBLEEC6IA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.572914018 (780h0m44.270482324s) [noise=true , address=185.167.204.205:4030 , piece_id=YYMDFRK6X7D264Z7FYECUT4H5GAQ52LW4FHX2JQ3GVL46EYCQPLA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.572975022 (780h0m44.270543369s) [noise=true , address=89.149.201.147:4018 , piece_id=H53SNMW7IPSPSHZJMJ2QVQMWJGLTHLK75A7FTSULPI2KRIREFWTQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.572990171 (780h0m44.270558507s) [seg_pos={0 0}, upload=686174]: Segment reached optimal threshold of 26 pieces.
Jan 7 03:29:56.573318433 (780h0m44.270886829s) [noise=true , address=185.167.204.206:4056 , piece_id=HEJV4MAFEP47TPNEES4WCH3BAVXFOICZQHCVITMAF2ITRXNO5TMA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: expected piece hash; context canceled; EOF
Jan 7 03:29:56.573341336 (780h0m44.270909723s) [noise=true , address=185.167.204.206:4056 , piece_id=HEJV4MAFEP47TPNEES4WCH3BAVXFOICZQHCVITMAF2ITRXNO5TMA, seg_pos={0 0}, upload=686174]: Long tail cancellation due to optimal threshold
Jan 7 03:29:56.573376612 (780h0m44.270944959s) [noise=true , address=185.167.204.205:4005 , piece_id=63Y7QNGHR4J4TIQJCUFULL5IRJ4NH7GCOQTJIGUXUZQHCEOSZ3AQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12B18LegNdvxjRqBgwnFB4Aig1nt5URm9Au7bWXsfbBPyCnterM): protocol: expected piece hash; context canceled; EOF
Jan 7 03:29:56.573415235 (780h0m44.270983571s) [noise=true , address=185.167.204.205:4005 , piece_id=63Y7QNGHR4J4TIQJCUFULL5IRJ4NH7GCOQTJIGUXUZQHCEOSZ3AQ, seg_pos={0 0}, upload=686174]: Long tail cancellation due to optimal threshold
Jan 7 03:29:56.573445671 (780h0m44.271014007s) [seg_pos={0 0}, upload=686174]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 7 03:29:56.573614446 (780h0m44.271182782s) [upload=686174]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 7 03:29:56.573626158 (780h0m44.271194495s) [upload=686174]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 7 03:29:56.727636981 (780h0m44.425205288s) [upload=686174]: Done uploading segments...
Jan 7 03:29:56.727651439 (780h0m44.425219744s) [upload=686174]: Upload finished. err: <nil>
Duration: 2.308558358s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
4 out of 60 is failed (threshold=3) [..............................................XX.XX.........] duration:
2.76584815s trace:
https://jaeger.dev.storj.io/trace/5a0e658196b93032
FAIL (2026-01-07 03:35:15 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 2.765871873s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [......................................................X.X...] duration:
840.747105ms trace:
https://jaeger.dev.storj.io/trace/7d6ac2d67d77a8e
FAIL (2026-01-07 03:35:09 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 840.765659ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
4 out of 60 is failed (threshold=3) [...............................................XX.XX........] duration:
2.846801912s trace:
https://jaeger.dev.storj.io/trace/5a0e658196b93032
FAIL (2026-01-07 03:34:16 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 2.846921314s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
2.15324097s trace:
https://jaeger.dev.storj.io/trace/3334419549ef794f
FAIL (2026-01-07 03:34:15 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
IRJ4NH7GCOQTJIGUXUZQHCEOSZ3AQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.867845507 (780h0m43.565413814s) [noise=true , address=81.171.14.70:4047 , piece_id=EJCUGN3SK5QJ2SJ4EJOQKFPRZ2MNWRU7YZGOION2FU6ZQB6MSGRA, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.868202545 (780h0m43.565770861s) [noise=true , address=81.171.14.70:4036 , piece_id=BBQ4LDGVSFMW4KNTJ7YG6OETOZG7QLIRJBTKLDPNDSNZBF4AT4HA, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.868539164 (780h0m43.56610748s) [noise=true , address=185.167.204.206:4057 , piece_id=UXKGFAX7BMQPCWS3EHT4NQIZPMWW5AADKCVJ3KCLZFFKNGLNIH5Q, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.868880141 (780h0m43.566448457s) [noise=true , address=81.171.14.70:4041 , piece_id=Y27EBWJKXYPD2JGGQP4FD3P54IGGMRVSHGZM3PDEQP34EDDNBIUQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.869236226 (780h0m43.566804532s) [noise=true , address=185.167.204.205:4009 , piece_id=EBCMNZL5AWY66QYIQME5COVCE2RDTFIANF6H5ZGQKMM4W6XZ2RSQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.869590868 (780h0m43.567159185s) [noise=true , address=89.149.201.147:4004 , piece_id=CNSJZVRROO57Z6JFSKAJXTIXJM5CW7LNFKUPARQYOODK62ZME25Q, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.869924462 (780h0m43.567492768s) [noise=true , address=185.167.204.206:4071 , piece_id=GI6IB5RH5RZDG6KATWRTN4VDFAT7M3DYE66JO5ILGBIPAHPCONPQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.870992627 (780h0m43.568560933s) [noise=true , address=185.167.204.205:4030 , piece_id=YYMDFRK6X7D264Z7FYECUT4H5GAQ52LW4FHX2JQ3GVL46EYCQPLA, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.872209531 (780h0m43.569777847s) [noise=true , address=81.171.14.70:4048 , piece_id=7JSD5BZR67JKHAWSE2A4J77C4WRGUTVT7AQSJUISM4YYNN2K2WJQ, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:55.873573488 (780h0m43.571141804s) [noise=true , address=81.171.14.70:4044 , piece_id=CXZP7YIMWPFFADSZD5GKUNSL4MDF7LCJ6AYKQO7JXQEAJBIZ2R4Q, seg_pos={0 0}, upload=686174]: Uploading piece...
Jan 7 03:29:56.325091724 (780h0m44.02266004s) [upload=686174]: Next returned nil segment
Jan 7 03:29:56.325102373 (780h0m44.022670689s) [upload=686174]: Waiting for error group managing segments...
Jan 7 03:29:56.507974282 (780h0m44.205542619s) [noise=true , address=81.171.14.70:4044 , piece_id=CXZP7YIMWPFFADSZD5GKUNSL4MDF7LCJ6AYKQO7JXQEAJBIZ2R4Q, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.510831971 (780h0m44.208400287s) [noise=true , address=185.167.204.206:4071 , piece_id=GI6IB5RH5RZDG6KATWRTN4VDFAT7M3DYE66JO5ILGBIPAHPCONPQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.512703608 (780h0m44.210271953s) [noise=true , address=185.167.204.206:4037 , piece_id=I5OOGCTL3M6AHE42FBJKXGDVOBU6G2Y4EJQWJ6HVIWDH42C25XXA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.513105689 (780h0m44.210673995s) [noise=true , address=185.167.204.206:4057 , piece_id=UXKGFAX7BMQPCWS3EHT4NQIZPMWW5AADKCVJ3KCLZFFKNGLNIH5Q, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.513837716 (780h0m44.211406052s) [noise=true , address=81.171.14.70:4048 , piece_id=7JSD5BZR67JKHAWSE2A4J77C4WRGUTVT7AQSJUISM4YYNN2K2WJQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.515147433 (780h0m44.212715769s) [noise=true , address=185.167.204.206:4068 , piece_id=YHS7B5DPLDAWU5VW4KPCCDSNZDLRHFVHP7EKRMOBRPKW7TEL3UJA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.516520046 (780h0m44.214088353s) [noise=true , address=185.167.204.206:4066 , piece_id=2CDD52BAQY47RQUCZKAQC2OBDCQA27PPY5Z726XARCV5FTHNHIDQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.516901610 (780h0m44.214469926s) [noise=true , address=185.167.204.206:4069 , piece_id=UE65STV44JVSAFQOGLTUYHI2L6IA75VPZ4BC4BS7JLK7TQ5KAVPA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.518187532 (780h0m44.215755867s) [noise=true , address=185.167.204.205:4015 , piece_id=TQL7XYTFFJ4NIYQVWVGPS5RT5R5OHEEYGAO7YYRONMRUFQNYWRMQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.518735856 (780h0m44.216304172s) [noise=true , address=89.149.201.147:4004 , piece_id=CNSJZVRROO57Z6JFSKAJXTIXJM5CW7LNFKUPARQYOODK62ZME25Q, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.520802537 (780h0m44.218370873s) [noise=true , address=81.171.14.70:4034 , piece_id=SY7EK3RNJNBL5YS4T4R6FBNIXAQB7VGRL4RDGGPJGW7OEUCJK6JA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.524619928 (780h0m44.222188274s) [noise=true , address=81.171.14.70:4047 , piece_id=EJCUGN3SK5QJ2SJ4EJOQKFPRZ2MNWRU7YZGOION2FU6ZQB6MSGRA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.530089416 (780h0m44.227657722s) [noise=true , address=185.167.204.206:4041 , piece_id=2VTQW5MDL6RWCTFV5KCWBYR56KGKVQHZREL5VUKCAWBEVFJSOKYA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.538532469 (780h0m44.236100804s) [noise=true , address=185.167.204.206:4053 , piece_id=GJOCKGE3V35P6MXVDVXX5VY75VLWLOWCY4DVHF2XQW2FUYOU3WBA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.539346680 (780h0m44.236915017s) [noise=true , address=185.167.204.205:4014 , piece_id=RIGBC2O4ARGFCPLEOOLEEP2DWDK3HTWQLDFDRJARLHBVLUQTHZKQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.540129662 (780h0m44.237697999s) [noise=true , address=185.167.204.206:4067 , piece_id=XEGSGVREIWRNLDP5DFLFOSTQNH2TSAIN4OYYRAFQX5BCYFHBRR2Q, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.541661795 (780h0m44.239230111s) [noise=true , address=81.171.14.70:4036 , piece_id=BBQ4LDGVSFMW4KNTJ7YG6OETOZG7QLIRJBTKLDPNDSNZBF4AT4HA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.549338997 (780h0m44.246907333s) [noise=true , address=185.167.204.205:4025 , piece_id=XDTBNB7H465JRLCV3MRB2KOGWJDT3QYCL7QUSW3ZMI2NXMDRKIRA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.554852136 (780h0m44.252420442s) [noise=true , address=185.167.204.205:4027 , piece_id=W7UY6AP6OUFEUDM4IFO6OHC6QQ35ARGW3DRXWFWZYYUZCIOFGAAA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.560151646 (780h0m44.257719952s) [noise=true , address=81.171.14.70:4041 , piece_id=Y27EBWJKXYPD2JGGQP4FD3P54IGGMRVSHGZM3PDEQP34EDDNBIUQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.560310303 (780h0m44.257878639s) [noise=true , address=89.149.201.147:4019 , piece_id=EBHVXES5VC6CENU26CB5WFNRKWHBXBOQ3ANBAF5Y5AL2WHOKSMZA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.560718114 (780h0m44.258286421s) [noise=true , address=185.167.204.205:4009 , piece_id=EBCMNZL5AWY66QYIQME5COVCE2RDTFIANF6H5ZGQKMM4W6XZ2RSQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.562226592 (780h0m44.259794909s) [noise=true , address=185.167.204.205:4004 , piece_id=TN3VC6E4IP5HYHUCEFVXPSPUXAVGMU4IN2BP5VOYGBX4OZRZEDQA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.563539496 (780h0m44.261107832s) [noise=true , address=81.171.14.70:4033 , piece_id=UUCMKUWY2FRDIYNURUHONEOAKORNRRVEMNNNPKQ5MIPLBLEEC6IA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.572914018 (780h0m44.270482324s) [noise=true , address=185.167.204.205:4030 , piece_id=YYMDFRK6X7D264Z7FYECUT4H5GAQ52LW4FHX2JQ3GVL46EYCQPLA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.572975022 (780h0m44.270543369s) [noise=true , address=89.149.201.147:4018 , piece_id=H53SNMW7IPSPSHZJMJ2QVQMWJGLTHLK75A7FTSULPI2KRIREFWTQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: <nil>
Jan 7 03:29:56.572990171 (780h0m44.270558507s) [seg_pos={0 0}, upload=686174]: Segment reached optimal threshold of 26 pieces.
Jan 7 03:29:56.573318433 (780h0m44.270886829s) [noise=true , address=185.167.204.206:4056 , piece_id=HEJV4MAFEP47TPNEES4WCH3BAVXFOICZQHCVITMAF2ITRXNO5TMA, seg_pos={0 0}, upload=686174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC): protocol: expected piece hash; context canceled; EOF
Jan 7 03:29:56.573341336 (780h0m44.270909723s) [noise=true , address=185.167.204.206:4056 , piece_id=HEJV4MAFEP47TPNEES4WCH3BAVXFOICZQHCVITMAF2ITRXNO5TMA, seg_pos={0 0}, upload=686174]: Long tail cancellation due to optimal threshold
Jan 7 03:29:56.573376612 (780h0m44.270944959s) [noise=true , address=185.167.204.205:4005 , piece_id=63Y7QNGHR4J4TIQJCUFULL5IRJ4NH7GCOQTJIGUXUZQHCEOSZ3AQ, seg_pos={0 0}, upload=686174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12B18LegNdvxjRqBgwnFB4Aig1nt5URm9Au7bWXsfbBPyCnterM): protocol: expected piece hash; context canceled; EOF
Jan 7 03:29:56.573415235 (780h0m44.270983571s) [noise=true , address=185.167.204.205:4005 , piece_id=63Y7QNGHR4J4TIQJCUFULL5IRJ4NH7GCOQTJIGUXUZQHCEOSZ3AQ, seg_pos={0 0}, upload=686174]: Long tail cancellation due to optimal threshold
Jan 7 03:29:56.573445671 (780h0m44.271014007s) [seg_pos={0 0}, upload=686174]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 7 03:29:56.573614446 (780h0m44.271182782s) [upload=686174]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 7 03:29:56.573626158 (780h0m44.271194495s) [upload=686174]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 7 03:29:56.727636981 (780h0m44.425205288s) [upload=686174]: Done uploading segments...
Jan 7 03:29:56.727651439 (780h0m44.425219744s) [upload=686174]: Upload finished. err: <nil>
Duration: 2.153255475s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......................................................X.X..] duration:
904.82468ms trace:
https://jaeger.dev.storj.io/trace/7d6ac2d67d77a8e
FAIL (2026-01-07 03:33:56 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 904.842875ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
4 out of 60 is failed (threshold=3) [................................................XX.XX.......] duration:
3.073345745s trace:
https://jaeger.dev.storj.io/trace/5a0e658196b93032
FAIL (2026-01-07 03:33:20 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 3.073366685s
core
uplink
eu1
|