Version

[psm-2]

Hello, I am trying to run mlx_parallm, but, it does not work with the newest version of MLX? Do you have any suggestions?

[willccbb]

Thanks for flagging -- can try to look into it at some point but I'm not really actively maintaining this, sorry. My hope is/was that someone would eventually just copy the functionality into mlx_lm but not sure what the status of that is.

[kushalkp88]

Hello! You can use the following versions for compatibility:

dependencies = [
"mlx (>=0.26.5,<0.27.0)",
"mlx-lm (==0.16.1)",
"huggingface-hub (==0.24.7)",
"hf-xet (>=1.1.5,<2.0.0)"
]
python 3.11.13

This should work effectively.

[kushalkp88]

Hello, I am trying to run mlx_parallm, but, it does not work with the newest version of MLX? Do you have any suggestions?

Hello! You can use the following versions for compatibility:

dependencies = [
"mlx (>=0.26.5,<0.27.0)",
"mlx-lm (==0.16.1)",
"huggingface-hub (==0.24.7)",
"hf-xet (>=1.1.5,<2.0.0)"
]
python 3.11.13

This should work effectively.