Install HuggingFace Models Directly in Open WebUI with Ollama Locally

Install HuggingFace Models Directly in Open WebUI with Ollama Locally

Fahd Mirza

4 дня назад

1,126 Просмотров

Ссылки и html тэги не поддерживаются


Комментарии:

@Luceo-xr6hb
@Luceo-xr6hb - 17.10.2024 18:20

Thank you so much~I never know that using models from huggingface in ollama can be this easy

Ответить
@chouawarasteven
@chouawarasteven - 17.10.2024 18:33

Hi, should the hugging face models ONLY be in GGUF format for them to run in ollama/openweb ui?

Ответить
@abhiabzs
@abhiabzs - 17.10.2024 18:35

Can you please create a video on comparing LMStudio vs Open Web UI + Ollama vs localai?

Ответить
@SonGoku-pc7jl
@SonGoku-pc7jl - 17.10.2024 18:39

thanks! not docker, ueeee, more ram for models xD Which do you think is more powerful, anythingllm, webui, lobechat or other?

Ответить
@existentialbaby
@existentialbaby - 17.10.2024 21:11

hi sir, most models i tried from HF on ollama are not optimised, sometimes they dont have markdown, sometimes, the information quality they output is lacklustre, gammar is off, punctuations etc.

Ответить
@char3736
@char3736 - 17.10.2024 21:33

I've been waiting for this for a long time. Thank you!

Ответить
@iamliam1241
@iamliam1241 - 18.10.2024 05:35

Can we use the models (text to speech, text to image) with ollama?, if yes, can you make an explanatory video, thank you very much.

Ответить
@Blakipino
@Blakipino - 19.10.2024 06:15

Is there a way to do this for vision models for analyzing images?

Ответить
@adibsadman4094
@adibsadman4094 - 19.10.2024 15:55

Hi Fahd, I'm absolutely loving the content on your channel and I think I might have an idea for you.

Could you please do a video on how to find and set the best setting on OpenWebUI using ollama models to best optimise their responses? For example how to find and set the best settings (Temperature, top k etc) for a coding model like codellama

I feel like simply importing the models and running them don't give the best outputs despite a lot of claims of them outperforming models like ChatGPT etc. Mine is not outperforming anything at the moment 😅

Ответить
@sridhartn83
@sridhartn83 - 20.10.2024 17:33

It doesn't work, I tried pulling l lama 3.2 11B model , just fails, download cancelled. :-(

Ответить