This application cant response to me? It is waiting for much time. It is not working.

[Yaseminh]

Now, Button name is go but in demo button name is autocomplete. I cant find solution for problem. I dont understand. Button is always turning but no response.

[Yaseminh]

It didn't respond at all for me, but it did in a different project. How long did it take to respond? I hope we find a solution to the problem.

[Practicing7]

Same issue! LLaAM 7B responses to me normally. But Alpaca didn't response to me.

[Yaseminh]

What is your ram size and specs of your machine? I say it's enough if one of them works, but I couldn't get a response :(

[Practicing7]

My machine has a ram size of 128G, an A6000 GPU with 48G memory.
OS: Ubuntu 22.04

[geniusfoever]

Same here, 32 G ram, Linux, alpaca 7B, no response at all. No error, seems stucked.

[manel-moles]

Same issue here.

[vulpcod3z]

Works from the demo web ui but utilizing the api call demos only sends and processes the request; there's no response sent back to the client.

UPDATE:
Wanted to include that I installed via npx dalai alpaca install instead of cloning, which works via the web ui.

[HidingCherry]

Also installed via npx dalai alpaca install 7B - same issue, no CPU usage, no response.
Running via docker (actually podman, but it doesn't make a difference).
I'll try llama 7B later.

Edit: works with Llama 7B - but I had to do the download manually, since it kinda stopped halfway through the download. No download-progress, but the estimated time roze.

[andreapago]

same problem here alpaca 7B and 13B do not seem to provide any reply...anyone any idea? I'm on Ubuntu with 16GB RAM, no GPU.
Thanks

[vulpcod3z]

same problem here alpaca 7B and 13B do not seem to provide any reply...anyone any idea? I'm on Ubuntu with 16GB RAM, no GPU. Thanks

Are you attempting to use the web interface or are you connecting via another application?

[andreapago]

Are you attempting to use the web interface or are you connecting via another application?

Just via the web interface.
Thanks

[vulpcod3z]

I'd check your nodejs version first. Ubuntu 20.04 and earlier don't support >10.19 where dalai needs >=18.

After that, check that your */dalai/alpaca/models directory actually has the models.