Docker Install Error

[cybrpimp]

Everything was going great until this error;

Any ideas how to fix?

[mattinannt]

@cybrpimp The line in the download_model.py where he throws the error is very simpel. it's just:

nlp = pipeline("text-generation", model=os.environ['GPT_MODEL'])

I have reproduced this error and it seems to occur when the environment variable is not set.

have you copied the .env.example file to .env as stated in the second step?

cp .env.example .env

You also need this file to set your domains in this file so the SSL certificates can be issued and traffic redirects in the right way.

[cybrpimp]

I do not believe the ENV file was used so I'll try that.

I'm on Windows so not sure if that makes a difference.

[cybrpimp]

This time I got this error

[mattinannt]

It seems to be an "out of memory" error. Maybe try to use the smaller model in the .env file:

GPT_MODEL=EleutherAI/gpt-neo-1.3B

If that doesn't work, you could try to not download the model in the build step but when running the image. for that remove / comment out this line in the api/Dockerfile

RUN python3 download_model.py

[cybrpimp]

Ok, I can try these options and report back. This server has either 64G or 128Gb so I would not think memory is the issue.