LLM for games

I have wanted to incorporate LLM/AI into a videogame in some way. I don't think text generation for locally-run stuff is good enough yet, but maybe it's fine for decision-making?

I haven't seen anyone recommend any particular models or versions or a complete setup for figuring out what will work, so I will do that myself small-scale and post the results. I am interested in having AI make decisions for characters in videogames, such as what to do based on your current stats, or when presented with some information, etc.

All tests will use llama-cli.exe from the latest https://github.com/ggerganov/llama.cpp/releases and run some variation of this command to generate output:

llama-cli.exe -m MODEL -p "PROMPT"
usually with -n 1 also