Very popular on GitHub.
Ollama allows you to run LLMs locally through your command line and is probably the easiest framework to get started with.
Just use the installer or the command line to install it. Then you can type ollama run modelname and it starts an interactive session where you can send prompts.
It supports all important models like llama2, mistral, vicunia, falcon, and many more. And trying out new models is as easy as running ollama pull modelname.
Overview
Start
Exit
