This note is for practical engineering notes on working with AI. For conceptual and philosophical notes see AI.
Local AI
Python and HuggingFace
See my note on Python, particularly Python#Machine setup and then visit various Hugging Face models / transformers and try to run them locally
Elixir and Bumblebee and LiveBook
Elixir LiveBook has a way to run the backend locally. You can then easily create "smart cells" that will do a bunch of the heavy lifting for you.
ollama
An amazingly simple and effective website and CLI for working with local LLMs.
LocalAI
I'm still experimenting with this