LocalAI is the free, Open Source alternative to OpenAI. LocalAI acts as a drop-in replacement REST API that's compatible with OpenAI API specifications for local inferencing. It allows you to run LLMs, generate images, audio (and more) locally or on-premises with consumer-grade hardware, supporting multiple model families that are compatible with the ggml format. Does not require GPU. It is maintained by mudler.