LocalAI provides a variety of images to support different environments. These images are available on quay.io and Docker Hub. All-in-One images comes with a pre-configured set of models and backends, standard images instead do not have any model pre-configured and installed. For GPU Acceleration support for Nvidia video graphic cards, use the Nvidia/CUDA images, if you don’t have a GPU, use the CPU images. If you have AMD or Mac Silicon, see the build section.| localai.io
warning Section under construction This section contains instruction on how to use LocalAI with GPU acceleration. ⚡ For acceleration for AMD or Metal HW is still in development, for additional details see the build Automatic Backend Detection linkWhen you install a model from the gallery (or a YAML file), LocalAI intelligently detects the required backend and your system’s capabilities, then downloads the correct version for you. Whether you’re running on a standard CPU, an NVIDIA GPU, ...| localai.io