A map of frameworks for abstracting interactions with and between large language models, plus two systems of organization for reasoning about LLM approaches and philosophies.| Two Sigma
The AI Controller Interface helps researchers and developers to efficiently implement existing strategies for controlling LLMs and invent new ones, enhancing LLM generation through improved accuracy, privacy, and compliance with formatting standards.| Microsoft Research
AutoMan is a platform for integrating human-based and digital computation. It allows programmers to “program with people”, which appear to the programmer to be ordinary function calls. …| Emery Berger
GitHub | Documentation | Paper| vLLM Blog