ParrotServe
[OSDI'24] Serving LLM-based Applications Efficiently with Semantic Variable
About
The powerful language understanding capability of large language models (LLMs) has enabled a new application paradigm, where one or multiple application entities, known as AI agents or co-pilots, communicate with LLMs via natural language, known as “prompts”, to accomplish a task collaboratively.
Open Source Health
- Stars
- 226
- Forks
- 16
- License
- MIT
- Last commit
- 2 years ago
Related Categories
Vendor
Microsoft
Empower every person and organization to achieve more.
Quick Links
Open Source
More by Microsoft
Related Products
Recognizers-Text
Recognizers-Text offers entity recognition and resolution for numbers, dates, and units in multiple languages.
More from this vendor
Language Server Protocol
Defines a common protocol for language servers.
More from this vendor
Lamar Benchmark
Source code for the ECCV 2022 paper "Benchmarking Localization and Mapping for Augmented Reality".
More from this vendor
Pyright
Static Type Checker for Python
More from this vendor
Component Detection
Scans your project to determine what components you use
More from this vendor