AWS Lambda Docker Serverless Inference
Serve scikit-learn, XGBoost, TensorFlow, and PyTorch models with AWS Lambda container images support.
Model DeploymentMLOps & Experiment TrackingOpen Source
About
This repository contains resources to help you deploy Lambda Functions based on Python and Java Docker Images.
Open Source Health
- Stars
- 101
- Forks
- 19
- License
- MIT-0
- Last commit
- 2 years ago
Jupyter Notebook
Alternatives to AWS Lambda Docker Serverless Inference
CHaiDNNby XilinxHLS based Deep Neural Network Accelerator Library for Xilinx Ultrascale+ MPSoCs- SoulX-FlashTalkby Soul AI LabSoulX-FlashTalk is the first 14B model to achieve sub-second start-up latency (0.87s) while maintaining a real-time throughput of 32 FPS on an 8xH800 node.
Ts Patternby Gabriel VergnaudThe exhaustive Pattern Matching library for TypeScript, with smart type inference.
Nobodywhoby NobodyWhoNobodyWho is an inference engine that lets you run LLMs locally and efficiently on any device.
ds4by Salvatore SanfilippoDeepSeek 4 Flash and PRO local inference engine for Metal, CUDA and ROCm
Resources & Links
Related Categories
Using AWS Lambda Docker Serverless Inference?
Track its cost next to the rest of your stack and get a reminder before it renews.
Add to my stackVendor
Aws Samples
Publisher of IAM Identity Center Team, Serverless Patterns and Siem On Amazon Opensearch Service
