Hello everyone! I'm happy to announce chat-rs, another LLM inference provider written in rust with streaming capabilities, tool calling, and intuitive ergonomics. I was heavily inspired by vercel's ai-sdk react framework and I wanted to have a semi opinionated rust alternative. Aside from the basics, we support full on model routers, human-in-the-loop for stop and pause, and thanks to tools-rs (posted yesterday) your agents will be able to call python tools.
Comments URL: https://news.ycombinator.com/item?id=47778390
Points: 1
# Comments: 0
来源: hnrss.org查看原文