R to @GentraceAI: Looks like an exciting update, can't wait to check it out!

RT by @room40xyz: New release • Multi-modal evaluation • Big organization features • Threading • Metadata and more:

R to @GentraceAI: More: • Evaluation results now automatically receive an average score • Prettier rendering of OpenAI function calls • Added a raw (JSON) view on timeline steps • Added a mechanism to render HTML outputs as HTML

R to @GentraceAI: Metadata Gentrace now supports arbitrary metadata on pipeline runs, evaluation runs, and evaluation results. This is useful for: • Include environmental information • Preformat / prettify data • Specify prompt or model versions • Link to additional debugging context

R to @GentraceAI: Threading To better track chats, conversations, and other multi-turn interactions with an AI feature / product, Gentrace now links together pipeline runs into Threads.

R to @GentraceAI: Big organization features We've added management features for big organizations: • Personal pipelines: for experimentation • Pipeline cloning: to new private or team pipelines • Editor role: a new write-access role that cannot adminstrate

R to @GentraceAI: Multi-modal evaluation Evaluate image-to-text generative pipelines by uploading images into Gentrace test cases. Gentrace invokes your generative pipeline on these image test cases. Text outputs are then uploaded to Gentrace and evaluated the usual way.

RT by @ankrgyl: We had a lot of fun working together on this plugin! 😄

RT by @mattmakai: 📣Rivet 1.5 is live! There are way too many updates for a single post, so let's focus on just one: NEW PLUGIN UI 🎉 It's now super easy to add plugins, including @AnthropicAI, @AssemblyAI, @GentraceAI, @Huggingface, @MongoDB, @pinecone, @braintrustdata, and others!

R to @memdotai: @memdotai mem it

RT by @damndanielliem: We're excited to host our first fireside chat with @GentraceAI — "Beyond the Chatbot" — where our panelists will discuss the applications their companies are pioneering today beyond the realm of chatbots, featuring: @gogwilt – Co-founder @ironclad_inc @isafulf – Member of Technical Staff @OpenAI Lifei Yu – AI Product Design Lead @asana @mathemagic1an – Founder, CEO @ Codegen See you on October 25! Kindly RSVP at http://lu.ma/gentracemem.