R to @JoschkaBraun: @joel_a_wilde i've seen people line that up better.

R to @OfficialLoganK: @PareaAI http://parea.ai

R to @md_rumpf: Follow me for updates on @hamilton_os ! We've got some great LLM workflow posts brewing.

R to @md_rumpf: Thanks! 🙌

R to @JoschkaBraun: of course! awesome product!

R to @md_rumpf: Great initiative guys! Appreciate the mentioning of @PareaAI :)

R to @md_rumpf: 🥁 Orchestration @SematicAI: The open-source orchestrator loved by ML teams. It enables end-to-end pipelines to reduce model turnaround time by 80%. @DAGWorks’s Hamilton: Open-source micro-orchestration framework for describing data flows. Companies use it for modeling data and feature engineering pipelines, prompt engineering, and LLM application workflows. Arakoo's EdgeChains: Open Source SDK that models generative AI applications as config management. Built on top of Jsonnet as the orchestration grammar.

R to @md_rumpf: 💬 Prompt Management & Testing @PareaAI: Improve and monitor the performance of your LLM apps through rigorous testing and version control. @hegel_ai 's PromptTools: Open-source tools for evaluation and experimentation with prompts, models, and vector databases. @TraceloopDev: Deploy with confidence. Automatically evaluate and monitor changes to models, prompts, and LLM architectures. @QueryVary: Test suite for LLMs. @Humanloop: Humanloop is like datadog for LLMs. They give you the tools you need to evaluate LLM apps and then take action to improve them.

R to @yazinsai: Would be great to hear more about this. My team and I are building @PareaAI and think it may be helpful. DM me if it seems useful.

R to @ycombinator: noiceee!!!!

Happy to officially announce @PareaAI today – DataDog for LLMs - the modern testing and monitoring stack for GenAI builders! @datadoghq

Congrats on the launch, @joschkabraun and @joel_a_wilde! @PareaAI (YC S23) provides a developer toolkit to debug, evaluate and monitor LLM applications, making it easy for companies to get consistent results. https://www.ycombinator.com/launches/J6N-parea-ai-the-developer-toolkit-for-debugging-and-monitoring-llm-apps

R to @hwchase17: Very cool, similar to @PareaAI

R to @patrickc: In case you don't work at Stripe, try @PareaAI

The @PareaAI team, had a blast yesterday at @stripe learning from Patrick and our fellow YC founders!

R to @heyBarsee: 10. For all other use cases, I’d checkout https://www.optimusprompt.ai, it automically optimizes prompts for you - no technique needed

It's about time!