👩‍💻Human Scorers

Coming Soon!

We are working on integrating human evaluations directly into our UI and API, allowing for the direct assessment of model responses. Human evaluations are essential for obtaining comprehensive feedback over time. Our future plans include offering Reinforcement Learning from Human Feedback (RLHF) as a service, leveraging human evaluations to refine and tune models further.