I was struggling with validating responses from LLMs due to their infamous non-deterministic nature.
I've tried to club Pydantic's validation with Instructor's retries mechanism to significantly improve accuracy even with structured data errors. You can learn more about this solution here https://blog.kusho.ai/from-chaos-to-order-structured-json-with-pydantic-and-instructor-in-llms-part-ii/
submitted by /u/soap94
[link] [comments]
from Software Development – methodologies, techniques, and tools. Covering Agile, RUP, Waterfall + more! https://ift.tt/zunl5KX