TLDR · PROGRAMMING, DESIGN & DATA SCIENCE

STRUCTURED LOGPROBS

github.comGitHub repository

Summary from the TLDR newsletter

This Python library enhances OpenAI chat completion response by adding detailed information about token log properties. It works with OpenAI Structured Outputs, a feature that ensures models will always generate responses that add here to a supplied JSON Schema. The library provides utilities for analyzing and incorporating token-level log probabilities into structured outputs to help developers understand the reliability of structured data extracted from OpenAI models.