Debug mechanism for showing OpenAI responses

[simonw]

I figured out a pattern for this here and it's really useful: #284 (comment)

[simonw]

This is particularly useful for writing tests, since seeing the raw HTTP response from the OpenAI endpoint shows me what I need to mock.

[simonw]

I'm going to do this with an environment variable:

LLM_OPENAI_SHOW_RESPONSES=1 llm -m chatgpt 'three word slogan for an an otter-run bakery'

Output:

data: {"id":"chatcmpl-80MK5s4E5KmkkskxTKVzEyD1WUcHc","object":"chat.completion.chunk","created":1695096501,"model":"gpt-3.5-turbo-0613","choices":[{"index":0,"delta":{"role":"assistant","content":""},"finish_reason":null}]}

data: {"id":"chatcmpl-80MK5s4E5KmkkskxTKVzEyD1WUcHc","object":"chat.completion.chunk","created":1695096501,"model":"gpt-3.5-turbo-0613","choices":[{"index":0,"delta":{"content":"\""},"finish_reason":null}]}

data: {"id":"chatcmpl-80MK5s4E5KmkkskxTKVzEyD1WUcHc","object":"chat.completion.chunk","created":1695096501,"model":"gpt-3.5-turbo-0613","choices":[{"index":0,"delta":{"content":"Fresh"},"finish_reason":null}]}

data: {"id":"chatcmpl-80MK5s4E5KmkkskxTKVzEyD1WUcHc","object":"chat.completion.chunk","created":1695096501,"model":"gpt-3.5-turbo-0613","choices":[{"index":0,"delta":{"content":"ly"},"finish_reason":null}]}

data: {"id":"chatcmpl-80MK5s4E5KmkkskxTKVzEyD1WUcHc","object":"chat.completion.chunk","created":1695096501,"model":"gpt-3.5-turbo-0613","choices":[{"index":0,"delta":{"content":" B"},"finish_reason":null}]}

data: {"id":"chatcmpl-80MK5s4E5KmkkskxTKVzEyD1WUcHc","object":"chat.completion.chunk","created":1695096501,"model":"gpt-3.5-turbo-0613","choices":[{"index":0,"delta":{"content":"aked"},"finish_reason":null}]}

data: {"id":"chatcmpl-80MK5s4E5KmkkskxTKVzEyD1WUcHc","object":"chat.completion.chunk","created":1695096501,"model":"gpt-3.5-turbo-0613","choices":[{"index":0,"delta":{"content":" Happiness"},"finish_reason":null}]}

data: {"id":"chatcmpl-80MK5s4E5KmkkskxTKVzEyD1WUcHc","object":"chat.completion.chunk","created":1695096501,"model":"gpt-3.5-turbo-0613","choices":[{"index":0,"delta":{"content":"\""},"finish_reason":null}]}

data: {"id":"chatcmpl-80MK5s4E5KmkkskxTKVzEyD1WUcHc","object":"chat.completion.chunk","created":1695096501,"model":"gpt-3.5-turbo-0613","choices":[{"index":0,"delta":{},"finish_reason":"stop"}]}

data: [DONE]


"Freshly Baked Happiness"