🐛 Bug Report: streaming openai responses api does not emit spans

[ellie-endgame]

Which component is this bug for?

OpenAI Instrumentation

📜 Description

Using the responses api, we do not see spans emitted if stream=True on the respones.create command for openapi.

it looks like, potentially, if streaming is being used it returns prior to starting the span.
https://github.com/traceloop/openllmetry/blob/main/packages/opentelemetry-instrumentation-openai/opentelemetry/instrumentation/openai/v1/responses_wrappers.py#L442

👟 Reproduction steps

script to reproduce:

# /// script
# dependencies = [
#   "opentelemetry-instrumentation-openai>=0.46.2",
#   "opentelemetry-api>=1.31.1",
#   "opentelemetry-sdk>=1.31.1",
#   "opentelemetry-exporter-otlp>=1.32.1",
#   "openai>=1.69.0",
# ]
# ///
import os
from urllib import response

from openai import OpenAI
from opentelemetry import trace
from opentelemetry.instrumentation.openai import OpenAIInstrumentor  # Traceloop's
from opentelemetry.sdk.trace import TracerProvider
from opentelemetry.sdk.trace.export import ConsoleSpanExporter, SimpleSpanProcessor

api_key = os.getenv("OPENAI_API_KEY")

tracer_provider = TracerProvider()
tracer_provider.add_span_processor(SimpleSpanProcessor(ConsoleSpanExporter()))
trace.set_tracer_provider(tracer_provider)

OpenAIInstrumentor().instrument()

tracer = trace.get_tracer(__name__)

with tracer.start_as_current_span("example-span"):
    client = OpenAI(api_key=api_key)
    response = client.responses.create(model="gpt-4o-mini", input=[{"role": "user", "content": "ping"}], stream=True)
    for chunk in response:
        print(chunk)

# example: OPENAI_API_KEY=... uv run scripts/missing-spans-when-streaming.py

👍 Expected behavior

It should show spans printed the console for the openapi responses api request

👎 Actual Behavior with Screenshots

It only shows ChatCompletionEvents, no spans.

🤖 Python Version

No response

📃 Provide any additional context for the Bug.

No response

👀 Have you spent some time to check if this bug has been raised before?

• I checked and didn't find similar issue

Are you willing to submit PR?

None

[nirga]

Thanks for reporting @ellie-endgame! Mind sharing the output of the console exporter here?

[ellie-endgame]

Thanks for reporting @ellie-endgame! Mind sharing the output of the console exporter here?

Sure!

ResponseCreatedEvent(response=Response(id='resp_68dac9f7b6288198962c51e226edcd3509e80aa70a8fb588', created_at=1759169015.0, error=None, incomplete_details=None, instructions=None, metadata={}, model='gpt-4o-mini-2024-07-18', object='response', output=[], parallel_tool_calls=True, temperature=1.0, tool_choice='auto', tools=[], top_p=1.0, background=False, conversation=None, max_output_tokens=None, max_tool_calls=None, previous_response_id=None, prompt=None, prompt_cache_key=None, reasoning=Reasoning(effort=None, generate_summary=None, summary=None), safety_identifier=None, service_tier='auto', status='in_progress', text=ResponseTextConfig(format=ResponseFormatText(type='text'), verbosity='medium'), top_logprobs=0, truncation='disabled', usage=None, user=None, store=True), sequence_number=0, type='response.created')
ResponseInProgressEvent(response=Response(id='resp_68dac9f7b6288198962c51e226edcd3509e80aa70a8fb588', created_at=1759169015.0, error=None, incomplete_details=None, instructions=None, metadata={}, model='gpt-4o-mini-2024-07-18', object='response', output=[], parallel_tool_calls=True, temperature=1.0, tool_choice='auto', tools=[], top_p=1.0, background=False, conversation=None, max_output_tokens=None, max_tool_calls=None, previous_response_id=None, prompt=None, prompt_cache_key=None, reasoning=Reasoning(effort=None, generate_summary=None, summary=None), safety_identifier=None, service_tier='auto', status='in_progress', text=ResponseTextConfig(format=ResponseFormatText(type='text'), verbosity='medium'), top_logprobs=0, truncation='disabled', usage=None, user=None, store=True), sequence_number=1, type='response.in_progress')
ResponseOutputItemAddedEvent(item=ResponseOutputMessage(id='msg_68dac9f9e7d48198a80dbf5faf3e141a09e80aa70a8fb588', content=[], role='assistant', status='in_progress', type='message'), output_index=0, sequence_number=2, type='response.output_item.added')
ResponseContentPartAddedEvent(content_index=0, item_id='msg_68dac9f9e7d48198a80dbf5faf3e141a09e80aa70a8fb588', output_index=0, part=ResponseOutputText(annotations=[], text='', type='output_text', logprobs=[]), sequence_number=3, type='response.content_part.added')
ResponseTextDeltaEvent(content_index=0, delta='It', item_id='msg_68dac9f9e7d48198a80dbf5faf3e141a09e80aa70a8fb588', logprobs=[], output_index=0, sequence_number=4, type='response.output_text.delta', obfuscation='HKONlFINHEawVN')
ResponseTextDeltaEvent(content_index=0, delta=' seems', item_id='msg_68dac9f9e7d48198a80dbf5faf3e141a09e80aa70a8fb588', logprobs=[], output_index=0, sequence_number=5, type='response.output_text.delta', obfuscation='TtK28WlRIf')
ResponseTextDeltaEvent(content_index=0, delta=' like', item_id='msg_68dac9f9e7d48198a80dbf5faf3e141a09e80aa70a8fb588', logprobs=[], output_index=0, sequence_number=6, type='response.output_text.delta', obfuscation='8ML2b0392zd')
ResponseTextDeltaEvent(content_index=0, delta=" you're", item_id='msg_68dac9f9e7d48198a80dbf5faf3e141a09e80aa70a8fb588', logprobs=[], output_index=0, sequence_number=7, type='response.output_text.delta', obfuscation='Q72JcsZSV')
ResponseTextDeltaEvent(content_index=0, delta=' using', item_id='msg_68dac9f9e7d48198a80dbf5faf3e141a09e80aa70a8fb588', logprobs=[], output_index=0, sequence_number=8, type='response.output_text.delta', obfuscation='C2u3elB5hq')
ResponseTextDeltaEvent(content_index=0, delta=' "', item_id='msg_68dac9f9e7d48198a80dbf5faf3e141a09e80aa70a8fb588', logprobs=[], output_index=0, sequence_number=9, type='response.output_text.delta', obfuscation='ENV2bpQxhqz69g')
ResponseTextDeltaEvent(content_index=0, delta='ping', item_id='msg_68dac9f9e7d48198a80dbf5faf3e141a09e80aa70a8fb588', logprobs=[], output_index=0, sequence_number=10, type='response.output_text.delta', obfuscation='Q3kSg6UxIsrs')
ResponseTextDeltaEvent(content_index=0, delta='"', item_id='msg_68dac9f9e7d48198a80dbf5faf3e141a09e80aa70a8fb588', logprobs=[], output_index=0, sequence_number=11, type='response.output_text.delta', obfuscation='IgwHxY3O02lNQWo')
ResponseTextDeltaEvent(content_index=0, delta=' in', item_id='msg_68dac9f9e7d48198a80dbf5faf3e141a09e80aa70a8fb588', logprobs=[], output_index=0, sequence_number=12, type='response.output_text.delta', obfuscation='tczKZqDokSUv0')
ResponseTextDeltaEvent(content_index=0, delta=' a', item_id='msg_68dac9f9e7d48198a80dbf5faf3e141a09e80aa70a8fb588', logprobs=[], output_index=0, sequence_number=13, type='response.output_text.delta', obfuscation='ojcEqIFWSazd90')
ResponseTextDeltaEvent(content_index=0, delta=' casual', item_id='msg_68dac9f9e7d48198a80dbf5faf3e141a09e80aa70a8fb588', logprobs=[], output_index=0, sequence_number=14, type='response.output_text.delta', obfuscation='Mj1ltUo7x')
ResponseTextDeltaEvent(content_index=0, delta=' context', item_id='msg_68dac9f9e7d48198a80dbf5faf3e141a09e80aa70a8fb588', logprobs=[], output_index=0, sequence_number=15, type='response.output_text.delta', obfuscation='cDOOS8pj')
ResponseTextDeltaEvent(content_index=0, delta='.', item_id='msg_68dac9f9e7d48198a80dbf5faf3e141a09e80aa70a8fb588', logprobs=[], output_index=0, sequence_number=16, type='response.output_text.delta', obfuscation='OVeGcdL0yQ4M3ex')
ResponseTextDeltaEvent(content_index=0, delta=' Are', item_id='msg_68dac9f9e7d48198a80dbf5faf3e141a09e80aa70a8fb588', logprobs=[], output_index=0, sequence_number=17, type='response.output_text.delta', obfuscation='YnKx5mrFLNgi')
ResponseTextDeltaEvent(content_index=0, delta=' you', item_id='msg_68dac9f9e7d48198a80dbf5faf3e141a09e80aa70a8fb588', logprobs=[], output_index=0, sequence_number=18, type='response.output_text.delta', obfuscation='dxN5IpsfwHKK')
ResponseTextDeltaEvent(content_index=0, delta=' looking', item_id='msg_68dac9f9e7d48198a80dbf5faf3e141a09e80aa70a8fb588', logprobs=[], output_index=0, sequence_number=19, type='response.output_text.delta', obfuscation='n77IzcYd')
ResponseTextDeltaEvent(content_index=0, delta=' for', item_id='msg_68dac9f9e7d48198a80dbf5faf3e141a09e80aa70a8fb588', logprobs=[], output_index=0, sequence_number=20, type='response.output_text.delta', obfuscation='oBE8tnnN4KvG')
ResponseTextDeltaEvent(content_index=0, delta=' information', item_id='msg_68dac9f9e7d48198a80dbf5faf3e141a09e80aa70a8fb588', logprobs=[], output_index=0, sequence_number=21, type='response.output_text.delta', obfuscation='7ptR')
ResponseTextDeltaEvent(content_index=0, delta=' on', item_id='msg_68dac9f9e7d48198a80dbf5faf3e141a09e80aa70a8fb588', logprobs=[], output_index=0, sequence_number=22, type='response.output_text.delta', obfuscation='77cBFswvZrnxw')
ResponseTextDeltaEvent(content_index=0, delta=' network', item_id='msg_68dac9f9e7d48198a80dbf5faf3e141a09e80aa70a8fb588', logprobs=[], output_index=0, sequence_number=23, type='response.output_text.delta', obfuscation='nCb8uBEQ')
ResponseTextDeltaEvent(content_index=0, delta=' diagnostics', item_id='msg_68dac9f9e7d48198a80dbf5faf3e141a09e80aa70a8fb588', logprobs=[], output_index=0, sequence_number=24, type='response.output_text.delta', obfuscation='94lD')
ResponseTextDeltaEvent(content_index=0, delta=',', item_id='msg_68dac9f9e7d48198a80dbf5faf3e141a09e80aa70a8fb588', logprobs=[], output_index=0, sequence_number=25, type='response.output_text.delta', obfuscation='ZLnJye0OZWIRRq7')
ResponseTextDeltaEvent(content_index=0, delta=' or', item_id='msg_68dac9f9e7d48198a80dbf5faf3e141a09e80aa70a8fb588', logprobs=[], output_index=0, sequence_number=26, type='response.output_text.delta', obfuscation='9oHdxLpER7YSy')
ResponseTextDeltaEvent(content_index=0, delta=' do', item_id='msg_68dac9f9e7d48198a80dbf5faf3e141a09e80aa70a8fb588', logprobs=[], output_index=0, sequence_number=27, type='response.output_text.delta', obfuscation='TA0435NSc41j1')
ResponseTextDeltaEvent(content_index=0, delta=' you', item_id='msg_68dac9f9e7d48198a80dbf5faf3e141a09e80aa70a8fb588', logprobs=[], output_index=0, sequence_number=28, type='response.output_text.delta', obfuscation='VcIp5MM3rgG1')
ResponseTextDeltaEvent(content_index=0, delta=' need', item_id='msg_68dac9f9e7d48198a80dbf5faf3e141a09e80aa70a8fb588', logprobs=[], output_index=0, sequence_number=29, type='response.output_text.delta', obfuscation='BrXAknRUfvz')
ResponseTextDeltaEvent(content_index=0, delta=' help', item_id='msg_68dac9f9e7d48198a80dbf5faf3e141a09e80aa70a8fb588', logprobs=[], output_index=0, sequence_number=30, type='response.output_text.delta', obfuscation='wVzlJUayOgX')
ResponseTextDeltaEvent(content_index=0, delta=' with', item_id='msg_68dac9f9e7d48198a80dbf5faf3e141a09e80aa70a8fb588', logprobs=[], output_index=0
# /// script
, sequence_number=31, type='response.output_text.delta', obfuscation='urTFNcqq1LQ')
ResponseTextDeltaEvent(content_index=0, delta=' something', item_id='msg_68dac9f9e7d48198a80dbf5faf3e141a09e80aa70a8fb588', logprobs=[], output_index=0, sequence_number=32, type='response.output_text.delta', obfuscation='32yoY6')
ResponseTextDeltaEvent(content_index=0, delta=' specific', item_id='msg_68dac9f9e7d48198a80dbf5faf3e141a09e80aa70a8fb588', logprobs=[], output_index=0, sequence_number=33, type='response.output_text.delta', obfuscation='3KjV5k3')
ResponseTextDeltaEvent(content_index=0, delta='?', item_id='msg_68dac9f9e7d48198a80dbf5faf3e141a09e80aa70a8fb588', logprobs=[], output_index=0, sequence_number=34, type='response.output_text.delta', obfuscation='0u896U5soEN9ph4')
ResponseTextDeltaEvent(content_index=0, delta=' Let', item_id='msg_68dac9f9e7d48198a80dbf5faf3e141a09e80aa70a8fb588', logprobs=[], output_index=0, sequence_number=35, type='response.output_text.delta', obfuscation='wJ4M5HcSF7GN')
ResponseTextDeltaEvent(content_index=0, delta=' me', item_id='msg_68dac9f9e7d48198a80dbf5faf3e141a09e80aa70a8fb588', logprobs=[], output_index=0, sequence_number=36, type='response.output_text.delta', obfuscation='sebKlJg2UEdtT')
ResponseTextDeltaEvent(content_index=0, delta=' know', item_id='msg_68dac9f9e7d48198a80dbf5faf3e141a09e80aa70a8fb588', logprobs=[], output_index=0, sequence_number=37, type='response.output_text.delta', obfuscation='wtz3yciHvCz')
ResponseTextDeltaEvent(content_index=0, delta='!', item_id='msg_68dac9f9e7d48198a80dbf5faf3e141a09e80aa70a8fb588', logprobs=[], output_index=0, sequence_number=38, type='response.output_text.delta', obfuscation='AR0JJ3mGoAcTCos')
ResponseTextDoneEvent(content_index=0, item_id='msg_68dac9f9e7d48198a80dbf5faf3e141a09e80aa70a8fb588', logprobs=[], output_index=0, sequence_number=39, text='It seems like you\'re using "ping" in a casual context. Are you looking for information on network diagnostics, or do you need help with something specific? Let me know!', type='response.output_text.done')
ResponseContentPartDoneEvent(content_index=0, item_id='msg_68dac9f9e7d48198a80dbf5faf3e141a09e80aa70a8fb588', output_index=0, part=ResponseOutputText(annotations=[], text='It seems like you\'re using "ping" in a casual context. Are you looking for information on network diagnostics, or do you need help with something specific? Let me know!', type='output_text', logprobs=[]), sequence_number=40, type='response.content_part.done')
ResponseOutputItemDoneEvent(item=ResponseOutputMessage(id='msg_68dac9f9e7d48198a80dbf5faf3e141a09e80aa70a8fb588', content=[ResponseOutputText(annotations=[], text='It seems like you\'re using "ping" in a casual context. Are you looking for information on network diagnostics, or do you need help with something specific? Let me know!', type='output_text', logprobs=[])], role='assistant', status='completed', type='message'), output_index=0, sequence_number=41, type='response.output_item.done')
ResponseCompletedEvent(response=Response(id='resp_68dac9f7b6288198962c51e226edcd3509e80aa70a8fb588', created_at=1759169015.0, error=None, incomplete_details=None, instructions=None, metadata={}, model='gpt-4o-mini-2024-07-18', object='response', output=[ResponseOutputMessage(id='msg_68dac9f9e7d48198a80dbf5faf3e141a09e80aa70a8fb588', content=[ResponseOutputText(annotations=[], text='It seems like you\'re using "ping" in a casual context. Are you looking for information on network diagnostics, or do you need help with something specific? Let me know!', type='output_text', logprobs=[])], role='assistant', status='completed', type='message')], parallel_tool_calls=True, temperature=1.0, tool_choice='auto', tools=[], top_p=1.0, background=False, conversation=None, max_output_tokens=None, max_tool_calls=None, previous_response_id=None, prompt=None, prompt_cache_key=None, reasoning=Reasoning(effort=None, generate_summary=None, summary=None), safety_identifier=None, service_tier='default', status='completed', text=ResponseTextConfig(format=ResponseFormatText(type='text'), verbosity='medium'), top_logprobs=0, truncation='disabled', usage=ResponseUsage(input_tokens=8, input_tokens_details=InputTokensDetails(cached_tokens=0), output_tokens=36, output_tokens_details=OutputTokensDetails(reasoning_tokens=0), total_tokens=44), user=None, store=True), sequence_number=42, type='response.completed')
{
    "name": "example-span",
    "context": {
        "trace_id": "0xc2f9e4d764290c3b8d65a197dff6a1ec",
        "span_id": "0xad0e8b88e487a39d",
        "trace_state": "[]"
    },
    "kind": "SpanKind.INTERNAL",
    "parent_id": null,
    "start_time": "2025-09-29T18:03:34.746937Z",
    "end_time": "2025-09-29T18:03:40.011178Z",
    "status": {
        "status_code": "UNSET"
    },
    "attributes": {},
    "events": [],
    "links": [],
    "resource": {
        "attributes": {
            "telemetry.sdk.language": "python",
            "telemetry.sdk.name": "opentelemetry",
            "telemetry.sdk.version": "1.37.0",
            "service.name": "unknown_service"
        },
        "schema_url": ""
    }
}

So it shows all the content events as we would expect, but we don't get a span showing the genai request and it's response.

[rtyer]

@nirga Believe I have a fix for this with the PR I opened. Streaming support was never implemented. I added it, following the openai chat completions approach as closely as possible.