Hey Mark L. Pederson

Streaming is supported, here is an example function stack you can use.

You will need to ensure you have a valid key or the request will fail opening the stream - this is set to work with the following environment variable openai_api_key

query streaming verb=GET {\n  input {\n  }\n\n  stack {\n    !function.run streaming as $stream1\n    stream.from_request {\n      url = \"https://api.openai.com/v1/chat/completions\"\n      method = \"POST\"\n      params = {}\n        |set:\"model\":\"gpt-5\"\n        |set:\"messages\":([]\n          |push:({}\n            |set:\"role\":\"system\"\n            |set:\"content\":\"You are a helpful assistant.\"\n          )\n          |push:({}\n            |set:\"role\":\"user\"\n            |set:\"content\":\"What is Xano the no-code backend? Please be verbose and detailed in your response.\"\n          )\n        )\n        |set:\"stream\":true\n      headers = []\n        |push:\"Content-Type: application/json\"\n        |push:\"Authorization: Bearer \"~$env.openai_api_key\n      timeout = 100\n      verify_host = false\n      verify_peer = false\n    } as $stream1\n  \n    foreach ($stream1) {\n      each as $item {\n        conditional {\n          if (($item|starts_with:\"data:\") && \"data\" != \"data: [DONE]\") {\n            api.stream {\n              value = $item|substr:6:0\n            }\n          }\n        }\n      }\n    }\n  }\n\n  response_type = \"stream\"\n  middleware = {pre: []}\n}

streaming response from openai compatible APIs