Practical approach for streaming UI from LLMs

(timetler.com)

50 points | by scranglis 4 days ago ago

6 comments

  • politelemon 6 hours ago ago

    This was a difficult read, not necessarily due to the merry-go-round of trying to find the right fit, but the overhead involved and the maintenance burden this is going to become over time. Once it starts it's never going to be just another thin layer.

    I'd prefer taking a step back to see if this is the right approach or if this safety can be solved in a much simpler way. Looking at the title of the submission I don't consider it practical. I would welcome any other ideas, I'm thinking along the lines of a simple and boring bff which does the parsing and validation and sending strongly typed objects to the front end.

  • rasfuranku 4 hours ago ago

    I quite like this, specially coming from the idea of creating custom UIs depending on the type of output required for the answer. Could be a great tool for visual learners.

  • guerrilla 6 hours ago ago

    Obviously the next step and already happening but for some reason I doubt it'll be this exact technology. We're probably going to see a lot of competition here.

    • etler 4 hours ago ago

      Author here. I'd love to see it! I settled on this approach after not finding any other ways to do it, but it's definitely not the only way. I'd like to see what other approaches people might come up with.

  • AIorNot 2 hours ago ago

    Interesting- I wonder if we can integrate this approach with a framework like AG-UI (as opposed to copilotkit)

    https://docs.ag-ui.com/quickstart/clients

  • amelius 4 hours ago ago

    Chatgpt already looks a lot like that, tbh.