# Sprites: Give the agent a screen **URL:** \ **Category:** Questions / Help\ **Tags:** sprites\ **Created:** [September 6, 2026, 8:06pm UTC](https://community.fly.io/t/sprites-give-the-agent-a-screen/28604 "2026-09-06T20:06:33Z")\ **Posts on this page:** 6\ **Page:** 1
**Author:** ![moishinetzer](https://sea1.discourse-cdn.com/fly1/user_avatar/community.fly.io/moishinetzer/32/47591_2.png) [@moishinetzer](https://community.fly.io/u/moishinetzer)\ **Post date:** [September 6, 2026, 8:06pm UTC](https://community.fly.io/t/sprites-give-the-agent-a-screen/28604/1 "2026-09-06T20:06:33Z")
If I wanted to build a “grok bot”-esque application where I have each agent using a Sprite, how can I give my sprite a screen / GUI to work with that I can watch and see which actions the agent is taking ---
**Author:** ![robgough](https://sea1.discourse-cdn.com/fly1/user_avatar/community.fly.io/robgough/32/4407_2.png) [@robgough](https://community.fly.io/u/robgough)\ **Post date:** [September 6, 2026, 11:27pm UTC](https://community.fly.io/t/sprites-give-the-agent-a-screen/28604/2 "2026-09-06T23:27:19Z")
I’ve been thinking about doing something similar. My best guess is they’ve got some sort of custom desktop window manager which has maybe some extra hooks that they can talk to, but they’re also claiming it’s using vision, so that’s probably all driven via VNC, although it’s not impossible that they’ve written their own screen sharing stuff. This is based off only having seen it in YouTube videos, I’ve not played with it myself yet. I think for a lot of my proposed use, just using a headless Chrome via Playwright is probably going to get me most of the way. ---
**Author:** ![moishinetzer](https://sea1.discourse-cdn.com/fly1/user_avatar/community.fly.io/moishinetzer/32/47591_2.png) [@moishinetzer](https://community.fly.io/u/moishinetzer)\ **Post date:** [September 15, 2026, 10:39am UTC](https://community.fly.io/t/sprites-give-the-agent-a-screen/28604/3 "2026-09-15T10:39:10Z")
No response from the team? Is this something slated for development? ---
**Author:** ![flyio-support](https://sea1.discourse-cdn.com/fly1/user_avatar/community.fly.io/flyio-support/32/46245_2.png) [@flyio-support](https://community.fly.io/u/flyio-support)\ **Post date:** [September 15, 2026, 6:14pm UTC](https://community.fly.io/t/sprites-give-the-agent-a-screen/28604/4 "2026-09-15T18:14:51Z")
Hi, thanks for your interest. There’s nothing directly planned to allow this as a native Sprite feature, but if the main thing you want your agent to do is browse the web, a headless browser with Playwright is likely the way to go. You can ask an LLM to code something where it e.g. takes screenshots as it goes and exposes them via a web server running on the Sprite, so you can peek at what it’s doing. For more general GUI use, starting a local Xvfb or similar might work. I’m not sure how an agent would be able to drive that, but it’s something you can ask the LLM as well. Really stretching it, you may be able to “stream” the xvfb display through something that can be exposed via a web service as well (akin to e.g. how some webcams give you a low-framerate stream using only a web browser). ---
**Author:** ![moishinetzer](https://sea1.discourse-cdn.com/fly1/user_avatar/community.fly.io/moishinetzer/32/47591_2.png) [@moishinetzer](https://community.fly.io/u/moishinetzer)\ **Post date:** [September 15, 2026, 6:31pm UTC](https://community.fly.io/t/sprites-give-the-agent-a-screen/28604/5 "2026-09-15T18:31:13Z")
Alright - consider this a feature request then. If the goal is for Sprites to be machines for agents then surely it makes sense to attach them in the same way: 1. Grok bot 2. Muse 3. Instinct Do it so that we can expose the sprites as a product to OUR customers! Seems like the natural next step in the way the world is going. Please relay this to the team 🙏 ---
**Author:** ![system](https://global.discourse-cdn.com/fly1/original/3X/6/e/6e8955d00cb218e186ebbe3a6ab06fefdce15290.svg) [@system](https://community.fly.io/u/system)\ **Post date:** [September 25, 2026, 6:32pm UTC](https://community.fly.io/t/sprites-give-the-agent-a-screen/28604/6 "2026-09-25T18:32:08Z")
This topic was automatically closed 10 days after the last reply. New replies are no longer allowed.