Rec Room’s Maker Pen AI Creative Tool Is Game Changing… ish

Hey everybody, it’s Under My Cap and welcome back to another video! Today we’re going to be looking at Maker AI. Yes, I said it like that because every single company is adding AI into their products right now, so let’s see what Rec Room is doing with it.

If you’d prefer to watch the full video, you can check it out here: Watch on YouTube

What Is Maker AI?

The Maker Pen in Rec Room now has a cute little green addition on top of it, and that’s your Maker AI coach. When you hold the Maker Pen, you can speak directly to it and it responds in a conversational way, asking what you’d like to do and helping you build and decorate your virtual space. It’s a surprisingly charming little tool, complete with a Rec Room logo on top, and it really does feel like having a helpful virtual assistant right in your hand.

Setting Up the Room

The room I was working in was very bare — literally nothing in it — so it was the perfect blank canvas to test out what Maker AI could do. I wanted to turn it into the best dorm room in the world, and I was genuinely curious to see just how well the AI could handle that challenge. One thing I noticed straight away is that the AI can only hear you when you’re actually holding the Maker Pen, which makes sense given how the tool is designed.

Adding a Bed and Moving Things Around

The first thing I asked for was a cozy bed, mentioning that my favourite colour is blue, and honestly it delivered really well — it spawned a bed in almost immediately. The only issue was that the bed ended up inside the wall, so I tried asking it to move the bed to a specific wall I was looking at. This is where things got a little rocky. I had to reset the AI a couple of times after it seemed to stop responding, but once I got it back on track it did a solid job of repositioning the bed to where I wanted it.

From there I started testing its ability to move objects relative to each other. I asked it to place a bucket on top of the bed, move a mirror behind me, and even swap the positions of the dog and the bucket. It got close enough on most of these, which was genuinely impressive. The dog ended up kind of floating near the bed, the bucket swap wasn’t perfect, and the mirror seemed to get replaced with a wood texture somewhere along the way — but overall, for an AI tool still in development, it was handling things pretty well.

More Advanced Testing

I wanted to push it a little further, so I tried a few more interesting requests. I asked it to delete all the lights in the room, set the sky dome to black, and change the time to nighttime — and it pulled all of that off really smoothly. That honestly felt like one of the most useful demonstrations of the tool, because being able to control the environment settings just by talking is a huge time saver for room creation.

I also asked it to apply a blocky, pixelated texture to one of the walls for a retro game-inspired look — without saying the word Minecraft, of course, for obvious reasons — and it generated a texture that looked fantastic. Watching the Rec Room logo appear on the wall while it was generating the image was a cool little touch too.

The Big Desk Test

The most ambitious test I ran was asking Maker AI to place five items on a desk that would logically make sense to be there. It actually thought through this really well, placing a modern book stack, a thin notebook, a cosy book nook, a thick notebook, and a small thick book stack. Seeing it reason through what belongs on a desk was genuinely cool to watch in real time. I then asked it to place the items on the top surface of the desk specifically, and to lay the books flat rather than standing them upright. It rotated them, though they weren’t perfectly flat, but for a tool that’s still being developed, it was a really solid effort.

One thing I also tested was whether Maker AI could detect hand positions in real time — for example, placing an object directly on my hand. It wasn’t able to do that, but it does use a pointing beam from the Maker Pen, so you can aim it at objects and ask questions like “what’s this in front of me?” and it will identify them correctly. That pointing mechanic is actually super useful for directing the AI when you want to reference a specific object in the room.

Final Thoughts

Overall, Maker AI is a genuinely interesting and promising feature that Rec Room is still actively developing. I had a really good experience with it, and I can already see it being incredibly useful for helping you move objects exactly where you want them, spawn items by simply pointing in a direction, or make sweeping changes to a room’s environment just by asking. It’s a very creative way of integrating AI into a video game, and I’m excited to see how it continues to improve.

If you enjoyed this, don’t forget to smash that like button and hit subscribe so you don’t miss future videos. I’ll catch you all around — have an awesome day everyone!