Ray-Ban Meta Gen 2 + Claude AI: A Practical Setup for Vibe Coders

If you already have Ray-Ban Meta Gen 2 glasses, an iPhone, and a Mac, they can become much more than a camera and Bluetooth headset. You can use them as a hands-free input device for AI, remote coding, content ideas, client notes, and day-to-day assistance.

What the glasses are good for out of the box

Hands-free photos and point-of-view video

Open-ear audio for calls, music, podcasts, and voice messages

Voice commands for texts, calls, reminders, and messaging

Meta AI for visual questions, translation, and basic everyday tasks

Useful for content creators, outdoor activities, client walkthroughs, and capturing ideas while your hands are occupied

The more interesting option: Claude instead of Meta AI

There is an open-source project called OpenGlasses that can route the glasses’ microphone and camera context to alternative AI models, including Claude.

Project: https://github.com/straff2002/OpenGlasses

In principle, this lets you create voice personas such as:

“Hey Claude” for brainstorming, business questions, scripts, and planning

A dedicated assistant for client meeting notes or follow-up ideas

A private/local assistant connected to Ollama or another OpenAI-compatible model

It is not a simple App Store install yet. It is a developer setup that requires building an iPhone app from source in Xcode.

What you need

Ray-Ban Meta Gen 2 glasses

iPhone compatible with the Meta AI app

A Mac capable of running Xcode — Apple Silicon Macs are ideal

A Meta developer account and access to Meta’s wearables developer tools

An Anthropic API key if using Claude through the API

Comfort following a technical setup guide, with help from Claude or Cursor if needed

Why this matters for vibe coders

Pair this with Claude Code/Claude Dispatch and you can move between three ways of working:

At your Mac: Use Claude Code, Cursor, or other tools to build projects.

On your iPhone: Use Claude Dispatch to send work to your Mac and check or guide active coding sessions remotely.

With the glasses: Capture ideas hands-free, ask Claude questions while walking or driving between meetings, describe what you are looking at, or dictate feature ideas without opening a laptop.

Example use case

You are walking through a local business before pitching them an AI-avatar video service. Wearing the glasses, you could dictate:

“Hey Claude, make a short follow-up note: this is a family-owned café, their best angle is friendly staff and locally roasted coffee. Suggest three thirty-second social-video ideas.”

Later, you use Claude Dispatch on your iPhone to tell Claude Code on your Mac:

“Turn that café note into a one-page proposal and three HeyGen video scripts.”

Important caveats

OpenGlasses and similar projects are experimental, not officially supported consumer features.

You will likely need Xcode, an Apple Developer account, and occasional troubleshooting.

API use costs money; Claude API billing is separate from a Claude Pro/Max subscription.

Be careful with privacy: do not record people or feed client-sensitive material into an AI system without consent.

These glasses do not replace a laptop or phone screen. Their real strength is hands-free capture, voice input, audio feedback, and point-of-view context.

Bottom line

For most people, Ray-Ban Meta glasses are a handy camera, headset, and voice assistant. For someone who uses Claude, codes with AI, creates content, or works with local clients, they can become a wearable “idea capture and AI input” device — especially when paired with an iPhone and Mac.

2 comments

Ray-Ban Meta Gen 2 + Claude AI: A Practical Setup for Vibe Coders