I build RealTime AI Cam, a free app that tells you what the camera is pointed at, out loud. Everything runs on the iPhone itself, so it works in airplane mode, with no account and nothing to buy.
It names objects as you move the camera and reads printed text and mail out loud. If you hold to ask a question about what it sees, it answers first with yes, no, or the number. Help Me Aim talks you into the shot for a face, a page or a label, then takes the picture once you're lined up. It translates printed Spanish into English with no internet, and 16 more languages after a one-time download. Every button is labeled for VoiceOver, and you can let VoiceOver do the talking if you prefer.
Here's where I'm stuck. The models have to be small enough to fit on the phone, so it still mislabels things sometimes. Most of the app came from blind users telling me what they needed, so if you try it, please tell me where it gets things wrong for you. It's on Android too if you have friends using TalkBack.
Comments
please add option to disable display auto-lock
iOS's 30-second auto-lock is fine for most apps, since users interact constantly (or VoiceOver keeps the screen awake). But in RealTime AI Cam, users routinely go longer than 30 seconds without touching the screen — for example, while using "help me aim" (and likely all the other functions) — so the display locks mid-task and interrupts the flow. Please add an option to disable display auto-lock for this app. Thanks
Screen auto-lock
Good catch LaBoheme, you're right. Right now the screen only stays awake in live mode, so Help Me Aim and the others can lock on you mid task. I'm fixing it so the screen stays on whenever the camera is running, on both iPhone and Android, and I'll post here when the update is out.
Re: Screen auto-lock
Hi Matt, can you also make the camera follow device orientation for "help me aim"? Landscape orientation is more appropriate in certain situation. When I tried to took a picture landscape, the picture came out sideways.
Landscape in Help Me Aim
Hi LaBoheme, thanks for this one, you were right. Help Me Aim wasn't always reading which way the phone was turned, so a landscape picture could get saved sideways. That's fixed now. The picture saves the way you held the phone, with the front or the back camera, and the Help Me Aim camera screen turns to landscape along with the phone. It's going into the next update together with the screen staying awake, and I'll post here when it's out.
Love the new models
Hello. I love the new models you can download offline. They are definitely much more detailed. However, I've noticed that if the description is lengthy, it gets cut off. Other than that, it's working wonderfully. Keep up the good work.
Long descriptions fixed in 1.4.2
Hi Matt,
Thanks so much, I'm really glad the new offline models are working well for you, and thank you for catching the cut-off descriptions. You were right: the more detailed models were running out of room before they finished. I fixed it in version 1.4.2, which is with Apple for review now. What's this? now starts with a one-line summary, then gives the full description, and it never stops in the middle of a sentence. Live Cam also describes the room in more detail when it opens. Let me know how it works for you once the update comes through.
problem with the latest update
One little problem with the latest update. When the app opens and you touch any place on the screen, vo says:
SplashScreen  Screenshot SETTINGS INFO GUIDE. RealTime Ai Camera. Read. Object Detection. What's this?. Help Me Aim. Live Cam. EXPERIMENTAL. Ava (Premium) ^. v1.4.1 (51)
As you see, it reads everything, you can't go to a specific item by touch. The only way to get to the function you want is to swipe through it, one by one.
I hope my explanation makes sense.
Re: problem with the latest update
That makes perfect sense, and thank you for catching it. The home screen is getting read as one big block, so touch exploration can't land on a single button. I'm fixing it so each button can be found by touch again, and it will be in the next update. Until then swiping through works, and I'm sorry for the extra steps.