thoughts on recent updates to picture smart with jaws 2024

By Michael, 19 March, 2024

Forum
Windows

So, what are all your thoughts on the new picture smart feature introduced in the latest build of jaws 2024?
I am very excited about this but see that it clearly needs more work to make it perfect. For one, I keep hitting that 50 count limit with chat gpt, even if I know for a fact I haven't invoked it 50 times ina single day.
I also like how it utilizes both google Gemini but find gemini to be unreliable, often with descriptions left completely blank, significantly more halusination than chat gpt, and interestingly, will simply make up it's own descriptions if you try to have it describe an empty canvus or try to use picture smart with screen shade on.

Options

Comments

By AnonyMouse on Monday, March 18, 2024 - 06:49

Member of the AppleVis Editorial Team

I agree that the new Picture Smart feature is a valuable addition to JAWS. It adeptly describes various scenarios and proves especially helpful when dealing with screenshots. Like you, I’ve also found Genesis to be somewhat less reliable. The rumor that Apple is in talks with Google to utilize its Genesis technology is interesting.

Furthermore, Be My Eyes is slated to arrive on the Windows platform this summer. I’m genuinely curious about how it will function, especially since we won’t encounter the limitations we’ve seen with JAWS, which caps at 50 pictures per day with ChatGPT. I wonder if both Be My Eyes and JAWS will provide similar descriptions or if they’ll differ slightly. Additionally, having the option to ask additional questions with the BME Windows Edition is a welcome bonus. This feature has now been checked off my JAWS wish list. Looking ahead, I’d love to see them tap into Microsoft’s new voices or even explore beyond the Vocalyzer Expressive voices.

By Brad on Monday, March 18, 2024 - 06:49

I can't. it's not in the demo and you can't pay £100 a year like you can in the US.

BeMyEyes is coming to windows? That will be interesting.

I think envision is doing a similar thing next year.

I hope that either of them let us click on buttons on the app.
Perhaps the 50 times a day thing is more about tokens and less about how many times you use it?

I hope BeMyEyes doesn't cap you like JAWS seams to.

Things are just getting better and better, just think where we'll be in 5 or so years, perhaps NVDA will have its own picture describer and we'll have habtick braille, either way; it'll be fun.

By Brian on Monday, March 18, 2024 - 06:49

Already has a few options for this. There is still the whole ''cap'' though. Still, that has more to do with Open AI/Chat GPT, than anything else. 🤷

By Brad on Monday, March 18, 2024 - 06:49

Plus with them you need an account, I don't think you do with the jaws version.

By Brian on Monday, March 18, 2024 - 06:49

Open AI accounts are dirt cheap. I like my add-ons, though I would like to see a more streamlined setup for the service. 🤷

By Brad on Monday, March 18, 2024 - 06:49

I thought I'd try this shiny new toy called open AI, nah I decided, it's not for me.

Months pass, "let's try open AI again!" I thought, oh, I can't use my live account, that's ok, I have gmail, I tried that and again, nah, not for me, so now I have no accounts left.

If I really need it I can make another gmail I'm sure but yeah, that's my story.