Description of App:
This App is based on the concept that people with visual impairment can 'see color by sound'. By touching the picture screen with your finger, you can recognize the shape, the shade, the color of what is being photographed, in this order, by voice and sound.
When you want to know the sight in front of you, take a picture. In addition, you can select a picture from your album and use it. If the picture is decided, turn off the Voice Over.
It represents eight colors of Red, Yellow red, Yellow, Yellow green, Green, Blue green, Blue and Purple with the organ "CDEFGABC" scale.
Brown and Beige are represented by the low sound "C" or "B" of piano.
It also expresses the light and shade with the sound of percussion instruments.
It is the App that people who can not see the picture feel the shape and color with sound. By the side, you can enjoy the photograph more directly if the visible person explains the photograph.
Apple Watch Support:
Free or Paid:
Device(s) App Was Tested On:
Easy to use.
Need to turn off the VoiceOver, when you enjoy the color in other methods, color name, sound of musical instruments, scales.
You can take a picture or get an image from the camera roll.
When a picture is displayed, there are two buttons on the lowest line on the screen.
On the bottom left is "Next" button, to change the mode of Line Drawing, Grayscale Image, and Color Picture.
On the bottom right is "close" button, to go back to the menu.
On each mode you can convert the color into the sound, but without VoiceOver.
Finger gestures you can use are: tap, drag, touch and hold.
How to use
1. Selecting a picture
Use the camera button to take a picture, or the album button to select a picture.
the picture of menu screen
2. Line Drawing
The type of line is two kinds of bold line and thin line.
Turn off the Voice Over. Touch the screen, if the touch point is a bold line, it responds with ‘Bold line’ by voice and ‘Don’ by sound. In the case of a thin line, it responds with ‘Thin line’ by voice and ‘Pan’ by sound. There is no sound where there is no line. If you trace slowly, it will be only sound.
When touching the screen, long press it, it tells the plane information of a certain size. That is, it responds by voice with `a lot of lines’ or `some lines’ or `no line’ in a square area around your finger (one side is about 1.5 cm).
On this screen, you can recognize the shape. Tap the ‘Next’ button on the bottom left to display Grayscale Image.
the picture of line drawing
3. Grayscale Image
The five types of shading color are White, Light gray, Gray, Dark gray, Black.
Touch the screen, the sounds of percussion instruments respond with White ‘Kon’, Light gray ‘Ton’, Gray ‘Pashi’, Dark gray ‘Bashi’, Black ‘Don’. In this way it responds the type of shading with voice and sound. If you trace slowly, it will be only sound.
When touching the screen, long press it, it tells the plane information of a certain size. It responds to the shading contained in a square area around your finger (one side is about 1.5 cm) and its proportion. The ratio is calculated as 10 as a whole, but the total may not be 10 in some cases because of rounding off etc..
On this screen, you can recognize the change in brightness and darkness of the picture. Tap the ‘Next’ button on the bottom left to get Color Picture.
the pictuer of grayscale image
4. Color Picture
10 kinds of color types in chromatic color are Red, Yellow red, Yellow, Yellow green, Green, Blue green, Blue, Purple, and Brown, and Beige. Achromatic color is 3 types of White, Gray, Black.
Touch the screen, it responds with color name by voice and sound. If you trace slowly it will only sound. Correspondence between color names and sounds is as follows.
With the sound scale of the organ, ‘C’ is Red, ‘D’ is Yellow red, ‘E’ is Yellow, ‘F’ is Yellow green, ‘G’ is Green, ‘A’ is Blue green, ‘B’ is Blue, the high sound ‘C’ is Purple.
In other words it expresses sounds of one octave.
Brown is piano low sound ‘C’, Beige is piano low sound ‘B’.
With the sound of the percussion instruments, White is ‘Kon’, Gray is ‘Pashi’, Black is ‘Don’.
Besides Brown, Beige, White, Gray and Black, there is a distinction between light color and dark color. Then light color is with sound ‘Ton’ and dark color is with sound ‘Bashi’.
Chromatic Color Sound Light・Dark
Red C（Organ） add
Yellow red D（Organ） add
Yellow E（Organ） add
Yellow green F（Organ） add
Green G（Organ） add
Blue green A（Organ） add
Blue B（Organ） add
Purple C（Organ high sound） add
Brown C（Piano low sound)
Beige B（Piano low sound
Achromatic Color Sound
When touching the screen, long press it, it tells the plane information of a certain size. It responds to the color names contained in a square area around your finger (one side is about 1.5 cm) and its proportion. There is no distinction between light and dark. The ratio is calculated as 10 as a whole, but the total may not be 10 in some cases because of rounding off etc..
Tap the ‘Next’ button in the bottom left to return to Line Drawing.
the picture of color picture
5. Key Points
Recognize the shape of what is shown in Line Drawing, and identify the light and dark areas in Grayscale Image. Then, by feeling color change and same color area in Color Picture, the thing is recognized by stepwise. However, complex images such as natural landscapes can have many lines, so in Line Drawing it is difficult to understand the shape.
Learn the relationship between voice and sound with touch, and by tracing slowly, you will feel the change in color due to the change in sound. If the same sound continues, it will be the same color area. If you do not understand the color, also touch and listen to the voice.
Voice and sounds will come out as much as you touch, so it may not correspond to the part you are looking at. Please slowly examine the pictures.
You can enjoy more photos by trying this App while asking someone with visual explanation.
6. Goal of the future App
It is the goal of this App that people without vision feel color. We will upgrade the App version based on opinions of people actually used. Please tap the ‘Contact’ button below and send me your opinions and impressions.
(This site ‘Contact’ page plays the same. )