Blender - the first 3D application with voice control?

General Forums Blender Development Discussion
#1

Would be be possible to have a voice control (voice recognition) for blender? I came up with this idea while having my headset on, noticing that i sometimes whisper the shortcuts im using.
Would it make sense to have voice control over the blender commands? Saying “Add Mesh Cube” to add a cube, saying “Merge vertices at last” to merge the selectes vertices and so on.

Is something like this technically possible at all? Which Language would Blender “speak”? How would something like this adapted into the current blender workflow? Obviously you can not select vertices or do sculpting strokes by voice control. But mostly other commands may work.

I’d like to read your opinions on this. I think this functionality would make blender pretty unique and fast to work with.

2 Likes
#2

Technically this is of course possible, at least hypothetically. Practically though… Pressing M 2, or, if you care about efficiency enough to reassign the merge shortcut to something more reachable, something like Alt+X 2 - you can do that like 3-5 times in the same amount of time you would require to enunciate “Merge vertices at last” clearly enough for any voice recognition to understand (and that’s assuming it itself is fast enough to process and recognize the command and context, which is a big assumption). Same with “Add Mesh Cube”, which is Shift + A 1 2.
Voice control will never be fast, anywhere, as compared to mouse/keyboard input.

1 Like
#3

Stan, thanks for your answer. The given commands were of course examples for any blender command.
Regarding the reaction speed of a voice control addon, i agree with you that this is a critical point. it would maybe need some context sensitive answering algorhythm, similar to the new search. If you give a vague command, the voice control could suggest similar possilbe commands to execute.

#4

i also thought about this. it would be cool for some commands like “left view”, “top view”,… not for modeling operators. there it really would be too slow.

i think it would be possible to do a python addon that uses windows’ speech recognition features. but i didn’t have time to look into it. also don’t know what could be used on linux.

1 Like
#5

Good point. It could make more sense in the “pheriphercial” Commands. “Render”, “Compositor” or file commands such as saving. commands that are not often used.

1 Like
#6

Here’s an example of this in 3ds Max from 10 years ago. I’ve seen other, more recent Max users working this way.

From 3 years ago in Max

Here’s one I just found for Blender. His source code is on his Gumroad. Might be worth checking out(It’s 3 years old)

3 Likes
#7

Hi @KarlAndreasGross.

To send commands (hotkeys) to Blender with your voice, you can use Voice Macro (a freeware for Windows): https://www.voicemacro.net/

And if you don’t have a microphone (or a headset with a microphone), you can use your smartphone as a microphone. To make the “bridge” between your smartphone and your computer, you can use https://wolicheng.com/womic/ (free).

3 Likes
#8

Thank you. I will dig into this. Switching workspaces and calling sculpt tools is a MUST on voice comand.

1 Like
#9

Thanks xan,
voicemacro seems to be an interesting first start. I like the idea of giving certain blender commands to certain control words. This is like a keymap, only with words.
A Blender addon for voice control should consider that. The user should have the option put certain commands onto control word of his own like. For expample the control word for switching to the node editor is “Noodles” :wink:

I hope that more people get interessted into this topic.

Arent there any AI Based solutions on Github?

#10

It hypothetically is possible, but will need code almost as big as Blender itself. I would prefer the development of Blender, instead of the Voice Recognition, and don’t have or know anyone who has problems and will need a voice recognition stuff.
All in all, I wouldn’t want a voice-recognition feature in Blender unless its smaller, and faster
And Voicemacro seems a good start, but I will still prefer a Keyboard and a Mouse

#11

I agree. I would also prefer the development of Blender to be focused on performance improvements, bug fixes, new features (related to 3D), etc.

I just don’t think that Voice Recognition should be implemented directly in Blender. Maybe it could be done as an add-on? (but even if it could, I think that it would be a huge task). IMO, third party tools like Voice Macro (or other softwares) already do the job pretty well.

3 Likes
#12

Ok, thanks to all who added information to this thread. I also agree that there are more important development tasks to do in blender, and voicemacro is a good helper for the current state of the art. lets see if this one continues in ten years from now.

#13

An idea. Add an adaptation of Voice Macro to cut down development time, Make it an option like other UI things. Make it limited to things as xsan2622 suggested.

Why? To make Blender available to those who may need it because of coordination problems or another malady further widening the customer base.

1 Like
#14

nobody demands to develop voice recognition from scratch for blender. that would be silly. :slight_smile: an add-on would use an existing voice recognition library. i am not sure what the advantages over voicemacro would be though?

#15

You’re totally in point! :smiley:

1 Like