You can’t actually interact with the cloth in realtime though (through the modifier). Last I checked, you can’t even do so much as watch the simulation unfold as it is baking.
The brush brings realtime interactivity, and it would be great if it was possible to use this to direct cloth motion for rendering purposes.