Constraints question: How to use child of with vertex group?

I want to use the “child of” constraint with a vertex group or something like that, i want the clothes of my character follow it but, i want to just one part of those clothes moving along with the parented bone and the other part moving freely. Is that possible? if it is , how? The part i want following the character is the hoodie following the head. Thanks for any help in advancement.