Array modifier on archimesh windows?


I created a wall segment with window holes in it and used Archimesh to put in a rail windows in one of the window holes.
Now I want to use an array modifier to create an apartment building.
So I set the empty of the rail window as a child to the wall segment and added 2 array modifiers.

The problem is the array modifiers only create an array of the wall segments but not of the achimesh rail window.

Do I have to manually copy and past the rail window in every window hole of the building?
Or is there a way to do this with the array modifier?

Thank you!