Not sure to be honest maybe you could move it a bit at a time and see if they follow it.
I have had bumble bees living in my house for a few years now and they make one heck of a noise in the wall cavity but it's nice to see them so all three nests can stay.