I was under the impression that
local beekeepers would remove the bees for free and not steal your fountain, but I've never looked into it.
Boric acid is supposed to be good at
pest control without being toxic to pets or humans. My granny once mentioned it for cockroach control.