I would love it if the guild leader could remove them... a former member put a fountain in and quit the game later, so it's just lagging everyone that goes into the castle.
Um, guild leaders can. O.o
We can't move furniture someone else put in a certain place, but we can send any furniture items that were placed into the guild castle back to their original owners--effectively removing them from the castle.