‘I can’t imagine Kate wanting to move into a place that was designed and redone by Meghan,’ claims Anne Diamond