Kate Middleton, Prince William and their children are moving to Forest Lodge later this year, and two families living in cottages near the residence were asked to vacate and have since relocated ahead of the royals' move.

According to People ’s reporting, the two families were asked to move on “earlier this summer” and “have since departed in preparation” for William, 43, and Kate, also 43, to relocate their three children, Prince George, 11, Princess Charlotte, 9, and Prince Louis, 6, from their current Adelaide Cottage in England.

But soon after the family started to unpack, things changed again. Queen Elizabeth died, just as Kate Middleton and Prince William landed in the dwelling. “It was not exactly the settling-in period they had hoped for,” a source said of that period in the Waleses’ lives.