While it was true that the Prince's Residence had to be shifted to a different location, it was not something that could be done overnight.
The large residence opposite King Rong's residence was left behind by the previous dynasty. As the two families had always been close, Fan Zijin had taken a liking to this area at first glance. He and Qi Haoran had gone to take a look and saw that the houses there were well maintained. The key was that one of the residences was located beside the mountain like King Rong's residence, and in that mountain there was a lake. Although it was not as majestic as the lake in King Rong's residence, the scenery was still splendid.
Thus, Fan Zijin had chosen this area, and with his status as a Prince, it was just right to connect three residences into one.