Certainly, the entire âimmigration should be permittedâ argument is that people should be allowed to live where they want. So saying that people who do not want to live in London should leave is entirely in line with this argument.
The problem is that the Conservatives are so obsessed with the idea that people think they are racists that they sack people who make reasonable statements which could be spun to imply racism.
IMHO, the people who think the Conservatives are racists are so deranged that they will never vote Conservative anyway. So the Conservatives should ignore them and concentrate on winning the votes of the sane.