Moderate Tories fear the party’s attack on human rights will alienate many voters and damage the UK’s global standing