‘We don’t know the social conditions under which these clothes are made,’ says Bruno Le Maire.