But I don't think the problem is that he sounds or looks like a toff, precisely.
From the economist.com
It is such bad taste but toff labels like Burberry want you to think that it is not.
From the independent.co.uk
If this is journalism, then it belongs in the trash pile with the other liberal toff.
From the washingtontimes.com
The pintsized toff is 8-1 to be holding a different cabinet post by this time in 2013.
From the mirror.co.uk
The grand old sport of toff-hunting is alive and well and flourishing among Labour MPs.
From the telegraph.co.uk
The choice of Sean Connery was so interesting because he's not a toff.
From the metro.co.uk
The broadsheet toff who'd interrupted them earlier ambled over, eating.
From the economist.com
Are the rugby pitches of the toff schools being sold off to make flats and office blocks?
From the guardian.co.uk
The evidence is, like Christopher Chichester's affected English toff accent, pretty weak.
From the boston.com
More examples
Informal term for an upper-class or wealthy person
In British English slang, a toff is a mildly derogatory term for someone with an aristocratic background, particularly someone who exudes an air of superiority. ...
In the series of adventure novels by John Creasey, the Toff is the nickname of the Honourable Richard Rollison, an upper-class crime sleuth. ...
An elegantly dressed person; A person of the upper class or high class pretence and usually communicating an air of superiority
(Toffed) A batsman of lower class may be given out 'toffed' if there is sufficient condescending frostiness from MCC spectators. This frostiness may be expressed through symbolic gestures, such as sleeping, reaching one's 80th birthday, or gazing indifferently into the rim of a straw trilby. ...