On the need for a rhetorical-question mark

'Didn't they have terrible times,' she asked me (and there was no question mark). 'Yes,' I said. 'Didn't they.'

- Martin Amis, Koba the Dread

(Though note that a rhetorical question, curiously, is still 'asked'.)