A man's ears are often as sensitive as his scrotum, so don't avoid this area.

Try gently licking his ears, lightly sucking on them, or lightly nibbling on his earlobe just before his orgasm and whisper something frank.