This may be possible with a plugin, something like this:
-
Track the voting events
'a_vote_up', 'a_vote_down', 'a_vote_nil'.
-
Check if the answer is the second by the user in the question (i.e. check if they have any questions with the same parentid and an earlier date/time).
-
If so, remove the points they would have gained from that answer.
This wouldn't survive points recalculations though, so maybe not a great idea.