perf: Handle restarts better in take_until_byte{,s,2,3}