Fix _audio_pts_offset setup when we are only processing audio.