Move _port_offset up to AudioPort, as MidiPort does not use it.