Write config after certificate chains have been created