The fact that he sometimes comes to California for business doesn't make California his place of residence. California may have a subject matter jurisdiction over the case. You need to provide more facts to your lawyer and ask for legal advice.