Ex-door neighbor

The person who used to be, but is no longer your next door neighbor.

I invited my ex-door neighbor from California; I hope you don't mind.