When you open the faction menu on the Faction tab and click on a member you notice that the "X" to close this dialog is exactly over the "abandon home" button.
Pressing the "X" to close the dialog also presses the "abandon home" button.
Pressing the "X" to close the dialog also presses the "abandon home" button.