A opção "purge" para apt-get
deve remover o pacote e o (s) arquivo (s) de configuração associado (s) ...
sudo apt-get purge <package_name>
A página man do apt-get ( link ) diz:
purge is identical to remove except that packages are removed and
purged (any configuration files are deleted too).