Uma solução que encontrei está executando um script que exclui o arquivo Quick Notes.one
em %userprofile%\Documents\OneNote Notebooks\My Notebook
periodicamente. Não parece que há uma opção para desativá-lo sendo recriado.
Outra opção vem de uma das respostas neste tópico nos fóruns da Microsoft :
I had to look back at how I did this on my OneNote. Open OneNote. Go to File, then select Options. Choose Save & Backup on the left of the window that opens. At the top of this window there should be a Save section and you will see Quick Notes Section, Backup Folder and Default Notebook Location and the location.
Change Quick Notes Section to another existing section in your OneNote. I made Quick Notes section refer to my Daily notes section that I type daily notes into and a Quick Notes section tab never appears on it's own anymore. Hope this helps.