The easiest way would just be to delete the entire BGII folder, and then search trough your registry for all "Baldur" entries and delete those folders/keys.
Should work in most cases.
I did what you said but still when I open bg2 from the cd the normal menu appears... and it has no install so I guess I'll have to format my computer