I believe you have an option in hole wizard not to apply textures to features. To remove them, it's either a face or a feature texture. Click on the feature RMB look for feature and appearance, texture then click on remove. If it's not there, then do it again but this time for the face.

remember part colors and texture work by parts, features and lastly by faces.