Remove the parts and make a small plate to bolt in place of the old bendix cover plate or use a small automotive freeze plug to block off the starter motor spigot hole.
If you want it to be pretty buy the stock powervalve cover and the stock flywheel cover from the non-estart model.