What needle do you have in it now?
If you go one size leaner on the pilot - it will just worsen the situation you are in. Going with a leaner needle and a richer pilot will help.
Right now - you are "pulling over" - which is having the idle screw cranked in to supply more fuel/air via the nozzle/needle - this is because the pilot is lean, etc. But it's a circular problem - needle too rich/pilot too lean then crank up idle to try to balance air/fuel ratio....
The ultimate fix is to send your carb to RB-Designs - he fixes the carb internally to resolve the sensitivity issue that it has on the idle/pilot circuits, bores it out and installs a divider plate, etc.
jeff