Personally, I only use the widget. It is far less trouble than the program.
All classes, for XCenter widgets, get loaded (when XCenter starts), even if you don't use them. It is probably a good idea to remove unused DLLs from the XCenter plugins directory. Just move them somewhere else (close XCenter first), so you can put them back if you decide to use them.