Steps:
1. From a run box type 'msconfig' and select the Startup Tab.
2. You can uncheck the applications you wish to stop from loading with Windows.
Alternatively, you can configure individual programs directly. A lot of programs have settings to control whether it runs when windows loads.
Or you can use AutoRun program. For more information, see here.
Compare this with startup folder, see here.