Not necessarily. The harddrive that Windows is installed to tends to be more fragmented than the one that stores large files that aren't often edited, such as videos and pictures.
I'm assuming you installed Windows on the smaller harddrive, because it'd be pretty stupid not to.