Yep, you'll need a hefty flash drive or external hard drive depending on the size of your iTunes library. Once you acquire one of the above, navigate to your music. For windows, it's probably 'Program Files>ITunes>'

In this folder copy and paste the 'Itunes' folder to your flash drive or external hard drive. Once your done copying, go to your new computer and copy and paste the folder to the same location from where you got it. What your essentially doing, is copying the folder contains your files, into the iTunes folder on your new computer. Then just go to your new iTunes and 'locate' the folder your pasted over. The music/videos/etc should reappear in your new iTunes library.

If you get lost, google your issue. There are many instructionals online.

-Justin

Follow the instructions in the link... the exact method will depend on your specific situation.