After plugging the external drive into the computer(USB), navigate to your files(usually in C:\Documents and Settings), right click on the folder and select copy. Now navigate to the external drive and paste the files there using the same technique.
External drives may also come with software that offer to automatically backup your files. Instructions are usually included.
Remember to keep your backup in a safe place.
External drives typically cost between $50 - $125