Yeah it's really annoying. I assumed it was my line-in cable/port not being up to scratch. It may well be a sound card issue - I just use the card my PC came with, the bog standard one. A new sound card is on my list of things to get when I get a job.
How do you use it? Is it an external sound card?