See, caller IDs can be spoofed, just like e-mails.
There are web sites and software that let you spoof phone numbers. I bet that if I really wanted to, I could call you pretending to be you. But why would I?
Here is one such site: http://www.spoofcard.com/
This one even lets you add background noise.