Sanjiv, take a look at the article by Daniel Kahneman et al. in the October edition of HBR. Professor Kahneman discusses noise and bias in this article very well. Measuring them in a data set will depend on the nature of the data and what I call the "difference in pairs" will help you. HTH.