noise confusion around feedback

After a skip-level convo I spent the afternoon dealing with I got surprises. Is there a source of truth for calibration or is it all word of mouth?