We often ignore our gut feelings about places, people- thinking that they are just assumptions. But they work really well for some people. They seem to have some strange capacity of guessing (!) such things!
May be its not assumption, they may be able to grasp that “little fluctuation of expression” or “tremor of voice” that reveals the true person; signs that we ignore just because they are too slight.