Mary distrusts the lady, but Faber also appears to have ulterior motives throughout the situation: particularly, pursuing Mary.
By keeping your fingers calm, and pressed against theirs, you'll really feel which one is twitching, and guess correctly most of the time.