.Google.com's Gary Illyes uncovers Googlebot collects links rather than "complying with" them, opposing formal records.Googlebot collects web links rather than observing all of them in real-time.Gary Illyes discussed this relevant information in Google.com's 'Browse Off The Record' podcast.Google.com's records contradicts the genuine crawler habits.