🤖/👨🦰 Recognise bots/crawlers/spiders using the user agent string.
Verify that a request is from Google using Google's recommended DNS verification steps
🕵 Verify an IP is related to a certain domain
A simple redis primitives to incr() and top() user agents