tigerbeer.com
robots.txt

Robots Exclusion Standard data for tigerbeer.com

Resource Scan

Scan Details

Site Domain tigerbeer.com
Base Domain tigerbeer.com
Scan Status Ok
Last Scan2024-05-25T03:23:00+00:00
Next Scan 2024-06-24T03:23:00+00:00

Last Scan

Scanned2024-05-25T03:23:00+00:00
URL https://tigerbeer.com/robots.txt
Redirect https://www.tigerbeer.com/robots.txt
Redirect Domain www.tigerbeer.com
Redirect Base tigerbeer.com
Domain IPs 52.157.142.5
Redirect IPs 23.55.39.163, 23.55.39.173
Response IP 184.27.123.91
Found Yes
Hash 60bfe8dfcede5d8a84d37797c27ec45872c85226084a5b793730d673e8aa76a3
SimHash 194c1bf06bc4

Groups

facebookexternalhit/1.0 (+http://www.facebook.com/externalhit_uatext.php)

Rule Path
Disallow

facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)

Rule Path
Disallow

facebookexternalhit/1.1

Rule Path
Disallow

facebot

Rule Path
Disallow

mozilla/5.0 (compatible; googlebot/2.1; +http://www.google.com/bot.html)

Rule Path
Disallow

googlebot

Rule Path
Disallow

mozilla/5.0 (compatible; semrushbot-sa/0.97; +http://www.semrush.com/bot.html)

Rule Path
Disallow

semrushbot-sa

Rule Path
Disallow

semrushbot

Rule Path
Disallow

bot

Rule Path
Disallow

crawler

Rule Path
Disallow

spider

Rule Path
Disallow

robot

Rule Path
Disallow

crawling

Rule Path
Disallow

pingdom

Rule Path
Disallow

*

Rule Path
Disallow /