takahe.tabletcorry.com
robots.txt

Robots Exclusion Standard data for takahe.tabletcorry.com

Resource Scan

Scan Details

Site Domain takahe.tabletcorry.com
Base Domain tabletcorry.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-03-18T12:11:01+00:00
Next Scan 2024-06-16T12:11:01+00:00

Last Successful Scan

Scanned2023-02-21T22:45:00+00:00
URL https://takahe.tabletcorry.com/robots.txt
Domain IPs 2600:9000:20fe:1a00:4:f58d:cf80:93a1, 2600:9000:20fe:3e00:4:f58d:cf80:93a1, 2600:9000:20fe:7a00:4:f58d:cf80:93a1, 2600:9000:20fe:9000:4:f58d:cf80:93a1, 2600:9000:20fe:ba00:4:f58d:cf80:93a1, 2600:9000:20fe:d200:4:f58d:cf80:93a1, 2600:9000:20fe:e200:4:f58d:cf80:93a1, 2600:9000:20fe:e400:4:f58d:cf80:93a1, 52.222.144.3, 52.222.144.59, 52.222.144.94, 52.222.144.97
Response IP 99.86.91.56
Found Yes
Hash f7ed81a567243139f0d57fc00a5cf0a996bba3bacadeceac56bdfd32172e458e
SimHash 901487215bf1

Groups

*

Rule Path
Disallow /tags/
Disallow /tags/*
Disallow /proxy/*

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

Comments

  • Don't allow any bot to crawl tags.
  • Don't allow bots to crawl through the proxy