faplayer.thefa.com
robots.txt

Robots Exclusion Standard data for faplayer.thefa.com

Resource Scan

Scan Details

Site Domain faplayer.thefa.com
Base Domain thefa.com
Scan Status Ok
Last Scan2024-04-26T08:25:01+00:00
Next Scan 2024-05-10T08:25:01+00:00

Last Scan

Scanned2024-04-26T08:25:01+00:00
URL https://faplayer.thefa.com/robots.txt
Domain IPs 108.138.246.106, 108.138.246.40, 108.138.246.49, 108.138.246.58, 2600:9000:234d:1000:15:abdc:8a40:93a1, 2600:9000:234d:1800:15:abdc:8a40:93a1, 2600:9000:234d:3400:15:abdc:8a40:93a1, 2600:9000:234d:5000:15:abdc:8a40:93a1, 2600:9000:234d:5a00:15:abdc:8a40:93a1, 2600:9000:234d:a00:15:abdc:8a40:93a1, 2600:9000:234d:aa00:15:abdc:8a40:93a1, 2600:9000:234d:c600:15:abdc:8a40:93a1
Response IP 18.165.171.37
Found Yes
Hash 85f6e64d82e66b2cd4b7a1b33dfa0f45f6b9623aed5e36e58540208a96993c2b
SimHash 67155c744592

Groups

googlebot

Rule Path
Disallow /private/

Other Records

Field Value
crawl-delay 100

Other Records

Field Value
sitemap https://faplayer.thefa.com/sitemap.xml

Warnings

  • `host` is not a known field.