fantasygully.com
robots.txt

Robots Exclusion Standard data for fantasygully.com

Resource Scan

Scan Details

Site Domain fantasygully.com
Base Domain fantasygully.com
Scan Status Ok
Last Scan2024-05-13T23:03:57+00:00
Next Scan 2024-05-20T23:03:57+00:00

Last Scan

Scanned2024-05-13T23:03:57+00:00
URL https://fantasygully.com/robots.txt
Redirect https://www.fantasygully.com/robots.txt
Redirect Domain www.fantasygully.com
Redirect Base fantasygully.com
Domain IPs 13.232.192.92
Redirect IPs 23.211.140.112, 23.211.140.73, 2600:1413:b000:1e::17d1:2e4a, 2600:1413:b000:1e::17d1:2e56
Response IP 184.27.123.90
Found Yes
Hash 6007ea57702d87cb51bf9be1e9ba3230f74f33d6ea31c36b42f6b4c3d53eeda8
SimHash 60004844cfb1

Groups

twitterbot

Rule Path
Disallow

*

Rule Path
Allow
Disallow /api/*
Disallow /socialapi/*

Other Records

Field Value
sitemap https://www.fantasygully.com/site-map/sitemap.xml