thebigfatlist.com
robots.txt

Robots Exclusion Standard data for thebigfatlist.com

Resource Scan

Scan Details

Site Domain thebigfatlist.com
Base Domain thebigfatlist.com
Scan Status Ok
Last Scan2024-11-18T01:42:19+00:00
Next Scan 2024-11-25T01:42:19+00:00

Last Scan

Scanned2024-11-18T01:42:19+00:00
URL https://thebigfatlist.com/robots.txt
Domain IPs 209.68.14.195
Response IP 209.68.14.195
Found Yes
Hash dfaaf3c5284706b57da5cdb82b7e027c2de64bc10252375b21873d8d5856420e
SimHash 59055414cd91

Groups

mediapartners-google

Rule Path
Disallow

twitterbot

Rule Path
Disallow

*

Rule Path
Disallow /admin/

Other Records

Field Value
sitemap https://thebigfatlist.com/sitemap-index.xml.gz