thebigfatlist.com
robots.txt

Robots Exclusion Standard data for thebigfatlist.com

Resource Scan

Scan Details

Site Domain thebigfatlist.com
Base Domain thebigfatlist.com
Scan Status Ok
Last Scan2024-09-22T15:23:20+00:00
Next Scan 2024-09-29T15:23:20+00:00

Last Scan

Scanned2024-09-22T15:23:20+00:00
URL https://thebigfatlist.com/robots.txt
Domain IPs 209.68.14.195
Response IP 209.68.14.195
Found Yes
Hash dfaaf3c5284706b57da5cdb82b7e027c2de64bc10252375b21873d8d5856420e
SimHash 59055414cd91

Groups

mediapartners-google

Rule Path
Disallow

twitterbot

Rule Path
Disallow

*

Rule Path
Disallow /admin/

Other Records

Field Value
sitemap https://thebigfatlist.com/sitemap-index.xml.gz