fourfats.com
robots.txt

Robots Exclusion Standard data for fourfats.com

Resource Scan

Scan Details

Site Domain fourfats.com
Base Domain fourfats.com
Scan Status Ok
Last Scan2024-05-22T17:12:18+00:00
Next Scan 2024-05-29T17:12:18+00:00

Last Scan

Scanned2024-05-22T17:12:18+00:00
URL https://www.fourfats.com/robots.txt
Domain IPs 199.34.228.77
Response IP 199.34.228.77
Found Yes
Hash 2d9d8b8fe27017727819425026f5896fded812e2fe79170a98380f709b035a9c
SimHash 6616d02267d3

Groups

nerdybot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /ajax/
Disallow /apps/
Disallow /privacy.html
Disallow /privacysc.html
Disallow /privacytc.html
Disallow /blackmoor-removed.html
Disallow /superboys-removed.html
Disallow /http%3A//www.fourfats.com/ads.txt
Disallow /maximus-removed.html
Disallow /toonshooters-removed.html

Other Records

Field Value
sitemap https://www.fourfats.com/sitemap.xml