acfreepress.com
robots.txt

Robots Exclusion Standard data for acfreepress.com

Resource Scan

Scan Details

Site Domain acfreepress.com
Base Domain acfreepress.com
Scan Status Ok
Last Scan2025-12-28T12:34:26+00:00
Next Scan 2026-01-04T12:34:26+00:00

Last Scan

Scanned2025-12-28T12:34:26+00:00
URL https://acfreepress.com/robots.txt
Redirect https://www.acfreepress.com/robots.txt
Redirect Domain www.acfreepress.com
Redirect Base acfreepress.com
Domain IPs 199.34.228.74
Redirect IPs 199.34.228.74
Response IP 199.34.228.74
Found Yes
Hash c27ae3b2a5cdaf63f79fe60276b4b04cab36d50c5c9cb6fdf2274924d6b8025a
SimHash 4255de36a7b3

Groups

nerdybot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /ajax/
Disallow /apps/
Disallow /2016-e-edition.html
Disallow /2017-e-edition.html
Disallow /2015-e-edition.html
Disallow /2014-e-edition.html
Disallow /2020-e-edition.html
Disallow /2019-e-edition.html
Disallow /2018-e-edition.html

Other Records

Field Value
sitemap https://www.acfreepress.com/sitemap.xml