ah-oy.fi
robots.txt

Robots Exclusion Standard data for ah-oy.fi

Resource Scan

Scan Details

Site Domain ah-oy.fi
Base Domain ah-oy.fi
Scan Status Ok
Last Scan2025-11-22T20:04:36+00:00
Next Scan 2025-12-22T20:04:36+00:00

Last Scan

Scanned2025-11-22T20:04:36+00:00
URL http://ah-oy.fi/robots.txt
Redirect http://www.ah-oy.fi/robots.txt
Redirect Domain www.ah-oy.fi
Redirect Base ah-oy.fi
Domain IPs 199.34.228.69
Redirect IPs 199.34.228.69
Response IP 199.34.228.69
Found Yes
Hash ab2191f119b605e6dbd164fca16a6b957d1c885aa6ebd690d391b5b81fe290d7
SimHash 2154dc562f93

Groups

nerdybot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /ajax/
Disallow /apps/
Disallow /vuokrataan.html
Disallow /yritys.html

Other Records

Field Value
sitemap http://www.ah-oy.fi/sitemap.xml