verkter.fi
robots.txt

Robots Exclusion Standard data for verkter.fi

Resource Scan

Scan Details

Site Domain verkter.fi
Base Domain verkter.fi
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan3/15/2025, 3:09:41 AM
Next Scan 6/13/2025, 3:09:41 AM

Last Successful Scan

Scanned5/2/2023, 4:23:52 AM
URL https://verkter.fi/robots.txt
Domain IPs 104.21.22.162, 172.67.205.167, 2606:4700:3031::6815:16a2, 2606:4700:3034::ac43:cda7
Response IP 104.21.22.162
Found Yes
Hash 8acbfbe0d7bb0376796d312814f0190c69c1f49d98abf66408328b81fedc5c15
SimHash 4441da5447f1

Groups

*

Rule Path
Disallow /CVS
Disallow /.svn$
Disallow /.idea$
Disallow /.sql$
Disallow /.tgz$
Disallow /app/
Disallow /downloader/
Disallow /errors/
Disallow /includes/
Disallow /lib/
Disallow /pkginfo/
Disallow /shell/
Disallow /var/
Disallow /api.php
Disallow /cron.php
Disallow /cron.sh
Disallow /error_log
Disallow /get.php
Disallow /install.php
Disallow /LICENSE.html
Disallow /LICENSE.txt
Disallow /LICENSE_AFL.txt
Disallow /README.txt
Disallow /RELEASE_NOTES.txt
Disallow /cgi-bin/
Disallow /cleanup.php
Disallow /apc.php
Disallow /memcache.php
Disallow /phpinfo.php
Disallow /deliverystatus/
Disallow */deliverystatus
Disallow /adeoweb_autorelated

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2