f-thies.de
robots.txt

Robots Exclusion Standard data for f-thies.de

Resource Scan

Scan Details

Site Domain f-thies.de
Base Domain f-thies.de
Scan Status Ok
Last Scan2024-09-20T04:02:48+00:00
Next Scan 2024-09-27T04:02:48+00:00

Last Scan

Scanned2024-09-20T04:02:48+00:00
URL https://f-thies.de/robots.txt
Domain IPs 85.13.147.162
Response IP 85.13.147.162
Found Yes
Hash 4db043c7ff13cf1812f53e08fdc8c0fe3ede9bab0b15316b49eb57b613b815ef
SimHash 6e18cdd47301

Groups

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

googlebot

Rule Path
Disallow /*?

*

Rule Path
Disallow /cache/
Disallow /help/
Disallow /images/
Disallow /templates/
Disallow /phpbb/admin/
Disallow /phpbb/album_mod/
Disallow /phpbb/cache/
Disallow /phpbb/ctracker/
Disallow /phpbb/db/
Disallow /phpbb/images/
Disallow /phpbb/includes/
Disallow /phpbb/language/
Disallow /phpbb/templates/
Disallow /phpbb/config.php
Disallow /phpbb/profile.php
Disallow /phpbb/groupcp.php
Disallow /phpbb/memberlist.php
Disallow /phpbb/modcp.php
Disallow /phpbb/posting.php
Disallow /phpbb/privmsg.php
Disallow /phpbb/viewonline.php
Disallow /phpbb/faq.php
Disallow /phpbb/ptopic*.html$
Disallow /phpbb/ntopic*.html$
Disallow /phpbb/ftopic*asc*.html$