cro.pl
robots.txt

Robots Exclusion Standard data for cro.pl

Resource Scan

Scan Details

Site Domain cro.pl
Base Domain cro.pl
Scan Status Ok
Last Scan2024-09-18T23:05:54+00:00
Next Scan 2024-09-25T23:05:54+00:00

Last Scan

Scanned2024-09-18T23:05:54+00:00
URL https://cro.pl/robots.txt
Redirect https://www.cro.pl/robots.txt
Redirect Domain www.cro.pl
Redirect Base cro.pl
Domain IPs 188.165.203.207
Redirect IPs 188.165.203.207
Response IP 188.165.203.207
Found Yes
Hash 64ee3a75ec86bc03b0bd4b0a4f5e3efe5b5e63412f96ae21b0dc18d943960204
SimHash 51385ce09376

Groups

*

Rule Path
Disallow /viewtopic.php
Disallow /viewforum.php
Disallow /index.php?
Disallow /posting.php
Disallow /ucp.php
Disallow /mcp.php
Disallow /post
Disallow /member
Disallow /memberlist.php
Disallow /faq.php

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60