soccer-rating.com
robots.txt

Robots Exclusion Standard data for soccer-rating.com

Resource Scan

Scan Details

Site Domain soccer-rating.com
Base Domain soccer-rating.com
Scan Status Ok
Last Scan2024-06-25T02:22:23+00:00
Next Scan 2024-07-02T02:22:23+00:00

Last Scan

Scanned2024-06-25T02:22:23+00:00
URL https://soccer-rating.com/robots.txt
Redirect https://www.soccer-rating.com/robots.txt
Redirect Domain www.soccer-rating.com
Redirect Base soccer-rating.com
Domain IPs 217.160.0.82
Redirect IPs 217.160.0.82
Response IP 217.160.0.82
Found Yes
Hash 21a23b3751072cb22852b5ff5ce6d18621ad3e0b324fd9000d37dab9551e5a9f
SimHash 251d0d53c5b1

Groups

*

Product Comment
* directed to all spiders, not just Scooter
Rule Path
Disallow /chart.pl

vegi bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

Other Records

Field Value
sitemap http://www.soccer-rating.com/sitemap.xml