rudoroz.pl
robots.txt

Robots Exclusion Standard data for rudoroz.pl

Resource Scan

Scan Details

Site Domain rudoroz.pl
Base Domain rudoroz.pl
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-03-16T20:39:44+00:00
Next Scan 2025-05-15T20:39:44+00:00

Last Successful Scan

Scanned2023-10-31T17:27:07+00:00
URL http://rudoroz.pl/robots.txt
Redirect http://www.rudoroz.pl/robots.txt
Redirect Domain www.rudoroz.pl
Redirect Base rudoroz.pl
Domain IPs 2.57.138.101
Redirect IPs 2.57.138.101
Response IP 2.57.138.101
Found Yes
Hash e7e450b6171ce3b5d322bccd271126fc00bb94c458c5de6730b9ffcb72176309
SimHash c8009a22a7a3

Groups

scrapy

Rule Path
Allow /

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap http://www.rudoroz.pl/sitemap.xml
sitemap http://www.rudoroz.pl/sitemap.rss