mirator.pl
robots.txt

Robots Exclusion Standard data for mirator.pl

Resource Scan

Scan Details

Site Domain mirator.pl
Base Domain mirator.pl
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-06-11T21:34:57+00:00
Next Scan 2025-08-10T21:34:57+00:00

Last Successful Scan

Scanned2025-04-13T21:31:46+00:00
URL https://mirator.pl/robots.txt
Domain IPs 185.135.89.195
Response IP 185.135.89.195
Found Yes
Hash 1bfcf611c39e08e4a008a7ac6b137f1b2bfd71ce31fa28584d405ce04f6a3233
SimHash 6b01da00a3b2

Groups

scrapy

Rule Path
Allow /

*

Rule Path
Allow /wp-admin/admin-ajax.php
Disallow /wp-admin/

Other Records

Field Value
sitemap https://mirator.pl/sitemap.xml
sitemap https://mirator.pl/sitemap.rss