perl1site.ru
robots.txt

Robots Exclusion Standard data for perl1site.ru

Resource Scan

Scan Details

Site Domain perl1site.ru
Base Domain perl1site.ru
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-06-13T09:43:20+00:00
Next Scan 2025-08-12T09:43:20+00:00

Last Successful Scan

Scanned2025-04-15T09:42:25+00:00
URL https://perl1site.ru/robots.txt
Domain IPs 37.230.118.213
Response IP 37.230.118.213
Found Yes
Hash f8750fd25dafa35391748f7542e7914597c1787e49aded52c100379798abfd05
SimHash 6958dc54c431

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 9

Other Records

Field Value
sitemap http://www.perl1site.ru/sitemap.xml