pereglin.com
robots.txt

Robots Exclusion Standard data for pereglin.com

Resource Scan

Scan Details

Site Domain pereglin.com
Base Domain pereglin.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-17T03:52:12+00:00
Next Scan 2024-12-16T03:52:12+00:00

Last Successful Scan

Scanned2024-03-24T22:59:14+00:00
URL https://pereglin.com/robots.txt
Domain IPs 148.251.53.103
Response IP 148.251.53.103
Found Yes
Hash 45d016de09a3510628ad24f8e63d0ca7b7f3bcec5897b3337ec03e68dd4ef31e
SimHash eb499c204e90

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Allow /

mj12bot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

cubot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

msnbot

Rule Path
Disallow /

msnbot/2.0b

Rule Path
Disallow /

link

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

mail.ru bot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

Other Records

Field Value
sitemap https://pereglin.com/sitemap_index.xml