pedtext.ru
robots.txt

Robots Exclusion Standard data for pedtext.ru

Resource Scan

Scan Details

Site Domain pedtext.ru
Base Domain pedtext.ru
Scan Status Ok
Last Scan3/19/2025, 6:06:51 AM
Next Scan 4/18/2025, 6:06:51 AM

Last Scan

Scanned3/19/2025, 6:06:51 AM
URL https://pedtext.ru/robots.txt
Domain IPs 104.21.28.109, 172.67.145.220, 2606:4700:3032::ac43:91dc, 2606:4700:3037::6815:1c6d
Response IP 104.21.28.109
Found Yes
Hash 2664bf9359fdd6385f56905e5ee2e6f22c92a276b6f54f23e7c0aefda3c11fa7
SimHash 4c51c242c371

Groups

*

Rule Path
Disallow /cgi-bin/

propowerbot/2.14

Rule Path
Disallow /

yandex

Rule Path
Allow /