re-phone.ru
robots.txt

Robots Exclusion Standard data for re-phone.ru

Resource Scan

Scan Details

Site Domain re-phone.ru
Base Domain re-phone.ru
Scan Status Ok
Last Scan2024-06-10T16:53:33+00:00
Next Scan 2024-06-17T16:53:33+00:00

Last Scan

Scanned2024-06-10T16:53:33+00:00
URL https://re-phone.ru/robots.txt
Domain IPs 104.21.25.120, 172.67.134.54, 2606:4700:3033::6815:1978, 2606:4700:3035::ac43:8636
Response IP 104.21.25.120
Found Yes
Hash dd4ca5736234e2b6bc5e1f1bf7808b3e973142514ad8c2567f0d4f4c8854d454
SimHash a329caa2c352

Groups

*

Rule Path
Disallow /*.xml$
Disallow /*.xml.gz$
Disallow /*.gz$
Disallow /comme*
Disallow /explo*
Disallow /search*

amazonbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /dat*

imagesiftbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 15