Log In Sign Up

expert3d.ru
robots.txt

Robots Exclusion Standard data for expert3d.ru

Resource Scan

Scan Details

Site Domain expert3d.ru
Base Domain expert3d.ru
Scan Status Ok
Last Scan2024-11-06T00:43:22+00:00
Next Scan 2024-12-06T00:43:22+00:00

Last Scan

Scanned2024-11-06T00:43:22+00:00
URL http://expert3d.ru/robots.txt
Domain IPs 2a00:15f8:a000:5:1:11:4:5408, 2a00:15f8:a000:5:1:12:4:5408, 2a00:15f8:a000:5:1:13:4:5408, 2a00:15f8:a000:5:1:14:4:5408, 90.156.201.102, 90.156.201.106, 90.156.201.50, 90.156.201.79
Response IP 90.156.201.102
Found Yes
Hash f5bdc48c95856dffaf209c7d362068c68ff03b9246c4b4c7db26dd7a2896d9cc
SimHash 68c084c14232

Groups

yandex

Rule Path
Allow /css/*.css
Allow /scripts/*.js

Other Records

Field Value
crawl-delay 3

googlebot

Rule Path
Allow /css/*.css
Allow /scripts/*.js

*

Rule Path
Allow /css/*.css
Allow /scripts/*.js

Other Records

Field Value
crawl-delay 6

googlebot-image

Rule Path
Allow /images/*.png
Allow /images/*.jgp
Allow /images/*.jpeg
Allow /images/*.svg
Allow /images/*.gif

yandeximages

Rule Path
Allow /images/*.png
Allow /images/*.jgp
Allow /images/*.jpeg
Allow /images/*.svg
Allow /images/*.gif

Other Records

Field Value
crawl-delay 3
Back to top

Other Records

Field Value
sitemap http://expert3d.ru/sitemap.xml
Back to top

Warnings

  • `host` is not a known field.
Back to top