Log In Sign Up

marketprovider.ru
robots.txt

Robots Exclusion Standard data for marketprovider.ru

Resource Scan

Scan Details

Site Domain marketprovider.ru
Base Domain marketprovider.ru
Scan Status Ok
Last Scan2024-09-01T03:43:57+00:00
Next Scan 2024-10-01T03:43:57+00:00

Last Scan

Scanned2024-09-01T03:43:57+00:00
URL https://marketprovider.ru/robots.txt
Domain IPs 104.21.94.49, 172.67.219.164, 2606:4700:3032::6815:5e31, 2606:4700:3032::ac43:dba4
Response IP 104.21.94.49
Found Yes
Hash a9a5be73d8a79397fbb9ee0c212e7d8692be8006f290f4eb49021e9419e42395
SimHash 4c4884425517

Groups

yandex

Rule Path
Disallow /*?
Disallow /cgi-sys/
Disallow /*.pdf

googlebot

Rule Path
Allow /*.js
Allow /*.css
Allow /*.png
Allow /*.jpg
Allow /*.svg
Disallow /*?
Disallow /cgi-sys/
Disallow /*.pdf

*

Rule Path
Disallow /*?
Disallow /cgi-sys/
Disallow /*.pdf
Back to top

Other Records

Field Value
sitemap https://marketprovider.ru/sitemap.xml
Back to top