Log In Sign Up

province.ru
robots.txt

Robots Exclusion Standard data for province.ru

Resource Scan

Scan Details

Site Domain province.ru
Base Domain province.ru
Scan Status Ok
Last Scan2024-09-22T00:29:29+00:00
Next Scan 2024-09-29T00:29:29+00:00

Last Scan

Scanned2024-09-22T00:29:29+00:00
URL https://province.ru/robots.txt
Redirect https://www.province.ru/robots.txt
Redirect Domain www.province.ru
Redirect Base province.ru
Domain IPs 104.21.92.163, 172.67.195.177, 2606:4700:3035::6815:5ca3, 2606:4700:3036::ac43:c3b1
Redirect IPs 104.21.92.163, 172.67.195.177, 2606:4700:3035::6815:5ca3, 2606:4700:3036::ac43:c3b1
Response IP 172.67.195.177
Found Yes
Hash aae3bbc387c63a0a1a16235ec96c77382a3e923d4c9dd528a27adb8ebad5cb16
SimHash 5ff5da425a22

Groups

yandex

Rule Path
Disallow /search/*
Disallow /article/*
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-content/plugins
Disallow /wp-login.php
Disallow /cgi-bin
Disallow /*.pdf$
Disallow /*author-id%3D*
Disallow /*photo_id%3D*
Disallow */amp/
Disallow /author/*
Disallow /daily/*
Disallow /page/
Allow /page/1/
Disallow /*.html/amp/

googlebot

Rule Path
Disallow /gsearch/
Disallow /search/*
Disallow /article/*
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-content/plugins
Disallow /wp-login.php
Disallow /cgi-bin
Disallow /*.pdf$
Disallow /*author-id%3D*
Disallow /*photo_id%3D*
Disallow /*utm%3Dshort
Disallow /daily/*
Disallow /page/
Allow /page/1/
Disallow /*.html/amp/

*

Rule Path
Disallow /*?
Disallow /search/
Disallow /article/*
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-content/plugins
Disallow /wp-login.php
Disallow /cgi-bin
Disallow /*.pdf$
Disallow /*author-id%3D*
Disallow /*photo_id%3D*
Disallow /daily/*
Disallow /*.html/amp/
Back to top

Other Records

Field Value
sitemap https://www.province.ru/sitemap/sitemap.xml
Back to top

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.
Back to top