my-obzor.com
robots.txt

Robots Exclusion Standard data for my-obzor.com

Resource Scan

Scan Details

Site Domain my-obzor.com
Base Domain my-obzor.com
Scan Status Ok
Last Scan2025-12-11T08:52:59+00:00
Next Scan 2025-12-18T08:52:59+00:00

Last Scan

Scanned2025-12-11T08:52:59+00:00
URL https://my-obzor.com/robots.txt
Domain IPs 104.21.30.173, 172.67.173.121, 2606:4700:3034::6815:1ead, 2606:4700:3036::ac43:ad79
Response IP 104.21.30.173
Found Yes
Hash dfb0d1cea9762c66c9d19e86bc3d4323b63c4e0760b5018c4cd64b2378366240
SimHash 0b41f6c48716

Groups

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /cgi-bin
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-content/plugins
Disallow /wp-content/cache
Disallow /wp-content/themes
Disallow /trackback
Disallow */trackback
Disallow */*/trackback
Disallow */*/feed/*/
Disallow */feed
Disallow /*?*
Disallow /tag
Disallow /l/
Disallow /l/*

yandex

Rule Path
Disallow /cgi-bin
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-content/plugins
Disallow /wp-content/cache
Disallow /wp-content/themes
Disallow /trackback
Disallow */trackback
Disallow */*/trackback
Disallow */*/feed/*/
Disallow */feed
Disallow /*?*
Disallow /tag
Disallow /l/
Disallow /l/*

Other Records

Field Value
sitemap https://my-obzor.com/sitemap.xml
sitemap https://my-obzor.com/otzyv/sitemap.xml

Warnings

  • `host` is not a known field.