Log In Sign Up

serdobol.space
robots.txt

Robots Exclusion Standard data for serdobol.space

Resource Scan

Scan Details

Site Domain serdobol.space
Base Domain serdobol.space
Scan Status Ok
Last Scan2024-05-29T19:18:27+00:00
Next Scan 2024-06-05T19:18:27+00:00

Last Scan

Scanned2024-05-29T19:18:27+00:00
URL https://serdobol.space/robots.txt
Domain IPs 45.130.41.81
Response IP 45.130.41.81
Found Yes
Hash 7746b73b8317bc2ac0a33c52a76a64abd0d7d54f124ea6637e69c100a6d434f4
SimHash 429c9c93a232

Groups

*

Rule Path
Disallow /admin/
Disallow /plugins/
Disallow /search/
Disallow /cart/
Disallow */?s=
Disallow *sort%3D
Disallow *view%3D
Disallow *utm%3D

Other Records

Field Value
crawl-delay 10

googlebot

Rule Path
Disallow /admin/
Disallow /plugins/
Disallow /search/
Disallow /cart/
Disallow */?s=
Disallow *sort%3D
Disallow *view%3D
Disallow *utm%3D
Allow /plugins/*.css
Allow /plugins/*.js
Allow /plugins/*.png
Allow /plugins/*.jpg
Allow /plugins/*.gif

Other Records

Field Value
crawl-delay 10

yandex

Rule Path
Disallow /admin/
Disallow /plugins/
Disallow /search/
Disallow /cart/
Disallow */?s=
Disallow *sort%3D
Disallow *view%3D
Allow /plugins/*.css
Allow /plugins/*.js
Allow /plugins/*.png
Allow /plugins/*.jpg
Allow /plugins/*.gif
Allow /*.png

Other Records

Field Value
crawl-delay 10
Back to top

Other Records

Field Value
sitemap https://serdobol.space/sitemap_index.xml
Back to top

Comments

  • User-agent: *
  • Disallow: /wp-admin
  • Disallow: /wp-includes
  • Disallow: /wp-content/plugins
  • Disallow: /wp-content/cache
  • Disallow: /wp-json/
  • Disallow: /xmlrpc.php
  • Disallow: /readme.html
  • Disallow: /*?
  • Disallow: /?s=
  • Allow: /*.css
  • Allow: /*.js
  • Allow: /*.rss
  • allow: */feed
  • Clean-Param: utm_source&utm_medium&utm_campaign
  • Clean-Param: openstat
  • Host: https://kareliapress.ru
  • Sitemap: https://kareliapress.ru/sitemap_index.xml
Back to top

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.
Back to top