varioterm.ru
robots.txt

Robots Exclusion Standard data for varioterm.ru

Resource Scan

Scan Details

Site Domain varioterm.ru
Base Domain varioterm.ru
Scan Status Ok
Last Scan2025-11-17T10:05:51+00:00
Next Scan 2025-12-17T10:05:51+00:00

Last Scan

Scanned2025-11-17T10:05:51+00:00
URL https://varioterm.ru/robots.txt
Domain IPs 31.31.196.138
Response IP 31.31.196.138
Found Yes
Hash 05c5c8eb6b9e95798e8dccf2be82ecf18f2162f01477a62918cfc8426e7bf079
SimHash c82cccc2c4bb

Groups

*

Rule Path
Disallow /?s=
Disallow /page/*/?s=
Disallow /search/

Other Records

Field Value Comment
crawl-delay 40 задает таймаут в 40 секунд для всеÑ

adsbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

Other Records

Field Value
sitemap https://varioterm.ru/sitemap_index.xml

Comments

  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK

Warnings

  • 2 invalid lines.