Log In Sign Up

findhow.org
robots.txt

Robots Exclusion Standard data for findhow.org

Resource Scan

Scan Details

Site Domain findhow.org
Base Domain findhow.org
Scan Status Ok
Last Scan2024-09-17T07:45:12+00:00
Next Scan 2024-09-24T07:45:12+00:00

Last Scan

Scanned2024-09-17T07:45:12+00:00
URL https://findhow.org/robots.txt
Domain IPs 94.247.135.94
Response IP 94.247.135.94
Found Yes
Hash 86939de89048abd53e9b4bce662aa9a73c2b16314a8a2f5f4fb50fe14fa8c683
SimHash 4e7c0d12a3c8

Groups

googlebot

Rule Path
Disallow /wp-admin
Disallow /wp-comments
Disallow /wp-content/plugins
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /banbot.html
Allow */*.css
Allow */*.js
Allow /law?z=%2Frus%2Fdocs%2FK940001000_
Allow /law?z=%2Frus%2Fdocs%2FK990000409_
Allow /law?z=%2Frus%2Fdocs%2FK950001000_
Allow /law?z=%2Frus%2Fdocs%2FK2100000400
Allow /law?z=%2Frus%2Fdocs%2FK2000000360
Allow /law?z=%2Frus%2Fdocs%2FK2000000350
Allow /law?z=%2Frus%2Fdocs%2FK1700000123
Allow /law?z=%2Frus%2Fdocs%2FK1700000120
Allow /law?z=%2Frus%2Fdocs%2FK1500000414
Allow /law?z=%2Frus%2Fdocs%2FK1500000377
Allow /law?z=%2Frus%2Fdocs%2FK1500000375
Allow /law?z=%2Frus%2Fdocs%2FK1400000235
Allow /law?z=%2Frus%2Fdocs%2FK1400000234
Allow /law?z=%2Frus%2Fdocs%2FK1400000231
Allow /law?z=%2Frus%2Fdocs%2FK1400000226
Allow /law?z=%2Frus%2Fdocs%2FK1100000518
Allow /law?z=%2Frus%2Fdocs%2FK080000095_
Allow /law?z=%2Frus%2Fdocs%2FK030000481_
Allow /law?z=%2Frus%2Fdocs%2FK030000477_
Allow /law?z=%2Frus%2Fdocs%2FK030000442_
Allow /law?z=%2Frus%2Fdocs%2FZ970000094_
Allow /law?z=%2Frus%2Fdocs%2FZ980000220_
Allow /law?z=%2Frus%2Fdocs%2FZ070000319_
Allow /law?z=%2Frus%2Fdocs%2FZ970000155_
Allow /law?z=%2Frus%2Fdocs%2FZ1400000176
Allow /law?z=%2Frus%2Fdocs%2FZ1400000202
Allow /law?z=%2Frus%2Fdocs%2FZ1300000105
Allow /law?z=%2Frus%2Fdocs%2FZ950002464_
Allow /law?z=%2Frus%2Fdocs%2FZ1500000434
Allow /law?z=%2Frus%2Fdocs%2FZ100000261_
Allow /law?z=%2Frus%2Fdocs%2FZ100000274_
Allow /law?z=%2Frus%2Fdocs%2FZ1400000188
Allow /law?z=%2Frus%2Fdocs%2FZ1700000081
Disallow /law

yandex

Rule Path
Disallow */amp
Disallow /wp-admin
Disallow /wp-comments
Disallow /wp-content/plugins
Disallow /wp-login.php
Disallow /wp-register.php
Disallow */trackback
Disallow */feed
Disallow */*/feed
Disallow /feed/*
Disallow */attachment/*
Disallow */tag/*
Disallow */page/*
Disallow */tag/*page%3D
Disallow /cgi-bin
Allow /law?z=%2Frus%2Fdocs%2FK940001000_
Allow /law?z=%2Frus%2Fdocs%2FK990000409_
Allow /law?z=%2Frus%2Fdocs%2FK950001000_
Allow /law?z=%2Frus%2Fdocs%2FK2100000400
Allow /law?z=%2Frus%2Fdocs%2FK2000000360
Allow /law?z=%2Frus%2Fdocs%2FK2000000350
Allow /law?z=%2Frus%2Fdocs%2FK1700000123
Allow /law?z=%2Frus%2Fdocs%2FK1700000120
Allow /law?z=%2Frus%2Fdocs%2FK1500000414
Allow /law?z=%2Frus%2Fdocs%2FK1500000377
Allow /law?z=%2Frus%2Fdocs%2FK1500000375
Allow /law?z=%2Frus%2Fdocs%2FK1400000235
Allow /law?z=%2Frus%2Fdocs%2FK1400000234
Allow /law?z=%2Frus%2Fdocs%2FK1400000231
Allow /law?z=%2Frus%2Fdocs%2FK1400000226
Allow /law?z=%2Frus%2Fdocs%2FK1100000518
Allow /law?z=%2Frus%2Fdocs%2FK080000095_
Allow /law?z=%2Frus%2Fdocs%2FK030000481_
Allow /law?z=%2Frus%2Fdocs%2FK030000477_
Allow /law?z=%2Frus%2Fdocs%2FK030000442_
Allow /law?z=%2Frus%2Fdocs%2FZ970000094_
Allow /law?z=%2Frus%2Fdocs%2FZ980000220_
Allow /law?z=%2Frus%2Fdocs%2FZ070000319_
Allow /law?z=%2Frus%2Fdocs%2FZ970000155_
Allow /law?z=%2Frus%2Fdocs%2FZ1400000176
Allow /law?z=%2Frus%2Fdocs%2FZ1400000202
Allow /law?z=%2Frus%2Fdocs%2FZ1300000105
Allow /law?z=%2Frus%2Fdocs%2FZ950002464_
Allow /law?z=%2Frus%2Fdocs%2FZ1500000434
Allow /law?z=%2Frus%2Fdocs%2FZ100000261_
Allow /law?z=%2Frus%2Fdocs%2FZ100000274_
Allow /law?z=%2Frus%2Fdocs%2FZ1400000188
Allow /law?z=%2Frus%2Fdocs%2FZ1700000081
Disallow /law
Disallow /wp-content/themes/trestoo/app/gos_vacancy/doc/*
Disallow /wp-content/themes/trestoo/parsed_cache/*
Disallow /wp-content/themes/trestoo/mobile_app/*
Disallow /banbot.html
Disallow /ped-test
Disallow /wp-content/themes/trestoo/app/obraz_docs/*
Allow */*.css
Allow */*.js

mj12bot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10.0

serpstatbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

mediatoolkitbot

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

*

Rule Path
Allow /law?z=%2Frus%2Fdocs%2FK940001000_
Allow /law?z=%2Frus%2Fdocs%2FK990000409_
Allow /law?z=%2Frus%2Fdocs%2FK950001000_
Allow /law?z=%2Frus%2Fdocs%2FK2100000400
Allow /law?z=%2Frus%2Fdocs%2FK2000000360
Allow /law?z=%2Frus%2Fdocs%2FK2000000350
Allow /law?z=%2Frus%2Fdocs%2FK1700000123
Allow /law?z=%2Frus%2Fdocs%2FK1700000120
Allow /law?z=%2Frus%2Fdocs%2FK1500000414
Allow /law?z=%2Frus%2Fdocs%2FK1500000377
Allow /law?z=%2Frus%2Fdocs%2FK1500000375
Allow /law?z=%2Frus%2Fdocs%2FK1400000235
Allow /law?z=%2Frus%2Fdocs%2FK1400000234
Allow /law?z=%2Frus%2Fdocs%2FK1400000231
Allow /law?z=%2Frus%2Fdocs%2FK1400000226
Allow /law?z=%2Frus%2Fdocs%2FK1100000518
Allow /law?z=%2Frus%2Fdocs%2FK080000095_
Allow /law?z=%2Frus%2Fdocs%2FK030000481_
Allow /law?z=%2Frus%2Fdocs%2FK030000477_
Allow /law?z=%2Frus%2Fdocs%2FK030000442_
Allow /law?z=%2Frus%2Fdocs%2FZ970000094_
Allow /law?z=%2Frus%2Fdocs%2FZ980000220_
Allow /law?z=%2Frus%2Fdocs%2FZ070000319_
Allow /law?z=%2Frus%2Fdocs%2FZ970000155_
Allow /law?z=%2Frus%2Fdocs%2FZ1400000176
Allow /law?z=%2Frus%2Fdocs%2FZ1400000202
Allow /law?z=%2Frus%2Fdocs%2FZ1300000105
Allow /law?z=%2Frus%2Fdocs%2FZ950002464_
Allow /law?z=%2Frus%2Fdocs%2FZ1500000434
Allow /law?z=%2Frus%2Fdocs%2FZ100000261_
Allow /law?z=%2Frus%2Fdocs%2FZ100000274_
Allow /law?z=%2Frus%2Fdocs%2FZ1400000188
Allow /law?z=%2Frus%2Fdocs%2FZ1700000081
Disallow /law
Disallow /wp-admin
Disallow /wp-comments
Disallow /wp-content/plugins
Disallow /wp-login.php
Disallow /wp-register.php
Disallow */trackback
Disallow */feed
Disallow */*/feed
Disallow /feed/*
Disallow */attachment/*
Disallow */tag/*
Disallow */page/*
Disallow */tag/*page%3D
Disallow /cgi-bin
Disallow /wp-content/themes/trestoo/app/gos_vacancy/doc/*
Disallow /wp-content/themes/trestoo/parsed_cache/*
Disallow /wp-content/themes/trestoo/mobile_app/*
Disallow /banbot.html
Disallow /wp-content/themes/trestoo/parsed_cache/*
Disallow /wp-content/themes/trestoo/app/obraz_docs/*
Allow */*.css
Allow */*.js
Back to top

Other Records

Field Value
sitemap https://findhow.org/sitemap.xml
Back to top

Warnings

  • `host` is not a known field.
Back to top