droidinformer.org
robots.txt

Robots Exclusion Standard data for droidinformer.org

Resource Scan

Scan Details

Site Domain droidinformer.org
Base Domain droidinformer.org
Scan Status Ok
Last Scan2024-06-27T02:49:55+00:00
Next Scan 2024-07-04T02:49:55+00:00

Last Scan

Scanned2024-06-27T02:49:55+00:00
URL https://droidinformer.org/robots.txt
Domain IPs 208.94.233.12
Response IP 208.94.233.12
Found Yes
Hash 0cc6ffdfda79ef0596ed988da37f5efd5324c4387309d02083cc0e499c33f84a
SimHash 2323d9e2f635

Groups

*

Rule Path
Disallow /search/
Disallow /ajax/
Disallow /manage/
Disallow /guest
Disallow /comment/
Disallow /downloads/page/
Disallow /page/topdevelopers*
Disallow /sort/
Disallow /software/sort/
Disallow /go/
Disallow /download/
Disallow /*/download/
Disallow /kcaptcha.php
Disallow /log.php
Disallow /hot_programs_counter.php
Disallow /js_tag.php
Disallow /filter/
Disallow /*/filter/
Disallow /275405283/

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

mediapartners-google

Rule Path
Disallow /ajax/
Disallow /manage/
Disallow /guest
Disallow /comment/
Disallow /go/
Disallow /kcaptcha.php
Disallow /log.php
Disallow /hot_programs_counter.php
Disallow /js_tag.php
Disallow /275405283/
Allow /

Comments

  • User-agent: YandexBot
  • Crawl-delay: 1