Log In Sign Up

dif-info.com
robots.txt

Robots Exclusion Standard data for dif-info.com

Resource Scan

Scan Details

Site Domain dif-info.com
Base Domain dif-info.com
Scan Status Ok
Last Scan2026-01-18T08:13:20+00:00
Next Scan 2026-01-25T08:13:20+00:00

Last Scan

Scanned2026-01-18T08:13:20+00:00
URL https://dif-info.com/robots.txt
Domain IPs 2a01:4f8:141:13bb::1, 46.4.115.183
Response IP 46.4.115.183
Found Yes
Hash b4148da4a79c4020b0274ef7a852ba919be2e6c8d89b73006f5534a7e5202c07
SimHash 17009271e7a2

Groups

googlebot

Rule Path
Disallow /nogooglebot/

*

Rule Path
Allow /
Disallow /admin.php
Disallow /assets/
Disallow /codeigniter/
Disallow /design/
Disallow /index.php/
Disallow /mysql/
Disallow /%21%21installer/
Disallow /%21installer/
Disallow /sxd/
Disallow /exp/
Disallow /ads/
Disallow /error/
Disallow /?ACT=37*

yandex, disco pump, wget, webzip, teleport pro, websnake, offline explorer, web-by-mail, teleport pro/1.29, scooter-w3-1.0

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.dif-info.com/sitemap.xml
Back to top

Comments

  • www.robotstxt.org/
  • http://code.google.com/web/controlcrawlindex/
  • ExpressionEngine
  • Disallow: /p/view/*/ivfrobl/
Back to top

Warnings

  • `host` is not a known field.
Back to top