sysmod.com
robots.txt

Robots Exclusion Standard data for sysmod.com

Resource Scan

Scan Details

Site Domain sysmod.com
Base Domain sysmod.com
Scan Status Ok
Last Scan2025-09-25T01:08:54+00:00
Next Scan 2025-10-02T01:08:54+00:00

Last Scan

Scanned2025-09-25T01:08:54+00:00
URL http://sysmod.com/robots.txt
Domain IPs 78.153.216.18
Response IP 78.153.216.18
Found Yes
Hash 853556b3b659e110c322d61f44a8cdeb894fe522f37f1238b4b36f68334bbe8f
SimHash e714d8847316

Groups

mediapartners-google*

Rule Path
Disallow

googlebot*

Rule Path
Disallow scanxls-paypal.htm

activeagent

Rule Path
Disallow /

cherrypicker*

Rule Path
Disallow /

cherrypickerse/1.0

Rule Path
Disallow /

cherrypickerelite/1.0

Rule Path
Disallow /

crescent_internet_toolpak_http_ole_control_v.1.0

Rule Path
Disallow /

crescent internet toolpak http ole control v.1.0

Rule Path
Disallow /

emailcollector/1.0

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

emailwolf 1.00

Rule Path
Disallow /

extractorpro

Rule Path
Disallow /

microsoft url control - 5.01.4511

Rule Path
Disallow /

microsoft url control - 6.00.8140

Rule Path
Disallow /

mozilla/2.0 (compatible; newt activex; win32)

Rule Path
Disallow /

nicerspro

Rule Path
Disallow /

roverbot

Rule Path
Disallow /

telesoft/1.29

Rule Path
Disallow /

webbandit/2.1

Rule Path
Disallow /

webbandit/3.50

Rule Path
Disallow /

webbandit/4.00.0

Rule Path
Disallow /

webbandit

Rule Path
Disallow /

webemailextractor/1.0b

Rule Path
Disallow /

whowhere

Rule Path
Disallow /

wx_mail/2.000

Rule Path
Disallow /

*

Rule Path
Disallow /_themes
Disallow /_images
Disallow /_derived
Disallow /_borders
Disallow scanxls-paypal.htm

Comments

  • Disallow: pspmatls.htm
  • Disallow: amazonca.htm
  • Disallow: amazonde.htm
  • Disallow: amazonfr.htm
  • Disallow: amazonuk.htm
  • Disallow: amazonus.htm