Log In Sign Up

comx-computers.co.za
robots.txt

Robots Exclusion Standard data for comx-computers.co.za

Resource Scan

Scan Details

Site Domain comx-computers.co.za
Base Domain comx-computers.co.za
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-10-10T03:34:32+00:00
Next Scan 2025-11-09T03:34:32+00:00

Last Successful Scan

Scanned2025-08-19T02:56:20+00:00
URL https://comx-computers.co.za/robots.txt
Redirect https://www.comx-computers.co.za/robots.txt
Redirect Domain www.comx-computers.co.za
Redirect Base comx-computers.co.za
Domain IPs 78.46.2.204
Redirect IPs 78.46.2.204
Response IP 78.46.2.204
Found Yes
Hash 2d595c2f5f784f99b619866edcc031fdb2e6726b46ee6e5fb444ce617a6255a2
SimHash b41d0f03c755

Groups

ia_archiver

Rule Path
Disallow /

*

Rule Path
Disallow /admin/
Disallow /admin_save/
Disallow /cgi-bin/
Disallow /clinks/
Disallow /compress/
Disallow /cr/
Disallow /db/
Disallow /flags/
Disallow /includes/
Disallow /ip2country/
Disallow /uploads/
Disallow /m/
Disallow /add/
Disallow /*-ts-ts.htm$
Disallow /login.php
Disallow /cart.php
Disallow /cart*.php

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5
Back to top

Comments

  • We do not allow any unauthorised spiders to access our site as it puts a strain on our
  • server. If we log you as a spider and you have ignored this file, we will ban
  • you and report you to our host where you will be banned accross the entire network.
  • YOU HAVE BEEN WARNED
  • If you need a PC or notebook, please visit:
  • http://www.comx-computers.co.za
  • http://www.lgshop.co.za
  • http://www.mecerpc.co.za
Back to top