365onpoint.co.za
robots.txt

Robots Exclusion Standard data for 365onpoint.co.za

Resource Scan

Scan Details

Site Domain 365onpoint.co.za
Base Domain 365onpoint.co.za
Scan Status Ok
Last Scan2025-05-03T11:30:14+00:00
Next Scan 2025-06-02T11:30:14+00:00

Last Scan

Scanned2025-05-03T11:30:14+00:00
URL https://365onpoint.co.za/robots.txt
Domain IPs 41.203.18.65
Response IP 41.203.18.65
Found Yes
Hash 234e365d787e76642f0296875f4ec5efca39fd7bba79b0c759fb84b19a062161
SimHash 415dc2f3e275

Groups

*

Rule Path
Disallow /cgi-bin
Disallow */trackback
Disallow */my-account
Disallow */comments
Allow /wp-content/uploads

googlebot-image

Rule Path
Disallow
Allow /*

mediapartners-google*

Rule Path
Disallow
Allow /*

ia_archiver

Rule Path
Disallow /

duggmirror

Rule Path
Disallow /

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

Comments

  • Disallow: /wp-admin
  • Disallow: /wp-includes
  • Disallow: /wp-content/plugins
  • Disallow: /wp-content/cache
  • Disallow: /wp-content/themes
  • Disallow: /wp-content/plugins/
  • Disallow: /trackback
  • Disallow: /feed
  • Disallow: /comments
  • Disallow: /category/*/*
  • Disallow: */feed
  • Google Image
  • Google AdSense
  • Internet Archiver Wayback Machine
  • digg mirror