mybroadband.co.za
robots.txt

Robots Exclusion Standard data for mybroadband.co.za

Resource Scan

Scan Details

Site Domain mybroadband.co.za
Base Domain mybroadband.co.za
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-07-15T03:11:20+00:00
Next Scan 2024-10-13T03:11:20+00:00

Last Successful Scan

Scanned2023-09-19T20:35:19+00:00
URL https://mybroadband.co.za/robots.txt
Domain IPs 104.22.46.73, 104.22.47.73, 172.67.29.179
Response IP 172.67.29.179
Found Yes
Hash 2c834cb9eeeaed9af8c5e945b3236232d85583bbc7d1f9394916de442d557155
SimHash 0845430d0550

Groups

*

Rule Path
Disallow /vb/printthread.php
Disallow /events/
Disallow /general/newsletter-generator/

googlebot-news

Rule Path
Disallow /news/industrynews/
Disallow /news/category/industrynews/

Comments

  • Disallow: /*.html?print$