southafrica.net
robots.txt

Robots Exclusion Standard data for southafrica.net

Resource Scan

Scan Details

Site Domain southafrica.net
Base Domain southafrica.net
Scan Status Ok
Last Scan2024-09-16T06:14:46+00:00
Next Scan 2024-10-16T06:14:46+00:00

Last Scan

Scanned2024-09-16T06:14:46+00:00
URL https://southafrica.net/robots.txt
Domain IPs 51.140.84.145
Response IP 51.140.84.145
Found Yes
Hash 58f692073b626eb0347bbf440a2e7cea2772fac30292b35149ebc5e0ef7ba834
SimHash ab11ac1168d3

Groups

*

Rule Path Comment
Disallow /*? -
Disallow /*1000$ -
Disallow /media/ -
Disallow /assets/translation/ -
Disallow /assets/templates/ -
Disallow /assets/header-layouts/ -
Disallow /insights.southafrica.net -
Disallow /satrends.southafrica.net -
Disallow /404-error/ -
Disallow /live.southafrica.net/umbraco/ /login

voltron

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

gomezagent

Rule Path
Disallow /

googlebot

Rule Path
Allow /

Other Records

Field Value
sitemap https://southafrica.net/sitemap.xml