rwrant.co.za
robots.txt

Robots Exclusion Standard data for rwrant.co.za

Resource Scan

Scan Details

Site Domain rwrant.co.za
Base Domain rwrant.co.za
Scan Status Ok
Last Scan2024-11-13T17:13:59+00:00
Next Scan 2024-11-20T17:13:59+00:00

Last Scan

Scanned2024-11-13T17:13:59+00:00
URL https://rwrant.co.za/robots.txt
Domain IPs 129.232.148.34
Response IP 129.232.148.34
Found Yes
Hash 51260a768ce423e738048c222d21e328c033b609c7414cc2397ead218edb615e
SimHash c13b54c04442

Groups

*

Rule Path
Disallow /cgi-bin
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-content/plugins
Disallow /wp-content/cache
Disallow /wp-content/themes
Disallow /page
Disallow /author
Disallow /trackback
Disallow /*trackback
Disallow /*trackback*
Disallow /*/trackback
Disallow /?*

Other Records

Field Value
sitemap https://rwrant.co.za/sitemap_index.xml