thestudenthub.co.za
robots.txt

Robots Exclusion Standard data for thestudenthub.co.za

Resource Scan

Scan Details

Site Domain thestudenthub.co.za
Base Domain thestudenthub.co.za
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2026-01-16T17:10:36+00:00
Next Scan 2026-04-16T17:10:36+00:00

Last Successful Scan

Scanned2023-12-05T06:03:25+00:00
URL https://thestudenthub.co.za/robots.txt
Redirect https://blackubuntu.com/robots.txt
Redirect Domain blackubuntu.com
Redirect Base blackubuntu.com
Domain IPs 41.203.16.6
Redirect IPs 129.232.138.39
Response IP 129.232.138.39
Found Yes
Hash 40fa6340f2003f4b55f3be86ede42867fe8f3e6f17af4c9c85777b31a487488b
SimHash 610108404fb2

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://blackubuntu.com/sitemap_index.xml