nxtinternships.co.za
robots.txt

Robots Exclusion Standard data for nxtinternships.co.za

Resource Scan

Scan Details

Site Domain nxtinternships.co.za
Base Domain nxtinternships.co.za
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-10-01T02:05:45+00:00
Next Scan 2025-12-30T02:05:45+00:00

Last Successful Scan

Scanned2021-12-24T09:21:06+00:00
URL https://nxtinternships.co.za/robots.txt
Redirect https://internship.works/robots.txt
Redirect Domain internship.works
Redirect Base internship.works
Response IP 172.67.212.230
Found Yes
Hash 4cd4c96b515cc3b463cc99660577f8fd8af826b33cc99ae6b8fbeb88151c90b6
SimHash 41001c408992

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://internship.works/sitemap_index.xml