Log In Sign Up

digitlab.co.za
robots.txt

Robots Exclusion Standard data for digitlab.co.za

Resource Scan

Scan Details

Site Domain digitlab.co.za
Base Domain digitlab.co.za
Scan Status Ok
Last Scan2025-11-24T04:42:29+00:00
Next Scan 2025-12-24T04:42:29+00:00

Last Scan

Scanned2025-11-24T04:42:29+00:00
URL https://digitlab.co.za/robots.txt
Domain IPs 104.21.29.231, 172.67.149.245, 2606:4700:3030::6815:1de7, 2606:4700:3030::ac43:95f5
Response IP 104.21.29.231
Found Yes
Hash 6b94ffe0851d0507229b1d706b07a5cb771639a306882af33abf946ce66cac5a
SimHash 4b20a88021b2

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

bingbot

Rule Path
Disallow /search
Disallow /wp-json/embedpress/v1/analytics/
Back to top

Other Records

Field Value
sitemap https://digitlab.co.za/sitemap_index.xml
Back to top

Comments

  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK
Back to top