glamour.co.za
robots.txt

Robots Exclusion Standard data for glamour.co.za

Resource Scan

Scan Details

Site Domain glamour.co.za
Base Domain glamour.co.za
Scan Status Ok
Last Scan2024-09-14T12:10:22+00:00
Next Scan 2024-09-21T12:10:22+00:00

Last Scan

Scanned2024-09-14T12:10:22+00:00
URL https://glamour.co.za/robots.txt
Redirect https://www.glamour.co.za/robots.txt
Redirect Domain www.glamour.co.za
Redirect Base glamour.co.za
Domain IPs 104.21.85.43, 172.67.202.71, 2606:4700:3035::6815:552b, 2606:4700:3036::ac43:ca47
Redirect IPs 104.21.85.43, 172.67.202.71, 2606:4700:3035::6815:552b, 2606:4700:3036::ac43:ca47
Response IP 172.67.202.71
Found Yes
Hash 07bbf36f0d99efd842285054778c35b482b30297fd10cebc0625a07645478893
SimHash 45851c7546d2

Groups

*

Rule Path
Allow *.js
Allow *.css
Disallow *search?q
Disallow */preview/
Disallow /test$
Disallow /xmlrpc.php
Disallow /profile
Disallow /cgi-bin/
Disallow /tmp/
Disallow /junk/
Disallow /index.php?*
Disallow /trackback/
Disallow /administrator/
Disallow */trackback/
Disallow /license.txt
Disallow *.php$

Other Records

Field Value
sitemap https://www.glamour.co.za/sitemap.xml
sitemap https://www.glamour.co.za/sitemap-tags.xml
sitemap https://www.glamour.co.za/sitemap-0.xml