crystalgbedu.com
robots.txt

Robots Exclusion Standard data for crystalgbedu.com

Resource Scan

Scan Details

Site Domain crystalgbedu.com
Base Domain crystalgbedu.com
Scan Status Ok
Last Scan2025-10-09T22:08:23+00:00
Next Scan 2025-10-16T22:08:23+00:00

Last Scan

Scanned2025-10-09T22:08:23+00:00
URL https://crystalgbedu.com/robots.txt
Domain IPs 104.21.65.247, 172.67.195.207, 2606:4700:3031::6815:41f7, 2606:4700:3035::ac43:c3cf
Response IP 104.21.65.247
Found Yes
Hash c81fdaf3f17c5e03a1dd48e51d7d4e03de38431a98edec202d26120baccce050
SimHash c924dea22633

Groups

googlebot

Rule Path
Disallow /

googlebot-news

Rule Path
Disallow /

googlebot-image

Rule Path
Disallow /

googlebot-mobile

Rule Path
Disallow /

mediapartners-google

Rule Path
Disallow /

*

Rule Path
Disallow /wp-admin/
Disallow /?s=
Disallow /page/*/?s=
Disallow /search/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://crystalgbedu.com/sitemap.xml