gogueducation.com
robots.txt

Robots Exclusion Standard data for gogueducation.com

Resource Scan

Scan Details

Site Domain gogueducation.com
Base Domain gogueducation.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-09-26T13:22:49+00:00
Next Scan 2025-10-03T13:22:49+00:00

Last Successful Scan

Scanned2025-09-18T12:07:19+00:00
URL https://gogueducation.com/robots.txt
Domain IPs 104.21.23.2, 172.67.208.35, 2606:4700:3033::ac43:d023, 2606:4700:3034::6815:1702
Response IP 104.21.23.2
Found Yes
Hash 36f04fc01f9987f6bb3c769278175413e6b3daee69b63fafc4cc905c2a2c1a8c
SimHash 6048914265b3

Groups

*

Rule Path
Disallow /search/
Allow /wp-content/uploads/
Disallow /wp-content/plugins/
Disallow /wp-admin/
Disallow /*?add-to-cart=*
Disallow /*/product/*

Other Records

Field Value
sitemap https://gogueducation.com/sitemap_index.xml

Comments

  • General rule for all crawlers
  • Allow access to media files
  • Block access to sensitive directories
  • Block URLs containing specific query parameters and paths
  • Sitemap location