Log In Sign Up

competitions.malcolmreading.com
robots.txt

Robots Exclusion Standard data for competitions.malcolmreading.com

Resource Scan

Scan Details

Site Domain competitions.malcolmreading.com
Base Domain malcolmreading.com
Scan Status Ok
Last Scan2025-08-16T23:46:24+00:00
Next Scan 2025-09-15T23:46:24+00:00

Last Scan

Scanned2025-08-16T23:46:24+00:00
URL https://competitions.malcolmreading.com/robots.txt
Domain IPs 104.26.14.69, 104.26.15.69, 172.67.72.191, 2606:4700:20::681a:e45, 2606:4700:20::681a:f45, 2606:4700:20::ac43:48bf
Response IP 172.67.72.191
Found Yes
Hash 8be324a32b874e031ca2c970d3e45b61d0c7931449ad2bd93e478c8922ed1b51
SimHash e2709b567f33

Groups

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /.env
Back to top

Other Records

Field Value
sitemap https://competitions.malcolmreading.com/sitemaps-1-sitemap.xml
sitemap https://competitions.malcolmreading.com/mku/sitemaps-1-sitemap.xml
sitemap https://competitions.malcolmreading.com/maasparramatta/sitemaps-1-sitemap.xml
sitemap https://competitions.malcolmreading.com/houstonendowment/sitemaps-1-sitemap.xml
sitemap https://competitions.malcolmreading.com/railwaymuseum/sitemaps-1-sitemap.xml
sitemap https://competitions.malcolmreading.com/nationalgallery/sitemaps-1-sitemap.xml
sitemap https://competitions.malcolmreading.com/butrint/sitemaps-1-sitemap.xml
sitemap https://competitions.malcolmreading.com/dallasmuseumofart/sitemaps-1-sitemap.xml
sitemap https://competitions.malcolmreading.com/nelson-atkins/sitemaps-1-sitemap.xml
sitemap https://competitions.malcolmreading.com/queenelizabethmemorial/sitemaps-1-sitemap.xml
sitemap https://competitions.malcolmreading.com/bethany/sitemaps-1-sitemap.xml
Back to top

Comments

  • robots.txt for /
  • live - don't allow web crawlers to index cpresources/ or vendor/
Back to top