Log In Sign Up

texasrocksolid.com
robots.txt

Robots Exclusion Standard data for texasrocksolid.com

Resource Scan

Scan Details

Site Domain texasrocksolid.com
Base Domain texasrocksolid.com
Scan Status Ok
Last Scan2025-11-27T15:29:44+00:00
Next Scan 2025-12-27T15:29:44+00:00

Last Scan

Scanned2025-11-27T15:29:44+00:00
URL https://texasrocksolid.com/robots.txt
Domain IPs 20.98.161.22
Response IP 20.98.161.22
Found Yes
Hash 0533d15d1524f77e47bd2b6447296e78d250c5322269757add4ef0413af6bcb2
SimHash 6308fb536692

Groups

*

Rule Path
Allow /
Disallow /general-interest.html
Disallow /windows-interest.html
Disallow /admin/
Disallow /api/
Disallow /_netlify/

Other Records

Field Value
crawl-delay 1

googlebot-image

Rule Path
Allow /images/

googlebot

Rule Path
Allow /*.css
Allow /*.js
Allow /images/
Back to top

Other Records

Field Value
sitemap https://texasrocksolid.com/sitemap.xml
Back to top

Comments

  • robots.txt for Texas Rock Solid Building Services
  • https://texasrocksolid.com/robots.txt
  • Sitemap location
  • Crawl-delay for respectful crawling
  • Disallow QR code landing pages (not for search engines)
  • Disallow admin/backend paths (if any exist in future)
  • Allow all images for Google Image Search
  • Allow all CSS and JS for proper rendering
Back to top