Log In Sign Up

csgo-guides.com
robots.txt

Robots Exclusion Standard data for csgo-guides.com

Resource Scan

Scan Details

Site Domain csgo-guides.com
Base Domain csgo-guides.com
Scan Status Ok
Last Scan2026-03-01T13:37:37+00:00
Next Scan 2026-03-08T13:37:37+00:00

Last Scan

Scanned2026-03-01T13:37:37+00:00
URL https://csgo-guides.com/robots.txt
Domain IPs 104.21.18.167, 172.67.182.193, 2606:4700:3030::ac43:b6c1, 2606:4700:3034::6815:12a7
Response IP 172.67.182.193
Found Yes
Hash aee030ecb02bc144137cf4332b9475833969b0e3dc734e8d0ba4a3610bd2cf57
SimHash 2646d91161c4

Groups

*

Rule Path
Allow /
Disallow /storage/
Disallow /vendor/
Disallow /*.json$
Disallow /*.xml$
Disallow /configs/
Allow /css/
Allow /js/
Allow /img/

Other Records

Field Value
crawl-delay 1

googlebot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 0

bingbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1
Back to top

Other Records

Field Value
sitemap https://csgo-guides.com/sitemap.xml
Back to top

Comments

  • robots.txt for CSGO-Guides.com
  • Last Updated: 2025
  • Sitemap Location
  • Disallow admin and internal paths
  • Allow CSS and JS for proper rendering
  • Crawl Delay for polite crawling
  • Google specific
  • Bing specific
Back to top