Log In Sign Up

theglobalgaming.com
robots.txt

Robots Exclusion Standard data for theglobalgaming.com

Resource Scan

Scan Details

Site Domain theglobalgaming.com
Base Domain theglobalgaming.com
Scan Status Ok
Last Scan2024-07-01T00:42:08+00:00
Next Scan 2024-07-08T00:42:08+00:00

Last Scan

Scanned2024-07-01T00:42:08+00:00
URL https://theglobalgaming.com/robots.txt
Domain IPs 104.26.12.172, 104.26.13.172, 172.67.68.130, 2606:4700:20::681a:cac, 2606:4700:20::681a:dac, 2606:4700:20::ac43:4482
Response IP 172.67.68.130
Found Yes
Hash d086f49861a075c9493a33fe62a4a7d3965e0176a40ac6d7ef2feb4dcf8917aa
SimHash 623619762533

Groups

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /.env
Disallow /cache/
Disallow /tag/

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

chatgpt

Rule Path
Disallow /

google-extended

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://theglobalgaming.com/sitemaps.xml
sitemap https://theglobalgaming.com/randomizer-sitemap/sitemap.xml
Back to top

Comments

  • robots.txt for https://theglobalgaming.com/
  • live - don't allow web crawlers to index cpresources/ or vendor/
Back to top