gladly.ai
robots.txt

Robots Exclusion Standard data for gladly.ai

Resource Scan

Scan Details

Site Domain gladly.ai
Base Domain gladly.ai
Scan Status Ok
Last Scan2026-01-12T12:58:06+00:00
Next Scan 2026-02-11T12:58:06+00:00

Last Scan

Scanned2026-01-12T12:58:06+00:00
URL https://gladly.ai/robots.txt
Redirect https://www.gladly.ai/robots.txt
Redirect Domain www.gladly.ai
Redirect Base gladly.ai
Domain IPs 76.76.21.21
Redirect IPs 66.33.60.194, 76.76.21.93
Response IP 66.33.60.194
Found Yes
Hash 4314d985fbe2b2408eab87516ef20d27120ce72a38ec7f06b7a82fc6ab75377e
SimHash 49944911e5c3

Groups

*

Rule Path
Allow /
Disallow /private/

googlebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

applebot

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

gptbot

Rule Path
Allow /

chatgpt-user

Rule Path
Allow /

claudebot

Rule Path
Allow /

claude-user

Rule Path
Allow /

google-extended

Rule Path
Allow /

ccbot

Rule Path
Allow /

meta-externalagent

Rule Path
Allow /

applebot-extended

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

youbot

Rule Path
Allow /

twitterbot

Rule Path
Allow /

Other Records

Field Value
sitemap https://localhost:3000/sitemap.xml