Log In Sign Up

redliondata.com
robots.txt

Robots Exclusion Standard data for redliondata.com

Resource Scan

Scan Details

Site Domain redliondata.com
Base Domain redliondata.com
Scan Status Ok
Last Scan2025-07-06T12:14:10+00:00
Next Scan 2025-08-05T12:14:10+00:00

Last Scan

Scanned2025-07-06T12:14:10+00:00
URL https://redliondata.com/robots.txt
Domain IPs 104.21.63.161, 172.67.171.13, 2606:4700:3032::ac43:ab0d, 2606:4700:3033::6815:3fa1
Response IP 172.67.171.13
Found Yes
Hash ff97edb5e110f0a9e5bfee31fa2b0791f3480b8edc569ab6353e5076fa53884c
SimHash 601c0940a0b3

Groups

*

Rule Path
Disallow /xmlrpc.php

ahrefsbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.redliondata.com/sitemap.xml
Back to top

Comments

  • global
Back to top