Log In Sign Up

reveleer.com
robots.txt

Robots Exclusion Standard data for reveleer.com

Resource Scan

Scan Details

Site Domain reveleer.com
Base Domain reveleer.com
Scan Status Ok
Last Scan2025-10-13T22:20:26+00:00
Next Scan 2025-11-12T22:20:26+00:00

Last Scan

Scanned2025-10-13T22:20:26+00:00
URL https://reveleer.com/robots.txt
Redirect https://www.reveleer.com/robots.txt
Redirect Domain www.reveleer.com
Redirect Base reveleer.com
Domain IPs 75.2.70.75, 99.83.190.102
Redirect IPs 13.203.125.58, 13.233.175.166, 3.109.243.18
Response IP 54.155.19.65
Found Yes
Hash 550e8c87b9d38897e752f784e0896451ff0b3e9acdc6e00684193fc78132dc16
SimHash 203071504ff7

Groups

*

Rule Path
Allow /

oai-searchbot
chatgpt-user
perplexitybot
firecrawlagent
andibot
exabot
phindbot
youbot
omgilibot
facebookbot

Rule Path
Allow /

gptbot
ccbot
google-extended

Rule Path
Allow /

*

Rule Path
Disallow /*?
Back to top

Other Records

Field Value
sitemap https://www.reveleer.com/sitemap.xml
Back to top

Comments

  • Allow traditional search crawlers
  • Allow AI search and agent use
  • Allow AI training data collection
  • Disallow access to URLs with query parameters for all bots
Back to top