Log In Sign Up

sqyre.app
robots.txt

Robots Exclusion Standard data for sqyre.app

Resource Scan

Scan Details

Site Domain sqyre.app
Base Domain sqyre.app
Scan Status Ok
Last Scan2025-10-17T02:30:25+00:00
Next Scan 2025-11-16T02:30:25+00:00

Last Scan

Scanned2025-10-17T02:30:25+00:00
URL https://sqyre.app/robots.txt
Redirect https://www.sqyre.app/robots.txt
Redirect Domain www.sqyre.app
Redirect Base sqyre.app
Domain IPs 75.2.60.5
Redirect IPs 13.215.239.219, 2406:da18:b3d:e201::258, 2406:da18:b3d:e201::259, 52.74.6.109
Response IP 52.74.6.109
Found Yes
Hash c6631a042a12e1ff16285e63955085d33ff05c423f7a48b0a51711b6bf9d6294
SimHash 76511a00c7c2

Groups

*

Rule Path
Allow /

gptbot
claudebot
claude-web
ccbot
googlebot-extended
applebot-extended
facebookbot
meta-externalagent
meta-externalfetcher
diffbot
perplexitybot
omgili
omgilibot
webzio-extended
imagesiftbot
bytespider
amazonbot
youbot
semrushbot-ocob
petalbot
velenpublicwebcrawler
turnitinbot
timpibot
oai-searchbot
icc-crawler
ai2bot
ai2bot-dolma
dataforseobot
awariobot
awariosmartbot
awariorssbot
google-cloudvertexbot
pangubot
kangaroo bot
sentibot
img2dataset
meltwater
seekr
peer39_crawler
cohere-ai
cohere-training-data-crawler
duckassistbot
scrapy

Rule Path
Disallow /

*

No rules defined. All paths allowed.

Back to top

Other Records

Field Value
sitemap https://www.sqyre.app/sitemap-index.xml
Back to top

Comments

  • Block all known AI crawlers and assistants
  • from using content for training AI models.
  • Source: https://robotstxt.com/ai
  • Block any non-specified AI crawlers (e.g., new
  • or unknown bots) from using content for training
  • AI models. This directive is still experimental
  • and may not be supported by all AI crawlers.
Back to top

Warnings

  • `disallowaitraining` is not a known field.
Back to top