fabframes.com
robots.txt

Robots Exclusion Standard data for fabframes.com

Resource Scan

Scan Details

Site Domain fabframes.com
Base Domain fabframes.com
Scan Status Ok
Last Scan2025-11-18T01:13:54+00:00
Next Scan 2025-11-25T01:13:54+00:00

Last Scan

Scanned2025-11-18T01:13:54+00:00
URL https://fabframes.com/robots.txt
Domain IPs 209.126.30.183
Response IP 209.126.30.183
Found Yes
Hash 1e961fda98353aa343c3df6bfb455069a3b44aaaa9e3d34cd0cd5393751d3d1b
SimHash 7295f901c767

Groups

ai2bot
ai2bot-dolma
amazonbot
anthropic-ai
applebot
applebot-extended
brightbot 1.0
bytespider
ccbot
chatgpt-user
claude-web
claudebot
cohere-ai
cohere-training-data-crawler
crawlspace
diffbot
duckassistbot
facebookbot
friendlycrawler
google-extended
googleother
googleother-image
googleother-video
gptbot
iaskspider/2.0
icc-crawler
imagesiftbot
img2dataset
isscyberriskcrawler
kangaroo bot
meta-externalagent
meta-externalfetcher
oai-searchbot
omgili
omgilibot
pangubot
perplexitybot
petalbot
scrapy
semrushbot-ocob
semrushbot-swa
sidetrade indexer bot
timpibot
velenpublicwebcrawler
webzio-extended
youbot
atraxbot
azureus
geohasher
pycurl
python-urllib
research-scan-bot
sosospider
twiceler
wget

Rule Path
Disallow /

*

Rule Path
Disallow /admin$
Disallow /app/
Disallow /catalogsearch/
Disallow /customer/
Disallow /errors/
Disallow /fabulou1
Disallow /qbi/
Disallow /static/
Disallow /main.appcache
Disallow /specials.html
Disallow /merchandise/skins/others.html
Disallow /corporate-government-1/corporate-government-ordering.html
Disallow /corporate-government/corporate-government-ordering.html
Disallow /images/88-101-Charley-Harpers-Magnificent-Beasts.pdf
Disallow /vendor/
Disallow *?price=
Disallow *%26price%3D
Disallow *?dir=
Disallow *%26dir%3D
Disallow *?order=
Disallow *%26order%3D
Disallow *?limit=
Disallow *%26limit%3D
Disallow *?SID=
Disallow *%26SID%3D

Other Records

Field Value
crawl-delay 1

facebookexternalhit

Rule Path
Allow /

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

bingbot

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.charleyharper.com/sitemap/sitemap.xml
sitemap https://www.fabframes.com/sitemaps/sitemap.xml
sitemap https://www.charleyharperartstudio.com/w3c/sitemap.xml

Comments

  • Sitemap: https://www.charleyharperartstudio.com/w3c/sitemap.xml
  • Sitemap: https://charleyharperartstudio.com/sitemaps/sitemaphs.xml
  • Sitemap: http://www.charleyharperartstudio.com/sitemaps/sitemaphw.xml
  • Sitemap: http://charleyharperartstudio.com/sitemaps/sitemaph.xml
  • Sitemap: https://charleyharper.com/sitemaps/sitemapcs.xml
  • Sitemap: http://www.charleyharper.com/sitemaps/sitemapcw.xml
  • Sitemap: http://charleyharper.com/sitemaps/sitemapc.xml
  • Sitemap: https://fabframes.com/sitemaps/sitemapfs.xml
  • Sitemap: http://www.fabframes.com/sitemaps/sitemapfw.xml
  • Sitemap: http://fabframes.com/sitemaps/sitemapf.xml
  • Sitemap: https://www.fabulousframesandart.com/sitemaps/sitemapsw.xml
  • Sitemap: https://fabulousframesandart.com/sitemaps/sitemaps.xml
  • Sitemap: http://www.fabulousframesandart.com/sitemaps/sitemapw.xml
  • Sitemap: http://fabulousframesandart.com/sitemaps/sitemap_.xml
  • NOTICE: all crawlers and bots are strictly prohibited from using this
  • content for AI training without complying with the terms of the RSL
  • Collective AI royalty license. Any use of this content for AI training
  • without a license is a violation of our intellectual property rights.

Warnings

  • `license` is not a known field.