solaris-shop.com
robots.txt

Robots Exclusion Standard data for solaris-shop.com

Resource Scan

Scan Details

Site Domain solaris-shop.com
Base Domain solaris-shop.com
Scan Status Ok
Last Scan2025-08-26T08:19:59+00:00
Next Scan 2025-09-25T08:19:59+00:00

Last Scan

Scanned2025-08-26T08:19:59+00:00
URL https://solaris-shop.com/robots.txt
Redirect https://www.solaris-shop.com/robots.txt
Redirect Domain www.solaris-shop.com
Redirect Base solaris-shop.com
Domain IPs 192.200.160.20
Redirect IPs 192.200.160.20
Response IP 192.200.160.20
Found Yes
Hash ab9caedc77486ad5e0831c2be2a39b6783ba98dbe92ec8c71e3c5083e4534d55
SimHash 771a8911c145

Groups

*

Rule Path
Allow /account.php
Allow /cart.php
Allow /checkout.php
Allow /finishorder.php
Allow /login.php
Allow /orderstatus.php
Allow /postreview.php
Allow /productimage.php
Allow /productupdates.php
Allow /remote.php
Allow /search.php
Allow /viewfile.php
Allow /wishlist.php
Allow /admin/
Allow /*sort%3D
Allow /__socialshop

*

Rule Path
Disallow /*?_bc_fsnf=1*
Disallow /*%26_bc_fsnf%3D1*

ai2bot
ai2bot-dolma
amazonbot
applebot
applebot-extended
bytespider
ccbot
chatgpt-user
claude-web
claudebot
diffbot
facebookbot
friendlycrawler
gptbot
google-extended
googleother
googleother-image
googleother-video
icc-crawler
isscyberriskcrawler
imagesiftbot
kangaroo bot
meta-externalagent
meta-externalfetcher
oai-searchbot
perplexitybot
petalbot
scrapy
sidetrade indexer bot
timpibot
velenpublicwebcrawler
webzio-extended
youbot
anthropic-ai
cohere-ai
facebookexternalhit
iaskspider/2.0
img2dataset
omgili
omgilibot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10