servistore.se
robots.txt

Robots Exclusion Standard data for servistore.se

Resource Scan

Scan Details

Site Domain servistore.se
Base Domain servistore.se
Scan Status Ok
Last Scan2025-09-14T22:54:53+00:00
Next Scan 2025-10-14T22:54:53+00:00

Last Scan

Scanned2025-09-14T22:54:53+00:00
URL https://servistore.se/robots.txt
Domain IPs 2a02:250:0:8::54, 93.188.2.52
Response IP 93.188.2.52
Found Yes
Hash 907de3a8460e3b1ea0a649862a24206ebf2af40356bb50655172207795173913
SimHash 70845b928510

Groups

*

Rule Path
Disallow /adm/
Disallow /func/
Disallow /customer-agreements/
Disallow /dibs/
Disallow /docs/
Disallow /js/ckeditor
Disallow /mailings/
Disallow /meta/
Disallow /routine/
Disallow /uc/
Disallow /cart_items.php
Disallow /cart_items_test.php
Disallow /user_content.php
Disallow /i_item_carousel.php
Disallow /i_item_grid.php
Disallow /i_page_data.php
Disallow /i_slideshow.php
Disallow /m_dynamic_content.php
Disallow /m_module_type.php
Disallow /footer.php
Disallow /header.php
Disallow /sitemap.php
Disallow /favicon.php
Disallow /index.php
Disallow /routine.php
Disallow /test.php
Allow /css/
Allow /js/
Allow /img/
Allow /svg/
Allow /fonts/
Disallow /*.php$
Disallow /*?

googlebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

slurp

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

baiduspider

Rule Path
Allow /

yandex

Rule Path
Allow /

sogou

Rule Path
Allow /

exabot

Rule Path
Allow /

applebot

Rule Path
Allow /

linkedinbot

Rule Path
Allow /

facebot

Rule Path
Allow /

pinterestbot

Rule Path
Allow /

ccbot

Rule Path
Allow /

petalbot

Rule Path
Allow /

mojeekbot

Rule Path
Allow /

ahrefsbot

Rule Path
Allow /

chatgpt-user

Rule Path
Allow /

openai-user

Rule Path
Allow /

google-extended

Rule Path
Allow /

gptbot

Rule Path
Allow /

claudebot

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

youbot

Rule Path
Allow /

bingpreview

Rule Path
Allow /

neevabot

Rule Path
Allow /

geo-bot

Rule Path
Allow /

archive.org_bot

Rule Path
Allow /

diffbot

Rule Path
Allow /

commoncrawl

Rule Path
Allow /

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

aspiegelbot

Rule Path
Disallow /

nutch

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

luminati

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

censysinspect

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

*

Rule Path
Disallow /

Other Records

Field Value
sitemap https://arcadedreams.se/sitemap

Comments

  • Allow CSS, JS, images, SVG, and fonts for proper rendering
  • Block direct access to all PHP files
  • Block all URL parameters
  • Allow legitimate search engines
  • Allow legitimate AI bots
  • Block unwanted bots, spammers & malicious crawlers
  • Block all other unknown bots
  • Sitemap