Log In Sign Up

stormywellington.com
robots.txt

Robots Exclusion Standard data for stormywellington.com

Resource Scan

Scan Details

Site Domain stormywellington.com
Base Domain stormywellington.com
Scan Status Ok
Last Scan2024-09-10T12:20:53+00:00
Next Scan 2024-10-10T12:20:53+00:00

Last Scan

Scanned2024-09-10T12:20:53+00:00
URL https://www.stormywellington.com/robots.txt
Domain IPs 104.18.22.89, 104.18.23.89, 2606:4700::6812:1659, 2606:4700::6812:1759
Response IP 104.18.22.89
Found Yes
Hash 1d223abb0281671e41a6bcaf67c2a7ae6a84a87bc0eee44fdf574663694f53af
SimHash 6a5051886339

Groups

*

Rule Path
Allow */modules/*.css
Allow */modules/*.js
Allow */modules/*.png
Allow */modules/*.jpg
Disallow /*?orderby=
Disallow /?orderby=
Disallow */?orderby=
Disallow /*?orderway=
Disallow /*?tag=
Disallow /*?id_currency=
Disallow /*?search_query=
Disallow /*?back=
Disallow /*?n=
Disallow /*%26orderby%3D
Disallow /*%26orderway%3D
Disallow /*%26tag%3D
Disallow /*%26id_currency%3D
Disallow /*%26search_query%3D
Disallow /*%26back%3D
Disallow /*%26n%3D
Disallow /*controller%3Daddresses
Disallow /*controller%3Daddress
Disallow /*controller%3Dauthentication
Disallow /*controller%3Dcart
Disallow /*controller%3Ddiscount
Disallow /*controller%3Dfooter
Disallow /*controller%3Dget-file
Disallow /*controller%3Dheader
Disallow /*controller%3Dhistory
Disallow /*controller%3Didentity
Disallow /*controller%3Dimages.inc
Disallow /*controller%3Dinit
Disallow /*controller%3Dmy-account
Disallow /*controller%3Dorder
Disallow /*controller%3Dorder-slip
Disallow /*controller%3Dorder-detail
Disallow /*controller%3Dorder-follow
Disallow /*controller%3Dorder-return
Disallow /*controller%3Dorder-confirmation
Disallow /*controller%3Dpagination
Disallow /*controller%3Dpassword
Disallow /*controller%3Dpdf-invoice
Disallow /*controller%3Dpdf-order-return
Disallow /*controller%3Dpdf-order-slip
Disallow /*controller%3Dproduct-sort
Disallow /*controller%3Dsearch
Disallow /*controller%3Dstatistics
Disallow /*controller%3Dattachment
Disallow /*controller%3Dguest-tracking
Disallow */cache/
Disallow */classes/
Disallow */config/
Disallow */controllers/
Disallow */css/
Disallow */download/
Disallow */js/
Disallow */localization/
Disallow */log/
Disallow */mails/
Disallow */modules/
Disallow */override/
Disallow */pdf/
Disallow */src/
Disallow */tools/
Disallow */translations/
Disallow */upload/
Disallow */vendor/
Disallow */web/
Disallow */webservice/
Disallow /password-recovery
Disallow /address
Disallow /addresses
Disallow /login
Disallow /cart
Disallow /discount
Disallow /order-history
Disallow /identity
Disallow /my-account
Disallow /order-follow
Disallow /credit-slip
Disallow /order
Disallow /my-orders/*
Disallow /search
Disallow /?s=
Disallow /guest-tracking
Disallow /order-confirmation
Disallow /seller
Disallow /store/*
Disallow /product_brand/*
Disallow /calendar/
Disallow /junk/

applebot

Rule Path
Disallow /ajax/
Disallow /album.php
Disallow /checkpoint/
Disallow /contact_importer/
Disallow /feeds/
Disallow /file_download.php
Disallow /hashtag/
Disallow /l.php
Disallow /live/
Disallow /moments_app/
Disallow /p.php
Disallow /photo.php
Disallow /photos.php
Disallow /sharer/
Disallow /store/*
Disallow /product_brand/*

baiduspider

Rule Path
Disallow /ajax/
Disallow /album.php
Disallow /checkpoint/
Disallow /contact_importer/
Disallow /feeds/
Disallow /file_download.php
Disallow /hashtag/
Disallow /l.php
Disallow /live/
Disallow /moments_app/
Disallow /p.php
Disallow /photo.php
Disallow /photos.php
Disallow /sharer/
Disallow /store/*
Disallow /product_brand/*

bing

Rule Path
Allow /
Disallow /store/*
Disallow /product_brand/*

bingbot

Rule Path
Allow /
Disallow /ajax/
Disallow /album.php
Disallow /checkpoint/
Disallow /contact_importer/
Disallow /feeds/
Disallow /file_download.php
Disallow /hashtag/
Disallow /l.php
Disallow /live/
Disallow /moments_app/
Disallow /p.php
Disallow /photo.php
Disallow /photos.php
Disallow /sharer/
Disallow /store/*
Disallow /product_brand/*

googlebot

Rule Path
Disallow /ajax/
Disallow /album.php
Disallow /checkpoint/
Disallow /contact_importer/
Disallow /feeds/
Disallow /file_download.php
Disallow /hashtag/
Disallow /l.php
Disallow /live/
Disallow /moments_app/
Disallow /p.php
Disallow /photo.php
Disallow /photos.php
Disallow /sharer/
Disallow /store/*
Disallow /product_brand/*
Disallow /calendar/
Disallow /junk/

ia_archiver

Rule Path
Disallow /
Disallow /ajax/
Disallow /album.php
Disallow /checkpoint/
Disallow /contact_importer/
Disallow /feeds/
Disallow /file_download.php
Disallow /hashtag/
Disallow /l.php
Disallow /live/
Disallow /moments_app/
Disallow /p.php
Disallow /photo.php
Disallow /photos.php
Disallow /sharer/
Disallow /store/*
Disallow /product_brand/*

msnbot

Rule Path
Allow /
Disallow /ajax/
Disallow /album.php
Disallow /checkpoint/
Disallow /contact_importer/
Disallow /feeds/
Disallow /file_download.php
Disallow /hashtag/
Disallow /l.php
Disallow /live/
Disallow /moments_app/
Disallow /p.php
Disallow /photo.php
Disallow /photos.php
Disallow /sharer/
Disallow /store/*
Disallow /product_brand/*

naverbot

Rule Path
Disallow /ajax/
Disallow /album.php
Disallow /checkpoint/
Disallow /contact_importer/
Disallow /feeds/
Disallow /file_download.php
Disallow /hashtag/
Disallow /l.php
Disallow /live/
Disallow /moments_app/
Disallow /p.php
Disallow /photo.php
Disallow /photos.php
Disallow /sharer/
Disallow /store/*
Disallow /product_brand/*

seznambot

Rule Path
Disallow /ajax/
Disallow /album.php
Disallow /checkpoint/
Disallow /contact_importer/
Disallow /feeds/
Disallow /file_download.php
Disallow /hashtag/
Disallow /l.php
Disallow /live/
Disallow /moments_app/
Disallow /p.php
Disallow /photo.php
Disallow /photos.php
Disallow /sharer/
Disallow /store/*
Disallow /product_brand/*

slurp

Rule Path
Allow /
Disallow /ajax/
Disallow /album.php
Disallow /checkpoint/
Disallow /contact_importer/
Disallow /feeds/
Disallow /file_download.php
Disallow /hashtag/
Disallow /l.php
Disallow /live/
Disallow /moments_app/
Disallow /p.php
Disallow /photo.php
Disallow /photos.php
Disallow /sharer/
Disallow /store/*
Disallow /product_brand/*

teoma

Rule Path
Allow /
Disallow /ajax/
Disallow /album.php
Disallow /checkpoint/
Disallow /contact_importer/
Disallow /feeds/
Disallow /file_download.php
Disallow /hashtag/
Disallow /l.php
Disallow /live/
Disallow /moments_app/
Disallow /p.php
Disallow /photo.php
Disallow /photos.php
Disallow /sharer/
Disallow /store/*
Disallow /product_brand/*

twitterbot

Rule Path
Disallow /ajax/
Disallow /album.php
Disallow /checkpoint/
Disallow /contact_importer/
Disallow /feeds/
Disallow /file_download.php
Disallow /hashtag/
Disallow /l.php
Disallow /live/
Disallow /moments_app/
Disallow /p.php
Disallow /photo.php
Disallow /photos.php
Disallow /sharer/
Disallow /store/*
Disallow /product_brand/*

yandex

Rule Path
Disallow /ajax/
Disallow /album.php
Disallow /checkpoint/
Disallow /contact_importer/
Disallow /feeds/
Disallow /file_download.php
Disallow /hashtag/
Disallow /l.php
Disallow /live/
Disallow /moments_app/
Disallow /p.php
Disallow /photo.php
Disallow /photos.php
Disallow /sharer/
Disallow /store/*
Disallow /product_brand/*

yeti

Rule Path
Disallow /ajax/
Disallow /album.php
Disallow /checkpoint/
Disallow /contact_importer/
Disallow /feeds/
Disallow /file_download.php
Disallow /hashtag/
Disallow /l.php
Disallow /live/
Disallow /moments_app/
Disallow /p.php
Disallow /photo.php
Disallow /photos.php
Disallow /sharer/
Disallow /store/*
Disallow /product_brand/*

applebot

Rule Path
Allow /ajax/pagelet/generic.php/PagePostsSectionPagelet
Allow /safetycheck/

baiduspider

Rule Path
Allow /ajax/pagelet/generic.php/PagePostsSectionPagelet
Allow /safetycheck/

bingbot

Rule Path
Allow /ajax/pagelet/generic.php/PagePostsSectionPagelet
Allow /safetycheck/

googlebot

Rule Path
Allow /ajax/pagelet/generic.php/PagePostsSectionPagelet
Allow /safetycheck/

ia_archiver

Rule Path
Allow /about/privacy
Allow /ajax/pagelet/generic.php/PagePostsSectionPagelet
Allow /full_data_use_policy
Allow /legal/terms
Allow /policy.php
Allow /safetycheck/

msnbot

Rule Path
Allow /ajax/pagelet/generic.php/PagePostsSectionPagelet
Allow /safetycheck/

naverbot

Rule Path
Allow /ajax/pagelet/generic.php/PagePostsSectionPagelet
Allow /safetycheck/

seznambot

Rule Path
Allow /ajax/pagelet/generic.php/PagePostsSectionPagelet
Allow /safetycheck/

slurp

Rule Path
Allow /ajax/pagelet/generic.php/PagePostsSectionPagelet
Allow /safetycheck/

teoma

Rule Path
Allow /ajax/pagelet/generic.php/PagePostsSectionPagelet
Allow /safetycheck/

twitterbot

Rule Path
Allow /ajax/pagelet/generic.php/PagePostsSectionPagelet
Allow /safetycheck/

yandex

Rule Path
Allow /ajax/pagelet/generic.php/PagePostsSectionPagelet
Allow /safetycheck/

yeti

Rule Path
Allow /ajax/pagelet/generic.php/PagePostsSectionPagelet
Allow /safetycheck/

discobot

Rule Path
Disallow /
Disallow /store/*
Disallow /product_brand/*

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 4

feedjira

Rule Path
Disallow /
Disallow /store/*
Disallow /product_brand/*

magpie-crawler

Rule Path
Disallow /

*

Rule Path
Disallow /bullpen/
Disallow /store/*
Disallow /product_brand/*

mj12bot

Rule Path
Disallow /
Disallow /store/*
Disallow /product_brand/*

semrushbot

Rule Path
Disallow /
Disallow /store/*
Disallow /product_brand/*

semrushbot-sa

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

alexibot

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

xenu’s

Rule Path
Disallow /

xenu’s link sleuth 1.1c

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

nextgensearchbot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

archive.org bot

Rule Path
Disallow /

linkwalker

Rule Path
Disallow /

gigablast spider

Rule Path
Disallow /

ia_archiver-web.archive.org

Rule Path
Disallow /

picscout

Rule Path
Disallow /

blexbot crawler

Rule Path
Disallow /

tineye

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

sistrix crawler

Rule Path
Disallow /

uptimerobot/2.0

Rule Path
Disallow /

ezooms robot

Rule Path
Disallow /

netestate ne crawler (+http://www.website-datenbank.de/)

Rule Path
Disallow /

wiseguys robot

Rule Path
Disallow /

turnitin robot

Rule Path
Disallow /

heritrix

Rule Path
Disallow /

pimonster

Rule Path
Disallow /

pimonster

Rule Path
Disallow /

pi-monster

Rule Path
Disallow /

eccp/1.0 (search@eniro.com)

Rule Path
Disallow /

psbot

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

naverbot
yeti

Rule Path
Disallow /

zbot

Rule Path
Disallow /

vagabondo

Rule Path
Disallow /

linkwalker

Rule Path
Disallow /

simplepie

Rule Path
Disallow /

wget

Rule Path
Disallow /

pixray-seeker

Rule Path
Disallow /

boardreader

Rule Path
Disallow /

quantify

Rule Path
Disallow /

plukkie

Rule Path
Disallow /

cuam

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

*

Rule Path
Disallow /cgi-bin/
Disallow /wp-admin/
Disallow /wp-login.php
Disallow /wp-admin/*
Disallow /wp-includes/
Disallow /wp-register.php
Disallow /wp-content/plugins/
Disallow /wp-content/cache/
Disallow /wp-content/themes/
Disallow /wp-content/uploads/
Disallow /feed/
Disallow /comments/
Disallow /category/
Disallow /tag/
Disallow /archives/
Disallow /author/
Disallow /extend/themes/search.php
Disallow /themes/search.php
Disallow /support/rss
Disallow /archive/
Disallow /client/
Disallow /recommended/
Disallow /comments/
Disallow /comments/feed/
Disallow /trackback/
Disallow /index.php
Disallow /xmlrpc.php
Disallow /readme.html
Disallow /refer/
Disallow /*.php$
Disallow /*.js$
Disallow /*.inc$
Disallow /*.css$
Disallow /*?
Disallow /*?*
Disallow *?*
Disallow *?replytocom
Disallow *?p=*
Disallow /blackhole/
Disallow /?blackhole
Disallow /$
Disallow /support
Disallow /privacy-policy
Disallow /terms
Disallow /legal/
Disallow /privacy-policy/
Disallow /norliden-policies/
Disallow /store-listing/*
Disallow /*?mweb*
Disallow /*?product_cat*
Disallow /*?product_tag*
Disallow /*?source_id*
Disallow /*?orderby*
Disallow /*?product_order*
Disallow /*?product_order=*
Disallow /*?product_count*
Disallow /*?page_size*
Disallow /?add-to-cart*
Disallow /*?orderby*
Disallow /*?orderby=*
Disallow /?orderby*
Disallow /*?product_order*
Disallow /*%26direction%3Drtl
Disallow /%26direction%3Drtl
Disallow /*%26direction*
Disallow /store/*
Disallow /product_brand/*
Disallow /?*
Allow /
Allow /wp-content/uploads/
Allow /wp-admin/admin-ajax.php
Allow /*.js*
Allow /*.css*
Allow /?amp
Allow /sell-online
Allow /about-norliden/
Allow /mission/
Allow /products/
Allow /community/
Allow /norliden-policies/
Allow /terms/
Allow /privacy-policy/
Allow /norliden-help-center/
Allow /seller-registraton/
Allow /vendor-dashboard/
Allow /contact-us/
Allow /vendor-register/
Allow /blog/

ninjabot

Rule Path
Allow /

google

Rule Path
Allow /

mediapartners-google*

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

googlebot-image

Rule Path
Allow /wp-content/uploads/

adsbot-google

Rule Path
Allow /

googlebot

Rule Path
Allow /
Disallow /nogooglebot/

googlebot-mobile

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://www.stormywellington.com/sitemap.xml
sitemap https://www.stormywellington.com/sitemap.rss
Back to top

Comments

  • robots.txt automatically generated by Alex Fernandez 1/13/2023
  • This file is to prevent the crawling and indexing of certain parts
  • of your site by web crawlers and spiders run by sites like Yahoo!
  • and Google. By telling these "robots" where not to go on your site,
  • you save bandwidth and server resources.
  • Allow Directives
  • Private pages
  • Directories
  • Files
  • Notice: Crawling Facebook is prohibited unless you have express written
  • permission. See: http://www.facebook.com/apps/site_scraping_tos_terms.php
  • Block bad SEO bots
  • Block NextGenSearchBot
  • Block ia-archiver from crawling site
  • Block archive.org_bot from crawling site
  • Block Archive.org Bot from crawling site
  • Block LinkWalker from crawling site
  • Block GigaBlast Spider from crawling site
  • Block ia_archiver-web.archive.org_bot from crawling site
  • Block PicScout Crawler from crawling site
  • Block BLEXBot Crawler from crawling site
  • Block TinEye from crawling site
  • Block SEOkicks
  • Block BlexBot
  • Block SISTRIX
  • Block Uptime robot
  • Block Ezooms Robot
  • Block netEstate NE Crawler (+http://www.website-datenbank.de/)
  • Block WiseGuys Robot
  • Block Turnitin Robot
  • Block Heritrix
  • Block pricepi
  • Block Eniro
  • Block Psbot
  • Block Youdao
  • BLEXBot
  • Block NaverBot
  • Block ZBot
  • Block Vagabondo
  • Block LinkWalker
  • Block SimplePie
  • Block Wget
  • Block Pixray-Seeker
  • Block BoardReader
  • Block Quantify
  • Block Plukkie
  • Block Cuam
  • https://megaindex.com/crawler
  • Wordpress
Back to top

Warnings

  • 2 invalid lines.
Back to top