anniescraftstore.com
robots.txt

Robots Exclusion Standard data for anniescraftstore.com

Resource Scan

Scan Details

Site Domain anniescraftstore.com
Base Domain anniescraftstore.com
Scan Status Ok
Last Scan2024-10-30T02:17:08+00:00
Next Scan 2024-11-06T02:17:08+00:00

Last Scan

Scanned2024-10-30T02:17:08+00:00
URL https://anniescraftstore.com/robots.txt
Redirect https://www.anniescatalog.com/robots.txt
Redirect Domain www.anniescatalog.com
Redirect Base anniescatalog.com
Domain IPs 208.40.241.77
Redirect IPs 208.40.241.73
Response IP 208.40.241.73
Found Yes
Hash c1a64f4943d5a127f75da3c2873b13894a5e5fa74680b8d00af437b27c19e15f
SimHash cad44c9ee301

Groups

dotbot

Rule Path
Disallow /

blekkobot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

fatbot

Rule Path
Disallow /

dealozbot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

news.grets.store

Rule Path
Disallow /

static.seders.website

Rule Path
Disallow /

info.seders.website

Rule Path
Disallow /

rida.tokyo

Rule Path
Disallow /

kar.razas.site

Rule Path
Disallow /

game.fertuk.site

Rule Path
Disallow /

ofer.bartikus.site

Rule Path
Disallow /

trast.mantero.online

Rule Path
Disallow /

garold.dertus.site

Rule Path
Disallow /

games.patlik.site

Rule Path
Disallow /

googlebot

Rule Path
Disallow /notify_me.html*
Disallow /promo/
Disallow *.bak*

bingbot

Rule Path
Disallow /notify_me.html*
Disallow /promo/
Disallow *.bak*

pinterestbot

Rule Path
Disallow /notify_me.html*
Disallow /promo/
Disallow *.bak*

bingshoppingbot

Rule Path
Disallow /notify_me.html*
Disallow /promo/
Disallow *.bak*

*

Rule Path
Disallow /img/
Disallow /images/
Disallow /admin/
Disallow /include/
Disallow /admin/
Disallow /cart/
Disallow /gallery/
Disallow /GeneratedItems/
Disallow /home_images/
Disallow /promo/
Disallow /pop_up_ads/
Disallow /pages/needlecraft/proof/
Disallow /promos/
Disallow /catalog_request.html
Disallow /tour/
Disallow /magazine_offer/proof.php
Disallow /classes/
Disallow /image.html
Disallow /responsive/
Disallow /videos/
Disallow /signature/spring2017/springbreeze.html
Disallow /tax/
Disallow /freepatternsforfans/
Disallow /cart/index.html
Disallow /customers/bookshelf.html
Disallow /customers/login.html
Disallow /csmodule/

geedoproductsearch

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10