awbridal.com
robots.txt

Robots Exclusion Standard data for awbridal.com

Resource Scan

Scan Details

Site Domain awbridal.com
Base Domain awbridal.com
Scan Status Ok
Last Scan2024-09-05T21:54:42+00:00
Next Scan 2024-10-05T21:54:42+00:00

Last Scan

Scanned2024-09-05T21:54:42+00:00
URL https://awbridal.com/robots.txt
Redirect https://www.awbridal.com/robots.txt
Redirect Domain www.awbridal.com
Redirect Base awbridal.com
Domain IPs 104.21.32.73, 172.67.184.100, 2606:4700:3034::6815:2049, 2606:4700:3035::ac43:b864
Redirect IPs 104.21.32.73, 172.67.184.100, 2606:4700:3034::6815:2049, 2606:4700:3035::ac43:b864
Response IP 104.21.32.73
Found Yes
Hash f4a798483dc945265feaa5478f3deabed72ef2eec3a85ed43ef5779dd8157f85
SimHash f724d3fcc211

Groups

*

Rule Path
Allow /
Disallow /amp/
Disallow /*?amp=*
Disallow /*product_list_order
Disallow /lib/
Disallow /*.php$
Disallow /pkginfo/
Disallow /report/
Disallow /var/
Disallow /catalog/
Disallow /customer/
Disallow /sendfriend/
Disallow /review/
Disallow /*SID%3D
Disallow /checkout/
Disallow /onestepcheckout/
Disallow /customer/*
Disallow /catalogsearch/
Disallow /catalog/product_compare/
Disallow /catalog/category/view/
Disallow /catalog/product/view/
Disallow /*?dir*
Disallow /*?dir=desc
Disallow /*?dir=asc
Disallow /*?limit=all
Disallow /*?mode*
Disallow /app/
Disallow /bin/
Disallow /dev/
Disallow /lib/
Disallow /phpserver/
Disallow /pub/
Disallow /404/
Disallow /control/
Disallow /questions/
Disallow /sendfriend/
Disallow /contacts/
Disallow /customer/
Disallow /customize/
Disallow /newsletter/
Disallow /poll/
Disallow /wishlist/*
Disallow /payfinish/
Disallow /bundle/
Disallow /cron.php
Disallow /cron.sh
Disallow /error_log
Disallow /*.php$
Disallow /*?p=*&
Disallow /*?SID=
Disallow /video
Disallow /*.txt
Disallow /developertoolbar/*
Disallow /amconf/
Disallow /lwht/

almaden

Rule Path
Disallow /

aspseek

Rule Path
Disallow /

axmo

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

booch

Rule Path
Disallow /

dts agent

Rule Path
Disallow /

downloader

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

emailwolf

Rule Path
Disallow /

expired domain sleuth

Rule Path
Disallow /

franklin locator

Rule Path
Disallow /

gaisbot

Rule Path
Disallow /

grub

Rule Path
Disallow /

hughcrawler

Rule Path
Disallow /

iaea.org

Rule Path
Disallow /

lcabotaccept

Rule Path
Disallow /

iconsurf

Rule Path
Disallow /

iltrovatore-setaccio

Rule Path
Disallow /

indy library

Rule Path
Disallow /

iupui

Rule Path
Disallow /

kittiecentral

Rule Path
Disallow /

larbin

Rule Path
Disallow /

lwp-trivial

Rule Path
Disallow /

metatagrobot

Rule Path
Disallow /

missigua locator

Rule Path
Disallow /

netresearchserver

Rule Path
Disallow /

nextgensearch

Rule Path
Disallow /

npbot

Rule Path
Disallow /

nutch

Rule Path
Disallow /

objectssearch

Rule Path
Disallow /

oracle ultra search

Rule Path
Disallow /

peerbot

Rule Path
Disallow /

pictureofinternet

Rule Path
Disallow /

plantynet

Rule Path
Disallow /

quepasacreep

Rule Path
Disallow /

scspider

Rule Path
Disallow /

soft411

Rule Path
Disallow /

spider.acont.de

Rule Path
Disallow /

sqworm

Rule Path
Disallow /

ssm agent

Rule Path
Disallow /

tamu

Rule Path
Disallow /

theusefulbot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

tutorial crawler

Rule Path
Disallow /

tutorgig

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

webzip

Rule Path
Disallow /

zipppbot

Rule Path
Disallow /

xenu

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

wget

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

mozdex

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

googlebot-image

Rule Path
Disallow

googlebot

Rule Path
Disallow

applebot

Rule Path
Disallow /

twitterbot

Rule Path
Disallow /

facebookexternalhit

Rule Path
Disallow /

pinterestbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.awbridal.com/sitemap.xml