ellwoodepps.com
robots.txt
Robots Exclusion Standard data for ellwoodepps.com
Resource Scan
Scan Details
| Site Domain | ellwoodepps.com |
| Base Domain | ellwoodepps.com |
| Scan Status | Ok |
| Last Scan | 2024-09-23T23:56:07+00:00 |
| Next Scan | 2024-10-23T23:56:07+00:00 |
Last Scan
| Scanned | 2024-09-23T23:56:07+00:00 |
| URL | https://ellwoodepps.com/robots.txt |
| Domain IPs | 209.126.22.156 |
| Response IP | 209.126.22.156 |
| Found | Yes |
| Hash | e7e3115a60c4c90bb41278ec547fce8343e91d02df5b13171c4a2205daca8c49 |
| SimHash | c7365fd0c773 |
Groups
ahrefsbot
amazonbot
applebot
awariobot
awariorssbot
awariosmartbot
blexbot
baiduspider
bytespider
daum
dataforseobot
dotbot
freshbot
facebot
geedobot
gnowitnewsbot
gptbot
mojeekbot
monsidobot
petalbot
seekportbot
semrushbot
senutobot
seznambot
sogou inst spider
sogou web spider
tinytestbot
twitterbot
velenpublicwebcrawler
yandex
yandexbot
yisouspider
coccocbot
coccocbot-ads
coccocbot-fast
coccocbot-image
coccocbot-shopping
coccocbot-web
dotbot
facebookexternalhit/1.1
rogerbot
yacybot
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Allow | /contacts/$ |
| Disallow | /404/ |
| Disallow | /app/ |
| Disallow | /captcha/ |
| Disallow | /cgi-bin/ |
| Disallow | /downloader/ |
| Disallow | /errors/ |
| Disallow | /includes/ |
| Disallow | /js/ |
| Disallow | /lib/ |
| Disallow | /magento/ |
| Disallow | /media/ |
| Disallow | /pkginfo/ |
| Disallow | /report/ |
| Disallow | /scripts/ |
| Disallow | /shell/ |
| Disallow | /skin/ |
| Disallow | /stats/ |
| Disallow | /var/ |
| Disallow | /catalog/product_compare/ |
| Disallow | /catalog/category/view/ |
| Disallow | /catalog/product/view/ |
| Disallow | /catalogsearch/ |
| Disallow | /checkout/ |
| Disallow | /control/ |
| Disallow | /contacts/ |
| Disallow | /customer/ |
| Disallow | /customize/ |
| Disallow | /newsletter/ |
| Disallow | /poll/ |
| Disallow | /review/ |
| Disallow | /sendfriend/ |
| Disallow | /tag/ |
| Disallow | /wishlist/ |
| Disallow | /adjnav/ |
| Disallow | /cron.php |
| Disallow | /cron.sh |
| Disallow | /error_log |
| Disallow | /install.php |
| Disallow | /LICENSE.html |
| Disallow | /LICENSE.txt |
| Disallow | /LICENSE_AFL.txt |
| Disallow | /PATCH*.sh |
| Disallow | /STATUS.txt |
| Disallow | /*?*SID=* |
| Disallow | /*?*accessory_category=* |
| Disallow | /*?*accessory_make_for_filter=* |
| Disallow | /*?*bow_category=* |
| Disallow | /*?*bow_make_for_filter=* |
| Disallow | /*?*bow_type=* |
| Disallow | /*?*firearm_action=* |
| Disallow | /*?*firearm_calibre=* |
| Disallow | /*?*firearm_calibre_group=* |
| Disallow | /*?*firearm_legal_classification=* |
| Disallow | /*?*firearm_make_for_filter=* |
| Disallow | /*?*firearm_type=* |
| Disallow | /*?*product_condition_used=* |
| Disallow | /*?*product_left_handed=* |
| Disallow | /*?*product_make=* |
| Disallow | /*?*product_on_sale=* |
| Disallow | /*?*product_sold=* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 30 |
Other Records
| Field | Value |
|---|---|
| sitemap | http://ellwoodepps.com/sitemap.xml |
Warnings
- 1 invalid line.
- `host` is not a known field.