shopfanexpo.com
robots.txt

Robots Exclusion Standard data for shopfanexpo.com

Resource Scan

Scan Details

Site Domain shopfanexpo.com
Base Domain shopfanexpo.com
Scan Status Ok
Last Scan2024-09-14T21:36:51+00:00
Next Scan 2024-10-14T21:36:51+00:00

Last Scan

Scanned2024-09-14T21:36:51+00:00
URL https://shopfanexpo.com/robots.txt
Redirect https://www.shopfanexpo.com/robots.txt
Redirect Domain www.shopfanexpo.com
Redirect Base shopfanexpo.com
Domain IPs 104.21.90.250, 172.67.163.90, 2606:4700:3033::6815:5afa, 2606:4700:3037::ac43:a35a
Redirect IPs 104.21.90.250, 172.67.163.90, 2606:4700:3033::6815:5afa, 2606:4700:3037::ac43:a35a
Response IP 104.21.90.250
Found Yes
Hash 965f829d92e8ef0370fc0a7699f6c09ffaef6d0d14a5ac32e35845f2f68294db
SimHash 7a56cd42e6f4

Groups

ninjabot

Rule Path
Allow /

*

Rule Path
Allow /catalog/view/theme/default/image/*
Allow /catalog/view/javascript/jquery/colorbox/colorbox.min.css
Disallow /*?brand_tabletpc
Disallow /*%26brand_tabletpc
Disallow /*?color_default
Disallow /*%26color_default
Disallow /*?filter_tag
Disallow /*%26filter_tag
Disallow /*?mode
Disallow /*%26mode
Disallow /*?cat
Disallow /*%26cat
Disallow /*?dir
Disallow /*%26dir
Disallow /*?color
Disallow /*%26color
Disallow /*?product_id
Disallow /*%26product_id
Disallow /*?minprice
Disallow /*%26minprice
Disallow /*?maxprice
Disallow /*%26maxprice
Disallow /*?route=checkout%2F
Disallow /*?route=account%2F
Disallow /*?route=product%2Fsearch
Disallow /catalog/
Disallow /*%26create%3D1
Disallow /?route=information%2Fcontact
Disallow /*?route=affiliate%2F
Disallow /*?keyword
Disallow /*?av
Disallow /admin/
Disallow /system/

ninjabot

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.shopfanexpo.com/index.php?route=extension/feed/google_sitemap