liberator.com
robots.txt

Robots Exclusion Standard data for liberator.com

Resource Scan

Scan Details

Site Domain liberator.com
Base Domain liberator.com
Scan Status Ok
Last Scan2024-05-22T20:29:39+00:00
Next Scan 2024-06-21T20:29:39+00:00

Last Scan

Scanned2024-05-22T20:29:39+00:00
URL https://liberator.com/robots.txt
Redirect https://www.liberator.com/robots.txt
Redirect Domain www.liberator.com
Redirect Base liberator.com
Domain IPs 34.199.243.241
Redirect IPs 108.156.133.101, 108.156.133.107, 108.156.133.90, 108.156.133.96
Response IP 108.156.133.101
Found Yes
Hash 575eb1d5ff27610eef593974a84be9266591f2caf39ec57cb46435f9d8a5f55d
SimHash c934984acdb0

Groups

*

Rule Path
Disallow /index.php/
Disallow /*?
Disallow /*?dir*
Disallow /*?dir=desc
Disallow /*?dir=asc
Disallow /*?limit=all
Disallow /*?mode*
Disallow /checkout/
Disallow /onestepcheckout/
Disallow /app/
Disallow /lib/
Disallow /bin/
Disallow /dev/
Disallow /phpserver/
Disallow /*.php$
Disallow /pkginfo/
Disallow /report/
Disallow /var/
Disallow /catalog/
Disallow /catalogsearch/
Disallow /catalog/product_compare/
Disallow /catalog/category/view/
Disallow /catalog/product/view/
Disallow /customer/
Disallow /customer/account/
Disallow /customer/account/login/
Disallow /customer/account/forgotpassword/
Disallow /customer/account/create/
Disallow /customer/account/login/referer/
Disallow /sendfriend/
Disallow /tag/
Disallow /review/
Disallow /stores/store/redirect/
Disallow /emails/
Disallow /*SID%3D
Allow /*?ver=*
Allow /*?size_hidden*
Allow /*?size*
Allow /*?color_material_combo*
Allow /*?Height*
Allow /*?avana_cover_type*

ia_archiver

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.liberator.com/media/sitemap/sitemap_liberator.xml