easylunettes.fr
robots.txt

Robots Exclusion Standard data for easylunettes.fr

Resource Scan

Scan Details

Site Domain easylunettes.fr
Base Domain easylunettes.fr
Scan Status Ok
Last Scan2024-06-12T17:49:11+00:00
Next Scan 2024-07-12T17:49:11+00:00

Last Scan

Scanned2024-06-12T17:49:11+00:00
URL https://easylunettes.fr/robots.txt
Redirect https://www.easylunettes.fr/robots.txt
Redirect Domain www.easylunettes.fr
Redirect Base easylunettes.fr
Domain IPs 3.165.82.110, 3.165.82.3, 3.165.82.45, 3.165.82.5
Redirect IPs 13.33.30.101, 13.33.30.117, 13.33.30.19, 13.33.30.92
Response IP 13.33.30.92
Found Yes
Hash f7f98b095da3d1f51dc85fe672c2d5703cdbba23978e872e8ec2bf1d0c1eb76a
SimHash 4454d8058621

Groups

psbot
archive.org_bot
seoscanners.net
cliqzbot
badbot
dotbot
yisouspider
yyspider
baiduspider
etaospider
huihuispider
wochachaspider
gwdangspider
youdaospider
bytespider
sogou web spider
sogou inst spider
sogou spider

Rule Path
Disallow /
Disallow /*price
Disallow /*categorySize
Disallow /?*manufacturer
Disallow /?*material
Disallow /?*age

googlebot

Rule Path
Disallow /search?query=
Disallow /cart/
Disallow /*.pdf$
Disallow /index/
Disallow /membership/
Disallow /geo-targeting/
Disallow /social-facebook/
Disallow /product/
Disallow /category-page/
Disallow /try-on/
Disallow /try-on-new/
Disallow /*sortBy
Disallow /optiker-zentrum/suchergebnisse/
Disallow /optinen-keskus/search-results/
Disallow /centro-ottico/search-results/
Disallow /centro-optico/search-results/
Disallow /centre-optique/search-results/
Disallow /optisch-centrum/zoek-resultaten/
Disallow /optiskt-centrum/sok-resultat/
Disallow /optisk-center/search-results/
Disallow /optical-center/search-results/
Disallow /optical-centre/search-results/
Disallow /share
Disallow /*price
Disallow /*categorySize
Disallow /?*manufacturer
Disallow /?*material
Disallow /?*age

*

Rule Path
Disallow /search?query=
Disallow /cart/
Disallow /*.pdf$
Disallow /index/
Disallow /membership/
Disallow /geo-targeting/
Disallow /social-facebook/
Disallow /product/
Disallow /category-page/
Disallow /try-on/
Disallow /try-on-new/
Disallow /*sortBy
Disallow /help/redijd0i1w-rect72y7mk1d8wh-clou3r5ikmildfront
Disallow /optiker-zentrum/suchergebnisse/
Disallow /optinen-keskus/search-results/
Disallow /centro-ottico/search-results/
Disallow /centro-optico/search-results/
Disallow /centre-optique/search-results/
Disallow /optisch-centrum/zoek-resultaten/
Disallow /optiskt-centrum/sok-resultat/
Disallow /optisk-center/search-results/
Disallow /optical-center/search-results/
Disallow /optical-centre/search-results/
Disallow /share
Disallow /*price
Disallow /*categorySize
Disallow /?*manufacturer
Disallow /?*material
Disallow /?*age

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.easylunettes.fr/centre-optique/sitemap.xml
sitemap https://www.easylunettes.fr/pimcore_sitemap/www_easylunettes_fr_pimcore_index.xml
sitemap https://www.easylunettes.fr/blog/sitemap.xml
sitemap https://www.easylunettes.fr/sitemap_xml/www_easylunettes_fr_index.xml
sitemap https://www.easylunettes.fr/grid_sitemap_xml/www_easylunettes_fr_index.xml