Log In Sign Up

promocatalogues.fr
robots.txt

Robots Exclusion Standard data for promocatalogues.fr

Resource Scan

Scan Details

Site Domain promocatalogues.fr
Base Domain promocatalogues.fr
Scan Status Ok
Last Scan2024-09-25T15:59:53+00:00
Next Scan 2024-10-02T15:59:53+00:00

Last Scan

Scanned2024-09-25T15:59:53+00:00
URL https://promocatalogues.fr/robots.txt
Redirect https://www.promocatalogues.fr/robots.txt
Redirect Domain www.promocatalogues.fr
Redirect Base promocatalogues.fr
Domain IPs 104.21.34.30, 172.67.167.215, 2606:4700:3033::6815:221e, 2606:4700:3034::ac43:a7d7
Redirect IPs 108.157.254.102, 108.157.254.12, 108.157.254.55, 108.157.254.9, 2600:9000:2753:0:1f:7c21:25c0:93a1, 2600:9000:2753:1800:1f:7c21:25c0:93a1, 2600:9000:2753:6e00:1f:7c21:25c0:93a1, 2600:9000:2753:9600:1f:7c21:25c0:93a1, 2600:9000:2753:a00:1f:7c21:25c0:93a1, 2600:9000:2753:c00:1f:7c21:25c0:93a1, 2600:9000:2753:c200:1f:7c21:25c0:93a1, 2600:9000:2753:f600:1f:7c21:25c0:93a1
Response IP 108.157.254.12
Found Yes
Hash 892cb50b1ec72425087fac709bdd1c4199f6605d55c13b9b8d56ea172dc74229
SimHash ca5cec23c6b1

Groups

*

Rule Path
Allow /
Disallow /chercher/*
Disallow /shopping-list/
Disallow /click-out/
Disallow /index.php/click-out/
Disallow /admin/
Disallow /cdn-cgi/
Disallow /offres/*?sort=relevance&page=*&*
Allow /offres/*?sort=relevance&page=*
Disallow /offres/*?page=*&*
Allow /offres/*?page=*
Disallow /offres/*?*
Disallow /marques/*?page=*&*
Allow /marques/*?page=*
Disallow /marques/*?*
Disallow /magasins/*?page=*&*
Allow /magasins/*?page=*
Disallow /magasins/*?*
Disallow /villes/*?page=*&*
Allow /villes/*?page=*
Disallow /villes/*?*
Disallow /nouveaux-catalogues?page=*&*
Allow /nouveaux-catalogues?page=*
Disallow /nouveaux-catalogues?*
Disallow /catalogues-presque-expires?page=*&*
Allow /catalogues-presque-expires?page=*
Disallow /catalogues-presque-expires?*
Disallow /catalogues-populaires?page=*&*
Allow /catalogues-populaires?page=*
Disallow /catalogues-populaires?*
Disallow /catalogues-recommandes?page=*&*
Allow /catalogues-recommandes?page=*
Disallow /catalogues-recommandes?*
Disallow /nouveaux-offres?page=*&*
Allow /nouveaux-offres?page=*
Disallow /nouveaux-offres?*
Disallow /offres-presque-expires?page=*&*
Allow /offres-presque-expires?page=*
Disallow /offres-presque-expires?*
Disallow /offres-populaires?page=*&*
Allow /offres-populaires?page=*
Disallow /offres-populaires?*
Disallow /offres-recommandes?page=*&*
Allow /offres-recommandes?page=*
Disallow /offres-recommandes?*
Disallow /brulant-ou-pas/populaire?page=*&*
Allow /brulant-ou-pas/populaire?page=*
Disallow /brulant-ou-pas/populaire?*
Disallow /brulant-ou-pas/tendance?page=*&*
Allow /brulant-ou-pas/tendance?page=*
Disallow /brulant-ou-pas/tendance?*
Disallow /brulant-ou-pas/nouveau?page=*&*
Allow /brulant-ou-pas/nouveau?page=*
Disallow /brulant-ou-pas/nouveau?*

adsbot-google

Rule Path
Disallow /click-out/
Disallow /admin/

*
adsbot-google

Rule Path
Disallow /cdn-cgi/bm/cv/
Disallow /cdn-cgi/challenge-platform/
Disallow /cdn-cgi/images/trace/
Disallow /cdn-cgi/rum
Disallow /cdn-cgi/scripts/
Disallow /cdn-cgi/styles/
Disallow /cdn-cgi/zaraz/

nuclei
wikido
riddler
petalbot
zoominfobot
go-http-client
node/simplecrawler
cazoodlebot
dotbot/1.0
gigabot
barkrowler
blexbot
magpie-crawler
mj12bot
ahrefsbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.promocatalogues.fr/sitemap.xml
Back to top