memodata.com
robots.txt

Robots Exclusion Standard data for memodata.com

Resource Scan

Scan Details

Site Domain memodata.com
Base Domain memodata.com
Scan Status Ok
Last Scan2024-05-16T08:11:00+00:00
Next Scan 2024-05-23T08:11:00+00:00

Last Scan

Scanned2024-05-16T08:11:00+00:00
URL http://memodata.com/robots.txt
Redirect http://www.memodata.com/robots.txt
Redirect Domain www.memodata.com
Redirect Base memodata.com
Domain IPs 193.252.57.200
Redirect IPs 45.130.239.118
Response IP 45.130.239.118
Found Yes
Hash 60677c188b608408ac712c43fd3eed00f486ea9e136dd27d84700cb24673c69a
SimHash fb20d724ab90

Groups

*

Rule Path
Disallow /common/
Disallow /2004/css
Disallow /2004/img
Disallow /2004/js
Disallow /2004/fr/advertising
Disallow /2004/fr/afaire
Disallow /2004/fr/js
Disallow /alexandria/unavailable

mediapartners-google*

Rule Path
Disallow

Comments

  • liste des répertoires à ne pas indexer