carrefourduweb.eu
robots.txt

Robots Exclusion Standard data for carrefourduweb.eu

Resource Scan

Scan Details

Site Domain carrefourduweb.eu
Base Domain carrefourduweb.eu
Scan Status Ok
Last Scan2025-10-26T00:38:08+00:00
Next Scan 2025-11-25T00:38:08+00:00

Last Scan

Scanned2025-10-26T00:38:08+00:00
URL https://carrefourduweb.eu/robots.txt
Domain IPs 2a00:7ee0:9:3:44:1:0:29, 91.234.194.113
Response IP 91.234.194.113
Found Yes
Hash 832668501e8db2bb01948fe14617df1569cb722570dbe22c39ed0cf4ada4c18e
SimHash 481c9d70ee1b

Groups

baiduspider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://carrefourduweb.eu/?feed=xmlsitemap001