ville-meaux.fr
robots.txt

Robots Exclusion Standard data for ville-meaux.fr

Resource Scan

Scan Details

Site Domain ville-meaux.fr
Base Domain ville-meaux.fr
Scan Status Ok
Last Scan3/30/2025, 11:29:07 AM
Next Scan 4/29/2025, 11:29:07 AM

Last Scan

Scanned3/30/2025, 11:29:07 AM
URL https://www.ville-meaux.fr/robots.txt
Domain IPs 87.98.187.73
Response IP 87.98.187.73
Found Yes
Hash 854bccf6771ef76f0860107e3bc4eed437361a84bfd0d04e159c6db7f6ee0094
SimHash ab284856e7f1

Groups

*

Rule Path
Allow /
Disallow /t3lib/
Disallow /typo3/
Disallow /typo3conf/
Disallow /*?id=*
Disallow /pdf
Disallow /pdf-*
Allow /typo3conf/ext/stratis_site/Resources/Public/

Other Records

Field Value
crawl-delay 5

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

linguee

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.ville-meaux.fr/sitemap.xml