sanex.fr
robots.txt

Robots Exclusion Standard data for sanex.fr

Resource Scan

Scan Details

Site Domain sanex.fr
Base Domain sanex.fr
Scan Status Ok
Last Scan2024-09-25T05:51:05+00:00
Next Scan 2024-10-25T05:51:05+00:00

Last Scan

Scanned2024-09-25T05:51:05+00:00
URL https://www.sanex.fr/robots.txt
Domain IPs 23.215.7.25, 23.215.7.5, 2600:1413:b000:1b::17d7:705, 2600:1413:b000:1b::17d7:719
Response IP 23.52.40.59
Found Yes
Hash 0968f5d4cabbc033308700179746a649e70ef38b89bef9ad365ef770d10ea3ef
SimHash 2d25cc51c791

Groups

swiftbot

Rule Path
Disallow /*.pdf$

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow *?bvstate=*
Disallow /content/
Disallow /cp-sites/
Disallow /skin-type-finder/what-type-of-skin-do-i-have/

Other Records

Field Value
sitemap https://www.sanex.fr/sitemap.xml

Warnings

  • `noindex` is not a known field.