codepromoblackfriday.fr
robots.txt

Robots Exclusion Standard data for codepromoblackfriday.fr

Resource Scan

Scan Details

Site Domain codepromoblackfriday.fr
Base Domain codepromoblackfriday.fr
Scan Status Ok
Last Scan2024-09-18T10:11:53+00:00
Next Scan 2024-09-25T10:11:53+00:00

Last Scan

Scanned2024-09-18T10:11:53+00:00
URL https://codepromoblackfriday.fr/robots.txt
Redirect https://www.codepromoblackfriday.fr/robots.txt
Redirect Domain www.codepromoblackfriday.fr
Redirect Base codepromoblackfriday.fr
Domain IPs 13.33.88.12, 13.33.88.15, 13.33.88.25, 13.33.88.3
Redirect IPs 13.33.28.113, 13.33.28.43, 13.33.28.53, 13.33.28.95
Response IP 13.33.28.43
Found Yes
Hash 78c04c49a51dc4d18d16f6b03b388ef127258977572b545f7864797fe6fae0a9
SimHash 6c4b5e54c212

Groups

*

Rule Path
Disallow /m/
Disallow /mpofferref
Disallow /mpclick
Disallow /honeypot.html
Disallow /sdc/
Disallow /api/
Disallow /rest/
Disallow /z/
Disallow /combo/build
Disallow /auth/
Disallow /member/
Disallow /secure/
Disallow /account/

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

Other Records

Field Value
sitemap https://www.codepromoblackfriday.fr/sitemap.xml