prefair.ca
robots.txt

Robots Exclusion Standard data for prefair.ca

Resource Scan

Scan Details

Site Domain prefair.ca
Base Domain prefair.ca
Scan Status Ok
Last Scan2025-12-17T10:17:26+00:00
Next Scan 2026-01-16T10:17:26+00:00

Last Scan

Scanned2025-12-17T10:17:26+00:00
URL https://prefair.ca/robots.txt
Redirect https://www.prefair.ca/robots.txt
Redirect Domain www.prefair.ca
Redirect Base prefair.ca
Domain IPs 174.142.247.38
Redirect IPs 104.21.3.147, 172.67.130.212, 2606:4700:3036::ac43:82d4, 2606:4700:3037::6815:393
Response IP 172.67.130.212
Found Yes
Hash e66c1b72c6f4d62d9556c5835a675ca480ebd870d2b044f82801d1b621cab6f4
SimHash e36a57e147f4

Groups

*

Rule Path
Disallow /inc/
Disallow /Gestion/
Disallow /auto/

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 15

slurp

Rule Path
Disallow

Other Records

Field Value
crawl-delay 100

gsa-crawler-www

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 100

googlebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 100

mediapartners-google

Rule Path
Disallow

yahoo-newscrawler

Rule Path
Disallow

msnbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 100

*

Rule Path
Disallow /config/
Disallow /handlers/
Disallow /includes/
Disallow /interceptors/
Disallow /layouts/
Disallow /logs/
Disallow /models/
Disallow /modules/
Disallow /modules_app/
Disallow /views/
Allow /

Comments

  • robots.txt pour le site