lebeau.ca
robots.txt

Robots Exclusion Standard data for lebeau.ca

Resource Scan

Scan Details

Site Domain lebeau.ca
Base Domain lebeau.ca
Scan Status Ok
Last Scan2024-09-18T20:16:22+00:00
Next Scan 2024-10-02T20:16:22+00:00

Last Scan

Scanned2024-09-18T20:16:22+00:00
URL https://lebeau.ca/robots.txt
Redirect https://www.lebeau.ca/robots.txt
Redirect Domain www.lebeau.ca
Redirect Base lebeau.ca
Domain IPs 174.142.247.32
Redirect IPs 104.21.79.198, 172.67.147.208, 2606:4700:3034::6815:4fc6, 2606:4700:3034::ac43:93d0
Response IP 172.67.147.208
Found Yes
Hash 2357a544708cc066cdce38bbcd66da0152c405cc6ec6c52b58757dfc22236297
SimHash 41525b314d70

Groups

slurp

Rule Path
Disallow

Other Records

Field Value
crawl-delay 100

gsa-crawler-www

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 100

googlebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 100

mediapartners-google

Rule Path
Disallow

yahoo-newscrawler

Rule Path
Disallow

msnbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 100

*

Rule Path
Disallow /config/
Disallow /handlers/
Disallow /interceptors/
Disallow /layouts/
Disallow /logs/
Disallow /models/
Disallow /modules/
Disallow /modules_app/
Disallow /views/
Disallow /includes/_sass/
Disallow /includes/_sassBlocks/
Disallow /includes/exceptions/
Disallow /includes/font/
Disallow /includes/helpers/
Disallow /includes/i18n/
Allow /

Other Records

Field Value
sitemap https://www.lebeau.ca/sitemap
sitemap https://www.speedyglass.ca/sitemap

Comments

  • Sitemap Lebeau
  • Sitemap Speedy Glass