machinefactory.ca
robots.txt

Robots Exclusion Standard data for machinefactory.ca

Resource Scan

Scan Details

Site Domain machinefactory.ca
Base Domain machinefactory.ca
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-10-20T15:43:10+00:00
Next Scan 2026-01-18T15:43:10+00:00

Last Successful Scan

Scanned2023-09-25T11:02:50+00:00
URL https://machinefactory.ca/robots.txt
Redirect https://www.machinefactory.ca/robots.txt
Redirect Domain www.machinefactory.ca
Redirect Base machinefactory.ca
Domain IPs 66.6.44.4
Redirect IPs 74.114.154.18, 74.114.154.22
Response IP 74.114.154.18
Found Yes
Hash 9f196ec865ff649dbf8b21c5a063f3dd9379c84bff8e39cc7fa90cb0f63556f7
SimHash 6bb4d845cd23

Groups

*

Rule Path
Disallow /random
Disallow /day
Disallow /sticky-ad-iframe.html
Disallow /privacy/consent

Other Records

Field Value
crawl-delay 1

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

sentibot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.machinefactory.ca/sitemap.xml

Comments

  • OpenAI's crawler
  • Common Crawl's crawler
  • SentiBot's crawler