ca.computersm.com
robots.txt

Robots Exclusion Standard data for ca.computersm.com

Resource Scan

Scan Details

Site Domain ca.computersm.com
Base Domain computersm.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-09-14T07:29:05+00:00
Next Scan 2024-12-13T07:29:05+00:00

Last Successful Scan

Scanned2024-01-26T07:27:11+00:00
URL https://ca.computersm.com/robots.txt
Redirect https://ca.compiau.com/robots.txt
Redirect Domain ca.compiau.com
Redirect Base compiau.com
Domain IPs 104.21.70.251, 172.67.141.22, 2606:4700:3031::ac43:8d16, 2606:4700:3032::6815:46fb
Redirect IPs 104.21.7.128, 172.67.155.121, 2606:4700:3030::ac43:9b79, 2606:4700:3033::6815:780
Response IP 104.21.7.128
Found Yes
Hash d13679794729db065f0baa71e009376e4914b4edd7860da6c0c9c241afe3a023
SimHash 67088c65e7b1

Groups

*

Rule Path
Disallow

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://ca.compiau.com/sitemap.xml

Warnings

  • `host` is not a known field.