ur.computersm.com
robots.txt

Robots Exclusion Standard data for ur.computersm.com

Resource Scan

Scan Details

Site Domain ur.computersm.com
Base Domain computersm.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-09-10T18:04:35+00:00
Next Scan 2025-12-09T18:04:35+00:00

Last Successful Scan

Scanned2024-01-27T17:56:26+00:00
URL https://ur.computersm.com/robots.txt
Redirect https://ur.compiau.com/robots.txt
Redirect Domain ur.compiau.com
Redirect Base compiau.com
Domain IPs 104.21.70.251, 172.67.141.22, 2606:4700:3031::ac43:8d16, 2606:4700:3032::6815:46fb
Redirect IPs 104.21.7.128, 172.67.155.121, 2606:4700:3030::ac43:9b79, 2606:4700:3033::6815:780
Response IP 104.21.7.128
Found Yes
Hash d030c67cd380f8be028538194715a16a76cc410a99e048a275fff67645ca0d95
SimHash 63099c4043b1

Groups

*

Rule Path
Disallow

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://ur.compiau.com/sitemap.xml

Warnings

  • `host` is not a known field.