ar.computersm.com
robots.txt

Robots Exclusion Standard data for ar.computersm.com

Resource Scan

Scan Details

Site Domain ar.computersm.com
Base Domain computersm.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-06-17T01:40:52+00:00
Next Scan 2024-09-15T01:40:52+00:00

Last Successful Scan

Scanned2024-01-27T01:15:22+00:00
URL https://ar.computersm.com/robots.txt
Redirect https://ar.compiau.com/robots.txt
Redirect Domain ar.compiau.com
Redirect Base compiau.com
Domain IPs 104.21.70.251, 172.67.141.22, 2606:4700:3031::ac43:8d16, 2606:4700:3032::6815:46fb
Redirect IPs 104.21.7.128, 172.67.155.121, 2606:4700:3030::ac43:9b79, 2606:4700:3033::6815:780
Response IP 104.21.7.128
Found Yes
Hash 82bc0fa22d5fc9373c0d412af9950664c4690194ad2db452498981d0088c128b
SimHash 67098051c3b0

Groups

*

Rule Path
Disallow

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://ar.compiau.com/sitemap.xml

Warnings

  • `host` is not a known field.