directo.soymotor.com
robots.txt
Robots Exclusion Standard data for directo.soymotor.com
Resource Scan
Scan Details
Site Domain | directo.soymotor.com |
Base Domain | soymotor.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-05-12T07:16:22+00:00 |
Next Scan | 2024-06-11T07:16:22+00:00 |
Last Successful Scan
Scanned | 2024-03-21T07:06:12+00:00 |
URL | https://directo.soymotor.com/robots.txt |
Domain IPs | 104.21.52.18, 172.67.194.73, 2606:4700:3031::6815:3412, 2606:4700:3034::ac43:c249 |
Response IP | 104.21.52.18 |
Found | Yes |
Hash | 0d9436c267f30ca91420cc2f521efd86b4d42da6bddaa284a6885ef1dbc08ddc |
SimHash | ac92190bc565 |
Groups
*
No rules defined. All paths allowed.
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Comments