yakutena.com
robots.txt
Robots Exclusion Standard data for yakutena.com
Resource Scan
Scan Details
Site Domain | yakutena.com |
Base Domain | yakutena.com |
Scan Status | Ok |
Last Scan | 2024-09-27T05:58:42+00:00 |
Next Scan | 2024-10-04T05:58:42+00:00 |
Last Scan
Scanned | 2024-09-27T05:58:42+00:00 |
URL | https://yakutena.com/robots.txt |
Redirect | http://www.yakutena.com/robots.txt |
Redirect Domain | www.yakutena.com |
Redirect Base | yakutena.com |
Domain IPs | 157.112.144.6 |
Redirect IPs | 157.112.144.6 |
Response IP | 157.112.144.6 |
Found | Yes |
Hash | ca679d03a97e751459549a567036495163f2c4cb2acfed6c7c223330979b8e85 |
SimHash | 681a79cdd816 |
Groups
*
No rules defined. All paths allowed.
Other Records
Field | Value |
---|---|
crawl-delay | 600 |
Warnings
- 1 invalid line.
Comments