asiashift.com
robots.txt
Robots Exclusion Standard data for asiashift.com
Resource Scan
Scan Details
| Site Domain | asiashift.com |
| Base Domain | asiashift.com |
| Scan Status | Ok |
| Last Scan | 2024-05-19T04:48:37+00:00 |
| Next Scan | 2024-06-18T04:48:37+00:00 |
Last Scan
| Scanned | 2024-05-19T04:48:37+00:00 |
| URL | https://asiashift.com/robots.txt |
| Domain IPs | 108.159.80.101, 108.159.80.112, 108.159.80.60, 108.159.80.9, 2600:9000:238c:1400:16:374f:5d80:93a1, 2600:9000:238c:4200:16:374f:5d80:93a1, 2600:9000:238c:5200:16:374f:5d80:93a1, 2600:9000:238c:6200:16:374f:5d80:93a1, 2600:9000:238c:6400:16:374f:5d80:93a1, 2600:9000:238c:8200:16:374f:5d80:93a1, 2600:9000:238c:8a00:16:374f:5d80:93a1, 2600:9000:238c:dc00:16:374f:5d80:93a1 |
| Response IP | 13.33.88.45 |
| Found | Yes |
| Hash | 968f6edc852828d6ae6cfc6918c2e9b2a992a0a59170fc39236419f018933258 |
| SimHash | 38089cc0ea9a |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /.well-known/* |
| Disallow | /dist/* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 60 |