ikulist.me
robots.txt
Robots Exclusion Standard data for ikulist.me
Resource Scan
Scan Details
| Site Domain | ikulist.me |
| Base Domain | ikulist.me |
| Scan Status | Ok |
| Last Scan | 2024-06-11T13:20:40+00:00 |
| Next Scan | 2024-07-11T13:20:40+00:00 |
Last Scan
| Scanned | 2024-06-11T13:20:40+00:00 |
| URL | https://ikulist.me/robots.txt |
| Domain IPs | 104.26.4.76, 104.26.5.76, 172.67.68.243, 2606:4700:20::681a:44c, 2606:4700:20::681a:54c, 2606:4700:20::ac43:44f3 |
| Response IP | 172.67.68.243 |
| Found | Yes |
| Hash | d10f8c38cccef87238c196fce3066ec4effd6951aabebc030f895c2b36514a06 |
| SimHash | c175c40c48d2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*tag%3A*%2C*%2C* |
| Disallow | /*job%3A*/tag%3A* |
| Disallow | /*tag%3A*/job%3A* |
| Disallow | /*/s%3A* |
| Disallow | /*?price_min* |
| Disallow | /*?price_range* |
| Disallow | /bookmark/add/* |