ikulist.me
robots.txt
Robots Exclusion Standard data for ikulist.me
Resource Scan
Scan Details
Site Domain | ikulist.me |
Base Domain | ikulist.me |
Scan Status | Ok |
Last Scan | 2024-09-09T13:55:23+00:00 |
Next Scan | 2024-10-09T13:55:23+00:00 |
Last Scan
Scanned | 2024-09-09T13:55:23+00:00 |
URL | https://ikulist.me/robots.txt |
Domain IPs | 104.26.4.76, 104.26.5.76, 172.67.68.243, 2606:4700:20::681a:44c, 2606:4700:20::681a:54c, 2606:4700:20::ac43:44f3 |
Response IP | 172.67.68.243 |
Found | Yes |
Hash | d10f8c38cccef87238c196fce3066ec4effd6951aabebc030f895c2b36514a06 |
SimHash | c175c40c48d2 |
Groups
*
Rule | Path |
---|---|
Disallow | /*tag%3A*%2C*%2C* |
Disallow | /*job%3A*/tag%3A* |
Disallow | /*tag%3A*/job%3A* |
Disallow | /*/s%3A* |
Disallow | /*?price_min* |
Disallow | /*?price_range* |
Disallow | /bookmark/add/* |