auction.whois.ai
robots.txt
Robots Exclusion Standard data for auction.whois.ai
Resource Scan
Scan Details
Site Domain | auction.whois.ai |
Base Domain | whois.ai |
Scan Status | Ok |
Last Scan | 2024-06-25T17:25:03+00:00 |
Next Scan | 2024-07-25T17:25:03+00:00 |
Last Scan
Scanned | 2024-06-25T17:25:03+00:00 |
URL | https://auction.whois.ai/robots.txt |
Domain IPs | 209.59.119.8 |
Response IP | 209.59.119.8 |
Found | Yes |
Hash | 1d5d89dc7bf96d4dba02101935ef6b94058882f4c05fd88a5dd5ab002592f6f2 |
SimHash | c86077e06919 |
Groups
*
Rule | Path |
---|---|
Disallow | /bids/ |
Disallow | /users/ |
Disallow | /orders/ |
Disallow | /auctions/watch/ |
Comments