wikirate.org
robots.txt
Robots Exclusion Standard data for wikirate.org
Resource Scan
Scan Details
Site Domain | wikirate.org |
Base Domain | wikirate.org |
Scan Status | Ok |
Last Scan | 2025-10-13T19:47:32+00:00 |
Next Scan | 2025-11-12T19:47:32+00:00 |
Last Scan
Scanned | 2025-10-13T19:47:32+00:00 |
URL | https://wikirate.org/robots.txt |
Domain IPs | 104.26.14.248, 104.26.15.248, 172.67.73.108, 2606:4700:20::681a:ef8, 2606:4700:20::681a:ff8, 2606:4700:20::ac43:496c |
Response IP | 104.26.14.248 |
Found | Yes |
Hash | c510f849b256c1115ded4600aa0e0666cfcff6c68ae50680a15540ce954676dc |
SimHash | cb32a052ebd6 |
Groups
*
Rule | Path |
---|---|
Disallow | /card/* |
Disallow | /create/* |
Disallow | /update/* |
Disallow | /delete/* |
Disallow | /admin/* |
Disallow | /account/* |
Disallow | /*/history |
Disallow | /*/history_and_references |
Disallow | /*.json |
Disallow | /*.csv |
Other Records
Field | Value |
---|---|
crawl-delay | 1 |