hakank.org
robots.txt
Robots Exclusion Standard data for hakank.org
Resource Scan
Scan Details
| Site Domain | hakank.org |
| Base Domain | hakank.org |
| Scan Status | Ok |
| Last Scan | 2024-09-16T16:21:05+00:00 |
| Next Scan | 2024-10-16T16:21:05+00:00 |
Last Scan
| Scanned | 2024-09-16T16:21:05+00:00 |
| URL | http://hakank.org/robots.txt |
| Domain IPs | 83.253.91.84 |
| Response IP | 83.253.91.84 |
| Found | Yes |
| Hash | 67212b47c3ebd1495d395265d1f465d6158593ec0f1cbf8baed5e282b7313ebd |
| SimHash | 431cf13628a2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /chiasmus |
| Disallow | /chiasmus/chiasmus.cgi |
| Disallow | /synonymer/synonym_path.cgi |
| Disallow | /synonymer/synonymer.cgi |
| Disallow | /isomorphic_words/isomorphic_words.cgi |
| Disallow | /vowels_away |
| Disallow | /ordo/ |
| Disallow | /simple_rhyme/ |
| Disallow | /new_markov_words/bloggtraffsammanfattningar.cgi |
| Disallow | /palin_gen/ |
| Disallow | /prefix_meld/ |
| Disallow | /minizinc/word_len3.mzn |
| Disallow | /minizinc/word_len4.mzn |
| Disallow | /minizinc/word_len5.mzn |
| Disallow | /minizinc/word_golf_n3.mzn |
| Disallow | /reading_scrambled_words/sim_0_0.swe |
| Disallow | /spelling_out_words/swe_not_full_spelling.txt |
| Disallow | /webblogg/mt-comments_x.cgi |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 4.5 |
Warnings
- 10 invalid lines.