ikee.lib.auth.gr
robots.txt
Robots Exclusion Standard data for ikee.lib.auth.gr
Resource Scan
Scan Details
Site Domain | ikee.lib.auth.gr |
Base Domain | auth.gr |
Scan Status | Ok |
Last Scan | 2024-11-11T22:36:23+00:00 |
Next Scan | 2024-11-25T22:36:23+00:00 |
Last Scan
Scanned | 2024-11-11T22:36:23+00:00 |
URL | https://ikee.lib.auth.gr/robots.txt |
Domain IPs | 155.207.201.104 |
Response IP | 155.207.201.104 |
Found | Yes |
Hash | 6d455da0582f0dd87e863ba4cd91e97fe980d5fd4ff69a06216399fdf1a41aec |
SimHash | c38fd022ea24 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /cgi-bin/ |
Disallow | /search |
Disallow | /search.py |
Disallow | /publiline.py |
Disallow | /yourbaskets |
Disallow | /yourbaskets/add |
Disallow | /youraccount |
Disallow | /yourmessages |
Disallow | /youralerts |
Disallow | /yourgroups |
Disallow | /oai2d/ |
Disallow | /oai2d.py/ |
Disallow | /search |
Disallow | /stats/ |
Disallow | /submit/ |
Disallow | /images/ |
Disallow | /record/*/linkbacks/sendtrackback |
Disallow | /record/*/export/* |
Disallow | /*.gif$ |
Disallow | /*.pdf$ |
Disallow | /*/usage |
Disallow | /rss |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
slurp
Rule | Path |
---|---|
Disallow | /cgi-bin/ |
Disallow | /search |
Disallow | /search.py |
Disallow | /publiline.py |
Disallow | /yourbaskets |
Disallow | /yourbaskets/add |
Disallow | /youraccount |
Disallow | /yourmessages |
Disallow | /youralerts |
Disallow | /yourgroups |
Disallow | /oai2d/ |
Disallow | /oai2d.py/ |
Disallow | /search |
Disallow | /stats/ |
Disallow | /submit/ |
Disallow | /images/ |
Disallow | /record/*/linkbacks/sendtrackback |
Disallow | /record/*/export/* |
Disallow | /*.gif$ |
Disallow | /*.pdf$ |
Disallow | /*/usage |
Disallow | /rss |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
googlebot
Rule | Path |
---|---|
Disallow | /cgi-bin/ |
Disallow | /search |
Disallow | /search.py |
Disallow | /publiline.py |
Disallow | /yourbaskets |
Disallow | /yourbaskets/add |
Disallow | /youraccount |
Disallow | /yourmessages |
Disallow | /youralerts |
Disallow | /yourgroups |
Disallow | /oai2d/ |
Disallow | /oai2d.py/ |
Disallow | /search |
Disallow | /stats/ |
Disallow | /images/ |
Disallow | /record/*/linkbacks/sendtrackback |
Disallow | /record/*/export/* |
Disallow | /*/usage |
Disallow | /rss |
Other Records
Field | Value |
---|---|
crawl-delay | 5 |
turnitinbot
Rule | Path |
---|---|
Disallow | /cgi-bin/ |
Disallow | /search |
Disallow | /search.py |
Disallow | /publiline.py |
Disallow | /yourbaskets |
Disallow | /yourbaskets/add |
Disallow | /youraccount |
Disallow | /yourmessages |
Disallow | /youralerts |
Disallow | /yourgroups |
Disallow | /oai2d/ |
Disallow | /oai2d.py/ |
Disallow | /search |
Disallow | /stats/ |
Disallow | /images/ |
Disallow | /record/*/linkbacks/sendtrackback |
Disallow | /record/*/export/* |
Disallow | /*/usage |
Disallow | /rss |
Other Records
Field | Value |
---|---|
crawl-delay | 30 |
mozilla/5.0 (compatible; proximic; +https://www.comscore.com/web-crawler),gzip(gfe)
Rule | Path |
---|---|
Disallow | / |
mozilla/5.0 (compatible; seznambot/3.2; +http://napoveda.seznam.cz/en/seznambot-intro/)
Rule | Path |
---|---|
Disallow | / |
mozilla/5.0 (compatible; heritrix/3.3.0-snapshot-20140702-2247 +http://archive.org/details/archive.org_bot)
Rule | Path |
---|---|
Disallow | / |
mozilla/5.0 (compatible; dotbot/1.2; +https://opensiteexplorer.org/dotbot; help@moz.com)
Rule | Path |
---|---|
Disallow | / |
recon (github.com/jimmysawczuk/recon; similar to facebot, facebookexternalhit/1.1)
Rule | Path |
---|---|
Disallow | / |
mozilla/5.0 (compatible) semanticscholarbot (+https://www.semanticscholar.org/crawler)
Rule | Path |
---|---|
Disallow | / |
mozilla/5.0 (compatible; dataforseobot/1.0; +https://dataforseo.com/dataforseo-bot)
Rule | Path |
---|---|
Disallow | / |
checklinks/1.3 (dispenserbot; +http://dispenser.info.tm/~dispenser/view/checklinks)
Rule | Path |
---|---|
Disallow | / |
mozilla/5.0 (compatible; adscanner/)/1.0 (http://seocompany.store; spider@seocompany.store)
Rule | Path |
---|---|
Disallow | / |
mozilla/5.0 (compatible; crawlson/1.0; +https://www.crawlson.com/search?q=site:e-nomothesia.gr)
Rule | Path |
---|---|
Disallow | / |
expanse_indexes_the_network_perimeters_of_our_customers._if_you_have_any_questions_or_concerns_please_reach_out_to:_scaninfo@expanseinc.com
Rule | Path |
---|---|
Disallow | / |