athesia.it
robots.txt
Robots Exclusion Standard data for athesia.it
Resource Scan
Scan Details
Site Domain | athesia.it |
Base Domain | athesia.it |
Scan Status | Ok |
Last Scan | 2024-09-20T20:27:57+00:00 |
Next Scan | 2024-10-20T20:27:57+00:00 |
Last Scan
Scanned | 2024-09-20T20:27:57+00:00 |
URL | https://athesia.it/robots.txt |
Redirect | https://www.athesiabuch.it/robots.txt |
Redirect Domain | www.athesiabuch.it |
Redirect Base | athesiabuch.it |
Domain IPs | 92.63.216.195 |
Redirect IPs | 92.63.216.195, 92.63.216.196 |
Response IP | 92.63.216.195 |
Found | Yes |
Hash | 209962f6ad074fae50c6b99c2c7eb0f0a1d53bad85270976722e26690ca793bb |
SimHash | 04581e038fba |
Groups
*
Rule | Path |
---|---|
Disallow | /basket |
Disallow | /notepad |
Disallow | /konto |
Disallow | /kassa |
Disallow | /recommend |
Disallow | /wishlist |
Disallow | /cover |
Disallow | /list? |
Disallow | /rezension*? |
Disallow | /buchtipps*? |
Disallow | /it/basket |
Disallow | /it/notepad |
Disallow | /it/konto |
Disallow | /it/kassa |
Disallow | /it/recommend |
Disallow | /it/wishlist |
Disallow | /it/cover |
Disallow | /it/list? |
Disallow | /it/rezension? |
Disallow | /it/buchtipps? |
Disallow | /item*? |
Disallow | /_* |
Allow | /buchtipps?isbn= |
Allow | /buchtipps?page= |
Allow | /list?*xid= |
Allow | /list?isbn= |
Allow | /item?isbn= |
Other Records
Field | Value |
---|---|
crawl-delay | 9 |
Other Records
Field | Value |
---|---|
sitemap | https://www.athesiabuch.it/sitemap.xml |