Log In Sign Up

astina.dk
robots.txt

Robots Exclusion Standard data for astina.dk

Resource Scan

Scan Details

Site Domain astina.dk
Base Domain astina.dk
Scan Status Ok
Last Scan2025-12-09T03:32:39+00:00
Next Scan 2026-01-08T03:32:39+00:00

Last Scan

Scanned2025-12-09T03:32:39+00:00
URL https://astina.dk/robots.txt
Redirect https://www.astina.dk/robots.txt
Redirect Domain www.astina.dk
Redirect Base astina.dk
Domain IPs 104.26.6.223, 104.26.7.223, 172.67.71.63, 2606:4700:20::681a:6df, 2606:4700:20::681a:7df, 2606:4700:20::ac43:473f
Redirect IPs 104.26.6.223, 104.26.7.223, 172.67.71.63, 2606:4700:20::681a:6df, 2606:4700:20::681a:7df, 2606:4700:20::ac43:473f
Response IP 104.26.6.223
Found Yes
Hash 19b6cda9b8e2170b7410eb71e5f41755bb56ab81297ef94e7caf16c60c81aabb
SimHash ed255c654eb9

Groups

facebookexternalhit

Rule Path
Allow /

*

Rule Path
Allow /includes/javascript/
Allow /includes/modules/rating/rating.js

Other Records

Field Value
crawl-delay 2
Back to top

Other Records

Field Value
sitemap https://www.astina.dk/sitemap.xml
Back to top

Comments

  • Disallow: /includes/
  • Disallow: /tmp/
  • Disallow: /.htaccess
  • Disallow: /*account.php
  • Disallow: /*account_edit.php
  • Disallow: /*account_history.php
  • Disallow: /*account_history_info.php
  • Disallow: /*account_password.php
  • Disallow: /*address_book.php
  • Disallow: /*address_book_process.php
  • Disallow: /*checkout_process.php
  • Disallow: /*checkout_success.php
  • Disallow: /*create_account_success.php
  • Disallow: /*login.php*
  • Disallow: /*logoff.php
  • Disallow: /*password_forgotten.php
  • Disallow: /*pollbooth.php*
  • Disallow: /*?row_by_page*
  • Disallow: /*?op*
  • Disallow: /*?pdf=true*
  • Disallow: /*index.php?r=*
Back to top

Warnings

  • `host` is not a known field.
Back to top