skymedia.de
robots.txt

Robots Exclusion Standard data for skymedia.de

Resource Scan

Scan Details

Site Domain skymedia.de
Base Domain skymedia.de
Scan Status Ok
Last Scan2024-05-27T13:02:43+00:00
Next Scan 2024-06-26T13:02:43+00:00

Last Scan

Scanned2024-05-27T13:02:43+00:00
URL https://skymedia.de/robots.txt
Redirect https://www.skymedia.de/robots.txt
Redirect Domain www.skymedia.de
Redirect Base skymedia.de
Domain IPs 5.77.62.184
Redirect IPs 5.77.62.184
Response IP 5.77.62.184
Found Yes
Hash d8f448eced225373d47a4cff15f0a58c6631e56f224b3d3a8b39e738ad927894
SimHash 8a1cc832feb0

Groups

*

Rule Path
Disallow
Allow /
Disallow /author/
Disallow /wp-admin/
Disallow /quiz/
Disallow /templatera/
Disallow /staging*
Allow /wp-admin/admin-ajax.php
Disallow /*.aspx$
Disallow /*.ashx$
Disallow /wp-cron.php
Disallow /403.shtml
Disallow /bbq-403.php
Disallow /*page_id%3D

twitterbot

Rule Path
Disallow
Allow /

ahrefsbot

Rule Path
Disallow

dotbot

Rule Path
Disallow

dalvik

Rule Path
Disallow

mauibot

Rule Path
Disallow

majestic

Rule Path
Disallow

petalbot

Rule Path
Disallow

semrushbot

Rule Path
Disallow

*

Rule Path
Disallow

Other Records

Field Value
sitemap https://www.skymedia.de/sitemap_index.xml

Comments

  • Crawlers Setup
  • Directories
  • Paths (clean URLs)
  • Disallow:
  • Paths (no clean URLs)
  • Disallow: /*.js$
  • Disallow: /*.css$
  • Files
  • old filters
  • Disallow: /*price=
  • Disallow: /*sizefilter=
  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK