Log In Sign Up

skymedia.de
robots.txt

Robots Exclusion Standard data for skymedia.de

Resource Scan

Scan Details

Site Domain skymedia.de
Base Domain skymedia.de
Scan Status Ok
Last Scan2024-10-24T13:04:10+00:00
Next Scan 2024-11-23T13:04:10+00:00

Last Scan

Scanned2024-10-24T13:04:10+00:00
URL https://skymedia.de/robots.txt
Redirect https://www.skymedia.de/robots.txt
Redirect Domain www.skymedia.de
Redirect Base skymedia.de
Domain IPs 5.77.62.184
Redirect IPs 5.77.62.184
Response IP 5.77.62.184
Found Yes
Hash 50a7f218e973f0918842b7d12d308d10392b7dee97845f5939bfb3a189b24251
SimHash 8a1cd832feb0

Groups

*

Rule Path
Disallow
Allow /
Disallow /author/
Disallow /wp-admin/
Disallow /quiz/
Disallow /templatera/
Disallow /staging*
Allow /wp-admin/admin-ajax.php
Disallow /*.aspx$
Disallow /*.ashx$
Disallow /wp-cron.php
Disallow /403.shtml
Disallow /bbq-403.php
Disallow /*page_id%3D

twitterbot

Rule Path
Disallow
Allow /

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

dalvik

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

majestic

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.skymedia.de/sitemap_index.xml
Back to top

Comments

  • Crawlers Setup
  • Directories
  • Paths (clean URLs)
  • Disallow:
  • Paths (no clean URLs)
  • Disallow: /*.js$
  • Disallow: /*.css$
  • Files
  • old filters
  • Disallow: /*price=
  • Disallow: /*sizefilter=
Back to top