vulkanmedia.se
robots.txt

Robots Exclusion Standard data for vulkanmedia.se

Resource Scan

Scan Details

Site Domain vulkanmedia.se
Base Domain vulkanmedia.se
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan4/5/2025, 3:23:42 AM
Next Scan 7/4/2025, 3:23:42 AM

Last Successful Scan

Scanned5/18/2024, 3:05:49 AM
URL https://vulkanmedia.se/robots.txt
Redirect https://www.vulkanmedia.se/robots.txt
Redirect Domain www.vulkanmedia.se
Redirect Base vulkanmedia.se
Domain IPs 172.66.40.140, 172.66.43.116
Redirect IPs 172.66.40.140, 172.66.43.116
Response IP 172.66.40.140
Found Yes
Hash c328b0bc72cac667f95b59fb6fc2662c556aada48fa5ea6ea5a0a5f7b7d35d8d
SimHash 0904b9206998

Groups

*

Rule Path
Disallow /app/
Disallow /bin/
Disallow /dev/
Disallow /lib/
Disallow /phpserver/
Disallow /pkginfo/
Disallow /report/
Disallow /setup/
Disallow /update/
Disallow /var/
Disallow /vendor/
Disallow /review/
Disallow /catalogsearch/
Disallow /catalog/product_compare/
Disallow /catalog/category/view/
Disallow /catalog/product/view/
Disallow /sendfriend/
Disallow /*SID%3D

Other Records

Field Value
sitemap https://www.vulkanmedia.se/pub/media/sitemap/sitemap.xml

Comments

  • Crawlers Setup
  • Directories
  • Paths (clean URLs)
  • Paths (not clean URLs)
  • Website Sitemap