korpen-jarfalla.se
robots.txt

Robots Exclusion Standard data for korpen-jarfalla.se

Resource Scan

Scan Details

Site Domain korpen-jarfalla.se
Base Domain korpen-jarfalla.se
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-08-16T03:06:39+00:00
Next Scan 2024-11-14T03:06:39+00:00

Last Successful Scan

Scanned2024-01-20T03:04:51+00:00
URL https://korpen-jarfalla.se/robots.txt
Redirect http://www.korpen-jarfalla.se/robots.txt
Redirect Domain www.korpen-jarfalla.se
Redirect Base korpen-jarfalla.se
Domain IPs 46.30.213.191
Redirect IPs 81.91.4.137
Response IP 81.91.4.137
Found Yes
Hash 702716ae54fe733358876a8ea37434a8eeef529306bba8902fe593a7f1117387
SimHash d13a84a0ebf3

Groups

*

Rule Path
Disallow /faktura/*
Disallow /dokument/*
Disallow /invoice/*
Disallow /rss/*
Disallow /spk/
Disallow /teamdata/files/*
Disallow /ifkgoteborg-futsal
Disallow /ifkgoteborg-futsal-herr
Disallow /ifkgoteborg-futsal-dam
Disallow /ifkgoteborg-futsal-p01
Disallow /*/znvy/*
Disallow /*/dokument/*

mj12bot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

Comments

  • http://www.majestic12.co.uk/projects/dsearch/mj12bot.php
  • https://megaindex.com/crawler
  • Backlink Analysis
  • https://www.semrush.com/bot/
  • http://www.opensiteexplorer.org/dotbot