Log In Sign Up

nyaskafferiet.se
robots.txt

Robots Exclusion Standard data for nyaskafferiet.se

Resource Scan

Scan Details

Site Domain nyaskafferiet.se
Base Domain nyaskafferiet.se
Scan Status Ok
Last Scan2026-03-17T10:42:50+00:00
Next Scan 2026-03-24T10:42:50+00:00

Last Scan

Scanned2026-03-17T10:42:50+00:00
URL https://nyaskafferiet.se/robots.txt
Redirect https://www.nyaskafferiet.se/robots.txt
Redirect Domain www.nyaskafferiet.se
Redirect Base nyaskafferiet.se
Domain IPs 168.231.106.38
Redirect IPs 168.231.106.38
Response IP 168.231.106.38
Found Yes
Hash b4cfb70b3975f4e9acf05af9431ee8c8b02dd4840c3ecb5d7eb788c45e13a724
SimHash 117d9942eed8

Groups

ia_archiver

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /

linkpadbot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

sistrix

Rule Path
Disallow /
Back to top

Comments

  • Block SEO and archiving crawlers
  • Block other known crawlers that may scrape for SEO or analytics
Back to top