Log In Sign Up

hair-blog.dk
robots.txt

Robots Exclusion Standard data for hair-blog.dk

Resource Scan

Scan Details

Site Domain hair-blog.dk
Base Domain hair-blog.dk
Scan Status Ok
Last Scan2024-05-29T01:51:54+00:00
Next Scan 2024-06-28T01:51:54+00:00

Last Scan

Scanned2024-05-29T01:51:54+00:00
URL https://hair-blog.dk/robots.txt
Domain IPs 104.21.80.171, 172.67.152.52, 2606:4700:3031::ac43:9834, 2606:4700:3037::6815:50ab
Response IP 104.21.80.171
Found Yes
Hash 22378daa22e01b11e64929117d7d48e42373f075d5f0ce2bead00f32cc9ca9c6
SimHash b8769dfce902

Groups

*

Rule Path
Disallow /ajax/
Disallow /backend/
Disallow /include/
Disallow /subdomains/
Disallow /search

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

semrushbot-seoab

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

ahrefssiteaudit

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /
Back to top

Comments

  • Aha! Du er nok nysgerrig, hva'?
  • Du er dog hjerteligt velkommen til at snuse med her - og du kan jo altid sende en e-mail hvis du har spørgsmÃ¥l.
  • Ha' en helt fantastisk dag :-))
  • Dbh, Christoffer Steenbeck
  • https://www.christoffersteenbeck.dk/
  • hej@christoffersteenbeck.dk
  • The fun
  • Disallow: /css/
  • Disallow: /js/
  • Kill Semrush
  • Kill Ahrefs
  • Kill Screaming Frog SEO Spider
Back to top

Warnings

  • 1 invalid line.
Back to top