Log In Sign Up

stugsommar.se
robots.txt

Robots Exclusion Standard data for stugsommar.se

Resource Scan

Scan Details

Site Domain stugsommar.se
Base Domain stugsommar.se
Scan Status Ok
Last Scan2024-09-28T02:00:16+00:00
Next Scan 2024-10-12T02:00:16+00:00

Last Scan

Scanned2024-09-28T02:00:16+00:00
URL https://stugsommar.se/robots.txt
Redirect https://www.stugsommar.se/robots.txt
Redirect Domain www.stugsommar.se
Redirect Base stugsommar.se
Domain IPs 94.127.53.79
Redirect IPs 23.59.168.107
Response IP 23.59.168.107
Found Yes
Hash 0f01e49a028245307f19db841cd192baf05b090aa53c7240f843a467b04d4f49
SimHash bd30b515cfb4

Groups

bingbot

Rule Path
Disallow /pubweb/graphics/google-map

*

Rule Path
Disallow /housecube/dancenter18/calendar
Disallow /housecube/dancenter18/search
Disallow /housecube/mini10/search
Disallow /pubweb/vishus/as400-test
Disallow /pubweb/vishus/dns-test
Disallow /pubweb/vishus12/calendar
Disallow /pubweb/vishus12/price
Disallow /pubweb/booking/
Disallow /pubweb/SendFormMail/
Disallow /pubweb/form-mail-captcha/
Disallow /pubweb/picture/
Disallow /pubweb/groundplan/
Disallow /pubweb/partner-picture/
Disallow /r/
Back to top

Other Records

Field Value
sitemap https://www.stugsommar.se/google-sitemap
Back to top

Comments

  • This file does not contain any secret URLs.
  • There is no information leak by having these URLs visible.
  • ALL of the URLs are visible on public pages.
  • Crawlers of all kinds know these URLs from visiting public pages.
  • The only purpose of this list is to reduce noise in Google indexing
  • and avoid getting bad score in Google.
  • Bing keeps fetching old GoogleMaps images which has been gone for many years.
  • This file does not contain any secret URLs.
  • There is no information leak by having these URLs visible.
  • ALL of the URLs are visible on public pages.
  • Crawlers of all kinds know these URLs from visiting public pages.
  • The only purpose of this list is to reduce noise in Google indexing
  • and avoid getting bad score in Google.
Back to top