shelly-forum.com
robots.txt

Robots Exclusion Standard data for shelly-forum.com

Resource Scan

Scan Details

Site Domain shelly-forum.com
Base Domain shelly-forum.com
Scan Status Ok
Last Scan2025-05-28T23:59:43+00:00
Next Scan 2025-06-27T23:59:43+00:00

Last Scan

Scanned2025-05-28T23:59:43+00:00
URL https://shelly-forum.com/robots.txt
Domain IPs 188.245.115.65, 2a01:4f8:c013:8014::1
Response IP 188.245.115.65
Found Yes
Hash 5db163bf4b2751cad5d9269ae036e8240d64b6f7464aa9e5f85c8fe3c99f2c76
SimHash ab08d072c912

Groups

*

Rule Path
Allow *
Disallow /*/acp/
Disallow /*/attachments/
Disallow /*/cache/
Disallow /*/language/
Disallow /*/lib/
Disallow /*/log/
Disallow /*/templates/
Disallow /*/tmp/
Disallow /*/user/
Disallow /*/register/
Disallow /*/login/
Disallow /*/lost-password/
Disallow /*/github-auth/
Disallow /*/twitter-auth/
Disallow /*/google-auth/
Disallow /*/facebook-auth/
Disallow /*?*postID=
Disallow /*?*tagID=
Disallow /*?*pageNo=1$
Disallow /*?*action=firstNew
Disallow /*?*action=lastPost
Disallow /*/search-result/
Disallow /*/search/
Disallow /*/tag-search/
Disallow /*/tagged/
Disallow /*/user-search/
Disallow /*/members-list/
Disallow /*?*sortField=
Disallow /*?*sortOrder=
Disallow /*?*filterByDate=
Disallow /*?*filterByStatus=
Disallow /*?*highlight=
Disallow /*?*objectType=
Disallow /*?*utm_source=
Disallow /*?*utm_medium=
Disallow /*?*utm_campaign=
Disallow /*/impressum/
Disallow /*/legal-notice/
Disallow /*/allgemeine-geschaeftsbedingungen/
Disallow /*/widerrufsbelehrung/
Disallow /*/datenschutzerklaerung/
Disallow /*/privacy-policy/
Disallow /*/nutzungsbedingungen/
Disallow /*/kontakt/
Disallow /*/contact/
Disallow /*/product-terms-and-conditions-download/

ahrefsbot
semrushbot
blexbot
dotbot
mj12bot
barkrowler
yandexbot
petalbot
sentibot
dataforseobot
megaindex
neticle
censysinspect
um-ic
researchbot
omgili
bytespider
mojeekbot
seocompany

Rule Path
Disallow /

amazonbot
pinterestbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

Other Records

Field Value
sitemap https://smarthome-forum.eu/sitemaps/sitemap.xml

Comments

  • 26-08-2024 by SoftCreatR.dev
  • sitemap
  • block internal directories
  • block user profiles
  • block registration and login
  • block post links
  • block search
  • block filtered / ordered pages
  • block utm
  • block legal pages and contact form
  • block crawler
  • limit crawler