dasquadforum.de
robots.txt

Robots Exclusion Standard data for dasquadforum.de

Resource Scan

Scan Details

Site Domain dasquadforum.de
Base Domain dasquadforum.de
Scan Status Ok
Last Scan2024-09-20T23:11:07+00:00
Next Scan 2024-09-27T23:11:07+00:00

Last Scan

Scanned2024-09-20T23:11:07+00:00
URL https://dasquadforum.de/robots.txt
Domain IPs 85.13.138.235
Response IP 85.13.138.235
Found Yes
Hash f5332dd3e1d87c1787c303ce9d43a645be77bb03a2a02b1f4776ae34fa68572b
SimHash eb19c072d802

Groups

*

Rule Path
Allow *
Disallow /members-list/
Disallow /gallery/
Disallow /blog/
Disallow /user/
Disallow /unread-thread-list/
Disallow /calendar.php
Disallow /*?page=User
Disallow /*?page=CalendarEvent
Disallow /*?page=Rules
Disallow /*?page=LegalNotice
Disallow /*?page=UserGalleryOverview
Disallow /*?page=UserThankList
Disallow /vbimghost.php
Disallow /vbgarage.php
Disallow /*?page=Attachment*
Disallow /*?page=Thread&amp%3B*
Disallow /*/acp/
Disallow /*/attachments/
Disallow /*/cache/
Disallow /*/language/
Disallow /*/lib/
Disallow /*/log/
Disallow /*/templates/
Disallow /*/tmp/
Disallow /*/user/
Disallow /*/register/
Disallow /*/login/
Disallow /*/lost-password/
Disallow /*/github-auth/
Disallow /*/twitter-auth/
Disallow /*/google-auth/
Disallow /*/facebook-auth/
Disallow /*?*postID=
Disallow /*?*tagID=
Disallow /*?*pageNo=1$
Disallow /*?*action=firstNew
Disallow /*?*action=lastPost
Disallow /*/search-result/
Disallow /*/search/
Disallow /*/tag-search/
Disallow /*/tagged/
Disallow /*/user-search/
Disallow /*/members-list/
Disallow /*?*sortField=
Disallow /*?*sortOrder=
Disallow /*?*filterByDate=
Disallow /*?*filterByStatus=
Disallow /*?*highlight=
Disallow /*?*objectType=
Disallow /*?*utm_source=
Disallow /*?*utm_medium=
Disallow /*?*utm_campaign=
Disallow /*/impressum/
Disallow /*/legal-notice/
Disallow /*/allgemeine-geschaeftsbedingungen/
Disallow /*/widerrufsbelehrung/
Disallow /*/datenschutzerklaerung/
Disallow /*/privacy-policy/
Disallow /*/nutzungsbedingungen/
Disallow /*/kontakt/
Disallow /*/contact/
Disallow /*/product-terms-and-conditions-download/

ahrefsbot
semrushbot
blexbot
dotbot
mj12bot
barkrowler
yandexbot
petalbot
sentibot
dataforseobot
megaindex
neticle
censysinspect
um-ic
researchbot
omgili
bytespider
mojeekbot
seocompany

Rule Path
Disallow /

amazonbot
pinterestbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

Comments

  • 2023-09-17 by dasquadforum.de
  • sitemap
  • Sitemap: https://dasquadforum.de/sitemap.xml
  • block old sites
  • block internal directories
  • block user profiles
  • block registration and login
  • block post links
  • block search
  • block filtered / ordered pages
  • block utm
  • block legal pages and contact form
  • block crawler
  • limit crawler