dogforum.de
robots.txt

Robots Exclusion Standard data for dogforum.de

Resource Scan

Scan Details

Site Domain dogforum.de
Base Domain dogforum.de
Scan Status Ok
Last Scan2024-06-04T23:10:19+00:00
Next Scan 2024-06-11T23:10:19+00:00

Last Scan

Scanned2024-06-04T23:10:19+00:00
URL https://dogforum.de/robots.txt
Redirect https://www.dogforum.de/robots.txt
Redirect Domain www.dogforum.de
Redirect Base dogforum.de
Domain IPs 104.26.10.130, 104.26.11.130, 172.67.70.24, 2606:4700:20::681a:a82, 2606:4700:20::681a:b82, 2606:4700:20::ac43:4618
Redirect IPs 104.26.10.130, 104.26.11.130, 172.67.70.24, 2606:4700:20::681a:a82, 2606:4700:20::681a:b82, 2606:4700:20::ac43:4618
Response IP 104.26.11.130
Found Yes
Hash 460a66b0b70c45b4234af588823ad8e240e100ae94f0cfdedadaa03b86a7a8e1
SimHash a369d352dd13

Groups

*

Rule Path
Allow *
Disallow /*/acp/
Disallow /*/attachments/
Disallow /*/cache/
Disallow /*/language/
Disallow /*/lib/
Disallow /*/log/
Disallow /*/templates/
Disallow /*/tmp/
Disallow /*/index.php
Disallow /*/user/
Disallow /*/register/
Disallow /*/login/
Disallow /*/lost-password/
Disallow /*?*postID=
Disallow /*?*tagID=
Disallow /*?*action=firstNew
Disallow /*?*action=lastPost
Disallow /*/search-result/
Disallow /*/search/
Disallow /*/tag-search/
Disallow /*/tagged/
Disallow /*/user-search/
Disallow /*/members-list/
Disallow /*?*sortField=
Disallow /*?*sortOrder=
Disallow /*?*filterByDate=
Disallow /*?*filterByStatus=
Disallow /*?*highlight=
Disallow /*?*objectType=
Disallow /gallery/map/
Disallow /regenbogenwiese/
Disallow /*?*utm_source=
Disallow /*?*utm_medium=
Disallow /*?*utm_campaign=
Disallow /*/impressum/
Disallow /*/legal-notice/
Disallow /*/agb/
Disallow /*/datenschutzerklaerung/
Disallow /*/privacy-policy/
Disallow /*/cookie-richtlinie/
Disallow /*/kontakt/
Disallow /*/contact/

Other Records

Field Value
sitemap https://www.dogforum.de/sitemap.xml

Comments

  • 2022-10-22 by SoftCreatR.dev
  • sitemap
  • block internal directories
  • block index.php requests
  • block user profiles
  • block registration and login
  • block post links
  • Disallow: /*?*pageNo=1$
  • block search
  • block filtered / ordered pages
  • block gallery map
  • block graveyard
  • block utm
  • block legal pages and contact form