bolidenforum.de
robots.txt

Robots Exclusion Standard data for bolidenforum.de

Resource Scan

Scan Details

Site Domain bolidenforum.de
Base Domain bolidenforum.de
Scan Status Ok
Last Scan2024-06-15T23:56:02+00:00
Next Scan 2024-06-22T23:56:02+00:00

Last Scan

Scanned2024-06-15T23:56:02+00:00
URL https://bolidenforum.de/robots.txt
Redirect https://www.bolidenforum.de/robots.txt
Redirect Domain www.bolidenforum.de
Redirect Base bolidenforum.de
Domain IPs 89.22.101.191
Redirect IPs 89.22.101.191
Response IP 89.22.101.191
Found Yes
Hash 118577d83b4cce7dc0d6333bcfafd0ef5ba4141755f13fa162991218e6d50aaf
SimHash 1bc4f9188173

Groups

*

Rule Path
Disallow /forum/admincp/
Disallow /forum/modcp/
Disallow /forum/attachments/
Disallow /forum/images/
Disallow /forum/members/
Disallow /forum/member/
Disallow /forum/search/
Disallow /forum/new-content/
Disallow /forum/auth/
Disallow /forum/register
Disallow /forum/uploader/url

google

Rule Path
Disallow /forum/artikel/
Disallow /forum/artikel/allgemein
Disallow /forum/artikel-und-reviews

google

Rule Path
Disallow /portal/
Disallow /portal/wp-content/uploads/
Disallow /portal/wp-content/uploads*

*

Rule Path
Disallow /*.jpg$
Disallow /*.png$
Disallow /*.gif$
Disallow /*.jpeg$

archive.org_bot

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

ia_archiver-web.archive.org

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.bolidenforum.de/forum/core/xmlsitemap.php
sitemap https://www.bolidenforum.de/portal/sitemap_index.xml

Comments

  • Hinzugefügt am 03.05.2024
  • Hinzugefügt am 05.06.2024
  • Disallow: /forum/attachments/
  • Disallow: /forum/attachments*
  • Disallow: /forum/filedata/
  • Disallow: /forum/filedata*
  • Disallow: /forum/filedata/fetch*
  • ChatGPT
  • Google Bard
  • Common Crawler