Log In Sign Up

bolidenforum.de
robots.txt

Robots Exclusion Standard data for bolidenforum.de

Resource Scan

Scan Details

Site Domain bolidenforum.de
Base Domain bolidenforum.de
Scan Status Ok
Last Scan2024-09-22T08:46:55+00:00
Next Scan 2024-09-29T08:46:55+00:00

Last Scan

Scanned2024-09-22T08:46:55+00:00
URL https://bolidenforum.de/robots.txt
Redirect https://www.bolidenforum.de/robots.txt
Redirect Domain www.bolidenforum.de
Redirect Base bolidenforum.de
Domain IPs 89.22.101.191
Redirect IPs 89.22.101.191
Response IP 89.22.101.191
Found Yes
Hash ee46390e20a3ae24d71689f50c6761ef9c6d39dd9a13da75486b9d4b99879859
SimHash 13d4f9108373

Groups

*

Rule Path
Disallow /forum/admincp/
Disallow /forum/modcp/
Disallow /forum/attachments/
Disallow /forum/images/
Disallow /forum/members/
Disallow /forum/member/
Disallow /forum/search/
Disallow /forum/new-content/
Disallow /forum/auth/
Disallow /forum/register
Disallow /forum/uploader/url

archive.org_bot

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

ia_archiver-web.archive.org

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.bolidenforum.de/forum/core/xmlsitemap.php
sitemap https://www.bolidenforum.de/portal/sitemap_index.xml
Back to top

Comments

  • Hinzugefügt am 03.05.2024
  • User-agent: *
  • Disallow: /forum/artikel/
  • Disallow: /forum/artikel/allgemein
  • Disallow: /forum/artikel-und-reviews
  • Hinzugefügt am 05.06.2024
  • Deaktiviert am 01.07.2024
  • User-agent: Google
  • Disallow: /portal/
  • Disallow: /forum/attachments/
  • Disallow: /forum/attachments*
  • Disallow: /forum/filedata/
  • Disallow: /forum/filedata*
  • Disallow: /forum/filedata/fetch*
  • Disallow: /portal/wp-content/uploads/
  • Disallow: /portal/wp-content/uploads*
  • User-agent: *
  • Disallow: /*.jpg$
  • Disallow: /*.png$
  • Disallow: /*.gif$
  • Disallow: /*.jpeg$
  • ChatGPT
  • Google Bard
  • User-agent: Google-Extended
  • Disallow: /
  • Common Crawler
Back to top