afrikaverein.de
robots.txt

Robots Exclusion Standard data for afrikaverein.de

Resource Scan

Scan Details

Site Domain afrikaverein.de
Base Domain afrikaverein.de
Scan Status Ok
Last Scan2024-10-25T00:58:06+00:00
Next Scan 2024-11-24T00:58:06+00:00

Last Scan

Scanned2024-10-25T00:58:06+00:00
URL https://afrikaverein.de/robots.txt
Domain IPs 80.242.135.105
Response IP 80.242.135.105
Found Yes
Hash 438e7e166f81dc60e506a09ae904bf20a7de165696c5df8761ef354c54382240
SimHash e984d11bbc70

Groups

*

Rule Path Comment
Allow / Allow bot to enter
Disallow /fileadmin/_processed_/ -
Disallow /fileadmin/_migrated/ -
Disallow /fileadmin/_temp_/ -
Disallow /fileadmin/user_upload/ -
Disallow /fileadmin/user_upload_new/ -
Disallow /fileadmin/scripts/ -
Disallow /fileadmin/scripts_backup/ -
Disallow /fileadmin/fonts/ -
Disallow /fileadmin/javascripts/ -
Disallow /fileadmin/flash/ -
Disallow /fileadmin/news_import/ -
Disallow /typo3/ Nothing to see here
Disallow /typo3conf/ Nothing to see here
Disallow /typo3temp/ Nothing to see here
Disallow /uploads/ Nothing to see here
Disallow /vendor/ Nothing to see here
Disallow /*?id=* Disable non-realurl
Disallow /*%26type%3D98 Disable print pages
Disallow /error/ -
Disallow /phpmyadmin/ -
Disallow /stats/ -
Disallow /sicherung/ -

surveybot

Rule Path
Disallow /

shopwiki

Rule Path
Disallow /

jakarta commons-httpclient

Rule Path
Disallow /

aboutusbot

Rule Path
Disallow /

semager

Rule Path
Disallow /

linguee

Rule Path
Disallow /

updownerbot

Rule Path
Disallow /

gonzo

Rule Path
Disallow /

zeusbot

Rule Path
Disallow /

*

Rule Path
Disallow

Other Records

Field Value Comment
sitemap https://www.afrikaverein.de/sitemap.xml Your Sitemap

Comments

  • templates, css, js.
  • Nothing to see here