pro-linux.de
robots.txt

Robots Exclusion Standard data for pro-linux.de

Resource Scan

Scan Details

Site Domain pro-linux.de
Base Domain pro-linux.de
Scan Status Ok
Last Scan2024-11-12T17:11:10+00:00
Next Scan 2024-11-19T17:11:10+00:00

Last Scan

Scanned2024-11-12T17:11:10+00:00
URL https://pro-linux.de/robots.txt
Redirect https://www.pro-linux.de/robots.txt
Redirect Domain www.pro-linux.de
Redirect Base pro-linux.de
Domain IPs 148.251.87.233, 2a01:4f8:202:62e8::2
Redirect IPs 148.251.87.233, 2a01:4f8:202:62e8::2
Response IP 148.251.87.233
Found Yes
Hash 926ea9ca9bef9ac31086f865c09e97d07cd93fa07ab67d16ab938bea2543bbcd
SimHash 4b4c5ce28d10

Groups

amazonbot
blexbot
checkmarknetwork
claudebot
facebookexternalhit
gptbot
ccbot
gofeed
http.rb

Rule Path
Disallow /

googlebot-news
googlebot
yahoo! slurp
yacybot

Rule Path
Disallow /images/NB3/captcha/
Disallow /cgi-bin/security
Disallow /awstats/
Disallow /produkte/
Disallow /forum/contribution.php
Disallow /forum/search.php
Disallow /news/1/*/comm/
Disallow /news/2/*/comm/
Disallow /artikel/2/*/comm/
Disallow /kurztipps/2/*/comm/
Disallow /lugs/2/*/comm/
Disallow /kalender/2/*/comm/
Disallow /umfragen/2/*/comm/
Disallow /news/1/insert/
Disallow /news/1/print/
Disallow /news/1/send/
Disallow /news/2/insert/
Disallow /news/2/print/
Disallow /news/2/send/
Disallow /artikel/2/insert/
Disallow /artikel/2/print/
Disallow /artikel/2/send/
Disallow /kurztipps/2/insert/
Disallow /kurztipps/2/print/
Disallow /kurztipps/2/send/
Disallow /lugs/2/insert/
Disallow /lugs/2/print/
Disallow /lugs/2/send/
Disallow /kalender/2/insert/
Disallow /kalender/2/print/
Disallow /kalender/2/send/
Disallow /kalender/3/
Disallow /umfragen/2/insert/
Disallow /umfragen/2/print/
Disallow /umfragen/2/send/
Disallow /NB3/news/
Disallow /NB3/artikel/
Disallow /NB3/lugs/
Disallow /NB3/kalender/
Disallow /NB3/umfragen/

*

Rule Path
Disallow /images/NB3/captcha/
Disallow /cgi-bin/security
Disallow /awstats/
Disallow /produkte/
Disallow /forum/contribution.php
Disallow /forum/search.php
Disallow /news/1/insert/
Disallow /news/1/print/
Disallow /news/1/send/
Disallow /news/2/insert/
Disallow /news/2/print/
Disallow /news/2/send/
Disallow /artikel/2/insert/
Disallow /artikel/2/print/
Disallow /artikel/2/send/
Disallow /kurztipps/2/insert/
Disallow /kurztipps/2/print/
Disallow /kurztipps/2/send/
Disallow /lugs/2/insert/
Disallow /lugs/2/print/
Disallow /lugs/2/send/
Disallow /kalender/2/insert/
Disallow /kalender/2/print/
Disallow /kalender/2/send/
Disallow /kalender/3/
Disallow /umfragen/2/insert/
Disallow /umfragen/2/print/
Disallow /umfragen/2/send/
Disallow /NB3/news/
Disallow /NB3/artikel/
Disallow /NB3/lugs/
Disallow /NB3/kalender/
Disallow /NB3/umfragen/

Other Records

Field Value
sitemap http://www.pro-linux.de/sitemaps/sitemap.xml
sitemap http://www.pro-linux.de/sitemaps/sitemap-news.xml
sitemap http://www.pro-linux.de/sitemaps/sitemap_app.gz
sitemap http://www.pro-linux.de/sitemaps/sitemap_forum.gz