pro-linux.de
robots.txt
Robots Exclusion Standard data for pro-linux.de
Resource Scan
Scan Details
Site Domain | pro-linux.de |
Base Domain | pro-linux.de |
Scan Status | Ok |
Last Scan | 2024-11-12T17:11:10+00:00 |
Next Scan | 2024-11-19T17:11:10+00:00 |
Last Scan
Scanned | 2024-11-12T17:11:10+00:00 |
URL | https://pro-linux.de/robots.txt |
Redirect | https://www.pro-linux.de/robots.txt |
Redirect Domain | www.pro-linux.de |
Redirect Base | pro-linux.de |
Domain IPs | 148.251.87.233, 2a01:4f8:202:62e8::2 |
Redirect IPs | 148.251.87.233, 2a01:4f8:202:62e8::2 |
Response IP | 148.251.87.233 |
Found | Yes |
Hash | 926ea9ca9bef9ac31086f865c09e97d07cd93fa07ab67d16ab938bea2543bbcd |
SimHash | 4b4c5ce28d10 |
Groups
amazonbot
blexbot
checkmarknetwork
claudebot
facebookexternalhit
gptbot
ccbot
gofeed
http.rb
Rule | Path |
---|---|
Disallow | / |
googlebot-news
googlebot
yahoo! slurp
yacybot
Rule | Path |
---|---|
Disallow | /images/NB3/captcha/ |
Disallow | /cgi-bin/security |
Disallow | /awstats/ |
Disallow | /produkte/ |
Disallow | /forum/contribution.php |
Disallow | /forum/search.php |
Disallow | /news/1/*/comm/ |
Disallow | /news/2/*/comm/ |
Disallow | /artikel/2/*/comm/ |
Disallow | /kurztipps/2/*/comm/ |
Disallow | /lugs/2/*/comm/ |
Disallow | /kalender/2/*/comm/ |
Disallow | /umfragen/2/*/comm/ |
Disallow | /news/1/insert/ |
Disallow | /news/1/print/ |
Disallow | /news/1/send/ |
Disallow | /news/2/insert/ |
Disallow | /news/2/print/ |
Disallow | /news/2/send/ |
Disallow | /artikel/2/insert/ |
Disallow | /artikel/2/print/ |
Disallow | /artikel/2/send/ |
Disallow | /kurztipps/2/insert/ |
Disallow | /kurztipps/2/print/ |
Disallow | /kurztipps/2/send/ |
Disallow | /lugs/2/insert/ |
Disallow | /lugs/2/print/ |
Disallow | /lugs/2/send/ |
Disallow | /kalender/2/insert/ |
Disallow | /kalender/2/print/ |
Disallow | /kalender/2/send/ |
Disallow | /kalender/3/ |
Disallow | /umfragen/2/insert/ |
Disallow | /umfragen/2/print/ |
Disallow | /umfragen/2/send/ |
Disallow | /NB3/news/ |
Disallow | /NB3/artikel/ |
Disallow | /NB3/lugs/ |
Disallow | /NB3/kalender/ |
Disallow | /NB3/umfragen/ |
*
Rule | Path |
---|---|
Disallow | /images/NB3/captcha/ |
Disallow | /cgi-bin/security |
Disallow | /awstats/ |
Disallow | /produkte/ |
Disallow | /forum/contribution.php |
Disallow | /forum/search.php |
Disallow | /news/1/insert/ |
Disallow | /news/1/print/ |
Disallow | /news/1/send/ |
Disallow | /news/2/insert/ |
Disallow | /news/2/print/ |
Disallow | /news/2/send/ |
Disallow | /artikel/2/insert/ |
Disallow | /artikel/2/print/ |
Disallow | /artikel/2/send/ |
Disallow | /kurztipps/2/insert/ |
Disallow | /kurztipps/2/print/ |
Disallow | /kurztipps/2/send/ |
Disallow | /lugs/2/insert/ |
Disallow | /lugs/2/print/ |
Disallow | /lugs/2/send/ |
Disallow | /kalender/2/insert/ |
Disallow | /kalender/2/print/ |
Disallow | /kalender/2/send/ |
Disallow | /kalender/3/ |
Disallow | /umfragen/2/insert/ |
Disallow | /umfragen/2/print/ |
Disallow | /umfragen/2/send/ |
Disallow | /NB3/news/ |
Disallow | /NB3/artikel/ |
Disallow | /NB3/lugs/ |
Disallow | /NB3/kalender/ |
Disallow | /NB3/umfragen/ |
Other Records
Field | Value |
---|---|
sitemap | http://www.pro-linux.de/sitemaps/sitemap.xml |
sitemap | http://www.pro-linux.de/sitemaps/sitemap-news.xml |
sitemap | http://www.pro-linux.de/sitemaps/sitemap_app.gz |
sitemap | http://www.pro-linux.de/sitemaps/sitemap_forum.gz |