computerbase.de
robots.txt
Robots Exclusion Standard data for computerbase.de
Resource Scan
Scan Details
| Site Domain | computerbase.de |
| Base Domain | computerbase.de |
| Scan Status | Ok |
| Last Scan | 2024-06-04T18:59:16+00:00 |
| Next Scan | 2024-06-11T18:59:16+00:00 |
Last Scan
| Scanned | 2024-06-04T18:59:16+00:00 |
| URL | https://computerbase.de/robots.txt |
| Redirect | https://www.computerbase.de/robots.txt |
| Redirect Domain | www.computerbase.de |
| Redirect Base | computerbase.de |
| Domain IPs | 212.83.33.137, 2a00:f48:2000:1::137 |
| Redirect IPs | 212.83.33.137, 2a00:f48:2000:1::137 |
| Response IP | 212.83.33.137 |
| Found | Yes |
| Hash | 3cc847f0160a4d24c97a854372259fbf849218c3c9581b700c01f9c49f90d801 |
| SimHash | fb1fd678ce8a |
Groups
ahrefsbot
awariorssbot
awariosmartbot
barkrowler
blexbot
dataforseobot
dotbot
ecoresearch
mj12bot
relemindbot
seekportbot
semrushbot
sentibot
serpstatbot
sirdatabot
trendictionbot
uipbot
uipbot/1.0
uipbot/1.0 (uipbot@semasio.net)
um-ic
velenpublicwebcrawler
weborama-fetcher
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | /api/ |
| Disallow | /forum/account/ |
| Disallow | /forum/conversations/ |
| Disallow | /forum/find-new/ |
| Disallow | /forum/goto/ |
| Disallow | /forum/members/ |
| Disallow | /forum/misc/ |
| Disallow | /forum/online/ |
| Disallow | /forum/posts/ |
| Disallow | /forum/search/ |
| Disallow | /forum/whats-new/ |
| Disallow | /forum/admin.php |
| Disallow | /forum/proxy.php |
| Disallow | /nlylew |
| Disallow | /preisvergleich/ |
| Disallow | /suche/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.computerbase.de/sitemap.xml |
| sitemap | https://www.computerbase.de/forum/sitemap.php |