webmart.de
robots.txt
Robots Exclusion Standard data for webmart.de
Resource Scan
Scan Details
| Site Domain | webmart.de |
| Base Domain | webmart.de |
| Scan Status | Ok |
| Last Scan | 2024-06-21T20:21:56+00:00 |
| Next Scan | 2024-07-21T20:21:56+00:00 |
Last Scan
| Scanned | 2024-06-21T20:21:56+00:00 |
| URL | https://www.webmart.de/robots.txt |
| Domain IPs | 3.124.111.36 |
| Response IP | 3.124.111.36 |
| Found | Yes |
| Hash | 9680ed974bc98a2fe3cf428d2d9609a52d25bb9f7c1127a454eb7784bbc278d5 |
| SimHash | 854e46046333 |
Groups
ahrefsbot
findestars
backlinkcrawler
myonid
peekyou
pipl
rapleaf
snitch
spock
tweepz
wink
yasni
yoname
yourtraces
zoominfo
sistrix
blexbot
jobboersebot
semrushbot
semrushbot-sa
mj12bot
| Rule | Path |
|---|---|
| Disallow | / |
*
| Product | Comment |
|---|---|
| * | All Spiders |
| Rule | Path | Comment |
|---|---|---|
| Disallow | /gif/ | Image Folder |
| Disallow | /login/ | User Folder |
| Disallow | /taf | - |
| Disallow | /t.cfm | - |
| Disallow | /faq.cfm | - |
| Disallow | /main.cfm | - |
| Disallow | /wmtaf.cfm | - |
| Disallow | /t.cfm | - |
| Disallow | /faq.cfm | - |
| Disallow | /main.cfm | - |
| Disallow | /map | - |
| Disallow | /usertest.cfm | - |
| Disallow | /l.cfm | - |
| Disallow | /callme.cfm | - |
| Disallow | /wmfm.cfm | - |
| Disallow | /login.html | - |
| Disallow | /new-user.html | - |
| Disallow | /votes | - |
| Disallow | /j.cfm | - |
| Disallow | /abo.cfm | - |
| Disallow | /*%26pid | - |
| Disallow | /*%26do%3Dimpressum | - |
| Disallow | /newsletter/ | - |
| Disallow | /nlhistory.cfm | - |
| Disallow | /web/impressum | - |
| Disallow | /web/agb | - |
| Disallow | /web/privacy | - |
| Disallow | /web/cookies | - |
| Disallow | /help/contact | - |
| Disallow | /shop/checkout | - |
Warnings
- 1 invalid line.