witzelounge.de
robots.txt
Robots Exclusion Standard data for witzelounge.de
Resource Scan
Scan Details
| Site Domain | witzelounge.de |
| Base Domain | witzelounge.de |
| Scan Status | Ok |
| Last Scan | 2024-09-29T10:29:36+00:00 |
| Next Scan | 2024-10-06T10:29:36+00:00 |
Last Scan
| Scanned | 2024-09-29T10:29:36+00:00 |
| URL | https://witzelounge.de/robots.txt |
| Domain IPs | 178.254.33.33 |
| Response IP | 178.254.33.33 |
| Found | Yes |
| Hash | 33524327af67e6d3880dd97da81bff1f2b60969436ef65f22a2f14dfba18459a |
| SimHash | e0a800984b7f |
Groups
aboutusbot*
aipbot*
augurfind*
baiduspider*
domainsdb.net*
emailcollector*
emailsiphon*
emailwolf*
extractorpro*
faxobot*
findlinks*
fraserbot*
getright*
gigabot*
girafa*
girafabot*
googlebot-image*
grub-client*
httrack*
iconsurf*
indy library*
larbin*
libwww-perl*
mj12bot*
msnbot-media*
msiecrawler*
net attach*
netresearchserver*
ng*
npbot*
offline explorer*
openintelligence*
panscient.com
psbot*
roverbot*
sbider*
scooter*
searchspider.com*
sitesnagger*
speedy spider*
surveybot*
szukacz*
t-h-u-n-d-e-r-s-t-o-n-e*
teleport*
vscooter*
web downloader*
webcapture*
webcopier*
webenhancer*
webreaper*
websauger*
websearchbench*
website downloader*
webstripper*
webwhacker*
webzip*
wwweasel*
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | /favicon.ico |