nextdoor.de
robots.txt
Robots Exclusion Standard data for nextdoor.de
Resource Scan
Scan Details
Site Domain | nextdoor.de |
Base Domain | nextdoor.de |
Scan Status | Ok |
Last Scan | 2024-09-18T17:21:54+00:00 |
Next Scan | 2024-09-25T17:21:54+00:00 |
Last Scan
Scanned | 2024-09-18T17:21:54+00:00 |
URL | https://nextdoor.de/robots.txt |
Domain IPs | 3.164.182.124, 3.164.182.13, 3.164.182.16, 3.164.182.75 |
Response IP | 18.165.140.47 |
Found | Yes |
Hash | a35d75d0131fd0d7ba71ec9e8ccd10d01f8d1e87fb3374b0acbb0a954bf9b8fd |
SimHash | 4854d1505571 |
Groups
googlebot
Rule | Path |
---|---|
Disallow | /join/ |
Disallow | /lidworden/ |
Disallow | /businesses/ |
Disallow | /reset_password/ |
Disallow | /invitation/ |
Disallow | /generic_unsub/ |
Disallow | /inv_unsub/ |
Disallow | /generic_nm_unsub/ |
Disallow | /category_unsub/ |
slurp
Rule | Path |
---|---|
Disallow | /join/ |
Disallow | /lidworden/ |
Disallow | /businesses/ |
Disallow | /reset_password/ |
Disallow | /invitation/ |
Disallow | /generic_unsub/ |
Disallow | /inv_unsub/ |
Disallow | /generic_nm_unsub/ |
Disallow | /category_unsub/ |
msnbot
Rule | Path |
---|---|
Disallow | /join/ |
Disallow | /lidworden/ |
Disallow | /businesses/ |
Disallow | /reset_password/ |
Disallow | /invitation/ |
Disallow | /generic_unsub/ |
Disallow | /inv_unsub/ |
Disallow | /generic_nm_unsub/ |
Disallow | /category_unsub/ |
ia_archiver
Rule | Path |
---|---|
Disallow | /join/ |
Disallow | /lidworden/ |
Disallow | /businesses/ |
Disallow | /reset_password/ |
Disallow | /invitation/ |
Disallow | /generic_unsub/ |
Disallow | /inv_unsub/ |
Disallow | /generic_nm_unsub/ |
Disallow | /category_unsub/ |
teoma
Rule | Path |
---|---|
Disallow | /join/ |
Disallow | /lidworden/ |
Disallow | /businesses/ |
Disallow | /reset_password/ |
Disallow | /invitation/ |
Disallow | /generic_unsub/ |
Disallow | /inv_unsub/ |
Disallow | /generic_nm_unsub/ |
Disallow | /category_unsub/ |
semrushbot
Rule | Path |
---|---|
Disallow | /join/ |
Disallow | /lidworden/ |
Disallow | /businesses/ |
Disallow | /reset_password/ |
Disallow | /invitation/ |
Disallow | /generic_unsub/ |
Disallow | /inv_unsub/ |
Disallow | /generic_nm_unsub/ |
Disallow | /category_unsub/ |
seobility
Rule | Path |
---|---|
Disallow | /join/ |
Disallow | /lidworden/ |
Disallow | /businesses/ |
Disallow | /reset_password/ |
Disallow | /invitation/ |
Disallow | /generic_unsub/ |
Disallow | /inv_unsub/ |
Disallow | /generic_nm_unsub/ |
Disallow | /category_unsub/ |
twitterbot
Rule | Path |
---|---|
Disallow | * |
Allow | /events/ |
Allow | /city/feed/ |
Allow | /city/post/ |
Allow | /agency/ |
Allow | /pages/ |
*
Rule | Path |
---|---|
Disallow | / |
Comments