fr.nextdoor.com
robots.txt
Robots Exclusion Standard data for fr.nextdoor.com
Resource Scan
Scan Details
Site Domain | fr.nextdoor.com |
Base Domain | nextdoor.com |
Scan Status | Ok |
Last Scan | 2024-09-27T14:25:57+00:00 |
Next Scan | 2024-10-04T14:25:57+00:00 |
Last Scan
Scanned | 2024-09-27T14:25:57+00:00 |
URL | https://fr.nextdoor.com/robots.txt |
Domain IPs | 3.161.82.16, 3.161.82.17, 3.161.82.86, 3.161.82.96 |
Response IP | 18.165.140.26 |
Found | Yes |
Hash | a35d75d0131fd0d7ba71ec9e8ccd10d01f8d1e87fb3374b0acbb0a954bf9b8fd |
SimHash | 4854d1505571 |
Groups
googlebot
Rule | Path |
---|---|
Disallow | /join/ |
Disallow | /lidworden/ |
Disallow | /businesses/ |
Disallow | /reset_password/ |
Disallow | /invitation/ |
Disallow | /generic_unsub/ |
Disallow | /inv_unsub/ |
Disallow | /generic_nm_unsub/ |
Disallow | /category_unsub/ |
slurp
Rule | Path |
---|---|
Disallow | /join/ |
Disallow | /lidworden/ |
Disallow | /businesses/ |
Disallow | /reset_password/ |
Disallow | /invitation/ |
Disallow | /generic_unsub/ |
Disallow | /inv_unsub/ |
Disallow | /generic_nm_unsub/ |
Disallow | /category_unsub/ |
msnbot
Rule | Path |
---|---|
Disallow | /join/ |
Disallow | /lidworden/ |
Disallow | /businesses/ |
Disallow | /reset_password/ |
Disallow | /invitation/ |
Disallow | /generic_unsub/ |
Disallow | /inv_unsub/ |
Disallow | /generic_nm_unsub/ |
Disallow | /category_unsub/ |
ia_archiver
Rule | Path |
---|---|
Disallow | /join/ |
Disallow | /lidworden/ |
Disallow | /businesses/ |
Disallow | /reset_password/ |
Disallow | /invitation/ |
Disallow | /generic_unsub/ |
Disallow | /inv_unsub/ |
Disallow | /generic_nm_unsub/ |
Disallow | /category_unsub/ |
teoma
Rule | Path |
---|---|
Disallow | /join/ |
Disallow | /lidworden/ |
Disallow | /businesses/ |
Disallow | /reset_password/ |
Disallow | /invitation/ |
Disallow | /generic_unsub/ |
Disallow | /inv_unsub/ |
Disallow | /generic_nm_unsub/ |
Disallow | /category_unsub/ |
semrushbot
Rule | Path |
---|---|
Disallow | /join/ |
Disallow | /lidworden/ |
Disallow | /businesses/ |
Disallow | /reset_password/ |
Disallow | /invitation/ |
Disallow | /generic_unsub/ |
Disallow | /inv_unsub/ |
Disallow | /generic_nm_unsub/ |
Disallow | /category_unsub/ |
seobility
Rule | Path |
---|---|
Disallow | /join/ |
Disallow | /lidworden/ |
Disallow | /businesses/ |
Disallow | /reset_password/ |
Disallow | /invitation/ |
Disallow | /generic_unsub/ |
Disallow | /inv_unsub/ |
Disallow | /generic_nm_unsub/ |
Disallow | /category_unsub/ |
twitterbot
Rule | Path |
---|---|
Disallow | * |
Allow | /events/ |
Allow | /city/feed/ |
Allow | /city/post/ |
Allow | /agency/ |
Allow | /pages/ |
*
Rule | Path |
---|---|
Disallow | / |
Comments