prod-photos.nextdoor.com
robots.txt
Robots Exclusion Standard data for prod-photos.nextdoor.com
Resource Scan
Scan Details
Site Domain | prod-photos.nextdoor.com |
Base Domain | nextdoor.com |
Scan Status | Ok |
Last Scan | 2024-05-08T04:55:50+00:00 |
Next Scan | 2024-05-15T04:55:50+00:00 |
Last Scan
Scanned | 2024-05-08T04:55:50+00:00 |
URL | https://prod-photos.nextdoor.com/robots.txt |
Domain IPs | 13.226.225.106, 13.226.225.116, 13.226.225.123, 13.226.225.56 |
Response IP | 18.165.171.24 |
Found | Yes |
Hash | a35d75d0131fd0d7ba71ec9e8ccd10d01f8d1e87fb3374b0acbb0a954bf9b8fd |
SimHash | 4854d1505571 |
Groups
googlebot
Rule | Path |
---|---|
Disallow | /join/ |
Disallow | /lidworden/ |
Disallow | /businesses/ |
Disallow | /reset_password/ |
Disallow | /invitation/ |
Disallow | /generic_unsub/ |
Disallow | /inv_unsub/ |
Disallow | /generic_nm_unsub/ |
Disallow | /category_unsub/ |
slurp
Rule | Path |
---|---|
Disallow | /join/ |
Disallow | /lidworden/ |
Disallow | /businesses/ |
Disallow | /reset_password/ |
Disallow | /invitation/ |
Disallow | /generic_unsub/ |
Disallow | /inv_unsub/ |
Disallow | /generic_nm_unsub/ |
Disallow | /category_unsub/ |
msnbot
Rule | Path |
---|---|
Disallow | /join/ |
Disallow | /lidworden/ |
Disallow | /businesses/ |
Disallow | /reset_password/ |
Disallow | /invitation/ |
Disallow | /generic_unsub/ |
Disallow | /inv_unsub/ |
Disallow | /generic_nm_unsub/ |
Disallow | /category_unsub/ |
ia_archiver
Rule | Path |
---|---|
Disallow | /join/ |
Disallow | /lidworden/ |
Disallow | /businesses/ |
Disallow | /reset_password/ |
Disallow | /invitation/ |
Disallow | /generic_unsub/ |
Disallow | /inv_unsub/ |
Disallow | /generic_nm_unsub/ |
Disallow | /category_unsub/ |
teoma
Rule | Path |
---|---|
Disallow | /join/ |
Disallow | /lidworden/ |
Disallow | /businesses/ |
Disallow | /reset_password/ |
Disallow | /invitation/ |
Disallow | /generic_unsub/ |
Disallow | /inv_unsub/ |
Disallow | /generic_nm_unsub/ |
Disallow | /category_unsub/ |
semrushbot
Rule | Path |
---|---|
Disallow | /join/ |
Disallow | /lidworden/ |
Disallow | /businesses/ |
Disallow | /reset_password/ |
Disallow | /invitation/ |
Disallow | /generic_unsub/ |
Disallow | /inv_unsub/ |
Disallow | /generic_nm_unsub/ |
Disallow | /category_unsub/ |
seobility
Rule | Path |
---|---|
Disallow | /join/ |
Disallow | /lidworden/ |
Disallow | /businesses/ |
Disallow | /reset_password/ |
Disallow | /invitation/ |
Disallow | /generic_unsub/ |
Disallow | /inv_unsub/ |
Disallow | /generic_nm_unsub/ |
Disallow | /category_unsub/ |
twitterbot
Rule | Path |
---|---|
Disallow | * |
Allow | /events/ |
Allow | /city/feed/ |
Allow | /city/post/ |
Allow | /agency/ |
Allow | /pages/ |
*
Rule | Path |
---|---|
Disallow | / |
Comments