segmentfault.com
robots.txt
Robots Exclusion Standard data for segmentfault.com
Resource Scan
Scan Details
| Site Domain | segmentfault.com |
| Base Domain | segmentfault.com |
| Scan Status | Ok |
| Last Scan | 2024-09-17T22:12:53+00:00 |
| Next Scan | 2024-09-24T22:12:53+00:00 |
Last Scan
| Scanned | 2024-09-17T22:12:53+00:00 |
| URL | https://segmentfault.com/robots.txt |
| Domain IPs | 47.93.92.69 |
| Response IP | 47.93.92.69 |
| Found | Yes |
| Hash | 546a6ff848586221991980dd4cebf3349c0b648a8c18b2dd84e9bba329951078 |
| SimHash | b405e8546a92 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /user/* |
| Disallow | /api/* |
| Disallow | /search?* |
| Disallow | /r/* |
| Disallow | /n/* |
| Disallow | /reco/* |
| Disallow | /*/edit$ |
| Disallow | /*/revision$ |
| Disallow | /ask |
| Disallow | /write |