nei.org
robots.txt
Robots Exclusion Standard data for nei.org
Resource Scan
Scan Details
| Site Domain | nei.org |
| Base Domain | nei.org |
| Scan Status | Ok |
| Last Scan | 2025-02-17T13:27:34+00:00 |
| Next Scan | 2025-03-19T13:27:34+00:00 |
Last Scan
| Scanned | 2025-02-17T13:27:34+00:00 |
| URL | https://nei.org/robots.txt |
| Domain IPs | 104.22.8.156, 104.22.9.156, 172.67.28.90, 2606:4700:10::6816:89c, 2606:4700:10::6816:99c, 2606:4700:10::ac43:1c5a |
| Response IP | 104.22.8.156 |
| Found | Yes |
| Hash | bd29f5c75393fca92d0c0331e443a4e19d773c3e9aad95ed5e69266cb851200d |
| SimHash | 801dcef9eca7 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /Search/ |
| Allow | /CorporateSite/media/filefolder |
| Disallow | /CorporateSite/ |
| Disallow | /members/ |
| Disallow | /Accounts/ |
| Disallow | /Archive/ |
| Disallow | /nei-virtual-event-quick-guide/ |
| Disallow | /CERAWeek2023/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |