econsumer.gov
robots.txt
Robots Exclusion Standard data for econsumer.gov
Resource Scan
Scan Details
| Site Domain | econsumer.gov |
| Base Domain | econsumer.gov |
| Scan Status | Ok |
| Last Scan | 2026-02-08T06:08:22+00:00 |
| Next Scan | 2026-03-10T06:08:22+00:00 |
Last Scan
| Scanned | 2026-02-08T06:08:22+00:00 |
| URL | https://econsumer.gov/robots.txt |
| Domain IPs | 3.171.198.111, 3.171.198.65, 3.171.198.69, 3.171.198.95 |
| Response IP | 3.171.198.65 |
| Found | Yes |
| Hash | 467afe937401044730493d29bf37d2c8116cf6cd28b50bf1ee84718947e2c1a0 |
| SimHash | 115674f3e4e8 |
Groups
*
| Rule | Path | Comment |
|---|---|---|
| Disallow | - | |
| Disallow | /admin/ | Admin pages |
| Disallow | /login/ | Login pages |
| Disallow | /register/ | Registration pages |
| Disallow | /api/ | API endpoints |
| Disallow | /_framework/ | Framework files |
| Disallow | /_content/ | Static content not meant for indexing |
| Disallow | /assets/ | Internal assets like JS, CSS, images |
| Disallow | /error/ | Error pages |
| Disallow | /private/ | Private data and files |
Comments