businessexpress.ny.gov
robots.txt
Robots Exclusion Standard data for businessexpress.ny.gov
Resource Scan
Scan Details
Site Domain | businessexpress.ny.gov |
Base Domain | ny.gov |
Scan Status | Ok |
Last Scan | 2024-08-28T18:59:41+00:00 |
Next Scan | 2024-09-27T18:59:41+00:00 |
Last Scan
Scanned | 2024-08-28T18:59:41+00:00 |
URL | https://businessexpress.ny.gov/robots.txt |
Redirect | https://www.businessexpress.ny.gov/robots.txt |
Redirect Domain | www.businessexpress.ny.gov |
Redirect Base | ny.gov |
Domain IPs | 129.152.92.105 |
Redirect IPs | 129.152.92.105 |
Response IP | 129.152.92.105 |
Found | Yes |
Hash | e5b1c4d367c9d4bb60f441da8507f5fdef2b9efa71df97f60edd7ea81793e2fb |
SimHash | 2412c260e952 |
Groups
*
Product | Comment |
---|---|
* | CUSTOM # CUSTOM |
Rule | Path | Comment |
---|---|---|
Disallow | /app/IFCPages/ | CUSTOM # CUSTOM |
Disallow | /app/bw_checklist/ | CUSTOM # CUSTOM |
Disallow | /app/iw_checklist/ | CUSTOM # CUSTOM |
Disallow | /app/dashboard/ | CUSTOM # CUSTOM |
Disallow | /euf/assets/ | CUSTOM # CUSTOM |
Disallow | /app/bw_checklist/ | CUSTOM # CUSTOM |
*
Product | Comment |
---|---|
* | ADDED BY HMS |
Rule | Path | Comment |
---|---|---|
Disallow | / | ADDED BY HMS |