adviserinfo.sec.gov
robots.txt
Robots Exclusion Standard data for adviserinfo.sec.gov
Resource Scan
Scan Details
Site Domain | adviserinfo.sec.gov |
Base Domain | sec.gov |
Scan Status | Ok |
Last Scan | 2024-05-20T23:28:51+00:00 |
Next Scan | 2024-06-19T23:28:51+00:00 |
Last Scan
Scanned | 2024-05-20T23:28:51+00:00 |
URL | https://adviserinfo.sec.gov/robots.txt |
Domain IPs | 104.18.39.8, 172.64.148.248, 2606:4700:4400::6812:2708, 2606:4700:4400::ac40:94f8 |
Response IP | 172.64.148.248 |
Found | Yes |
Hash | 770f62ad2eff853e71b95432b7c0df923258c120324527fc943ee30fb9f4785e |
SimHash | 4801dc558577 |
Groups
*
Rule | Path |
---|---|
Disallow | /IAPD/WebLock |
Disallow | /IAPD/content/viewform/adv*.aspx |
Disallow | /firm/brochure/ |
Disallow | /IAPD/Content/Common/crd_iapd_Brochure.aspx |
Disallow | /firm/accountsuprise/ |
Other Records
Field | Value |
---|---|
sitemap | https://reports.adviserinfo.sec.gov/seo/sitemap.xml |