discountasp.net
robots.txt
Robots Exclusion Standard data for discountasp.net
Resource Scan
Scan Details
Site Domain | discountasp.net |
Base Domain | discountasp.net |
Scan Status | Ok |
Last Scan | 2024-09-04T07:05:25+00:00 |
Next Scan | 2024-10-04T07:05:25+00:00 |
Last Scan
Scanned | 2024-09-04T07:05:25+00:00 |
URL | https://discountasp.net/robots.txt |
Domain IPs | 104.26.6.59, 104.26.7.59, 172.67.71.11, 2606:4700:20::681a:63b, 2606:4700:20::681a:73b, 2606:4700:20::ac43:470b |
Response IP | 104.26.6.59 |
Found | Yes |
Hash | e29cca4005152a8de573de99cd410a1d5abd4a0748367629b40c7525e6f90a9a |
SimHash | 8959da95c793 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /policies/default.aspx |
Disallow | /policies/terms-and-conditions/default.aspx |
Disallow | /policies/acceptable-use/default.aspx |
Disallow | /policies/domain-agreement/default.aspx |
Disallow | /policies/affiliate-agreement/default.aspx |
Disallow | /policies/privacy/default.aspx |
Disallow | /about-us/careers/default.aspx |
Disallow | /tfs-hosting/policies/default.aspx |
Disallow | /tfs-hosting/policies/terms-and-conditions/default.aspx |
Disallow | /tfs-hosting/policies/sla/default.aspx |
Other Records
Field | Value |
---|---|
sitemap | http://www.discountasp.net/sitemap.xml.gz |
sitemap | https://online.webceo.com/submission/smaps/9a7dc68e.xml.gz |