frontier-justice.com
robots.txt
Robots Exclusion Standard data for frontier-justice.com
Resource Scan
Scan Details
Site Domain | frontier-justice.com |
Base Domain | frontier-justice.com |
Scan Status | Ok |
Last Scan | 2024-10-01T04:55:03+00:00 |
Next Scan | 2024-10-31T04:55:03+00:00 |
Last Scan
Scanned | 2024-10-01T04:55:03+00:00 |
URL | https://frontier-justice.com/robots.txt |
Redirect | https://www.frontier-justice.com/robots.txt |
Redirect Domain | www.frontier-justice.com |
Redirect Base | frontier-justice.com |
Domain IPs | 3.229.145.178 |
Redirect IPs | 108.156.133.5, 108.156.133.68, 108.156.133.88, 108.156.133.91 |
Response IP | 108.156.133.68 |
Found | Yes |
Hash | 68b3ababd2e5c9901f43ffc625ca79e3353990b2c0e3c7e628b3c34314032eae |
SimHash | e721fc4acad3 |
Groups
*
Rule | Path |
---|---|
Disallow | /index.php/ |
Disallow | /*? |
Disallow | /checkout/ |
Disallow | /app/ |
Disallow | /lib/ |
Disallow | /*.php$ |
Disallow | /pkginfo/ |
Disallow | /report/ |
Disallow | /var/ |
Disallow | /catalog/ |
Disallow | /customer/ |
Disallow | /sendfriend/ |
Disallow | /review/ |
Disallow | /*SID%3D |
Other Records
Field | Value |
---|---|
crawl-delay | 15 |