pentera.io
robots.txt
Robots Exclusion Standard data for pentera.io
Resource Scan
Scan Details
Site Domain | pentera.io |
Base Domain | pentera.io |
Scan Status | Ok |
Last Scan | 2024-09-30T15:05:07+00:00 |
Next Scan | 2024-10-30T15:05:07+00:00 |
Last Scan
Scanned | 2024-09-30T15:05:07+00:00 |
URL | https://pentera.io/robots.txt |
Domain IPs | 141.193.213.20, 141.193.213.21 |
Response IP | 141.193.213.20 |
Found | Yes |
Hash | 8bc092a8538d8e664550b3fd9070088115ccad67ff95cc086be40476a863dc85 |
SimHash | d109fe00ce83 |
Groups
*
Rule | Path |
---|---|
Disallow | /wp-admin/ |
Disallow | */feed/ |
Disallow | /feed/ |
Allow | *.js |
Allow | *.css |
Allow | /wp-admin/admin-ajax.php |
*
Rule | Path |
---|---|
Disallow | /wp-content/uploads/wp-import-export-lite/ |
Other Records
Field | Value |
---|---|
sitemap | https://pentera.io/sitemap_index.xml |
Comments