bentanner.com
robots.txt
Robots Exclusion Standard data for bentanner.com
Resource Scan
Scan Details
| Site Domain | bentanner.com |
| Base Domain | bentanner.com |
| Scan Status | Ok |
| Last Scan | 2025-09-13T22:25:49+00:00 |
| Next Scan | 2025-09-27T22:25:49+00:00 |
Last Scan
| Scanned | 2025-09-13T22:25:49+00:00 |
| URL | https://www.bentanner.com/robots.txt |
| Domain IPs | 69.22.188.40, 69.22.188.41 |
| Response IP | 69.22.188.41 |
| Found | Yes |
| Hash | fb153deca82138971f96ea19cdce5a2065fed23e5e378e722538bb04f9e96152 |
| SimHash | d00eccceef44 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /adm/ |
| Disallow | /ajax/ |
| Disallow | /com/ |
| Disallow | /ext/ |
| Disallow | /ltr/ |
| Disallow | /mem/ |
| Disallow | /mu/ |
| Disallow | /pp/ |
| Disallow | /ezp/ |
| Disallow | /cart/ |
| Disallow | /c/*/login |
| Disallow | /c/*/signup* |
| Disallow | /fees |
| Disallow | /signup/trial |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.bentanner.com/user-sitemap/sitemap-U0000nEbaAE8jUPs/0.xml.gz |
Comments