barnegatathletics.com
robots.txt
Robots Exclusion Standard data for barnegatathletics.com
Resource Scan
Scan Details
| Site Domain | barnegatathletics.com |
| Base Domain | barnegatathletics.com |
| Scan Status | Ok |
| Last Scan | 2024-07-01T12:29:20+00:00 |
| Next Scan | 2024-07-08T12:29:20+00:00 |
Last Scan
| Scanned | 2024-07-01T12:29:20+00:00 |
| URL | https://barnegatathletics.com/robots.txt |
| Domain IPs | 34.202.151.185, 52.200.79.233, 54.158.12.24, 54.208.187.92 |
| Response IP | 34.202.151.185 |
| Found | Yes |
| Hash | 31c22a6c23b55e0abcea3b92f74280fe8c64ee279436a3c217a85c7f04f038a7 |
| SimHash | ab86e482c371 |
Groups
amazon-kendra
| Product | Comment |
|---|---|
| amazon-kendra | Amazon Kendra Web Crawler |
| Rule | Path | Comment |
|---|---|---|
| Disallow | / | disallow access to any pages |
*
| Rule | Path |
|---|---|
| Disallow | /admin/ |
| Disallow | /cfformprotect/ |
| Disallow | /cftags/ |
| Disallow | /common/ |
| Disallow | /config/ |
| Disallow | /export/ |
| Disallow | /fonts/ |
| Disallow | /frameworks/ |
| Disallow | /img/ |
| Disallow | /includes/ |
| Disallow | /layouts/ |
| Disallow | /model/ |
| Disallow | /modules/ |
| Disallow | /services/ |
| Disallow | /src/ |
| Disallow | /udf/ |
| Disallow | /WEB-INF/ |