americanfireglass.com
robots.txt
Robots Exclusion Standard data for americanfireglass.com
Resource Scan
Scan Details
| Site Domain | americanfireglass.com |
| Base Domain | americanfireglass.com |
| Scan Status | Ok |
| Last Scan | 2024-09-08T22:05:51+00:00 |
| Next Scan | 2024-10-08T22:05:51+00:00 |
Last Scan
| Scanned | 2024-09-08T22:05:51+00:00 |
| URL | https://americanfireglass.com/robots.txt |
| Domain IPs | 199.189.224.204 |
| Response IP | 199.189.224.204 |
| Found | Yes |
| Hash | 29d2d0d8650c7234fd0ad359296f79ec43bfccd08a667293974e092ab8c3eccb |
| SimHash | 74385c56ea51 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | |
| Disallow | |
| Disallow | /catalogpdf |
| Disallow | /checkout |
| Disallow | /sale |
| Disallow | /index.php |
| Disallow | /paymentprofile |
| Disallow | /afg |
| Disallow | /outdoor |
| Disallow | /media |
| Disallow | /blog |
| Disallow | /Matt |
| Disallow | /investor-relation |
| Disallow | /catalog |
| Disallow | /oneclickorder |
| Disallow | /careerform |
| Disallow | /contacts |
| Disallow | /product |
| Disallow | /gallery |
| Disallow | /p/ |
| Disallow | /inspiration/index |
| Disallow | /catalogsearch/result |
| Disallow | /onlinedealers?pid |
| Disallow | /catalog/product/view/id |
| Disallow | /black-friday-sales |
| Disallow | /12-days-of-deals |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
Warnings
- 2 invalid lines.
- `user agent` is not a known field.