pelicanparts.com
robots.txt
Robots Exclusion Standard data for pelicanparts.com
Resource Scan
Scan Details
| Site Domain | pelicanparts.com |
| Base Domain | pelicanparts.com |
| Scan Status | Failed |
| Failure Reason | Scan timed out. |
| Last Scan | 2024-06-11T23:42:37+00:00 |
| Next Scan | 2024-07-11T23:42:37+00:00 |
Last Successful Scan
| Scanned | 2024-05-13T20:28:05+00:00 |
| URL | https://pelicanparts.com/robots.txt |
| Redirect | https://www.pelicanparts.com/robots.txt |
| Redirect Domain | www.pelicanparts.com |
| Redirect Base | pelicanparts.com |
| Domain IPs | 23.251.218.5 |
| Redirect IPs | 23.251.218.5 |
| Response IP | 23.251.218.5 |
| Found | Yes |
| Hash | 45fecfc74559796f60859197b47da7c134e440442a1cfd9e2b05c264ea5d0b2b |
| SimHash | 414c1502d19a |
Groups
adsbot-google
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin/ksearch/ |
| Disallow | /cgi-bin/dbsql/db.cgi |
| Disallow | /cgi-bin/smart/S-mart.cgi |
| Disallow | /cgi-bin/smart/s-mart.cgi |
| Disallow | /cgi-bin/smart/SuperCart-2014.cgi |
| Disallow | /cgi-bin/smart/oboe/track_lookup.pl |
| Disallow | /cgi-bin/smart/oboe/track.pl |
| Disallow | /cgi-bin/smart/SuperCart-Track.cgi |
| Disallow | /cgi-bin/pmpre/ |
| Disallow | /cgi-bin/PerlDesk/ |
| Disallow | /cgi-bin/SuperCat/ |
| Disallow | /cgi-bin/tell_friend/ |
| Disallow | /cgi-bin/Wizards/ |
| Disallow | /cgi-bin/register/ |
| Disallow | /cgi-bin/webadverts/ |
| Disallow | /catalog/SuperCat/z_Archive |
| Disallow | /catalog/SuperCat_mobile/ |
| Disallow | /catalog/SuperCat/SuperCatPS9/ |
| Disallow | /catalog/SuperCat/SuperCatPS9_mobile/ |
| Disallow | /catalog/SuperCat/SuperCatPS10/ |
| Disallow | /catalog/SuperCat/SuperCatPS10_mobile/ |
| Disallow | /catalog/SuperCat/SuperCatPS11/ |
| Disallow | /catalog/SuperCat/SuperCatPS11_mobile/ |
| Disallow | /catalog/SuperCat/SuperCatPS12/ |
| Disallow | /catalog/SuperCat/SuperCatPS12_mobile/ |
| Disallow | /catalog/SuperCat/SuperCatPS13/ |
| Disallow | /catalog/SuperCat/SuperCatPS13_mobile/ |
| Disallow | /cgi-bin/autocat/load_page.cgi |
| Disallow | /cgi-bin/perldesk/pdesk.cgi |
| Disallow | /byv-*/p-* |
| Disallow | /byc-*/p-* |
| Disallow | /byb-*/p-* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.pelicanparts.com/static_pages_HTTPS.xml.gz |
| sitemap | https://www.pelicanparts.com/SubCat_SiteMap_HTTPS.xml |
| sitemap | https://www.pelicanparts.com/Catalog_SiteMap_HTTPS.xml |
| sitemap | https://www.pelicanparts.com/catalog/SuperCat/SuperCat_SiteMap_index_HTTPS.xml |
| sitemap | https://www.pelicanparts.com/Sitemaps/Genuine_Parts_Sitemap-Index_https.xml |
| sitemap | https://www.pelicanparts.com/shopby-sitemap.xml |