globaltestsupply.com
robots.txt
Robots Exclusion Standard data for globaltestsupply.com
Resource Scan
Scan Details
Site Domain | globaltestsupply.com |
Base Domain | globaltestsupply.com |
Scan Status | Ok |
Last Scan | 2024-09-25T19:43:54+00:00 |
Next Scan | 2024-10-25T19:43:54+00:00 |
Last Scan
Scanned | 2024-09-25T19:43:54+00:00 |
URL | https://www.globaltestsupply.com/robots.txt |
Domain IPs | 104.239.197.129 |
Response IP | 104.239.197.129 |
Found | Yes |
Hash | 9d8755560a1f154cda29e5703058810248d744f4e28581a845a3a0844bfdfea8 |
SimHash | 560e9dd22c99 |
Groups
facebookexternalhit
facebookcatalog
No rules defined. All paths allowed.
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
*
Rule | Path |
---|---|
Disallow | /shop/* |
Disallow | /content/privacy-security.html |
Disallow | /products/tes* |
Disallow | /content/resources.html |
Disallow | /brands/chase-instruments/ph-water-quality-hydrometers |
Disallow | /brands/baker/moisture-and-humidity-accessories |
Disallow | /brands/baker/psychrometer |
Disallow | /files/R-Support/* |
Disallow | /product/duracell-am2x-battery-c-cell |
Disallow | /product/duracell-am1x-battery-d-cell |
Disallow | /brands/duracell |
Disallow | /content/30-day-returns.html |
Disallow | /content/save5-promo-code |
Disallow | /content/credit-info |
Disallow | /content/exclusive-promotions |
Disallow | /files/Metermaid-Recall-June2018.pdf |
Disallow | /files/Metermaid-Recall-June2018-PMS.pdf |
Disallow | /ajax/* |
Disallow | /orders/bankInformation/ |
Disallow | /content/extra5-promo-code |
Disallow | /fr/information/code-promo-extra5 |
Disallow | /online/exx-series-advanced-thermal-imaging-cameras-from-flir |
Disallow | /app/ip_info/Visitor/CountryCode |
Disallow | /content/sales-terms |
Disallow | /content/return |
Disallow | /content/Enbridgecontract |
Disallow | /pdfs/resources/link-only/FLIR-What-Do-You-Need-to-Measure-2022-Brochures.pdf |
Disallow | /files/REED-CAD-PRICING-2023.pdf |
Disallow | /files/REED-USD-PRICING-2023.pdf |
Disallow | /files/REED-CAD-PRICING-2023.xlsx |
Disallow | /files/REED-USD-PRICING-2023.xlsx |
Disallow | /files/itm-gts-2024-media-kit.pdf |
Other Records
Field | Value |
---|---|
crawl-delay | 2 |
Other Records
Field | Value |
---|---|
sitemap | http://www.globaltestsupply.com/sitemap.xml |
Comments