globaltestsupply.com
robots.txt

Robots Exclusion Standard data for globaltestsupply.com

Resource Scan

Scan Details

Site Domain globaltestsupply.com
Base Domain globaltestsupply.com
Scan Status Ok
Last Scan2024-09-25T19:43:54+00:00
Next Scan 2024-10-25T19:43:54+00:00

Last Scan

Scanned2024-09-25T19:43:54+00:00
URL https://www.globaltestsupply.com/robots.txt
Domain IPs 104.239.197.129
Response IP 104.239.197.129
Found Yes
Hash 9d8755560a1f154cda29e5703058810248d744f4e28581a845a3a0844bfdfea8
SimHash 560e9dd22c99

Groups

ahrefsbot

Rule Path
Disallow /

awariobot
awariosmartbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

coccocbot
coccocbot-image
coccocbot-web

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

domainstatsbot

Rule Path
Disallow /

dotbot
dotbot

Rule Path
Disallow /

ezlynx
ezoic
ezoic

Rule Path
Disallow /

facebookexternalhit
facebookcatalog

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

friendlycrawler

Rule Path
Disallow /

geedobot
geedo

Rule Path
Disallow /

keys-so-bot

Rule Path
Disallow /

linguee

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mojeekbot

Rule Path
Disallow /

orbbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

seekport crawler
seekportbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

tineye

Rule Path
Disallow /

*

Rule Path
Disallow /shop/*
Disallow /content/privacy-security.html
Disallow /products/tes*
Disallow /content/resources.html
Disallow /brands/chase-instruments/ph-water-quality-hydrometers
Disallow /brands/baker/moisture-and-humidity-accessories
Disallow /brands/baker/psychrometer
Disallow /files/R-Support/*
Disallow /product/duracell-am2x-battery-c-cell
Disallow /product/duracell-am1x-battery-d-cell
Disallow /brands/duracell
Disallow /content/30-day-returns.html
Disallow /content/save5-promo-code
Disallow /content/credit-info
Disallow /content/exclusive-promotions
Disallow /files/Metermaid-Recall-June2018.pdf
Disallow /files/Metermaid-Recall-June2018-PMS.pdf
Disallow /ajax/*
Disallow /orders/bankInformation/
Disallow /content/extra5-promo-code
Disallow /fr/information/code-promo-extra5
Disallow /online/exx-series-advanced-thermal-imaging-cameras-from-flir
Disallow /app/ip_info/Visitor/CountryCode
Disallow /content/sales-terms
Disallow /content/return
Disallow /content/Enbridgecontract
Disallow /pdfs/resources/link-only/FLIR-What-Do-You-Need-to-Measure-2022-Brochures.pdf
Disallow /files/REED-CAD-PRICING-2023.pdf
Disallow /files/REED-USD-PRICING-2023.pdf
Disallow /files/REED-CAD-PRICING-2023.xlsx
Disallow /files/REED-USD-PRICING-2023.xlsx
Disallow /files/itm-gts-2024-media-kit.pdf

Other Records

Field Value
crawl-delay 2

Other Records

Field Value
sitemap http://www.globaltestsupply.com/sitemap.xml

Comments

  • Facebook crawlers
  • Ref: https://developers.facebook.com/docs/sharing/webmasters/crawler/