Log In Sign Up

unitedhardware.com
robots.txt

Robots Exclusion Standard data for unitedhardware.com

Resource Scan

Scan Details

Site Domain unitedhardware.com
Base Domain unitedhardware.com
Scan Status Ok
Last Scan2024-09-22T15:50:39+00:00
Next Scan 2024-10-22T15:50:39+00:00

Last Scan

Scanned2024-09-22T15:50:39+00:00
URL https://unitedhardware.com/robots.txt
Redirect https://www.unitedhardware.com/robots.txt
Redirect Domain www.unitedhardware.com
Redirect Base unitedhardware.com
Domain IPs 104.26.4.89, 104.26.5.89, 172.67.69.134, 2606:4700:20::681a:459, 2606:4700:20::681a:559, 2606:4700:20::ac43:4586
Redirect IPs 104.18.34.50, 172.64.153.206, 2606:4700:4400::6812:2232, 2606:4700:4400::ac40:99ce
Response IP 104.18.34.50
Found Yes
Hash 2b1c1a58b6415a511eedb2848419630eeb4fc57a362856b8f1b1130d9be89ae0
SimHash 6e5d0701c7d5

Groups

googlebot

Rule Path
Allow /$
Allow /sitemapindex.xml
Allow /sitemap1.xml
Allow /about-us/
Allow /SDSOnRequest/
Allow /Services/it-resources-retail-data-store-technology/contact-us-it
Allow /Marketing/
Allow /Marketing/buying-markets
Allow /Marketing/hardware-hank
Allow /Support/ContactUs
Allow /Support/severe-weather-notice
Allow /MyAccount/ResetPassword
Allow /SignIn
Allow /TransparencyInCoverage
Allow /TermsandConditions
Disallow /

bingbot

Rule Path
Allow /$
Allow /sitemapindex.xml
Allow /sitemap1.xml
Allow /about-us/
Allow /SDSOnRequest/
Allow /Services/it-resources-retail-data-store-technology/contact-us-it
Allow /Marketing/
Allow /Marketing/buying-markets
Allow /Marketing/hardware-hank
Allow /Support/ContactUs
Allow /Support/severe-weather-notice
Allow /MyAccount/ResetPassword
Allow /SignIn
Allow /TransparencyInCoverage
Allow /TermsandConditions
Disallow /

*

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.unitedhardware.com/sitemapindex.xml
Back to top

Comments

  • allow: /$ #not all bot follow this standard
Back to top