techdata.com
robots.txt

Robots Exclusion Standard data for techdata.com

Resource Scan

Scan Details

Site Domain techdata.com
Base Domain techdata.com
Scan Status Ok
Last Scan2024-10-21T06:10:28+00:00
Next Scan 2024-11-20T06:10:28+00:00

Last Scan

Scanned2024-10-21T06:10:28+00:00
URL https://techdata.com/robots.txt
Redirect https://www.techdata.com/robots.txt
Redirect Domain www.techdata.com
Redirect Base techdata.com
Domain IPs 45.60.103.47, 45.60.31.47
Redirect IPs 45.60.35.47
Response IP 45.60.35.47
Found Yes
Hash 3acb08209fc4ab18cd5649bcb0217029da3eaa361f370720ba2ff45a128bb42d
SimHash 89043c208c20

Groups

*

Rule Path
Disallow /cen/
Disallow /content/cen/
Disallow /content/Content/cen/
Disallow /content/Reseller/secure/cen/
Disallow /content/cfra/
Disallow /content/Reseller/secure/cfra/
Disallow /content/service/
Disallow /reseller/
Disallow /business/
Disallow /tools/
Disallow /apcc/
Disallow /tdmobility/
Disallow /shop/
Disallow /order/
Disallow /aces/
Disallow /beyondtrust/
Disallow /portal/
Disallow /security/
Disallow /images/
Allow /techsolutions/security
Disallow /techsolutions/
Disallow /tdengage/
Disallow /api/
Disallow /TDSKUSelector.aspx?q=addressbook
Disallow /bridge.aspx?strurl=%2Fcontent%2Fvisitor%2Fabouttd%2Flogoguide.aspx
Disallow *.pdf
Disallow /annualprograms/

Other Records

Field Value
sitemap https://www.techdata.com/us/sitemap.xml