Log In Sign Up

techtarget.com
robots.txt

Robots Exclusion Standard data for techtarget.com

Resource Scan

Scan Details

Site Domain techtarget.com
Base Domain techtarget.com
Scan Status Ok
Last Scan2024-06-15T00:26:50+00:00
Next Scan 2024-06-22T00:26:50+00:00

Last Scan

Scanned2024-06-15T00:26:50+00:00
URL https://techtarget.com/robots.txt
Redirect https://www.techtarget.com/robots.txt
Redirect Domain www.techtarget.com
Redirect Base techtarget.com
Domain IPs 34.120.117.196
Redirect IPs 104.18.36.196, 172.64.151.60, 2606:4700:4400::6812:24c4, 2606:4700:4400::ac40:973c
Response IP 172.64.151.60
Found Yes
Hash aadaa3724f507ef8d451efb4f5d303fd4bd057e96efacc7ad9c3ea8a813adf0d
SimHash 7bc68780f4a5

Groups

*

Rule Path
Disallow /cdn-cgi/
Disallow /wp-admin/
Disallow /admin/
Disallow /page/etpk_0/
Disallow /search/query?q=*
Disallow /search/query
Disallow /*?s=*
Disallow /es/busqueda/pregunta?q=*
Disallow /es/busqueda/pregunta
Disallow /pt/buscar/pergunta?q=*
Disallow /pt/buscar/pergunta
Disallow /de/suche/frage?q=*
Disallow /de/suche/frage
Disallow /patientengagement/search/query
Disallow /searchnetworking/search/query
Disallow /searchsecurity/search/query
Disallow /searchunifiedcommunications/search/query
Disallow /searchwindowsserver/search/query
Disallow /searchenterpriseai/search/query
Disallow /searchstorage/search/query
Disallow /searchdatabackup/search/query
Disallow /searchapparchitecture/search/query
Disallow /searchcio/search/query
Disallow /searchcloudcomputing/search/query
Disallow /searchmobilecomputing/search/query
Disallow /searcherp/search/query
Disallow /searchhrsoftware/search/query
Disallow /searchdatacenter/search/query
Disallow /searchdisasterrecovery/search/query
Disallow /searchdatamanagement/search/query
Disallow /searchcontentmanagement/search/query
Disallow /searchbusinessanalytics/search/query
Disallow /searchcustomerexperience/search/query
Disallow /searchenterprisedesktop/search/query
Disallow /searchvirtualdesktop/search/query
Disallow /searchitchannel/search/query
Disallow /searchitoperations/search/query
Disallow /searchsoftwarequality/search/query
Disallow /searchaws/search/query
Disallow /searchsap/search/query
Disallow /searchvmware/search/query
Disallow /searchoracle/search/query
Disallow /iotagenda/search/query
Disallow /searchhealthit/search/query
Disallow /whatis/search/query
Disallow /sustainability/search/query

mediapartners-google

Rule Path
Allow /search/
Allow /googleNews.xml

updownerbot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /search/query?q=*
Disallow /search/query
Disallow /*?s=*
Disallow /es/busqueda/pregunta?q=*
Disallow /es/busqueda/pregunta
Disallow /pt/buscar/pergunta?q=*
Disallow /pt/buscar/pergunta
Disallow /de/suche/frage?q=*
Disallow /de/suche/frage

Other Records

Field Value
crawl-delay 3

msnbot

Rule Path
Disallow /search/query?q=*
Disallow /search/query
Disallow /*?s=
Disallow /es/busqueda/pregunta?q=*
Disallow /es/busqueda/pregunta
Disallow /pt/buscar/pergunta?q=*
Disallow /pt/buscar/pergunta
Disallow /de/suche/frage?q=*
Disallow /de/suche/frage

Other Records

Field Value
crawl-delay 3

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 3

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 3
Back to top

Other Records

Field Value
sitemap https://www.techtarget.com/searchnetworking/siteIndex.xml
sitemap https://www.techtarget.com/searchnetworking/googleNews.xml
sitemap https://www.techtarget.com/searchnetworking/siteIndexVideo.xml
sitemap https://www.techtarget.com/searchsecurity/siteIndex.xml
sitemap https://www.techtarget.com/searchsecurity/googleNews.xml
sitemap https://www.techtarget.com/searchsecurity/siteIndexVideo.xml
sitemap https://www.techtarget.com/searchunifiedcommunications/siteIndex.xml
sitemap https://www.techtarget.com/searchunifiedcommunications/googleNews.xml
sitemap https://www.techtarget.com/searchunifiedcommunications/siteIndexVideo.xml
sitemap https://www.techtarget.com/searchwindowsserver/siteIndex.xml
sitemap https://www.techtarget.com/searchwindowsserver/googleNews.xml
sitemap https://www.techtarget.com/searchwindowsserver/siteIndexVideo.xml
sitemap https://www.techtarget.com/searchenterpriseai/siteIndex.xml
sitemap https://www.techtarget.com/searchenterpriseai/googleNews.xml
sitemap https://www.techtarget.com/searchenterpriseai/siteIndexVideo.xml
sitemap https://www.techtarget.com/searchstorage/siteIndex.xml
sitemap https://www.techtarget.com/searchstorage/googleNews.xml
sitemap https://www.techtarget.com/searchstorage/siteIndexVideo.xml
sitemap https://www.techtarget.com/searchdatabackup/siteIndex.xml
sitemap https://www.techtarget.com/searchdatabackup/googleNews.xml
sitemap https://www.techtarget.com/searchdatabackup/siteIndexVideo.xml
sitemap https://www.techtarget.com/searchapparchitecture/siteIndex.xml
sitemap https://www.techtarget.com/searchapparchitecture/googleNews.xml
sitemap https://www.techtarget.com/searchapparchitecture/siteIndexVideo.xml
sitemap https://www.techtarget.com/searchcio/siteIndex.xml
sitemap https://www.techtarget.com/searchcio/googleNews.xml
sitemap https://www.techtarget.com/searchcio/siteIndexVideo.xml
sitemap https://www.techtarget.com/searchcloudcomputing/siteIndex.xml
sitemap https://www.techtarget.com/searchcloudcomputing/googleNews.xml
sitemap https://www.techtarget.com/searchcloudcomputing/siteIndexVideo.xml
sitemap https://www.techtarget.com/searchmobilecomputing/siteIndex.xml
sitemap https://www.techtarget.com/searchmobilecomputing/googleNews.xml
sitemap https://www.techtarget.com/searchmobilecomputing/siteIndexVideo.xml
sitemap https://www.techtarget.com/searcherp/siteIndex.xml
sitemap https://www.techtarget.com/searcherp/googleNews.xml
sitemap https://www.techtarget.com/searcherp/siteIndexVideo.xml
sitemap https://www.techtarget.com/searchhrsoftware/siteIndex.xml
sitemap https://www.techtarget.com/searchhrsoftware/googleNews.xml
sitemap https://www.techtarget.com/searchhrsoftware/siteIndexVideo.xml
sitemap https://www.techtarget.com/searchdatacenter/siteIndex.xml
sitemap https://www.techtarget.com/searchdatacenter/googleNews.xml
sitemap https://www.techtarget.com/searchdatacenter/siteIndexVideo.xml
sitemap https://www.techtarget.com/searchdisasterrecovery/siteIndex.xml
sitemap https://www.techtarget.com/searchdisasterrecovery/googleNews.xml
sitemap https://www.techtarget.com/searchdisasterrecovery/siteIndexVideo.xml
sitemap https://www.techtarget.com/searchdatamanagement/siteIndex.xml
sitemap https://www.techtarget.com/searchdatamanagement/googleNews.xml
sitemap https://www.techtarget.com/searchdatamanagement/siteIndexVideo.xml
sitemap https://www.techtarget.com/searchcontentmanagement/siteIndex.xml
sitemap https://www.techtarget.com/searchcontentmanagement/googleNews.xml
sitemap https://www.techtarget.com/searchcontentmanagement/siteIndexVideo.xml
sitemap https://www.techtarget.com/searchbusinessanalytics/siteIndex.xml
sitemap https://www.techtarget.com/searchbusinessanalytics/googleNews.xml
sitemap https://www.techtarget.com/searchbusinessanalytics/siteIndexVideo.xml
sitemap https://www.techtarget.com/searchcustomerexperience/siteIndex.xml
sitemap https://www.techtarget.com/searchcustomerexperience/googleNews.xml
sitemap https://www.techtarget.com/searchcustomerexperience/siteIndexVideo.xml
sitemap https://www.techtarget.com/searchenterprisedesktop/siteIndex.xml
sitemap https://www.techtarget.com/searchenterprisedesktop/googleNews.xml
sitemap https://www.techtarget.com/searchenterprisedesktop/siteIndexVideo.xml
sitemap https://www.techtarget.com/searchvirtualdesktop/siteIndex.xml
sitemap https://www.techtarget.com/searchvirtualdesktop/googleNews.xml
sitemap https://www.techtarget.com/searchvirtualdesktop/siteIndexVideo.xml
sitemap https://www.techtarget.com/searchitchannel/siteIndex.xml
sitemap https://www.techtarget.com/searchitchannel/googleNews.xml
sitemap https://www.techtarget.com/searchitchannel/siteIndexVideo.xml
sitemap https://www.techtarget.com/searchitoperations/siteIndex.xml
sitemap https://www.techtarget.com/searchitoperations/googleNews.xml
sitemap https://www.techtarget.com/searchitoperations/siteIndexVideo.xml
sitemap https://www.techtarget.com/searchsoftwarequality/siteIndex.xml
sitemap https://www.techtarget.com/searchsoftwarequality/googleNews.xml
sitemap https://www.techtarget.com/searchsoftwarequality/siteIndexVideo.xml
sitemap https://www.techtarget.com/searchsap/siteIndex.xml
sitemap https://www.techtarget.com/searchsap/googleNews.xml
sitemap https://www.techtarget.com/searchsap/siteIndexVideo.xml
sitemap https://www.techtarget.com/searchaws/siteIndex.xml
sitemap https://www.techtarget.com/searchaws/googleNews.xml
sitemap https://www.techtarget.com/searchaws/siteIndexVideo.xml
sitemap https://www.techtarget.com/searchvmware/siteIndex.xml
sitemap https://www.techtarget.com/searchvmware/googleNews.xml
sitemap https://www.techtarget.com/searchvmware/siteIndexVideo.xml
sitemap https://www.techtarget.com/iotagenda/siteIndex.xml
sitemap https://www.techtarget.com/iotagenda/googleNews.xml
sitemap https://www.techtarget.com/iotagenda/siteIndexVideo.xml
sitemap https://www.techtarget.com/searchoracle/siteIndex.xml
sitemap https://www.techtarget.com/searchoracle/googleNews.xml
sitemap https://www.techtarget.com/searchoracle/siteIndexVideo.xml
sitemap https://www.techtarget.com/searchhealthit/siteIndex.xml
sitemap https://www.techtarget.com/searchhealthit/googleNews.xml
sitemap https://www.techtarget.com/searchhealthit/siteIndexVideo.xml
sitemap https://www.techtarget.com/whatis/siteIndex.xml
sitemap https://www.techtarget.com/whatis/googleNews.xml
sitemap https://www.techtarget.com/whatis/siteIndexVideo.xml
sitemap https://www.techtarget.com/sustainability/siteIndex.xml
sitemap https://www.techtarget.com/sustainability/googleNews.xml
sitemap https://www.techtarget.com/sustainability/siteIndexVideo.xml
sitemap https://www.techtarget.com/patientengagement/siteIndex.xml
sitemap https://www.techtarget.com/patientengagement/googleNews.xml
Back to top

Warnings

  • 2 invalid lines.
Back to top