targethd.net
robots.txt

Robots Exclusion Standard data for targethd.net

Resource Scan

Scan Details

Site Domain targethd.net
Base Domain targethd.net
Scan Status Ok
Last Scan2024-11-15T14:12:03+00:00
Next Scan 2024-11-22T14:12:03+00:00

Last Scan

Scanned2024-11-15T14:12:03+00:00
URL https://targethd.net/robots.txt
Redirect https://www.targethd.net/robots.txt
Redirect Domain www.targethd.net
Redirect Base targethd.net
Domain IPs 104.21.2.69, 172.67.128.220, 2606:4700:3034::6815:245, 2606:4700:3037::ac43:80dc
Redirect IPs 104.21.2.69, 172.67.128.220, 2606:4700:3034::6815:245, 2606:4700:3037::ac43:80dc
Response IP 104.21.2.69
Found Yes
Hash 335b8d9da63ea74a443d2c8c1dfe8a7816d7c03cfc2f188ae8b191cdca1612ef
SimHash 632451cc41bc

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /wp-content/uploads/wpo/wpo-plugins-tables-list.json
Allow /*/*.css
Allow /*/*.js
Disallow /wp-includes/
Disallow /readme.html
Disallow /license.txt
Disallow /xmlrpc.php
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /*/disclaimer/*
Disallow /*?attachment_id=%2F
Disallow /privacy-policy/
Disallow /uploads/wpo-plugins-tables-list.json
Disallow /wp-content/uploads/wpo-plugins-tables-list.json

googlebot

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

adsbot-google-mobile

Rule Path
Allow /

bingbot

Rule Path
Allow /

msnbot

Rule Path
Allow /

applebot

Rule Path
Allow /

yandex

Rule Path
Allow /

slurp

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

qwantify

Rule Path
Allow /
Disallow /feed/
Disallow /feed/%24/
Disallow /comments/feed/
Disallow /trackback/
Disallow /*/?author=*
Disallow /*/author/*
Disallow /author*
Disallow /author/
Disallow /*/comments%24/
Disallow /*/feed%24/
Disallow /*/trackback/
Disallow /*/trackback%24/
Disallow /?feed=%2F
Disallow /wp-comments/
Disallow /wp-feed/
Disallow /wp-trackback/
Disallow /*/replytocom%3D/
Disallow /wp-content/uploads/wpo-plugins-tables-list.json

Other Records

Field Value
sitemap https://www.targethd.net/sitemap.xml
sitemap https://www.targethd.net/sitemap.rss