dhdl.info
robots.txt
Robots Exclusion Standard data for dhdl.info
Resource Scan
Scan Details
| Site Domain | dhdl.info |
| Base Domain | dhdl.info |
| Scan Status | Ok |
| Last Scan | 2024-09-30T18:50:28+00:00 |
| Next Scan | 2024-10-07T18:50:28+00:00 |
Last Scan
| Scanned | 2024-09-30T18:50:28+00:00 |
| URL | https://dhdl.info/robots.txt |
| Redirect | https://www.dhdl.info/robots.txt |
| Redirect Domain | www.dhdl.info |
| Redirect Base | dhdl.info |
| Domain IPs | 104.21.93.192, 172.67.214.6, 2606:4700:3030::ac43:d606, 2606:4700:3036::6815:5dc0 |
| Redirect IPs | 104.21.93.192, 172.67.214.6, 2606:4700:3030::ac43:d606, 2606:4700:3036::6815:5dc0 |
| Response IP | 172.67.214.6 |
| Found | Yes |
| Hash | 5c2fcd7bd42de2326caff95b3be5a85e7a1dec237a75da5645beaa4031bc5b4a |
| SimHash | d95f49b2c8b2 |
Groups
googlebot-image
| Rule | Path |
|---|---|
| Disallow | /asa/ |
| Disallow | /assets/themes/d-h-d-l/images/avatar/ |
| Disallow | /youtube/ |
aboundexbot
ahrefsbot
aihitbot
archive.org_bot
backlinkcrawler
baiduspider
ccbot
cliqzbot
domaincrawler
dotbot
easouspider
ec2linkfinder
exabot
ezooms
fetch
genieo
gptbot
go-http-client/2.0
grub-client
httrack
ia_archiver
ia_archiver-web.archive.org
ia_archiver/1.6
infopath
infopath.2
ip-web-crawler.com
libwww
linkpadbot
mail.ru
meanpathbot
microsoft.url.control
mj12bot
mozilla/4.0
msiecrawler
netestate ne crawler
npbot
offline explorer
panscient.com
petalbot
psbot
screaming frog seo spider
searchmetericsbot
searchspider
semrushbot
seokicks-robot
seznambot
sitebot
sitecheck.internetseer.com
sitesnagger
sosospider
spbot
swebot
taptubot
teleport
teleportpro
turnitinbot
twengabot
twiceler
ubicrawler
vscooter
wbsearchbot
webcapture
webcopier
webreaper
webstripper
webzip
wget
wget
wotbox
xenu
xenu's
xenu's link sleuth 1.1c
yandex
zealbot
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | *%26preview%3D* |
| Disallow | *?s=* |
| Disallow | /?s= |
| Disallow | /comments/ |
| Disallow | */comments/ |
| Disallow | /feed/ |
| Disallow | */feed/ |
| Disallow | /rss/ |
| Disallow | */rss/ |
| Disallow | /trackback/ |
| Disallow | */trackback/ |
| Disallow | /cgi-bin/ |
| Disallow | /logs/ |
| Disallow | /usage/ |
| Disallow | /wp-admin/ |
| Allow | /wp-admin/admin-ajax.php |
| Disallow | /webalizer/ |
| Disallow | /assets/plugins/ |
| Disallow | /assets/upgrade/ |
| Disallow | /zu/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.dhdl.info/sitemap_index.xml |
Comments