hitsdailydouble.com
robots.txt

Robots Exclusion Standard data for hitsdailydouble.com

Resource Scan

Scan Details

Site Domain hitsdailydouble.com
Base Domain hitsdailydouble.com
Scan Status Ok
Last Scan2024-05-27T13:42:07+00:00
Next Scan 2024-06-26T13:42:07+00:00

Last Scan

Scanned2024-05-27T13:42:07+00:00
URL https://hitsdailydouble.com/robots.txt
Domain IPs 172.66.40.151, 172.66.43.105, 2606:4700:3108::ac42:2897, 2606:4700:3108::ac42:2b69
Response IP 172.66.43.105
Found Yes
Hash 72d6f9c2eea89066270f4bc06959c29910965957f5f407c2766956d808579b4e
SimHash 4876d4d2c545

Groups

*

Rule Path
Allow /
Disallow /inc/
Disallow /js/
Disallow /css/
Disallow /tools/
Allow /inc/css/
Disallow /text_search

Other Records

Field Value
crawl-delay 10

bingbot

Rule Path
Allow /
Allow /js/s101_admin
Disallow /js/s101_admin/popups/

googlebot

Rule Path
Allow /
Allow /js/s101_admin
Disallow /js/s101_admin/popups/

slurp

Rule Path
Allow /
Allow /js/s101_admin
Disallow /js/s101_admin/popups/

duckduckbot

Rule Path
Allow /
Allow /js/s101_admin
Disallow /js/s101_admin/popups/

baiduspider

Rule Path
Allow /
Allow /js/s101_admin
Disallow /js/s101_admin/popups/

facebot

Rule Path
Allow /
Allow /js/s101_admin
Disallow /js/s101_admin/popups/

ia_archiver

Rule Path
Allow /
Allow /js/s101_admin
Disallow /js/s101_admin/popups/

bingbot

Rule Path
Allow /
Allow /js/s101_admin
Disallow /js/s101_admin/tour/

googlebot

Rule Path
Allow /
Allow /js/s101_admin
Disallow /js/s101_admin/tour/

slurp

Rule Path
Allow /
Allow /js/s101_admin
Disallow /js/s101_admin/tour/

duckduckbot

Rule Path
Allow /
Allow /js/s101_admin
Disallow /js/s101_admin/tour/

baiduspider

Rule Path
Allow /
Allow /js/s101_admin
Disallow /js/s101_admin/tour/

facebot

Rule Path
Allow /
Allow /js/s101_admin
Disallow /js/s101_admin/tour/

ia_archiver

Rule Path
Allow /
Allow /js/s101_admin
Disallow /js/s101_admin/tour/

spbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

wormly

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

blekkobot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

megaindex.com/crawler

Rule Path
Disallow /

Other Records

Field Value
sitemap https://m.hitsdailydouble.com/sitemap.xml

Comments

  • E-mail webmaster@section101.com if you're authorized to access this site, but getting denied.