dandyhorse.cc
robots.txt

Robots Exclusion Standard data for dandyhorse.cc

Resource Scan

Scan Details

Site Domain dandyhorse.cc
Base Domain dandyhorse.cc
Scan Status Ok
Last Scan2025-07-14T19:40:25+00:00
Next Scan 2025-08-13T19:40:25+00:00

Last Scan

Scanned2025-07-14T19:40:25+00:00
URL https://dandyhorse.cc/robots.txt
Domain IPs 145.223.119.226
Response IP 145.223.119.226
Found Yes
Hash 04342df1a8ad17b2d28b5ffa334ddaa5f427b95ae406d1c0542d911b620966aa
SimHash 6a045b214a3d

Groups

*

Rule Path
Disallow /cgi-bin
Disallow /wp-admin/
Disallow /*add-to-cart%3D*
Disallow *?attachment_id=
Disallow */embed
Disallow *utm%3D
Disallow */wlwmanifest.xml
Disallow /readme.html
Disallow /*?s=*
Disallow /?jsf=*
Disallow /?fbclid=*
Allow /wp-admin/admin-ajax.php

googlebot-image

Rule Path
Allow /
Disallow

mediapartners-google

Rule Path
Allow /
Disallow

adsbot-google

Rule Path
Allow /

adsbot-google-mobile

Rule Path
Allow /

bingbot

Rule Path
Allow /

msnbot

Rule Path
Allow /

msnbot-media

Rule Path
Allow /wp-content/uploads/

applebot

Rule Path
Allow /

yandeximages

Rule Path
Allow /wp-content/uploads/

slurp

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

qwantify

Rule Path
Allow /

baiduspider

Rule Path
Allow /

baiduspider/2.0

Rule Path
Allow /

baiduspider-video

Rule Path
Allow /

baiduspider-image

Rule Path
Allow /

sogou spider

Rule Path
Allow /

sogou web spider

Rule Path
Allow /

sosospider

Rule Path
Allow /

sosospider+

Rule Path
Allow /

sosospider/2.0

Rule Path
Allow /

yodao

Rule Path
Allow /

youdao

Rule Path
Allow /

youdaobot

Rule Path
Allow /

youdaobot/1.0

Rule Path
Allow /

facebookexternalhit/1.0

Rule Path
Allow /

facebookexternalhit/1.1

Rule Path
Allow /

facebookplatform/1.0

Rule Path
Allow /

facebot/1.0

Rule Path
Allow /

visionutils/0.2

Rule Path
Allow /

datagnionbot

Rule Path
Allow /

twitterbot

Rule Path
Allow /

linkedinbot/1.0

Rule Path
Allow /

pinterest/0.1

Rule Path
Allow /

pinterest/0.2

Rule Path
Allow /

petalbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://dandyhorse.cc/sitemaps.xml

Warnings

  • `host` is not a known field.