andys.md
robots.txt

Robots Exclusion Standard data for andys.md

Resource Scan

Scan Details

Site Domain andys.md
Base Domain andys.md
Scan Status Ok
Last Scan2024-09-22T08:22:24+00:00
Next Scan 2024-10-22T08:22:24+00:00

Last Scan

Scanned2024-09-22T08:22:24+00:00
URL https://andys.md/robots.txt
Domain IPs 194.33.40.143
Response IP 194.33.40.143
Found Yes
Hash 43a69690e171e584013e5ad938c32b9bacb6fd9b812e64d5253a41eaeaf752ab
SimHash 2910a3334699

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /tmp/
Disallow /?s=
Disallow /search/
Disallow /*/feed/
Disallow /trackback/
Allow *.js
Allow *.css
Allow /amp

*

Rule Path
Disallow /cpzlab.com

googlebot-mobile

Rule Path
Allow /

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

googlebot-video

Rule Path
Allow /

bingbot

Rule Path
Allow /

slurp

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

msnbot

Rule Path
Allow /

yahoo pipes 1.0

Rule Path
Allow /

yahoo! slurp

Rule Path
Allow /

baiduspider

Rule Path
Allow /

baiduspider-news

Rule Path
Allow /

baiduspider-image

Rule Path
Allow /

yandexbot

Rule Path
Allow /

yandeximages

Rule Path
Allow /

yandexnews

Rule Path
Allow /

yandexwebmaster

Rule Path
Allow /

yandexpagechecker

Rule Path
Allow /

zyborg

Rule Path
Allow /

exabot

Rule Path
Allow /

facebot

Rule Path
Allow /

ia_archiver

Rule Path
Allow /

archive.org_bot

Rule Path
Allow /

architextspider

Rule Path
Allow /

feedfetcher-google

Rule Path
Allow /

linkedinbot

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.andys.md/theme/sitemap.xml

Warnings

  • 2 invalid lines.