dy2077.com
robots.txt

Robots Exclusion Standard data for dy2077.com

Resource Scan

Scan Details

Site Domain dy2077.com
Base Domain dy2077.com
Scan Status Ok
Last Scan2024-05-28T17:16:45+00:00
Next Scan 2024-06-27T17:16:45+00:00

Last Scan

Scanned2024-05-28T17:16:45+00:00
URL https://dy2077.com/robots.txt
Domain IPs 154.38.91.152
Response IP 154.38.91.152
Found Yes
Hash 4682b883db6f46a4040c35954e0e4fd7b8c284fd54da07493c8e4b524d291177
SimHash d8dd5b63ee88

Groups

*

Rule Path
Disallow /*.php/*
Disallow /template/
Disallow /static/
Disallow /wp-*
Disallow /*?*

mj12bot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

dataforseo-bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

mail.ru

Rule Path
Disallow /

extlinksbot

Rule Path
Disallow /

aihitbot

Rule Path
Disallow /

researchscan

Rule Path
Disallow /

dnyzbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

googlebot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

censysinspect

Rule Path
Disallow /

ahrefs

Rule Path
Disallow /

seostar

Rule Path
Disallow /

webmeup-crawler

Rule Path
Disallow /

facebot

Rule Path
Disallow /

twitterbot

Rule Path
Disallow /

uptimebot

Rule Path
Disallow /

Other Records

Field Value
sitemap /rss/baidu.xml
sitemap /rss/bing.xml
sitemap /rss/sogou.xml
sitemap /rss/so.xml
sitemap /rss/google.xml