Log In Sign Up

audioknigi-lib-mp3.com
robots.txt

Robots Exclusion Standard data for audioknigi-lib-mp3.com

Resource Scan

Scan Details

Site Domain audioknigi-lib-mp3.com
Base Domain audioknigi-lib-mp3.com
Scan Status Ok
Last Scan2024-10-02T00:22:12+00:00
Next Scan 2024-11-01T00:22:12+00:00

Last Scan

Scanned2024-10-02T00:22:12+00:00
URL https://audioknigi-lib-mp3.com/robots.txt
Domain IPs 195.161.68.104
Response IP 195.161.68.104
Found Yes
Hash 2919917c72841d4791147386fca1c1c3d62614808b8888bfb3ae527427dddd2f
SimHash 426cdc416692

Groups

*

Rule Path
Disallow /search/
Disallow /reader/
Disallow /promo/
Disallow /knigi/read-book/
Disallow /view/
Disallow /*.mp3$

googlebot

Rule Path
Disallow /search/
Disallow /reader/
Disallow /promo/
Disallow /knigi/read-book/
Disallow /view/
Disallow /*.mp3$
Allow /

googlebot-image

Rule Path
Allow /

mediapartners-google

Rule Path
Disallow /*.mp3$
Allow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

megaindex.ru
megaindex
megaindex.com

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /
Back to top

Warnings

  • `host` is not a known field.
Back to top