musicares.org
robots.txt

Robots Exclusion Standard data for musicares.org

Resource Scan

Scan Details

Site Domain musicares.org
Base Domain musicares.org
Scan Status Ok
Last Scan2024-06-02T00:09:30+00:00
Next Scan 2024-06-09T00:09:30+00:00

Last Scan

Scanned2024-06-02T00:09:30+00:00
URL https://musicares.org/robots.txt
Domain IPs 108.157.254.118, 108.157.254.55, 108.157.254.60, 108.157.254.81
Response IP 108.157.254.60
Found Yes
Hash d35d6f33f89c9f78646e335b585166e03da470e482f15f0cb0e8e0a186c0c9b2
SimHash 78045854d7d0

Groups

*

Rule Path
Disallow

googlebot

Rule Path
Disallow

googlebot-news

Rule Path
Disallow

bingbot

Rule Path
Disallow
Disallow /search%3D%26
Disallow /search%3D?
Disallow /search?
Disallow /search*
Disallow /search/*

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.musicares.org/sitemap.xml
sitemap https://www.musicares.org/sitemap_news.xml
sitemap https://www.musicares.org/feed_rss.xml

Comments

  • Paths (no clean URLs)

Warnings

  • 5 invalid lines.