freemusicarchive.org
robots.txt

Robots Exclusion Standard data for freemusicarchive.org

Resource Scan

Scan Details

Site Domain freemusicarchive.org
Base Domain freemusicarchive.org
Scan Status Ok
Last Scan2024-06-12T13:52:54+00:00
Next Scan 2024-06-19T13:52:54+00:00

Last Scan

Scanned2024-06-12T13:52:54+00:00
URL https://freemusicarchive.org/robots.txt
Domain IPs 104.26.10.182, 104.26.11.182, 172.67.73.168, 2606:4700:20::681a:ab6, 2606:4700:20::681a:bb6, 2606:4700:20::ac43:49a8
Response IP 104.26.11.182
Found Yes
Hash 3b932548ef998f2421a16422772cfb5083c824e2821538da25886fb8d0988b83
SimHash 3a2558500517

Groups

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://files.freemusicarchive.org/storage-freemusicarchive-org/sitemaps/sitemap.xml