Log In Sign Up

audioboo.org
robots.txt

Robots Exclusion Standard data for audioboo.org

Resource Scan

Scan Details

Site Domain audioboo.org
Base Domain audioboo.org
Scan Status Ok
Last Scan2024-09-18T22:35:53+00:00
Next Scan 2024-09-25T22:35:53+00:00

Last Scan

Scanned2024-09-18T22:35:53+00:00
URL https://audioboo.org/robots.txt
Domain IPs 104.21.19.198, 172.67.188.152, 2606:4700:3030::ac43:bc98, 2606:4700:3035::6815:13c6
Response IP 104.21.19.198
Found Yes
Hash 8946321d8b01710c2e4c407d8a74205d55f223ee5aadea272b1ad33fe56d14f7
SimHash 4c078c53c71c

Groups

semrushbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

vkrobotrb

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

*

Rule Path
Disallow /engine/
Disallow /engine/download.php
Disallow /*?*
Disallow */favorites/*/
Disallow */favorites/
Allow */xfsearch/cikl/*
Allow */xfsearch/avtora/*
Disallow */xfsearch/*/
Disallow */orderdesc/*
Disallow */f/*
Allow /ads.txt

Other Records

Field Value
crawl-delay 2.0
Back to top

Other Records

Field Value
sitemap http://audioboo.org/sitemap.xml
Back to top

Warnings

  • `host` is not a known field.
Back to top