birdsong.fm
robots.txt

Robots Exclusion Standard data for birdsong.fm

Resource Scan

Scan Details

Site Domain birdsong.fm
Base Domain birdsong.fm
Scan Status Ok
Last Scan2024-09-20T00:06:36+00:00
Next Scan 2024-09-27T00:06:36+00:00

Last Scan

Scanned2024-09-20T00:06:36+00:00
URL https://birdsong.fm/robots.txt
Redirect https://www.birdsong.fm/robots.txt
Redirect Domain www.birdsong.fm
Redirect Base birdsong.fm
Domain IPs 199.34.228.59
Redirect IPs 199.34.228.59
Response IP 199.34.228.59
Found Yes
Hash dfdd40cc355b68967cd0a3a951c444f84c0d7ae94ab3b6a4433d8f43d8d4449b
SimHash 4954dc766f93

Groups

nerdybot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /ajax/
Disallow /apps/

Other Records

Field Value
sitemap https://www.birdsong.fm/sitemap.xml