Log In Sign Up

songsterr.com
robots.txt

Robots Exclusion Standard data for songsterr.com

Resource Scan

Scan Details

Site Domain songsterr.com
Base Domain songsterr.com
Scan Status Ok
Last Scan2024-11-13T17:29:14+00:00
Next Scan 2024-11-20T17:29:14+00:00

Last Scan

Scanned2024-11-13T17:29:14+00:00
URL https://songsterr.com/robots.txt
Redirect https://www.songsterr.com/robots.txt
Redirect Domain www.songsterr.com
Redirect Base songsterr.com
Domain IPs 2600:1f18:b31:eb01::c1, 2600:1f18:b31:eb02::c2, 2600:1f18:b31:eb03::c3, 3.219.44.66, 34.202.113.218, 44.195.180.112
Redirect IPs 2600:1f18:b31:eb01::c1, 2600:1f18:b31:eb02::c2, 2600:1f18:b31:eb03::c3, 3.219.44.66, 34.202.113.218, 44.195.180.112
Response IP 3.219.44.66
Found Yes
Hash 973dc9698afdef367e56dec11a5f2fd04209ff2bc926d9b8f63fc926a9c6b4a6
SimHash 41805c60de11

Groups

*

Rule Path
Disallow /a/wo/
Disallow /a/ajax/
Disallow /store/
Disallow /Environ/wo/
Disallow /wo/
Disallow /ajax/
Disallow /11209340/
Disallow /a/wa/Revisions/
Disallow /a/wa/CollaborationAction/
Disallow /a/wa/CrowdfundingAction/
Disallow /a/wa/FavoriteToggleAction/
Disallow /a/wa/TabRequestsAction/
Disallow /a/wa/user
Disallow /a/wa/song
Disallow /a/wsa/*?*nocrawl=1
Disallow /guru.png
Disallow /page/
Disallow /api/
Disallow /a/wsa/*?redesign=on
Disallow /a/wsa/*?redesign=off
Disallow /watch?v=*

mediapartners-google

Rule Path
Allow /a/wo/
Allow /wo/

proximic

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1
Back to top

Other Records

Field Value
sitemap https://www.songsterr.com/sitemap.xml
Back to top

Warnings

  • 4 invalid lines.
Back to top