soundsnap.com
robots.txt

Robots Exclusion Standard data for soundsnap.com

Resource Scan

Scan Details

Site Domain soundsnap.com
Base Domain soundsnap.com
Scan Status Ok
Last Scan2024-04-29T04:23:36+00:00
Next Scan 2024-05-29T04:23:36+00:00

Last Scan

Scanned2024-04-29T04:23:36+00:00
URL https://soundsnap.com/robots.txt
Redirect https://www.soundsnap.com/robots.txt
Redirect Domain www.soundsnap.com
Redirect Base soundsnap.com
Domain IPs 216.239.32.21
Redirect IPs 2404:6800:4003:c1c::79, 74.125.24.121
Response IP 142.251.175.121
Found Yes
Hash 4e32c89bad38a0b3c2dd6dc7bc4f0ae4238211106cbaf7cf10ca2702785a54ea
SimHash e814d92586d3

Groups

*

Rule Path
Disallow /audio/download/
Disallow /audio/mp3/
Disallow /files/
Disallow /search/
Disallow /favorite_nodes/
Disallow /user/
Disallow /u/
Disallow /streamers/
Disallow /api/recurly/log/
Disallow /themes/
Disallow /modules/
Allow /themes/*/assets/
Allow /themes/*/js/
Allow /themes/*/css/
Allow /themes/*/*.css$
Disallow /*/feed$
Allow /tags/feed
Disallow /node/add

Other Records

Field Value
sitemap https://www.soundsnap.com/sitemap.xml

Comments

  • Website Sitemap
  • Directories
  • URLs
  • 'feed' is a valid tag