935thebeach.com
robots.txt

Robots Exclusion Standard data for 935thebeach.com

Resource Scan

Scan Details

Site Domain 935thebeach.com
Base Domain 935thebeach.com
Scan Status Ok
Last Scan2024-05-24T13:18:29+00:00
Next Scan 2024-06-23T13:18:29+00:00

Last Scan

Scanned2024-05-24T13:18:29+00:00
URL https://935thebeach.com/robots.txt
Redirect https://www.935thebeach.com/robots.txt
Redirect Domain www.935thebeach.com
Redirect Base 935thebeach.com
Domain IPs 34.250.153.99
Redirect IPs 18.155.202.33, 18.155.202.35, 18.155.202.9, 18.155.202.91
Response IP 108.157.52.100
Found Yes
Hash 341243bb9c601ba97b7a7dc4a041df4495b50b6761df703bbbd816070e3330f1
SimHash 6d3c5414cdd1

Groups

*

Rule Path
Disallow /_hp/
Disallow /artist/
Disallow /searchresults/

Other Records

Field Value
crawl-delay 8

Other Records

Field Value
sitemap https://www.935thebeach.com/sitemap.xml