njbeachcams.com
robots.txt

Robots Exclusion Standard data for njbeachcams.com

Resource Scan

Scan Details

Site Domain njbeachcams.com
Base Domain njbeachcams.com
Scan Status Ok
Last Scan2024-11-07T22:42:56+00:00
Next Scan 2024-11-14T22:42:56+00:00

Last Scan

Scanned2024-11-07T22:42:56+00:00
URL https://njbeachcams.com/robots.txt
Domain IPs 104.21.68.235, 172.67.200.58, 2606:4700:3032::ac43:c83a, 2606:4700:3036::6815:44eb
Response IP 104.21.68.235
Found Yes
Hash b0ebf582a38d51682f0bc1717a9efb4564c2a756ed73481b1d40314749092c28
SimHash 4c141b755590

Groups

*

Rule Path
Allow /*.js*
Allow /*.css*
Allow /*.png*
Allow /*.jpg*
Allow /*.gif*
Disallow /cache/
Disallow /cli/
Disallow /tmp/

googlebot

Rule Path
Disallow /beach-cams/

Other Records

Field Value
sitemap https://njbeachcams.com/sitemap_index.xml