Log In Sign Up

beno.com
robots.txt

Robots Exclusion Standard data for beno.com

Resource Scan

Scan Details

Site Domain beno.com
Base Domain beno.com
Scan Status Ok
Last Scan2024-05-18T10:17:05+00:00
Next Scan 2024-06-01T10:17:05+00:00

Last Scan

Scanned2024-05-18T10:17:05+00:00
URL https://beno.com/robots.txt
Redirect https://www.beno.com/robots.txt
Redirect Domain www.beno.com
Redirect Base beno.com
Domain IPs 18.155.68.104, 18.155.68.116, 18.155.68.34, 18.155.68.84, 2600:9000:23d2:2600:1e:e6f2:68c0:93a1, 2600:9000:23d2:3c00:1e:e6f2:68c0:93a1, 2600:9000:23d2:4800:1e:e6f2:68c0:93a1, 2600:9000:23d2:6a00:1e:e6f2:68c0:93a1, 2600:9000:23d2:7a00:1e:e6f2:68c0:93a1, 2600:9000:23d2:800:1e:e6f2:68c0:93a1, 2600:9000:23d2:b800:1e:e6f2:68c0:93a1, 2600:9000:23d2:fa00:1e:e6f2:68c0:93a1
Redirect IPs 54.192.18.39, 54.192.18.41, 54.192.18.54, 54.192.18.71
Response IP 13.33.88.114
Found Yes
Hash 315a91a1b95af68c9bdadbe5948bc8a012bdf327876835ec84101cbe9604e5f9
SimHash 4a1509100bd1

Groups

*

Rule Path
Disallow /*.json$
Disallow /*.js$
Disallow /error

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow
Back to top

Other Records

Field Value
sitemap https://www.beno.com/sitemap.xml
Back to top

Comments

  • Block files ending in .json and any other JS files
  • The asterisks allows any file name
  • The dollar sign ensures it only matches the end of an URL and not a oddly formatted url (e.g. /locations.json.html)
Back to top