Log In Sign Up

gravitywaves.com
robots.txt

Robots Exclusion Standard data for gravitywaves.com

Resource Scan

Scan Details

Site Domain gravitywaves.com
Base Domain gravitywaves.com
Scan Status Ok
Last Scan2025-10-23T21:38:26+00:00
Next Scan 2025-10-30T21:38:26+00:00

Last Scan

Scanned2025-10-23T21:38:26+00:00
URL http://gravitywaves.com/robots.txt
Domain IPs 157.245.169.113
Response IP 157.245.169.113
Found Yes
Hash c1eb34b759c6501bd97dff284a21a7b725dd6f6077c935dedaac06472afad5cf
SimHash bd042fc06ed0

Groups

*

Rule Path
Disallow /bm
Back to top

Comments

  • Robots.txt file for http://www.GravityWaves.com/bm*
  • Robots.txt file for http://www.GravityWaves.com/re*
  • All robots will spider the domain
  • turn off inapprpriate directories
  • Disallow: /chem
  • Disallow: /re
  • ===========================================
  • The following from Last.fm's robots.txt file
  • courtesy Wired.com
  • Disallow: /harming/humans
  • Disallow: /ignoring/human/orders
  • Disallow: /harm/to/self
Back to top