Log In Sign Up

alexannesty.com
robots.txt

Robots Exclusion Standard data for alexannesty.com

Resource Scan

Scan Details

Site Domain alexannesty.com
Base Domain alexannesty.com
Scan Status Ok
Last Scan2025-12-12T21:27:42+00:00
Next Scan 2025-12-19T21:27:42+00:00

Last Scan

Scanned2025-12-12T21:27:42+00:00
URL https://alexannesty.com/robots.txt
Domain IPs 77.72.2.76
Response IP 77.72.2.76
Found Yes
Hash bc716e2cc99c3b33a590dce51ca6d447ad7ce1d392b1f828f1da7f6838107bfc
SimHash 87095ce18f63

Groups

*

Rule Path
Disallow /flb/
Back to top

Other Records

Field Value
sitemap http://alexannesty.com/sitemap.xml
Back to top

Comments

  • robots.txt
  • @version 2.1.0
  • @updated 12/09/19
  • ~project Alex Annesty
  • ~frameless 2.0.0
  • ~source_file robots.txt
  • ~source_version 2.0.1
  • Usage:
  • Add 'Disallow: /' below 'User-agent: *' to tell robots not to spider test + dev websites
  • Add 'Disallow: /dirname/' below 'User-agent: *' for each directory you want robots to ignore
  • Do not combine 'Disallow: /' with any other 'Disallow:' statements
Back to top