Log In Sign Up

firstsightone.com
robots.txt

Robots Exclusion Standard data for firstsightone.com

Resource Scan

Scan Details

Site Domain firstsightone.com
Base Domain firstsightone.com
Scan Status Ok
Last Scan2026-02-24T04:15:24+00:00
Next Scan 2026-03-03T04:15:24+00:00

Last Scan

Scanned2026-02-24T04:15:24+00:00
URL https://www.firstsightone.com/robots.txt
Domain IPs 142.251.12.121, 2404:6800:4003:c05::79
Response IP 172.217.194.121
Found Yes
Hash 1352a4af8245126235790052b0c77964afc5b03591ffa855da48918d56745543
SimHash e112c811e5b3

Groups

*

Rule Path
Disallow /search/
Disallow /comments/
Disallow /archive/
Disallow /feeds/
Disallow /label/
Disallow /*?updated-max=
Disallow /*?updated-min=
Disallow /*?max-results=
Disallow /*?m=0
Back to top

Other Records

Field Value
sitemap https://www.firstsightone.com/sitemap.xml
Back to top

Comments

  • Allow all search engines to crawl main content
  • Optional: Block low-value pages if needed
  • Disallow: /privacy-policy/
  • Disallow: /terms-of-service/
  • Sitemap location
Back to top