Log In Sign Up

gentsnav.com
robots.txt

Robots Exclusion Standard data for gentsnav.com

Resource Scan

Scan Details

Site Domain gentsnav.com
Base Domain gentsnav.com
Scan Status Ok
Last Scan2026-02-03T17:05:47+00:00
Next Scan 2026-03-05T17:05:47+00:00

Last Scan

Scanned2026-02-03T17:05:47+00:00
URL https://gentsnav.com/robots.txt
Redirect https://www.gentsnav.com/robots.txt
Redirect Domain www.gentsnav.com
Redirect Base gentsnav.com
Domain IPs 172.66.40.124, 172.66.43.132, 2606:4700:3108::ac42:287c, 2606:4700:3108::ac42:2b84
Redirect IPs 172.66.40.124, 172.66.43.132, 2606:4700:3108::ac42:287c, 2606:4700:3108::ac42:2b84
Response IP 172.66.40.124
Found Yes
Hash 634f0d725edcdf59ed70080e7a7107e1664386a9a0997714a8ee7ac548aa4144
SimHash 411c4850e5f2

Groups

amazonbot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

arquivo-web-crawler

Rule Path
Disallow /

arquivo-web-crawler

Rule Path
Disallow /

webarchive.loc.gov

Rule Path
Disallow /

*

Rule Path
Disallow
Back to top

Other Records

Field Value
sitemap https://www.gentsnav.com/sitemap.xml
Back to top

Comments

  • Block AI training
  • Block web archives
  • Allow search engines
Back to top