sfhiv.org
robots.txt

Robots Exclusion Standard data for sfhiv.org

Resource Scan

Scan Details

Site Domain sfhiv.org
Base Domain sfhiv.org
Scan Status Ok
Last Scan2025-11-09T10:12:12+00:00
Next Scan 2025-12-09T10:12:12+00:00

Last Scan

Scanned2025-11-09T10:12:12+00:00
URL https://sfhiv.org/robots.txt
Redirect https://www.sfhiv.net/robots.txt
Redirect Domain www.sfhiv.net
Redirect Base sfhiv.net
Domain IPs 104.21.44.33, 172.67.194.161, 2606:4700:3030::ac43:c2a1, 2606:4700:3034::6815:2c21
Redirect IPs 104.21.34.130, 172.67.161.67, 2606:4700:3031::ac43:a143, 2606:4700:3036::6815:2282
Response IP 104.21.34.130
Found Yes
Hash a82ce667ed4cde75a5f364b7001b819aa22e61d7e4af29965f194a7cd429f284
SimHash 28599cd2a346

Groups

*

Rule Path
Disallow /cgi-bin
Disallow /wp-admin
Disallow /trackback
Disallow */trackback
Disallow */*/trackback
Disallow */*/feed/*/
Disallow */feed

ahrefsbot

Rule Path
Disallow /

waybackmachine

Rule Path
Disallow /

iaarchiver

Rule Path
Disallow /

heritrix

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.sfhiv.org/sitemap_index.xml