socolivepp.cc
robots.txt

Robots Exclusion Standard data for socolivepp.cc

Resource Scan

Scan Details

Site Domain socolivepp.cc
Base Domain socolivepp.cc
Scan Status Ok
Last Scan5/24/2025, 12:33:47 PM
Next Scan 6/23/2025, 12:33:47 PM

Last Scan

Scanned5/24/2025, 12:33:47 PM
URL https://socolivepp.cc/robots.txt
Redirect https://harvardarabalumni.org/robots.txt
Redirect Domain harvardarabalumni.org
Redirect Base harvardarabalumni.org
Domain IPs 104.21.85.220, 172.67.211.191, 2606:4700:3034::6815:55dc, 2606:4700:3037::ac43:d3bf
Redirect IPs 104.21.54.138, 172.67.138.251, 2606:4700:3030::6815:368a, 2606:4700:3032::ac43:8afb
Response IP 104.21.54.138
Found Yes
Hash 05a864b425faa7add391e4ff8e2f940eb1dbe293bc33467ddd195b0de8513673
SimHash 6a08d804c3ba

Groups

*

Rule Path
Allow /
Disallow /wp-admin/
Disallow /*/trackback
Disallow /img/
Disallow /tag/
Disallow /feed
Disallow /*/feed
Disallow /?s=*
Disallow /?link=*
Disallow /attachment/
Disallow /author/
Disallow /page/*
Disallow /*?utm_source
Disallow /*%26utm_source

facebookexternalhit

Rule Path
Allow /

Other Records

Field Value
sitemap https://harvardarabalumni.org/sitemap.xml

Comments

  • Allow Facebook scraper