jeffknupp.com
robots.txt

Robots Exclusion Standard data for jeffknupp.com

Resource Scan

Scan Details

Site Domain jeffknupp.com
Base Domain jeffknupp.com
Scan Status Ok
Last Scan2026-01-23T15:43:30+00:00
Next Scan 2026-01-30T15:43:30+00:00

Last Scan

Scanned2026-01-23T15:43:30+00:00
URL https://jeffknupp.com/robots.txt
Redirect https://socolivetvo.cc/robots.txt
Redirect Domain socolivetvo.cc
Redirect Base socolivetvo.cc
Domain IPs 104.21.23.187, 172.67.212.191, 2606:4700:3034::6815:17bb, 2606:4700:3037::ac43:d4bf
Redirect IPs 104.18.8.5, 104.18.9.5, 2606:4700::6812:805, 2606:4700::6812:905
Response IP 104.18.9.5
Found Yes
Hash 159283058b2045bfa8b84b850fc38a8ad4456340364bfb49cea4197f641744bb
SimHash 6b08d804cbb2

Groups

*

Rule Path
Allow /
Disallow /wp-admin/
Disallow /*/trackback
Disallow /img/
Disallow /tag/
Disallow /feed
Disallow /*/feed
Disallow /?s=*
Disallow /?link=*
Disallow /attachment/
Disallow /author/
Disallow /page/*
Disallow /*?utm_source
Disallow /*%26utm_source

facebookexternalhit

Rule Path
Allow /

Other Records

Field Value
sitemap https://socolivetvo.cc/sitemap.xml

Comments

  • Allow Facebook scraper