kaufmanit.com
robots.txt

Robots Exclusion Standard data for kaufmanit.com

Resource Scan

Scan Details

Site Domain kaufmanit.com
Base Domain kaufmanit.com
Scan Status Ok
Last Scan2026-01-22T08:43:25+00:00
Next Scan 2026-02-21T08:43:25+00:00

Last Scan

Scanned2026-01-22T08:43:25+00:00
URL https://kaufmanit.com/robots.txt
Domain IPs 104.26.4.140, 104.26.5.140, 172.67.71.147, 2606:4700:20::681a:48c, 2606:4700:20::681a:58c, 2606:4700:20::ac43:4793
Response IP 104.26.5.140
Found Yes
Hash b6304582967be7c15dbc3d85c439d1c338f16919c9c393f9f761eeeac5241aa7
SimHash 6c0058d2c593

Groups

*

Rule Path
Disallow /feed/
Disallow /rss/
Disallow /rss2/
Disallow /comments/feed/
Disallow /*?utm_source
Disallow /*?utm_medium
Disallow /*?utm_campaign
Disallow /*?trk=
Disallow /*?ref=
Disallow /search/
Disallow /page/
Allow /

Other Records

Field Value
sitemap https://kaufmanit.com/sitemap.xml

Comments

  • Block WordPress feeds
  • Block search result pages
  • Block pagination beyond page 1
  • Allow everything else
  • Sitemap