historyinpieces.com
robots.txt

Robots Exclusion Standard data for historyinpieces.com

Resource Scan

Scan Details

Site Domain historyinpieces.com
Base Domain historyinpieces.com
Scan Status Ok
Last Scan2025-03-11T07:29:22+00:00
Next Scan 2025-04-10T07:29:22+00:00

Last Scan

Scanned2025-03-11T07:29:22+00:00
URL https://historyinpieces.com/robots.txt
Domain IPs 104.21.50.144, 172.67.207.1, 2606:4700:3030::ac43:cf01, 2606:4700:3034::6815:3290
Response IP 104.21.50.144
Found Yes
Hash 5b6268a0cf35a508be72af098a5d71d2e7a8edfcb38207b6d525ad94810b7ef7
SimHash 50308802c5bb

Groups

*

Rule Path
Disallow */?s=
Disallow /search/
Disallow */?amp=1&s=
Disallow /wp-login.php
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /feed/
Disallow /*/feed/

ia_archiver

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

Comments

  • All Bots
  • Block Unwanted Bots
  • Block content use in Bard and AI but allows search bot