smartbrief.com
robots.txt

Robots Exclusion Standard data for smartbrief.com

Resource Scan

Scan Details

Site Domain smartbrief.com
Base Domain smartbrief.com
Scan Status Ok
Last Scan2025-08-31T19:47:13+00:00
Next Scan 2025-09-07T19:47:13+00:00

Last Scan

Scanned2025-08-31T19:47:13+00:00
URL https://smartbrief.com/robots.txt
Redirect https://www.smartbrief.com/robots.txt
Redirect Domain www.smartbrief.com
Redirect Base smartbrief.com
Domain IPs 141.193.213.20, 141.193.213.21
Redirect IPs 141.193.213.20, 141.193.213.21
Response IP 141.193.213.21
Found Yes
Hash 242fdd70b8a7e6256593575f6c2b31240117afb53f7cb263c88f28140eb973e7
SimHash 08095d2492b3

Groups

*

Rule Path
Disallow *?pageSequence*
Disallow *?campaign*
Disallow */partner*
Disallow *?brief*
Disallow *?mode*
Disallow */getsample*
Disallow */sharedsummary*
Disallow *weeks-most-clicked*
Disallow */branded*
Disallow *getLast.action?*

Other Records

Field Value
sitemap https://www.smartbrief.com/sitemap_index.xml