breakingnewsbrief.com
robots.txt

Robots Exclusion Standard data for breakingnewsbrief.com

Resource Scan

Scan Details

Site Domain breakingnewsbrief.com
Base Domain breakingnewsbrief.com
Scan Status Ok
Last Scan2024-04-30T23:01:10+00:00
Next Scan 2024-05-07T23:01:10+00:00

Last Scan

Scanned2024-04-30T23:01:10+00:00
URL https://breakingnewsbrief.com/robots.txt
Domain IPs 108.138.246.107, 108.138.246.26, 108.138.246.35, 108.138.246.8
Response IP 3.160.246.29
Found Yes
Hash 0cfe4357b4ae5a99f534b3b0ae1c117ec8d87eec9bed132fb6fcce5ddb43f2cf
SimHash 291a4e2627f2

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /*-ns
Disallow /*-return-allow
Disallow /*-return-denied
Disallow /*confirmation*
Disallow /*denied*
Disallow /allow
Disallow /api/
Disallow /cdn/
Disallow /complete*
Disallow /cookies
Disallow /donotsell
Disallow /expired
Disallow /landing*
Disallow /msgpost/
Disallow /not-supported
Disallow /pn/
Disallow /privacy
Disallow /return-allow
Disallow /return-denied
Disallow /safari
Disallow /search*
Disallow /social
Disallow /sponsored/
Disallow /sub-status
Disallow /subscription-failed
Disallow /terms
Disallow /testimonial/
Disallow /timelinepost/
Disallow /unsubscribe

mediapartners-google

Rule Path
Allow /*-ns
Allow /*-return-allow
Allow /*-return-denied
Allow /*confirmation*
Allow /*denied*
Allow /allow
Allow /complete*
Allow /landing*
Allow /not-supported
Allow /return-allow
Allow /return-denied
Allow /safari
Allow /social
Allow /testimonial/
Allow /timelinepost/

adsbot-google

Rule Path
Allow /*-ns
Allow /*-return-allow
Allow /*-return-denied
Allow /*confirmation*
Allow /*denied*
Allow /allow
Allow /complete*
Allow /landing*
Allow /not-supported
Allow /return-allow
Allow /return-denied
Allow /safari
Allow /social
Allow /testimonial/
Allow /timelinepost/

googlebot

Rule Path
Allow /*-ns
Allow /*-return-allow
Allow /*-return-denied
Allow /*confirmation*
Allow /*denied*
Allow /allow
Allow /complete*
Allow /landing*
Allow /not-supported
Allow /return-allow
Allow /return-denied
Allow /safari
Allow /social
Allow /testimonial/
Allow /timelinepost/

googlebot-image

Rule Path
Allow /*-ns
Allow /*-return-allow
Allow /*-return-denied
Allow /*confirmation*
Allow /*denied*
Allow /allow
Allow /complete*
Allow /landing*
Allow /not-supported
Allow /return-allow
Allow /return-denied
Allow /safari
Allow /social
Allow /testimonial/
Allow /timelinepost/