bpdaily.com
robots.txt

Robots Exclusion Standard data for bpdaily.com

Resource Scan

Scan Details

Site Domain bpdaily.com
Base Domain bpdaily.com
Scan Status Ok
Last Scan2025-10-31T12:43:43+00:00
Next Scan 2025-11-07T12:43:43+00:00

Last Scan

Scanned2025-10-31T12:43:43+00:00
URL https://bpdaily.com/robots.txt
Redirect https://www.bpdaily.com/robots.txt
Redirect Domain www.bpdaily.com
Redirect Base bpdaily.com
Domain IPs 34.195.124.212
Redirect IPs 13.226.69.115, 13.226.69.21, 13.226.69.36, 13.226.69.42, 2600:9000:271a:2e00:4:f5cf:6d40:93a1, 2600:9000:271a:4400:4:f5cf:6d40:93a1, 2600:9000:271a:5a00:4:f5cf:6d40:93a1, 2600:9000:271a:7400:4:f5cf:6d40:93a1, 2600:9000:271a:b000:4:f5cf:6d40:93a1, 2600:9000:271a:d400:4:f5cf:6d40:93a1, 2600:9000:271a:e200:4:f5cf:6d40:93a1, 2600:9000:271a:e800:4:f5cf:6d40:93a1
Response IP 3.165.75.104
Found Yes
Hash a75a4a4d661d9dc3bdd3820f2c8331f1ad23c709cc470090a724d31dd1fa6fec
SimHash ca2c7981cb90

Groups

facebookexternalhit

Rule Path
Allow /

twitterbot

Rule Path
Allow /*?utm_

*

Rule Path
Allow /
Disallow /*wp-admin/
Disallow /*wp-includes
Disallow /*wp-content
Disallow /*wp-json
Allow /*?comment
Allow /*?cexp_id=
Allow /*?show=trending
Allow /*?show=recent
Allow /*wp-includes*.jpg
Allow /*wp-content*.jpg
Allow /*wp-includes*.jpeg
Allow /*wp-content*.jpeg
Allow /*wp-includes*.jpe
Allow /*wp-content*.jpe
Allow /*wp-includes*.png
Allow /*wp-content*.png
Allow /*wp-includes*.css
Allow /*wp-content*.css
Allow /*wp-includes*.js
Allow /*wp-content*.js
Allow /*wp-includes*.gif
Allow /*wp-content*.gif
Allow /*wp-includes*.svg
Allow /*wp-content*.svg
Allow /*wp-includes*.webp
Allow /*wp-content*.webp
Allow /*?media_id

Other Records

Field Value
sitemap https://www.bpdaily.com/sitemap.xml
sitemap https://www.bpdaily.com/tags-sitemap.xml
sitemap https://www.bpdaily.com/categories-sitemap.xml
sitemap https://www.bpdaily.com/news-sitemap.xml
sitemap https://www.bpdaily.com/authors-sitemap-index.xml