bbcposts.com
robots.txt

Robots Exclusion Standard data for bbcposts.com

Resource Scan

Scan Details

Site Domain bbcposts.com
Base Domain bbcposts.com
Scan Status Ok
Last Scan2025-06-24T16:51:14+00:00
Next Scan 2025-07-01T16:51:14+00:00

Last Scan

Scanned2025-06-24T16:51:14+00:00
URL https://bbcposts.com/robots.txt
Domain IPs 104.21.17.140, 172.67.176.209, 2606:4700:3031::ac43:b0d1, 2606:4700:3035::6815:118c
Response IP 172.67.176.209
Found Yes
Hash 5285353990e20b6b35148018830c12a2596b48c39e90a4422db3af97a3c7958c
SimHash 8b14683e8792

Groups

archive.org_bot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

Other Records

Field Value
sitemap https://bbcposts.com/sitemap.xml