Log In Sign Up

btenews.com
robots.txt

Robots Exclusion Standard data for btenews.com

Resource Scan

Scan Details

Site Domain btenews.com
Base Domain btenews.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-02-25T09:47:29+00:00
Next Scan 2025-05-26T09:47:29+00:00

Last Successful Scan

Scanned2024-07-08T09:45:15+00:00
URL https://btenews.com/robots.txt
Domain IPs 104.21.58.216, 172.67.207.245, 2606:4700:3033::6815:3ad8, 2606:4700:3034::ac43:cff5
Response IP 104.21.58.216
Found Yes
Hash 72ea608998a83f1b1db078cd9e3698c8aa6ce4d9443997076981bf41d6eb9bba
SimHash 0168d1c40ea9

Groups

*

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://btenews.com/sitemaps.xml
sitemap https://btenews.com/sitemap-basement-1.xml
sitemap https://btenews.com/sitemap-basement-2.xml
sitemap https://btenews.com/sitemap-basement-3.xml
sitemap https://btenews.com/sitemap-basement-4.xml
sitemap https://btenews.com/sitemap-basement-5.xml
sitemap https://btenews.com/sitemap-basement-6.xml
sitemap https://btenews.com/sitemap-basement-7.xml
sitemap https://btenews.com/sitemap-basement-8.xml
sitemap https://btenews.com/sitemap-basement-9.xml
sitemap https://btenews.com/sitemap-basement-10.xml
sitemap https://btenews.com/sitemap-basement-11.xml
sitemap https://btenews.com/sitemap-basement-12.xml
sitemap https://btenews.com/sitemap-basement-13.xml
sitemap https://btenews.com/sitemap-basement-14.xml
sitemap https://08mw.btenews.com/sitemap-base.xml
sitemap https://07mw.btenews.com/sitemaps-base.xml
sitemap https://12mw.btenews.com/sitemaps-base.xml
Back to top