btbseo.com
robots.txt

Robots Exclusion Standard data for btbseo.com

Resource Scan

Scan Details

Site Domain btbseo.com
Base Domain btbseo.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-01-18T04:49:26+00:00
Next Scan 2025-04-18T04:49:26+00:00

Last Successful Scan

Scanned2024-05-31T04:08:42+00:00
URL https://btbseo.com/robots.txt
Domain IPs 104.21.38.212, 172.67.168.125, 2606:4700:3030::6815:26d4, 2606:4700:3037::ac43:a87d
Response IP 104.21.38.212
Found Yes
Hash c8cbcaff41c87d1f8649a39eb8a32e996e25966521d2e0ca1bc3e3110e23d5c6
SimHash 580cc254cd95

Groups

*

Rule Path
Disallow
Disallow /user
Disallow /user/*
Disallow /upload
Disallow /upload/*
Disallow /favorite
Disallow /favorite/*
Disallow /api
Disallow /api/*

twitterbot

Rule Path
Disallow

Other Records

Field Value
sitemap http://51myben.com/sitemaps