bitcoin-ad.com
robots.txt
Robots Exclusion Standard data for bitcoin-ad.com
Resource Scan
Scan Details
| Site Domain | bitcoin-ad.com |
| Base Domain | bitcoin-ad.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2025-06-29T14:18:02+00:00 |
| Next Scan | 2025-09-27T14:18:02+00:00 |
Last Successful Scan
| Scanned | 2022-01-19T09:46:10+00:00 |
| URL | https://bitcoin-ad.com/robots.txt |
| Redirect | https://www.bitcoin-ad.com/robots.txt |
| Redirect Domain | www.bitcoin-ad.com |
| Redirect Base | bitcoin-ad.com |
| Response IP | 104.21.62.18 |
| Found | Yes |
| Hash | b3ebada642be55a5fb7d49843eb79ca62c5678f1231afa8841bd7c77089dd090 |
| SimHash | 145d4444d162 |
Groups
pimeyesbot
discordbot
pinterestbot
telegrambot
linkdexbot
facebookexternalhit
ia_archiver
blexbot
dotbot
dotbot
zoominfobot
sistrix
sistrix crawler
sistrix
seokicks-robot
searchmetricsbot
mj12bot
surveybot
seodiver
spbot
backlinkcrawler
magpie-crawler
kraken
plukkie
rogerbot
adsbot
semanticbot
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | /*.html$ |
| Disallow | /glogin |
| Disallow | /login/facebook |
| Disallow | /login/google |
| Disallow | /newcampaign |
| Disallow | /account/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.bitcoin-ad.com/sitemap-profile.xml.gz |