# bds-btc

**Repository Path**: netdebug/bds-btc

## Basic Information

- **Project Name**: bds-btc
- **Description**: 将区块链数据同步到消息队列中，供上游服务消费
- **Primary Language**: C++
- **License**: Apache-2.0
- **Default Branch**: master
- **Homepage**: https://bds.jdcloud.com/
- **GVP Project**: No

## Statistics

- **Stars**: 0
- **Forks**: 5
- **Created**: 2019-07-25
- **Last Updated**: 2020-12-19

## Categories & Tags

**Categories**: Uncategorized

**Tags**: None

## README

# bds-btc 
![logo](./doc/bds-logo.png)
## Introduction
bds-btc is one of the independent modules in open source project of block chain data service (BDS) - provides full node service.

*bds-btc* Based on the v0.17.0 version of [bitcoin/bitcoin](https://github.com/bitcoin/bitcoin),*bds-btc* redeveloped to support sending new block data directly to message middleware service of kafka to facilitate upstream services to subscribe and consume.

## Architecture 
![Architecture](./doc/bds-architecture.jpg)

## Environmental Deployment
### Install BTC
#### Environment Initialization
[build-unix](./doc/build-unix.md)

#### Install steps

1. Compile

 ```
   ./autogen.sh
   ./configure
   make
   make install # optional
 ```

2. Run full node and support sending messages to Kafka

```
   /usr/local/bin/bitcoind -kafka -kafkaproxyhost=<kafka 代理的ip地址> -kafkaproxyport=<kafka 代理的访问端口，默认是 8082> -kafkatopic=btc -datadir=<数据目录> -rpcuser=<账号> -rpcpassword=<密码>
```

### Install confluent and kafka
#### Install kafka
See [kafka](https://kafka.apache.org/quickstart)

##### Modify config/server.properties 

* message.max.bytes=1048576000

#### Install confluent 
see [confluent](https://docs.confluent.io/current/installation/installing_cp/zip-tar.html#prod-kafka-cli-install)

Unzip the confluent package and run Confluent REST Proxy

##### Modify  <path-to-confluent>/etc/kafka-rest/kafka-rest.properties 

* max.request.size = 1048576000
* buffer.memory = 1048576000
* send.buffer.bytes = 1048576000

### Install BDS 
See [BDS](https://github.com/jdcloud-bds/bds)

### Database
Database we now support SQL Server, PostgreSQL, you can choose one as a data storage method.

#### SQL Server
Buy [JCS For SQL Server](https://www.jdcloud.com/cn/products/jcs-for-sql-server)

#### PostgreSQL 
Buy [JCS For PostgreSQL](https://www.jdcloud.com/cn/products/jcs-for-postgresql)

### Install Grafana 
See [Grafana Official](https://grafana.com/)

## New funtion 

1. The new function of sending messages to Kafka is added（every time a new block is synchronized by full node, the data of the block is sent to kafka and the data structure is customized).
2. Sendblock and sendbatchblock are newly added as RPC interfaces to trigger full node to send data for a specific block.

### Source Code Change History
[bds-btc](./CHANGE_HISTORY.md)

## Contributing
[Contributing guide](./CONTRIBUTING.md)

## License
[Apache License 2.0](./LICENSE)

## Project Demonstration
[Blockchain Data Service](https://bds.jdcloud.com/)