You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

234 lines
8.8 KiB

[RPC] Static swagger (#3880) * manually swagging Signed-off-by: Karoly Albert Szabo <szabo.karoly.a@gmail.com> * three definitions with polymorphism Signed-off-by: Karoly Albert Szabo <szabo.karoly.a@gmail.com> * added blockchain and block Signed-off-by: Karoly Albert Szabo <szabo.karoly.a@gmail.com> * low quality generation, commit, block_response and validators Signed-off-by: Karoly Albert Szabo <szabo.karoly.a@gmail.com> * genesis and consensus states endpoints Signed-off-by: Karoly Albert Szabo <szabo.karoly.a@gmail.com> * fix indentation Signed-off-by: Karoly Albert Szabo <szabo.karoly.a@gmail.com> * consensus parameters Signed-off-by: Karoly Albert Szabo <szabo.karoly.a@gmail.com> * fix indentation Signed-off-by: Karoly Albert Szabo <szabo.karoly.a@gmail.com> * add height to consensus parameters endpoint Signed-off-by: Karoly Albert Szabo <szabo.karoly.a@gmail.com> * unconfirmed_txs and num_unconfirmed_txs Signed-off-by: Karoly Albert Szabo <szabo.karoly.a@gmail.com> * add missing query parameter Signed-off-by: Karoly Albert Szabo <szabo.karoly.a@gmail.com> * add ABCI queries Signed-off-by: Karoly Albert Szabo <szabo.karoly.a@gmail.com> * added index document for swagger documentation Signed-off-by: Karoly Albert Szabo <szabo.karoly.a@gmail.com> * add missing routes Signed-off-by: Karoly Albert Szabo <szabo.karoly.a@gmail.com> * contract tests added on CCI Signed-off-by: Karoly Albert Szabo <szabo.karoly.a@gmail.com> * contract tests job should be in the test suite Signed-off-by: Karoly Albert Szabo <szabo.karoly.a@gmail.com> * simplify requirements to test Signed-off-by: Karoly Albert Szabo <szabo.karoly.a@gmail.com> * typo Signed-off-by: Karoly Albert Szabo <szabo.karoly.a@gmail.com> * build is a prerequisite to start localnet Signed-off-by: Karoly Albert Szabo <szabo.karoly.a@gmail.com> * reduce nodejs size, move goodman to get_tools, add docs, fix comments Signed-off-by: Karoly Albert Szabo <szabo.karoly.a@gmail.com> * Update scripts/get_tools.sh That's cleaner, thanks! Co-Authored-By: Anton Kaliaev <anton.kalyaev@gmail.com> * xz not supported by cci image, let's keep it simple Signed-off-by: Karoly Albert Szabo <szabo.karoly.a@gmail.com> * REMOVE-indirect debug of CCI paths Signed-off-by: Karoly Albert Szabo <szabo.karoly.a@gmail.com> * dirty experiment, volume is empty but binary has been produced Signed-off-by: Karoly Albert Szabo <szabo.karoly.a@gmail.com> * dirty experiment, volume is empty but binary has been produced Signed-off-by: Karoly Albert Szabo <szabo.karoly.a@gmail.com> * dirty experiment going on Signed-off-by: Karoly Albert Szabo <szabo.karoly.a@gmail.com> * locally works, CCI have difficulties with second layaer containers volumes Signed-off-by: Karoly Albert Szabo <szabo.karoly.a@gmail.com> * restore experiment, use machine instead of docker for contract tests Signed-off-by: Karoly Albert Szabo <szabo.karoly.a@gmail.com> * simplify a bit Signed-off-by: Karoly Albert Szabo <szabo.karoly.a@gmail.com> * rollback on machine golang Signed-off-by: Karoly Albert Szabo <szabo.karoly.a@gmail.com> * Document the changes Signed-off-by: Karoly Albert Szabo <szabo.karoly.a@gmail.com> * Changelog Signed-off-by: Karoly Albert Szabo <szabo.karoly.a@gmail.com> * comments Signed-off-by: Karoly Albert Szabo <szabo.karoly.a@gmail.com>
5 years ago
  1. PACKAGES=$(shell go list ./...)
  2. OUTPUT?=build/tendermint
  3. INCLUDE = -I=${GOPATH}/src/github.com/tendermint/tendermint -I=${GOPATH}/src -I=${GOPATH}/src/github.com/gogo/protobuf/protobuf
  4. BUILD_TAGS?='tendermint'
  5. LD_FLAGS = -X github.com/tendermint/tendermint/version.GitCommit=`git rev-parse --short=8 HEAD` -s -w
  6. BUILD_FLAGS = -mod=readonly -ldflags "$(LD_FLAGS)"
  7. all: check build test install
  8. # The below include contains the tools.
  9. include tools.mk
  10. include tests.mk
  11. ########################################
  12. ### Build Tendermint
  13. build:
  14. CGO_ENABLED=0 go build $(BUILD_FLAGS) -tags $(BUILD_TAGS) -o $(OUTPUT) ./cmd/tendermint/
  15. build_c:
  16. CGO_ENABLED=1 go build $(BUILD_FLAGS) -tags "$(BUILD_TAGS) cleveldb" -o $(OUTPUT) ./cmd/tendermint/
  17. build_race:
  18. CGO_ENABLED=1 go build -race $(BUILD_FLAGS) -tags $(BUILD_TAGS) -o $(OUTPUT) ./cmd/tendermint
  19. install:
  20. CGO_ENABLED=0 go install $(BUILD_FLAGS) -tags $(BUILD_TAGS) ./cmd/tendermint
  21. install_c:
  22. CGO_ENABLED=1 go install $(BUILD_FLAGS) -tags "$(BUILD_TAGS) cleveldb" ./cmd/tendermint
  23. ########################################
  24. ### Protobuf
  25. protoc_all: protoc_libs protoc_merkle protoc_abci protoc_grpc protoc_proto3types
  26. %.pb.go: %.proto
  27. ## If you get the following error,
  28. ## "error while loading shared libraries: libprotobuf.so.14: cannot open shared object file: No such file or directory"
  29. ## See https://stackoverflow.com/a/25518702
  30. ## Note the $< here is substituted for the %.proto
  31. ## Note the $@ here is substituted for the %.pb.go
  32. protoc $(INCLUDE) $< --gogo_out=Mgoogle/protobuf/timestamp.proto=github.com/golang/protobuf/ptypes/timestamp,Mgoogle/protobuf/duration.proto=github.com/golang/protobuf/ptypes/duration,plugins=grpc:../../..
  33. ########################################
  34. ### Build ABCI
  35. # see protobuf section above
  36. protoc_abci: abci/types/types.pb.go
  37. protoc_proto3types: types/proto3/block.pb.go
  38. build_abci:
  39. @go build -mod=readonly -i ./abci/cmd/...
  40. install_abci:
  41. @go install -mod=readonly ./abci/cmd/...
  42. ########################################
  43. ### Distribution
  44. # dist builds binaries for all platforms and packages them for distribution
  45. # TODO add abci to these scripts
  46. dist:
  47. @BUILD_TAGS=$(BUILD_TAGS) sh -c "'$(CURDIR)/scripts/dist.sh'"
  48. go-mod-cache: go.sum
  49. @echo "--> Download go modules to local cache"
  50. @go mod download
  51. .PHONY: go-mod-cache
  52. go.sum: go.mod
  53. @echo "--> Ensure dependencies have not been modified"
  54. @go mod verify
  55. @go mod tidy
  56. draw_deps:
  57. @# requires brew install graphviz or apt-get install graphviz
  58. go get github.com/RobotsAndPencils/goviz
  59. @goviz -i github.com/tendermint/tendermint/cmd/tendermint -d 3 | dot -Tpng -o dependency-graph.png
  60. get_deps_bin_size:
  61. @# Copy of build recipe with additional flags to perform binary size analysis
  62. $(eval $(shell go build -work -a $(BUILD_FLAGS) -tags $(BUILD_TAGS) -o $(OUTPUT) ./cmd/tendermint/ 2>&1))
  63. @find $(WORK) -type f -name "*.a" | xargs -I{} du -hxs "{}" | sort -rh | sed -e s:${WORK}/::g > deps_bin_size.log
  64. @echo "Results can be found here: $(CURDIR)/deps_bin_size.log"
  65. ########################################
  66. ### Libs
  67. protoc_libs: libs/kv/types.pb.go
  68. # generates certificates for TLS testing in remotedb and RPC server
  69. gen_certs: clean_certs
  70. certstrap init --common-name "tendermint.com" --passphrase ""
  71. certstrap request-cert --common-name "remotedb" -ip "127.0.0.1" --passphrase ""
  72. certstrap sign "remotedb" --CA "tendermint.com" --passphrase ""
  73. mv out/remotedb.crt libs/db/remotedb/test.crt
  74. mv out/remotedb.key libs/db/remotedb/test.key
  75. certstrap request-cert --common-name "server" -ip "127.0.0.1" --passphrase ""
  76. certstrap sign "server" --CA "tendermint.com" --passphrase ""
  77. mv out/server.crt rpc/lib/server/test.crt
  78. mv out/server.key rpc/lib/server/test.key
  79. rm -rf out
  80. # deletes generated certificates
  81. clean_certs:
  82. rm -f libs/db/remotedb/test.crt
  83. rm -f libs/db/remotedb/test.key
  84. rm -f rpc/lib/server/test.crt
  85. rm -f rpc/lib/server/test.key
  86. test_libs:
  87. go test -tags clevedb boltdb $(PACKAGES)
  88. grpc_dbserver:
  89. protoc -I libs/db/remotedb/proto/ libs/db/remotedb/proto/defs.proto --go_out=plugins=grpc:libs/db/remotedb/proto
  90. protoc_grpc: rpc/grpc/types.pb.go
  91. protoc_merkle: crypto/merkle/merkle.pb.go
  92. ########################################
  93. ### Formatting, linting, and vetting
  94. fmt:
  95. @go fmt ./...
  96. lint:
  97. @echo "--> Running linter"
  98. @golangci-lint run
  99. DESTINATION = ./index.html.md
  100. ###########################################################
  101. ### Documentation
  102. build-docs:
  103. cd docs && \
  104. while read p; do \
  105. (git checkout $${p} && npm install && VUEPRESS_BASE="/$${p}/" npm run build) ; \
  106. mkdir -p ~/output/$${p} ; \
  107. cp -r .vuepress/dist/* ~/output/$${p}/ ; \
  108. cp ~/output/$${p}/index.html ~/output ; \
  109. done < versions ;
  110. sync-docs:
  111. cd ~/output && \
  112. echo "role_arn = ${DEPLOYMENT_ROLE_ARN}" >> /root/.aws/config ; \
  113. echo "CI job = ${CIRCLE_BUILD_URL}" >> version.html ; \
  114. aws s3 sync . s3://${WEBSITE_BUCKET} --profile terraform --delete ; \
  115. aws cloudfront create-invalidation --distribution-id ${CF_DISTRIBUTION_ID} --profile terraform --path "/*" ;
  116. .PHONY: sync-docs
  117. ###########################################################
  118. ### Docker image
  119. build-docker:
  120. cp $(OUTPUT) DOCKER/tendermint
  121. docker build --label=tendermint --tag="tendermint/tendermint" DOCKER
  122. rm -rf DOCKER/tendermint
  123. ###########################################################
  124. ### Local testnet using docker
  125. # Build linux binary on other platforms
  126. build-linux: tools
  127. GOOS=linux GOARCH=amd64 $(MAKE) build
  128. build-docker-localnode:
  129. @cd networks/local && make
  130. # Runs `make build_c` from within an Amazon Linux (v2)-based Docker build
  131. # container in order to build an Amazon Linux-compatible binary. Produces a
  132. # compatible binary at ./build/tendermint
  133. build_c-amazonlinux:
  134. $(MAKE) -C ./DOCKER build_amazonlinux_buildimage
  135. docker run --rm -it -v `pwd`:/tendermint tendermint/tendermint:build_c-amazonlinux
  136. # Run a 4-node testnet locally
  137. localnet-start: localnet-stop build-docker-localnode
  138. @if ! [ -f build/node0/config/genesis.json ]; then docker run --rm -v $(CURDIR)/build:/tendermint:Z tendermint/localnode testnet --config /etc/tendermint/config-template.toml --v 4 --o . --populate-persistent-peers --starting-ip-address 192.167.10.2; fi
  139. docker-compose up
  140. # Stop testnet
  141. localnet-stop:
  142. docker-compose down
  143. ###########################################################
  144. ### Remote full-nodes (sentry) using terraform and ansible
  145. # Server management
  146. sentry-start:
  147. @if [ -z "$(DO_API_TOKEN)" ]; then echo "DO_API_TOKEN environment variable not set." ; false ; fi
  148. @if ! [ -f $(HOME)/.ssh/id_rsa.pub ]; then ssh-keygen ; fi
  149. cd networks/remote/terraform && terraform init && terraform apply -var DO_API_TOKEN="$(DO_API_TOKEN)" -var SSH_KEY_FILE="$(HOME)/.ssh/id_rsa.pub"
  150. @if ! [ -f $(CURDIR)/build/node0/config/genesis.json ]; then docker run --rm -v $(CURDIR)/build:/tendermint:Z tendermint/localnode testnet --v 0 --n 4 --o . ; fi
  151. cd networks/remote/ansible && ANSIBLE_HOST_KEY_CHECKING=False ansible-playbook -i inventory/digital_ocean.py -l sentrynet install.yml
  152. @echo "Next step: Add your validator setup in the genesis.json and config.tml files and run \"make sentry-config\". (Public key of validator, chain ID, peer IP and node ID.)"
  153. # Configuration management
  154. sentry-config:
  155. cd networks/remote/ansible && ansible-playbook -i inventory/digital_ocean.py -l sentrynet config.yml -e BINARY=$(CURDIR)/build/tendermint -e CONFIGDIR=$(CURDIR)/build
  156. sentry-stop:
  157. @if [ -z "$(DO_API_TOKEN)" ]; then echo "DO_API_TOKEN environment variable not set." ; false ; fi
  158. cd networks/remote/terraform && terraform destroy -var DO_API_TOKEN="$(DO_API_TOKEN)" -var SSH_KEY_FILE="$(HOME)/.ssh/id_rsa.pub"
  159. # Build hooks for dredd, to skip or add information on some steps
  160. build-contract-tests-hooks:
  161. ifeq ($(OS),Windows_NT)
  162. go build -mod=readonly $(BUILD_FLAGS) -o build/contract_tests.exe ./cmd/contract_tests
  163. else
  164. go build -mod=readonly $(BUILD_FLAGS) -o build/contract_tests ./cmd/contract_tests
  165. endif
  166. # Run a nodejs tool to test endpoints against a localnet
  167. # The command takes care of starting and stopping the network
  168. # prerequisits: build-contract-tests-hooks build-linux
  169. # the two build commands were not added to let this command run from generic containers or machines.
  170. # The binaries should be built beforehand
  171. contract-tests:
  172. dredd
  173. # To avoid unintended conflicts with file names, always add to .PHONY
  174. # unless there is a reason not to.
  175. # https://www.gnu.org/software/make/manual/html_node/Phony-Targets.html
  176. .PHONY: check build build_race build_abci dist install install_abci check_tools tools update_tools draw_deps \
  177. protoc_abci protoc_libs gen_certs clean_certs grpc_dbserver fmt build-linux localnet-start \
  178. localnet-stop build-docker build-docker-localnode sentry-start sentry-config sentry-stop protoc_grpc protoc_all \
  179. build_c install_c test_with_deadlock cleanup_after_test_with_deadlock lint build-contract-tests-hooks contract-tests \
  180. build_c-amazonlinux