You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

133 lines
9.4 KiB

add support for block pruning via ABCI Commit response (#4588) * Added BlockStore.DeleteBlock() * Added initial block pruner prototype * wip * Added BlockStore.PruneBlocks() * Added consensus setting for block pruning * Added BlockStore base * Error on replay if base does not have blocks * Handle missing blocks when sending VoteSetMaj23Message * Error message tweak * Properly update blockstore state * Error message fix again * blockchain: ignore peer missing blocks * Added FIXME * Added test for block replay with truncated history * Handle peer base in blockchain reactor * Improved replay error handling * Added tests for Store.PruneBlocks() * Fix non-RPC handling of truncated block history * Panic on missing block meta in needProofBlock() * Updated changelog * Handle truncated block history in RPC layer * Added info about earliest block in /status RPC * Reorder height and base in blockchain reactor messages * Updated changelog * Fix tests * Appease linter * Minor review fixes * Non-empty BlockStores should always have base > 0 * Update code to assume base > 0 invariant * Added blockstore tests for pruning to 0 * Make sure we don't prune below the current base * Added BlockStore.Size() * config: added retain_blocks recommendations * Update v1 blockchain reactor to handle blockstore base * Added state database pruning * Propagate errors on missing validator sets * Comment tweaks * Improved error message Co-Authored-By: Anton Kaliaev <anton.kalyaev@gmail.com> * use ABCI field ResponseCommit.retain_height instead of retain-blocks config option * remove State.RetainHeight, return value instead * fix minor issues * rename pruneHeights() to pruneBlocks() * noop to fix GitHub borkage Co-authored-by: Anton Kaliaev <anton.kalyaev@gmail.com>
5 years ago
  1. ## v0.34
  2. \*\*
  3. Special thanks to external contributors on this release:
  4. Friendly reminder, we have a [bug bounty program](https://hackerone.com/tendermint).
  5. ### BREAKING CHANGES:
  6. - CLI/RPC/Config
  7. - [evidence] \#4959 Add json tags to `DuplicateVoteEvidence`
  8. - [light] \#4946 `tendermint lite` cmd has been renamed to `tendermint light`
  9. - [privval] \#4582 `round` in private_validator_state.json is no longer a string in json it is now a number
  10. - [rpc] [\#4792](https://github.com/tendermint/tendermint/pull/4792) `/validators` are now sorted by voting power (@melekes)
  11. - [rpc] \#4937 Return an error when `page` pagination param is 0 in `/validators`, `tx_search` (@melekes)
  12. - [rpc] \#5137 The json tags of `gasWanted` & `gasUsed` in `ResponseCheckTx` & `ResponseDeliverTx` have been made snake_case. (`gas_wanted` & `gas_used`)
  13. - Apps
  14. - [abci] [\#4704](https://github.com/tendermint/tendermint/pull/4704) Add ABCI methods `ListSnapshots`, `LoadSnapshotChunk`, `OfferSnapshot`, and `ApplySnapshotChunk` for state sync snapshots. `ABCIVersion` bumped to 0.17.0.
  15. - [abci] \#4989 `Proof` within `ResponseQuery` has been renamed to `ProofOps`
  16. - [abci] `CheckTxType` Protobuf enum names are now uppercase, to follow Protobuf style guide
  17. - P2P Protocol
  18. - [blockchain] \#4637 Migrate blockchain reactor(s) to Protobuf encoding
  19. - [evidence] \#4949 Migrate evidence reactor to Protobuf encoding
  20. - [mempool] \#4940 Migrate mempool from to Protobuf encoding
  21. - [p2p/pex] \#4973 Migrate `p2p/pex` reactor to Protobuf encoding
  22. - [statesync] \#4943 Migrate state sync reactor to Protobuf encoding
  23. - Blockchain Protocol
  24. - [evidence] [\#4780](https://github.com/tendermint/tendermint/pull/4780) Cap evidence to an absolute number (@cmwaters)
  25. - Add `max_num` to consensus evidence parameters (default: 50 items).
  26. - [evidence] \#4725 Remove `Pubkey` from `DuplicateVoteEvidence`
  27. - [state] \#4845 Include `BeginBlock#Events`, `EndBlock#Events`, `DeliverTx#Events`, `GasWanted` and `GasUsed` into `LastResultsHash` (@melekes)
  28. - [types] [\#4792](https://github.com/tendermint/tendermint/pull/4792) Sort validators by voting power to enable faster commit verification (@melekes)
  29. - On-disk serialization
  30. - [state] \#4679 Migrate state module to Protobuf encoding
  31. - `BlockStoreStateJSON` is now `BlockStoreState` and is encoded as binary in the database
  32. - [store] \#4778 Migrate store module to Protobuf encoding
  33. - Light client, private validator
  34. - [light] \#4964 Migrate light module migration to Protobuf encoding
  35. - [privval] \#4985 Migrate `privval` module to Protobuf encoding
  36. - Go API
  37. - [light] \#4946 Rename `lite2` pkg to `light`. Remove `lite` implementation.
  38. - [crypto] [\#4721](https://github.com/tendermint/tendermint/pull/4721) Remove `SimpleHashFromMap()` and `SimpleProofsFromMap()` (@erikgrinaker)
  39. - [crypto] \#4940 All keys have become `[]byte` instead of `[<size>]byte`. The byte method no longer returns the marshaled value but just the `[]byte` form of the data.
  40. - [crypto] \4988 Removal of key type multisig
  41. - The key has been moved to the [Cosmos-SDK](https://github.com/cosmos/cosmos-sdk/blob/master/crypto/types/multisig/multisignature.go)
  42. - [crypto] \#4989 Remove `Simple` prefixes from `SimpleProof`, `SimpleValueOp` & `SimpleProofNode`.
  43. - `merkle.Proof` has been renamed to `ProofOps`.
  44. - Protobuf messages `Proof` & `ProofOp` has been moved to `proto/crypto/merkle`
  45. - `SimpleHashFromByteSlices` has been renamed to `HashFromByteSlices`
  46. - `SimpleHashFromByteSlicesIterative` has been renamed to `HashFromByteSlicesIterative`
  47. - `SimpleProofsFromByteSlices` has been renamed to `ProofsFromByteSlices`
  48. - [crypto] \#4941 Remove suffixes from all keys.
  49. - ed25519: type `PrivKeyEd25519` is now `PrivKey`
  50. - ed25519: type `PubKeyEd25519` is now `PubKey`
  51. - secp256k1: type`PrivKeySecp256k1` is now `PrivKey`
  52. - secp256k1: type`PubKeySecp256k1` is now `PubKey`
  53. - sr25519: type `PrivKeySr25519` is now `PrivKey`
  54. - sr25519: type `PubKeySr25519` is now `PubKey`
  55. - multisig: type `PubKeyMultisigThreshold` is now `PubKey`
  56. - [libs] \#4831 Remove `Bech32` pkg from Tendermint. This pkg now lives in the [cosmos-sdk](https://github.com/cosmos/cosmos-sdk/tree/4173ea5ebad906dd9b45325bed69b9c655504867/types/bech32)
  57. - [rpc/client] \#4947 `Validators`, `TxSearch` `page`/`per_page` params become pointers (@melekes)
  58. - `UnconfirmedTxs` `limit` param is a pointer
  59. - [proto] \#5025 All proto files have been moved to `/proto` directory.
  60. - Using the recommended the file layout from buf, [see here for more info](https://buf.build/docs/lint-checkers#file_layout)
  61. - [state] \#4679 `TxResult` is a Protobuf type defined in `abci` types directory
  62. - [types] \#4939 `SignedMsgType` has moved to a Protobuf enum types
  63. - [types] \#4962 `ConsensusParams`, `BlockParams`, `EvidenceParams`, `ValidatorParams` & `HashedParams` are now Protobuf types
  64. - [types] \#4852 Vote & Proposal `SignBytes` is now func `VoteSignBytes` & `ProposalSignBytes`
  65. - [types] \#4798 Simplify `VerifyCommitTrusting` func + remove extra validation (@melekes)
  66. - [types] \#4845 Remove `ABCIResult`
  67. - [types] \#5029 Rename all values from `PartsHeader` to `PartSetHeader` to have consistency
  68. - [types] \#4939 `Total` in `Parts` & `PartSetHeader` has been changed from a `int` to a `uint32`
  69. - [types] \#4939 Vote: `ValidatorIndex` & `Round` are now `int32`
  70. - [types] \#4939 Proposal: `POLRound` & `Round` are now `int32`
  71. - [types] \#4939 Block: `Round` is now `int32`
  72. - [consensus] \#4582 RoundState: `Round`, `LockedRound` & `CommitRound` are now `int32`
  73. - [consensus] \#4582 HeightVoteSet: `round` is now `int32`
  74. - [rpc/jsonrpc/server] \#5141 Remove `WriteRPCResponseArrayHTTP` (use `WriteRPCResponseHTTP` instead) (@melekes)
  75. ### FEATURES:
  76. - [abci] \#5031 Add `AppVersion` to consensus parameters (@james-ray)
  77. - ... making it possible to update your ABCI application version via `EndBlock` response
  78. - [evidence] [\#4532](https://github.com/tendermint/tendermint/pull/4532) Handle evidence from light clients (@melekes)
  79. - [evidence] [#4821](https://github.com/tendermint/tendermint/pull/4821) Amnesia evidence can be detected, verified and committed (@cmwaters)
  80. - [light] [\#4532](https://github.com/tendermint/tendermint/pull/4532) Submit conflicting headers, if any, to a full node & all witnesses (@melekes)
  81. - [p2p] \#4981 Expose `SaveAs` func on NodeKey (@melekes)
  82. - [rpc] [\#4532](https://github.com/tendermint/tendermint/pull/4923) Support `BlockByHash` query (@fedekunze)
  83. - [rpc] \#4979 Support EXISTS operator in `/tx_search` query (@melekes)
  84. - [rpc] \#5017 Add `/check_tx` endpoint to check transactions without executing them or adding them to the mempool (@melekes)
  85. - [statesync] Add state sync support, where a new node can be rapidly bootstrapped by fetching state snapshots from peers instead of replaying blocks. See the `[statesync]` config section.
  86. - [rpc] [\#5108](https://github.com/tendermint/tendermint/pull/5108) Subscribe using the websocket for new evidence events (@cmwaters)
  87. ### IMPROVEMENTS:
  88. - [consensus] [\#4578](https://github.com/tendermint/tendermint/issues/4578) Attempt to repair the consensus WAL file (`data/cs.wal/wal`) automatically in case of corruption (@alessio)
  89. - The original WAL file will be backed up to `data/cs.wal/wal.CORRUPTED`.
  90. - [evidence] [\#4722](https://github.com/tendermint/tendermint/pull/4722) Improved evidence db (@cmwaters)
  91. - [evidence] [\#4839](https://github.com/tendermint/tendermint/pull/4839) Reject duplicate evidence from being proposed (@cmwaters)
  92. - [evidence] [\#4892](https://github.com/tendermint/tendermint/pull/4892) Remove redundant header from phantom validator evidence (@cmwaters)
  93. - [light] [\#4935](https://github.com/tendermint/tendermint/pull/4935) Fetch and compare a new header with witnesses in parallel (@melekes)
  94. - [light] [\#4929](https://github.com/tendermint/tendermint/pull/4929) compare header w/ witnesses only when doing bisection (@melekes)
  95. - [light] [\#4916](https://github.com/tendermint/tendermint/pull/4916) validate basic for inbound validator sets and headers before further processing them (@cmwaters)
  96. - [p2p/conn] \#4795 Return err on `signChallenge()` instead of panic
  97. - [state] [\#4781](https://github.com/tendermint/tendermint/pull/4781) Export `InitStateVersion` for the initial state version (@erikgrinaker)
  98. - [txindex] [\#4466](https://github.com/tendermint/tendermint/pull/4466) Allow to index an event at runtime (@favadi)
  99. - `abci.EventAttribute` replaces `KV.Pair`
  100. - [libs] \#5126 Add a sync package which wraps sync.(RW)Mutex & deadlock.(RW)Mutex and use a build flag (deadlock) in order to enable deadlock checking
  101. - [types] [\#4905](https://github.com/tendermint/tendermint/pull/4905) Add `ValidateBasic` to validator and validator set (@cmwaters)
  102. - [rpc] \#4968 JSON encoding is now handled by `libs/json`, not Amino
  103. - [mempool] Add RemoveTxByKey() exported function for custom mempool cleaning (@p4u)
  104. ### BUG FIXES:
  105. - [blockchain/v2] Correctly set block store base in status responses (@erikgrinaker)
  106. - [consensus] [\#4895](https://github.com/tendermint/tendermint/pull/4895) Cache the address of the validator to reduce querying a remote KMS (@joe-bowman)
  107. - [consensus] \#4970 Stricter on `LastCommitRound` check (@cuonglm)
  108. - [p2p][\#5136](https://github.com/tendermint/tendermint/pull/5136) Fix error for peer with the same ID but different IPs (@valardragon)
  109. - [proxy] \#5078 Fix a bug, where TM does not exit when ABCI app crashes (@melekes)