The ABCI message types are defined in a protobuf file.
ABCI methods are split across four separate ABCI connections:
InitChain
, BeginBlock
, DeliverTx
, EndBlock
, Commit
CheckTx
Info
, SetOption
, Query
ListSnapshots
, LoadSnapshotChunk
, OfferSnapshot
, ApplySnapshotChunk
The consensus connection is driven by a consensus protocol and is responsible for block execution.
The mempool connection is for validating new transactions, before they're shared or included in a block.
The info connection is for initialization and for queries from the user.
The snapshot connection is for serving and restoring state sync snapshots.
Additionally, there is a Flush
method that is called on every connection,
and an Echo
method that is just for debugging.
More details on managing state across connections can be found in the section on ABCI Applications.
Some methods (Echo, Info, InitChain, BeginBlock, EndBlock, Commit
),
don't return errors because an error would indicate a critical failure
in the application and there's nothing Tendermint can do. The problem
should be addressed and both Tendermint and the application restarted.
All other methods (SetOption, Query, CheckTx, DeliverTx
) return an
application-specific response Code uint32
, where only 0
is reserved
for OK
.
Finally, Query
, CheckTx
, and DeliverTx
include a Codespace string
, whose
intended use is to disambiguate Code
values returned by different domains of the
application. The Codespace
is a namespace for the Code
.
Some methods (CheckTx, BeginBlock, DeliverTx, EndBlock
)
include an Events
field in their Response*
. Each event contains a type and a
list of attributes, which are key-value pairs denoting something about what happened
during the method's execution.
Events can be used to index transactions and blocks according to what happened
during their execution. Note that the set of events returned for a block from
BeginBlock
and EndBlock
are merged. In case both methods return the same
tag, only the value defined in EndBlock
is used.
Each event has a type
which is meant to categorize the event for a particular
Response*
or tx. A Response*
or tx may contain multiple events with duplicate
type
values, where each distinct entry is meant to categorize attributes for a
particular event. Every key and value in an event's attributes must be UTF-8
encoded strings along with the event type itself.
Example:
abci.ResponseDeliverTx{
// ...
Events: []abci.Event{
{
Type: "validator.provisions",
Attributes: []abci.EventAttribute{
abci.EventAttribute{Key: []byte("address"), Value: []byte("..."), Index: true},
abci.EventAttribute{Key: []byte("amount"), Value: []byte("..."), Index: true},
abci.EventAttribute{Key: []byte("balance"), Value: []byte("..."), Index: true},
},
},
{
Type: "validator.provisions",
Attributes: []abci.EventAttribute{
abci.EventAttribute{Key: []byte("address"), Value: []byte("..."), Index: true},
abci.EventAttribute{Key: []byte("amount"), Value: []byte("..."), Index: false},
abci.EventAttribute{Key: []byte("balance"), Value: []byte("..."), Index: false},
},
},
{
Type: "validator.slashed",
Attributes: []abci.EventAttribute{
abci.EventAttribute{Key: []byte("address"), Value: []byte("..."), Index: false},
abci.EventAttribute{Key: []byte("amount"), Value: []byte("..."), Index: true},
abci.EventAttribute{Key: []byte("reason"), Value: []byte("..."), Index: true},
},
},
// ...
},
}
A part of Tendermint's security model is the use of evidence which serves as proof of malicious behaviour by a network participant. It is the responsibility of Tendermint to detect such malicious behaviour, to gossip this and commit it to the chain and once verified by all validators to pass it on to the application through the ABCI. It is the responsibility of the application then to handle the evidence and exercise punishment.
EvidenceType has the following protobuf format:
enum EvidenceType {
UNKNOWN = 0;
DUPLICATE_VOTE = 1;
LIGHT_CLIENT_ATTACK = 2;
}
There are two forms of evidence: Duplicate Vote and Light Client Attack. More information can be found in either data structures or accountability
ABCI applications must implement deterministic finite-state machines to be securely replicated by the Tendermint consensus. This means block execution over the Consensus Connection must be strictly deterministic: given the same ordered set of requests, all nodes will compute identical responses, for all BeginBlock, DeliverTx, EndBlock, and Commit. This is critical, because the responses are included in the header of the next block, either via a Merkle root or directly, so all nodes must agree on exactly what they are.
For this reason, it is recommended that applications not be exposed to any external user or process except via the ABCI connections to a consensus engine like Tendermint Core. The application must only change its state based on input from block execution (BeginBlock, DeliverTx, EndBlock, Commit), and not through any other kind of request. This is the only way to ensure all nodes see the same transactions and compute the same results.
If there is some non-determinism in the state machine, consensus will eventually fail as nodes disagree over the correct values for the block header. The non-determinism must be fixed and the nodes restarted.
Sources of non-determinism in applications may include:
See #56 for original discussion.
Note that some methods (SetOption, Query, CheckTx, DeliverTx
) return
explicitly non-deterministic data in the form of Info
and Log
fields. The Log
is
intended for the literal output from the application's logger, while the
Info
is any additional info that should be returned. These are the only fields
that are not included in block header computations, so we don't need agreement
on them. All other fields in the Response*
must be strictly deterministic.
The first time a new blockchain is started, Tendermint calls
InitChain
. From then on, the following sequence of methods is executed for each
block:
BeginBlock, [DeliverTx], EndBlock, Commit
where one DeliverTx
is called for each transaction in the block.
The result is an updated application state.
Cryptographic commitments to the results of DeliverTx, EndBlock, and
Commit are included in the header of the next block.
State sync allows new nodes to rapidly bootstrap by discovering, fetching, and applying state machine snapshots instead of replaying historical blocks. For more details, see the state sync section.
When a new node is discovering snapshots in the P2P network, existing nodes will call
ListSnapshots
on the application to retrieve any local state snapshots. The new node will
offer these snapshots to its local application via OfferSnapshot
.
Once the application accepts a snapshot and begins restoring it, Tendermint will fetch snapshot
chunks from existing nodes via LoadSnapshotChunk
and apply them sequentially to the local
application with ApplySnapshotChunk
. When all chunks have been applied, the application
AppHash
is retrieved via an Info
query and compared to the blockchain's AppHash
verified
via light client.
Message (string)
: A string to echo backMessage (string)
: The input stringVersion (string)
: The Tendermint software semantic versionBlockVersion (uint64)
: The Tendermint Block Protocol versionP2PVersion (uint64)
: The Tendermint P2P Protocol versionData (string)
: Some arbitrary informationVersion (string)
: The application software semantic versionAppVersion (uint64)
: The application protocol versionLastBlockHeight (int64)
: Latest block for which the app has
called CommitLastBlockAppHash ([]byte)
: Latest result of CommitAppVersion
will be included in the Header of every block.LastBlockAppHash
and LastBlockHeight
to
be updated during Commit
, ensuring that Commit
is never
called twice for the same block height.Key (string)
: Key to setValue (string)
: Value to set for keyCode (uint32)
: Response codeLog (string)
: The output of the application's logger. May
be non-deterministic.Info (string)
: Additional information. May
be non-deterministic.Time (google.protobuf.Timestamp)
: Genesis time.ChainID (string)
: ID of the blockchain.ConsensusParams (ConsensusParams)
: Initial consensus-critical parameters.Validators ([]ValidatorUpdate)
: Initial genesis validators, sorted by voting power.AppStateBytes ([]byte)
: Serialized initial application state. Amino-encoded JSON bytes.InitialHeight (int64)
: Height of the initial block (typically 1
).ConsensusParams (ConsensusParams)
: Initial
consensus-critical parameters (optional).Validators ([]ValidatorUpdate)
: Initial validator set (optional).AppHash ([]byte)
: Initial application hash.Data ([]byte)
: Raw query bytes. Can be used with or in lieu
of Path.Path (string)
: Path of request, like an HTTP GET path. Can be
used with or in liue of Data.
Height (int64)
: The block height for which you want the query
(default=0 returns data for the latest committed block). Note
that this is the height of the block containing the
application's Merkle root hash, which represents the state as it
was after committing the block at Height-1Prove (bool)
: Return Merkle proof with response if possibleCode (uint32)
: Response code.Log (string)
: The output of the application's logger. May
be non-deterministic.Info (string)
: Additional information. May
be non-deterministic.Index (int64)
: The index of the key in the tree.Key ([]byte)
: The key of the matching data.Value ([]byte)
: The value of the matching data.Proof (Proof)
: Serialized proof for the value data, if requested, to be
verified against the AppHash
for the given Height.Height (int64)
: The block height from which data was derived.
Note that this is the height of the block containing the
application's Merkle root hash, which represents the state as it
was after committing the block at Height-1Codespace (string)
: Namespace for the Code
.type
field to support many types
of Merkle trees and encoding formats.Hash ([]byte)
: The block's hash. This can be derived from the
block header.Header (struct{})
: The block header.LastCommitInfo (LastCommitInfo)
: Info about the last commit, including the
round, and the list of validators and which ones signed the last block.ByzantineValidators ([]Evidence)
: List of evidence of
validators that acted maliciously.Events ([]abci.Event)
: Type & Key-Value events for indexingLastCommitInfo
and ByzantineValidators
can be used to determine
rewards and punishments for the validators. NOTE validators here do not
include pubkeys.Tx ([]byte)
: The request transaction bytesType (CheckTxType)
: What type of CheckTx
request is this? At present,
there are two possible values: CheckTx_New
(the default, which says
that a full check is required), and CheckTx_Recheck
(when the mempool is
initiating a normal recheck of a transaction).Code (uint32)
: Response codeData ([]byte)
: Result bytes, if any.Log (string)
: The output of the application's logger. May
be non-deterministic.Info (string)
: Additional information. May
be non-deterministic.GasWanted (int64)
: Amount of gas requested for transaction.GasUsed (int64)
: Amount of gas consumed by transaction.Events ([]abci.Event)
: Type & Key-Value events for indexing
transactions (eg. by account).Codespace (string)
: Namespace for the Code
.ResponseCheckTx.Code != 0
will be rejected - they will not be broadcast to
other nodes or included in a proposal block.Tx ([]byte)
: The request transaction bytes.Code (uint32)
: Response code.Data ([]byte)
: Result bytes, if any.Log (string)
: The output of the application's logger. May
be non-deterministic.Info (string)
: Additional information. May
be non-deterministic.GasWanted (int64)
: Amount of gas requested for transaction.GasUsed (int64)
: Amount of gas consumed by transaction.Events ([]abci.Event)
: Type & Key-Value events for indexing
transactions (eg. by account).Codespace (string)
: Namespace for the Code
.ResponseDeliverTx.Code == 0
only if the transaction is fully valid.Height (int64)
: Height of the block just executed.ValidatorUpdates ([]ValidatorUpdate)
: Changes to validator set (set
voting power to 0 to remove).ConsensusParamUpdates (ConsensusParams)
: Changes to
consensus-critical time, size, and other parameters.Events ([]abci.Event)
: Type & Key-Value events for indexingH
impact blocks H+1
, H+2
, and
H+3
, but only effects changes on the validator set of H+2
:
H+1
: NextValidatorsHashH+2
: ValidatorsHash (and thus the validator set)H+3
: LastCommitInfo (ie. the last validator set)H
apply for block H+1
Data ([]byte)
: The Merkle root hash of the application stateRetainHeight (int64)
: Blocks below this height may be removed. Defaults
to 0
(retain all).ResponseCommit.Data
is included as the Header.AppHash
in the next block
Query
can return proofs about the application state anchored
in this Merkle root hashRetainHeight
with caution! If all nodes in the network remove historical
blocks then this data is permanently lost, and no new nodes will be able to
join the network and bootstrap. Historical blocks may also be required for
other purposes, e.g. auditing, replay of non-persisted heights, light client
verification, and so on.Snapshots ([]Snapshot)
: List of local state snapshots.Snapshot
data type for details.Height (uint64)
: The height of the snapshot the chunks belongs to.Format (uint32)
: The application-specific format of the snapshot the chunk belongs to.Chunk (uint32)
: The chunk index, starting from 0
for the initial chunk.Chunk ([]byte)
: The binary chunk contents, in an arbitray format. Chunk messages cannot be
larger than 16 MB including metadata, so 10 MB is a good starting point.Snapshot (Snapshot)
: The snapshot offered for restoration.AppHash ([]byte)
: The light client-verified app hash for this height, from the blockchain.Result (Result)
: The result of the snapshot offer.
ACCEPT
: Snapshot is accepted, start applying chunks.ABORT
: Abort snapshot restoration, and don't try any other snapshots.REJECT
: Reject this specific snapshot, try others.REJECT_FORMAT
: Reject all snapshots with this format
, try others.REJECT_SENDERS
: Reject all snapshots from all senders of this snapshot, try others.OfferSnapshot
is called when bootstrapping a node using state sync. The application may
accept or reject snapshots as appropriate. Upon accepting, Tendermint will retrieve and
apply snapshot chunks via ApplySnapshotChunk
. The application may also choose to reject a
snapshot in the chunk response, in which case it should be prepared to accept further
OfferSnapshot
calls.AppHash
can be trusted, as it has been verified by the light client. Any other data
can be spoofed by adversaries, so applications should employ additional verification schemes
to avoid denial-of-service attacks. The verified AppHash
is automatically checked against
the restored application at the end of snapshot restoration.Snapshot
data type or the state sync section.Index (uint32)
: The chunk index, starting from 0
. Tendermint applies chunks sequentially.Chunk ([]byte)
: The binary chunk contents, as returned by LoadSnapshotChunk
.Sender (string)
: The P2P ID of the node who sent this chunk.Result (Result)
: The result of applying this chunk.
ACCEPT
: The chunk was accepted.ABORT
: Abort snapshot restoration, and don't try any other snapshots.RETRY
: Reapply this chunk, combine with RefetchChunks
and RejectSenders
as appropriate.RETRY_SNAPSHOT
: Restart this snapshot from OfferSnapshot
, reusing chunks unless
instructed otherwise.REJECT_SNAPSHOT
: Reject this snapshot, try a different one.RefetchChunks ([]uint32)
: Refetch and reapply the given chunks, regardless of Result
. Only
the listed chunks will be refetched, and reapplied in sequential order.RejectSenders ([]string)
: Reject the given P2P senders, regardless of Result
. Any chunks
already applied will not be refetched unless explicitly requested, but queued chunks from these senders will be discarded, and new chunks or other snapshots rejected.Snapshot.Metadata
and/or incrementally verifying contents against AppHash
.Info
call to verify that
LastBlockAppHash
and LastBlockHeight
matches the expected values, and record the
AppVersion
in the node state. It then switches to fast sync or consensus and joins the
network.OfferSnapshot
.
The application should be prepared to reset and accept it or abort as appropriate.Version (Version)
: Version of the blockchain and the applicationChainID (string)
: ID of the blockchainHeight (int64)
: Height of the block in the chainTime (google.protobuf.Timestamp)
: Time of the previous block.
For most blocks it's the weighted median of the timestamps of the valid votes in the
block.LastCommit, except for the initial height where it's the genesis time.LastBlockID (BlockID)
: Hash of the previous (parent) blockLastCommitHash ([]byte)
: Hash of the previous block's commitValidatorsHash ([]byte)
: Hash of the validator set for this blockNextValidatorsHash ([]byte)
: Hash of the validator set for the next blockConsensusHash ([]byte)
: Hash of the consensus parameters for this blockAppHash ([]byte)
: Data returned by the last call to Commit
- typically the
Merkle root of the application state after executing the previous block's
transactionsLastResultsHash ([]byte)
: Root hash of all results from the txs from the previous block.EvidenceHash ([]byte)
: Hash of the evidence included in this blockProposerAddress ([]byte)
: Original proposer for the blockLastResultsHash
is the root hash of a Merkle tree built from ResponseDeliverTx
responses (Log
, Info
, Codespace
and Events
fields are ignored).Block (uint64)
: Protocol version of the blockchain data structures.App (uint64)
: Protocol version of the application.Address ([]byte)
: Address of the validator (the first 20 bytes of SHA256(public key))Power (int64)
: Voting power of the validatorPubKey (PubKey)
: Public key of the validatorPower (int64)
: Voting power of the validatorValidator (Validator)
: A validatorSignedLastBlock (bool)
: Indicates whether or not the validator signed
the last blockType (string)
: Type of the public key. A simple string like "ed25519"
.
In the future, may indicate a serialization algorithm to parse the Data
,
for instance "amino"
.Data ([]byte)
: Public key data. For a simple public key, it's just the
raw bytes. If the Type
indicates an encoding algorithm, this is the
encoded public key.Type (EvidenceType)
: Type of the evidence. An enum of possible evidence's.Validator (Validator
: The offending validatorHeight (int64)
: Height when the offense occuredTime (google.protobuf.Timestamp)
: Time of the block that was committed at the height that the offense occuredTotalVotingPower (int64)
: Total voting power of the validator set at
height Height
Round (int32)
: Commit round.Votes ([]VoteInfo)
: List of validators addresses in the last validator set
with their voting power and whether or not they signed a vote.Block (BlockParams)
: Parameters limiting the size of a block and time between consecutive blocks.Evidence (EvidenceParams)
: Parameters limiting the validity of
evidence of byzantine behaviour.Validator (ValidatorParams)
: Parameters limiting the types of pubkeys validators can use.Version (VersionParams)
: The ABCI application version.MaxBytes (int64)
: Max size of a block, in bytes.MaxGas (int64)
: Max sum of GasWanted
in a proposed block.
MaxAgeNumBlocks (int64)
: Max age of evidence, in blocks.
MaxAgeDuration (time.Duration)
: Max age of evidence, in time.
It should correspond with an app's "unbonding period" or other similar
mechanism for handling Nothing-At-Stake
attacks.
MaxAgeNumBlocks
&& MaxAgeDuration
is considered
stale and ignored.MaxAgeDuration
is usually equal to the
unbonding period. MaxAgeNumBlocks
is calculated by dividing the unboding
period by the average block time (e.g. 2 weeks / 6s per block = 2d8h).MaxNum (uint32)
: The maximum number of evidence that can be committed to a single block
PubKeyTypes ([]string)
: List of accepted pubkey types. Uses same
naming as PubKey.Type
.AppVersion (uint64)
: The ABCI application version.Ops ([]ProofOp)
: List of chained Merkle proofs, of possibly different types
Type (string)
: Type of Merkle proof and how it's encoded.Key ([]byte)
: Key in the Merkle tree that this proof is for.Data ([]byte)
: Encoded Merkle proof for the key.Fields:
Height (uint64)
: The height at which the snapshot was taken (after commit).Format (uint32)
: An application-specific snapshot format, allowing applications to version
their snapshot data format and make backwards-incompatible changes. Tendermint does not
interpret this.Chunks (uint32)
: The number of chunks in the snapshot. Must be at least 1 (even if empty).Hash (bytes)
: An arbitrary snapshot hash. Must be equal only for identical snapshots across
nodes. Tendermint does not interpret the hash, it only compares them.Metadata (bytes)
: Arbitrary application metadata, for example chunk hashes or other
verification data.Usage:
Metadata
). Chunks may be retrieved from all nodes that have the same snapshot.