We are working to finalize an updated Tendermint specification with formal proofs of safety and liveness.
In the meantime, see the description in the docs.
There are also relevant but somewhat outdated descriptions in Jae Kwon's original whitepaper and Ethan Buchman's master's thesis.