I often read that checkpoints protect the network from a 51% attack because an attacker cannot reverse transactions made before the last checkpoint.
How exactly does this checkpoint mechanism work? And who creates the checkpoints?
The checkpoints are hard coded into the standard client. The concept is, that the standard client will accept all transactions up to the checkpoint as valid and irreversible. If anyone tries to fork the blockchain starting from a block before the checkpoint, the client will not accept the fork. This makes those blocks "set in stone".
Update on this as of time of writing, just to clarify more specifically upon the other answer: dependence on checkpoints in the security model has been significantly reduced, they are only used in one very specific case now. That case is just to ignore forks from the chain early on, before the most recently seen checkpoint. When a node has seen a block it recognises as a checkpoint, any further blocks received below that height will be ignored.
It is a long term goal of removing the checkpoints entirely, because they are a source of confusion over the security model and power the developers have. But currently the role they serve is to prevent low difficulty header flooding attacks, and there has been no alternative solution proposed yet (that I know of).
Bitcoin consensus algo is probabilistic (rather than deterministic) so in theory there is always the possibility of reversibility. The checkpoint gets around that by setting how far back it with even consider looking for blocks to verify.