The point of a virtual currency is to get everyone out of your business. You're so into personal privacy, and your libertarian outlook, that you don't even want the government involved in your money. Even thinking about government-backed money makes you mad. Seeing Alexander Hamilton's smug face just makes you want to get "Burr" tattooed on your neck.
Assuming this outlook is common among virtual currency enthusiasts, it's not surprising that peer-to-peer networks are popular in the sector.
In general, P2P situations cut out the middlemen. Interested parties work things out with each other, rather than involving an intermediary. In the realm of virtual currencies, that means the currencies can be transferred from one individual to another, without having a bank or broker in the mix.