A Bitcoin wallet is loosely the equivalent of a physical wallet on the Bitcoin network.
The wallet actually contains your private key(s) which allow you to spend the bitcoins allocated to it in the blockchain.
Each Bitcoin wallet can show you the total balance of all bitcoins it controls and lets you pay a specific amount to a specific person, just like a real wallet. This is different from credit cards where you are charged by the merchant.