Look around these forums - there are many people who have made peltier 'blocks' where the water directly comes into contact with the peltier element, and sealed the assembly around the edges with epoxy or similar to prevent leakage. It's certainly not an efficient way of doing it, though.