Rubber liner first. I have installed many ponds using it. With a little knowledge on how to install it correctly you can have a leak free pond for many years.
On larger ponds Reinforced PVC works well. It is not flexible enough for smaller ponds, but for the big ones it works well and is tough as nails.
