For pictures coming from a good source (dvd, good divx, ...) if the picture is sharp, it is better to keep its size, i.e 720 for a DVD.
If it is blurry (zoomed picture, VHS, TV, ...) then it is better to reduce it a little, e.g. 640 or less.