Should we have tax taken out of pay or put it into saving until the end of the year for income tax bill?

I am so happy that I will get a small refund. The man that did my income tax told me to have more taken out of my check next year so I will not be paying next year.
Is it better to put my money in a savings account, then pay the taxes when they are due? Should you have more taken out of your check so you get some back or don't pay a big amount at the end of the year?