You have no income tax liability, but depending upon the size of the remaining balance you may face federal gift tax issues. Your son has no tax liability; your generosity in paying off his mortgage is a gift to him.
Payments within one tax year of the entire amount due to a participant in a qualified retirement plan. Qualifying lump sums may be directly rolled over tax free, or, in some cases, are eligible for current tax under a favorable averaging method.