It usually costs more to get a second mortgage, the closing costs of which range from 2 to 3 percent of the loan amount. Closing costs are lower with most refinancing deals, especially as lenders compete for business and offer no points/no cost deals. However, you may elect to pay points when you refinance your loan in order to buy down your interest rate, and that could boost the cost.