I have two loans that comprise one mortgage. Is it possible to refinance only one?

The first loan is a decent interest rate, but the second is high. Can I refinance just the one to get a lower rate?