Depending on when you bought, you may be able to roll at least some of the costs into the newly re-financed loan, if the house is worth quite a bit more than what you still owe. Talk to your bank, and also talk to a couple of other banks about refinancing. A good rule of thumb is that if you can recoup the cost of refinancing within 2 years (and you plan to stay in the house longer than that), then it is worth it to refinance.

You want a lower rate? Refinance.

The only issue is you are too cheap to do this. Sorry.

HOWEVER, usually with a refin, there are no transfer taxes since you are NOT transferring the property. In fact, many lenders have zero cost refinancing or very low costs – much much less the a purchase.