Quiet lake shoreline with a modest home tucked behind willow trees

How People Actually Afford a Vacation Home in the Mountains (Second Mortgages, Equity, and Trade-Offs)

Most Blue Ridge second-home buyers stack cash, borrowed equity, and a mortgage to reach the median ask. What each source costs, and the tax trap inside it.

Thomas Echea

·

The Quick Version

  • Fannin’s median ask was $699,950 in July 2026, so 10% down runs about $69,995.
  • Most people who afford a vacation home here stack cash, borrowed equity, and a sale.
  • A cash-out refinance on your primary home stops at 80% loan-to-value.
  • Equity borrowed against one house to buy another is generally not deductible.
  • A 401(k) loan caps at $50,000 and repays in five years.
  • Fannin’s price-reduced share was 21.2%, against 28.0% in Gilmer and 28.8% in Union.

Last updated August 2026.

Almost nobody writes one check. Fannin County’s median asking price was $699,950 in July 2026, and most people who afford a vacation home here reach that figure by stacking two or three sources. Savings covers some. Equity borrowed against the house they already own covers more. Sometimes proceeds from a sale close the gap.

So the real question is rarely whether you qualify. It is where the money comes from, and what pulling it breaks. That second half gets skipped. Every source of funds costs you something elsewhere, and a few carry a tax bill that surfaces months after closing.

How do people actually afford a vacation home in the mountains?

By combining sources. A conventional second-home purchase needs 10% down, which is roughly $69,995 against Fannin’s July 2026 median. Very few buyers have that sitting idle and also have closing costs, reserves, and furnishing money sitting beside it.

So the stack usually runs three deep. Liquid savings covers part of the down payment. A line drawn against the primary residence covers the rest. The mortgage on the mountain house handles the remaining 90%. Sometimes a maturing investment or a business distribution replaces one leg.

I’m Thomas Echea, and I own homes in Blue Ridge and Fort Lauderdale, so I have run this arithmetic on myself as well as for clients. The stack is normal. What separates a comfortable purchase from a strained one is whether the buyer priced the cost of each leg before signing, not after.

Can you borrow against your primary home to buy a cabin?

Yes, and it is the single most common source after cash. Three instruments do it, and they behave differently.

A cash-out refinance replaces your existing mortgage with a larger one and hands you the difference. Fannie Mae caps a one-unit principal residence at 80% loan-to-value on a cash-out, so a $600,000 house carrying a $300,000 balance releases roughly $180,000 before costs. The catch is that you re-rate the entire balance, not just the new money.

A HELOC is a revolving line behind your first mortgage, usually at a variable rate. It leaves a low first-mortgage rate untouched, which matters if yours was written years ago. A closed-end second mortgage does the same thing at a fixed rate and a fixed term.

For how the loan on the mountain house itself works once the down payment is assembled, see how cabin financing works in Blue Ridge.

What does the money have to cover in the North Georgia mountains?

More than the down payment. Fannie Mae sets a two-month reserve floor on a manually underwritten second-home purchase, measured against the new payment, and an automated underwriting run can ask for more. Lenders add reserves for every other financed property you hold. The Selling Guide section on minimum reserve requirements carries the full table. That is cash the loan file needs to see and you cannot spend.

Mountain stream in Blue Ridge, Georgia
Mountain stream in Blue Ridge, Georgia.

Georgia also adds a closing-table line most out-of-state buyers have never met. The intangible recording tax runs $1.50 per $500 of the face amount of a long-term note secured by Georgia real estate. On a $629,955 loan that comes to roughly $1,890, capped at $25,000 per instrument.

Then the recurring side. Unincorporated Fannin ran 9.073 total mills in 2025, and Georgia assesses at 40% of appraised worth, so a $699,950 place carries roughly $2,540 a year. Georgia’s homestead exemption applies only to a legal residence, so a getaway pays that on the full assessed amount. The breakdown sits in the guide to Fannin County property taxes.

Does pulling equity cost you the mortgage interest deduction?

Usually, yes, and this is the trade-off buyers discover late. Interest on home equity debt is deductible only when the borrowed money buys, builds, or substantially improves the home that secures the loan. Borrow against your Atlanta house to buy a Blue Ridge cabin and the borrowed money improved a different property, so that interest generally is not deductible.

There is a second ceiling. The mortgage interest deduction covers acquisition debt on a principal residence plus one other residence, up to $750,000 combined, or $375,000 if you file separately. That ceiling applies to debt incurred after December 15, 2017. Older debt keeps a $1 million limit. Two mortgages totalling more than your line do not both deduct in full.

Worth knowing if you were waiting it out: that cap was originally written to expire after 2025, and it no longer does. The July 2025 reconciliation law made both the $750,000 limit and the equity-interest restriction permanent, so there is no sunset to plan around.

The practical consequence is that the instrument barely matters here. Cash-out refinance or HELOC, if the debt is secured by the Atlanta house and the money buys the cabin, the answer comes out the same. What changes it is which property secures the debt. A mortgage taken against the cabin to acquire the cabin is acquisition debt. Ask a CPA before you choose, not after the wire clears.

Do buyers borrow from retirement accounts?

Some do, and the rules are tighter than people expect. A 401(k) loan is limited to the lesser of $50,000 or half your vested balance, and it repays over five years. That $50,000 shrinks by the highest balance you carried on any plan loan during the previous 12 months, which catches anyone who has borrowed recently.

The longer repayment window that plans allow for a home purchase applies only to a principal residence. A mountain getaway is not one, so the five-year clock governs. On a $50,000 loan that is a real monthly obligation running alongside two mortgages, and if you leave the job the balance typically comes due much faster.

A securities-based line of credit against a taxable brokerage account avoids the retirement-plan rules entirely and settles quickly, which is why it shows up in competitive situations. It also carries a margin call if the collateral falls, so it works best as a bridge to a permanent loan rather than as the permanent loan.

Does waiting for a price cut work in Fannin County?

Less often than one county over. Fannin’s price-reduced share was 21.2% in July 2026, against 28.0% in Gilmer County and 28.8% in Union County the same month. Sellers here hold their numbers harder than the neighboring counties do.

County (July 2026)Median list priceShare of listings that cut priceMedian days on market
Fannin$699,95021.2%78
Gilmer$506,75028.0%73
Union$472,20028.8%76

Read that as a funding signal rather than a market forecast. Roughly four listings in five hold their number here. Anyone counting on a seller’s reduction to close the last $40,000 of a stack has picked the flimsiest leg. The 78-day median does buy you time to arrange the money properly, and that is the better use of patience.

What does an assembled purchase look like?

Here is the median-priced version, using a conventional second-home loan at 10% down and the county’s own tax and recording figures.

LineAmountSource
Purchase price$699,950Fannin median ask, July 2026
Mortgage on the cabin$629,955Conventional second-home loan, 90% LTV
Down payment$69,995Cash plus equity from the primary home
Georgia intangible recording tax~$1,890$1.50 per $500 of the note
Reserves the lender must see2 months of the new paymentHeld, not spent

The median listing measures 2,456 square feet at $325 per square foot, so this is a real house rather than a weekend shed. If the stack above looks tight, the honest move is a smaller number rather than a thinner reserve. Browse current inventory in the guide to cabins for sale in Blue Ridge, GA.

Frequently asked questions

How much do you need to put down on a vacation home in Blue Ridge?

Ten percent is the floor on a conventional second-home purchase, because Fannie Mae caps a one-unit second home at 90% loan-to-value. Against Fannin County’s July 2026 median asking price of $699,950, that is about $69,995, before closing costs and required reserves.

Can you use a HELOC on your primary home to buy a second home?

Yes. Lenders permit it, and it ranks among the most common down-payment sources. The limitation is tax treatment rather than eligibility. Equity-debt interest qualifies only where the borrowed money buys, builds, or substantially improves the dwelling pledged as collateral. Draw on one property to acquire another and the write-off generally disappears.

How much equity can you pull out of your primary residence?

On a conventional cash-out refinance of a one-unit principal residence, Fannie Mae caps the new loan at 80% of the home’s value. A $600,000 home with a $300,000 balance therefore releases roughly $180,000 before closing costs, and the entire balance reprices at the new rate.

Can you borrow from a 401(k) to buy a vacation home?

Usually yes, if the plan permits loans, but the limit is the lesser of $50,000 or half your vested balance, and that $50,000 is reduced by the highest plan-loan balance you carried in the previous 12 months. Repayment runs five years. The extended repayment period that plans may offer for a home purchase applies only to a principal residence, so a getaway does not qualify for it.

Is mortgage interest on a second home deductible?

Acquisition debt on a principal residence plus one other qualifies, subject to a $750,000 combined cap, or $375,000 filing separately, for debt incurred after December 15, 2017. Debt older than that keeps a $1 million limit. Renting the place out invokes a separate rulebook governing how much of the year it still counts as yours. That comparison sits in a second home versus an investment property.

What extra closing costs does Georgia charge on a mountain purchase?

The intangible recording tax is the one out-of-state purchasers miss. Georgia charges $1.50 per $500 of the face amount of a long-term note secured by real property, capped at $25,000 per instrument. A $629,955 note therefore adds roughly $1,890 at the settlement table.

Does a second home get the Georgia homestead exemption?

No. Georgia’s homestead exemption applies only to a legal residence, so a getaway is taxed on its full assessed value. Unincorporated Fannin County totalled 9.073 mills for 2025, and Georgia assesses at 40% of appraised worth, which puts a $699,950 place near $2,540 a year with no exemption available.

Thomas Echea

Thomas Echea

Founder · REALTOR® · Compass GA+ FL

Thomas Echea is a real estate broker working in North Georgia and South Florida. He represents buyers, sellers, and the long view between the two markets.

More from the journal

Recent entries.

Questions on this one?

Reply by email or pick up the phone. I read every note.