Warren Buffett, the CEO of Berkshire Hathaway (BRK-A, BRK-B), doesn’t think free trade should stop just because it hurts some people.

“The truth about free trade is that it benefits 320 million-plus people in a way that they really can’t see and never think about,” Buffett said at The Brazil Conference at Harvard and MIT earlier this month. “It’s not itemized on the slip when they pay at the register at War-Mart or anything of the sort. So it’s diffused. It’s unrecognized. And nobody goes to sleep at night thinking about how much better they’re living because we have free trade.”

The 86-year-old, who is also the third-richest person in the world with an estimated fortune of $74.1 billion, recognized that it does hurt specific groups of people.

“The people it hurts — and it does hurt people — it’s very specific and they know what happened to them and they don’t feel it’s fair that it happened to them and I happen to agree with them. But that doesn’t mean you stop free trade.”

Retraining isn’t necessarily the solution either. Instead, Buffett thinks there should be policies that take care people whose jobs are impacted. He noted that the United States is a “very rich” country with close to $60,000 GDP per capita.

“So you have to take care, and if you don’t take care of the people who are specifically hurt by that you can’t blame them for voting for anybody that promises them that they’ll end their pain,” Buffett said. “If you’ve got something that is a benefit to all of society and it’s going to hurt a few individuals, part of a wise administration of government policy is to make sure you take care of the people who are going to be hurt specifically. Because in a democracy otherwise they’ll get organized. I’ve got every sympathy in the world for the steelworker, but you do not want to give up free trade.”

The dangers of isolationism

He went on to argue that if the country isolated itself there could be potentially dangerous consequences.

“Just postulate two kinds of worlds — One where the United States is isolated by itself and is doing fine and much of the world is suffering because of nationalist policies we have. Or one where everybody is improving and the emerging and poorer countries are growing faster than GDP per capita than the United States,” he said. “Well, you want the second world, particularly when people have nuclear weapons around. You do not want a lot of jealous countries around the world that have nuclear weapons or cyber capabilities or whatever it may be.”

He added that it’s important for the president to be “very candid” and deliver a message that some people who don’t deserve to be hurt will be impacted lost jobs, but there will be a safety net.