Only one in seven displaced workers has a direct path to a growing job, and most new work in healthcare and construction can't be done remotely.