It is merely a “wild guess about the distance left to goal.”
A guess that does not take into account any obstacles in the world.
So you use the shortest line between points.

It is the brown distance in the example below, used by the algorithm to compute the actual path in cyan.
It is best to underestimate the true distance, otherwise a path may be generated that is not the shortest.