If Gust removes a unit with Eye of the Herald during a move, is the token still created?

No. The effect tries to play a token here, but here cannot be determined at resolution because the unit is gone, so no token is created.