It isn't "hard". It is "realistic". Remember that X-Plane uses realistic aerodynamic figurings and it is not a game. It is meant for realism, period.
Not trying to burst your bubble. Keep practicing. Sometime soon, given determination, you will get it.