First you must calibrate the stick in the Windows control panel under game controllers, and while there also check that "poll with interupts" is blank and not ticked under the stick id properties, before calibrating in AH. If its out of calibration in the system, it may cause out of calibration errors in AH.
Calibrating in AH you move the stick to the limits of its movement in ALL directions including the twist rudder control if it has one, then let the stick go to its self center, and press finish. The throttle control you also move that to its limits in each direction, but it is not important that it is centred when finishing the calibration. The stick should be showing centred once that's done. If its jumping around increase the damping on each axis, and make sure there is a little deadband set. 5%-8% is usually enough on the deadband slider. Damping set about 25%-30% initially on the damping slider, except rudder which can be more. See if that improves control. Adjust damping to suit. By setting the right amount nose bounce in AH can be reduced. More damping -smoother control but slower response. Less damping - faster response but prone to bouncing around. Select the different axis in the drop down box.
A lot of nose bounce is caused by large rudder movements, if it has a twist stick reduce the response curve about center in the sliders, you can do that for roll and pitch too, but you cannot reduce the overall "throw"