And you followed these steps below? Centered the external arm of the governor linkage? Because that's whats holding it in.
PDF reader page 117
Remove tie wrap (6) and injection line (4).
Remove supply line (7).
Remove clamps (
and return line (9).
Remove clamp (10) and hose (11).
MARINE CORPS TM 05926B/06509B-34
ARMY TM 5-6115-615-34
NAVY NAVFAC P-8-646-34
AIR FORCE TO 35C2-3-386-32
If pump is pushed upwards as screws (12) are removed, rotate
crankshaft approximately 90° to rotate camshaft to low
point of cam lobe.
Remove three screws (12) and washers (13).
Position external arm of governor linkage (1, Figure 6-3) to midpoint of
travel and remove injection pump (14, Figure 6-2) and shims (15).
Do not remove actuator or fork unless damaged, refer to TM 05926B/06509B-
12/TM 5-6115-615-12/NAVFAC P-8-646-12/TO 35C2-3-386-31 manual, paragraph 4-
44