Not sure what you have for a hone, but I have used this successfully.
Lisle 15000 micrometer head cylinder hone.
Engine Cylinder Hone, 3" - 4-1/4" Range. Shop Lisle Engine Cylinder Hone, 3" - 4-1/4" Range at ToolDiscounter
www.tooldiscounter.com
Even with the 80 grit stone it takes hours to get to .020" over, but I have done it successfully.
You will never get there with a ball hone and even a 3 finger will never happen unless you can find some coarse stones and even then it may end up egg shaped.
The Lisle hone puts even pressure that you dial in, not spring loaded.
Once you get close then switch to 240g, and 400g as you go.