The KISS principle is something that I "try" to live my life by. No, it's not about kissing girls (or is it?), KISS in this case stands for "Keep It Simple Stupid". Finances, or even life in general, is much easier and efficient if you keep it simple.
I think one of the things that prevents people from getting started with improving their finances is spending too much time trying to figure out the "best" or "optimum" thing to do. They get caught up in calculations and complex strategies to try to shave a tiny bit off their debt or to squeeze an extra 0.5% return out of their investments over 20 years.
For most people it's much better to just do "something" and (like you say) do it now. Anything at all to get them headed in the right direction is better than agonizing over whether you'd be slightly better off buying or renting, or contributing to an RRSP or a TFSA, or investing in fund X versus fund Y.
Just start saving, paying off your debt, reducing expenses and worry about the complicated stuff later.
Then GatesVP adds:
If you're new to this and you've decided to turn your financial life around, just pick the worst financial offender in your life and fix it up. Rinse and repeat. Expect to be at it for a year or two, especially if you have a complex life with kids and cars and mortgages and two jobs and credit card debt.
So like the readers mentioned above, if you have a money problem, hack at it one at a time. If you have analysis paralysis (as I often do), if the choices will achieve close to the same result, dive into one option. The key, I believe, is to do something and to keep it as simple as possible.
photo credit: kartik_mistry