Now, as for idiot proof, bear in mind we don't know how ... never mind.
While you can put together a less expensive rig with careful shopping, I believe it's too confusing the first time. A kit makes life simpler.
I recommend an Aquatek regulator kit. It includes a bubble counter with check valve. It's simple, easy, and complete. The pressure is preset so all you have to adjust is the needle valve for your bubble per second or minute. By the way, never tighten a needle valve all the way down. The needle part of the name is accurate and the tip is easily damaged.
http://www.amazon.com/AQUATEK-Regul...LM7G/ref=sr_1_1?ie=UTF8&qid=1326242908&sr=8-1
which runs $80.00 currently. The only regret I have with mine is that I didn't get the six outlet version for $30.00 more.
http://www.amazon.com/AQUATEK-Regul...YYTS/ref=sr_1_3?ie=UTF8&qid=1326242908&sr=8-3
The kit is made for standard CO2 cylinders, but they offer a paint ball tank adapter for $16.99 which makes life easier for some folks.
http://www.amazon.com/AQUATEK-CO2-P...9QDC/ref=sr_1_2?ie=UTF8&qid=1326242908&sr=8-2
While that is all one really needs, a diffuser of some sort to make the CO2 bubble smaller will provide better dispersal in the tank. That diffuser could be a simple as a 1" chunk of bamboo chopstick stuck in the end of a piece of air line, connected to the bubble counter.
If you decide to go with a standard CO2 cylinder, the most complicated decision is to swap tanks or get your tank refilled.
Fortunately that will probably be decided for you by the nearest supplier.
Fire Extinguisher places refill. AirGas and Purity usually only swap tanks. They take your empty tank, charge you for the gas and give you a fresh tank.
There are about 659,476 variations on the above.