Did all life start with a single bacteria?

Absolutely yes. But the "single bacterium" idea is oversimplified, as it could have happened several times simultaneously (and could still be occuring).