Paying bills by Internet

So far, I haven't done the electronic bill pay thing, not trusting the security of the internet, Windows, and clueless IT departments at my vendors.
But my bank is driving me toward it. First they gave up on returning canceled checks some years ago. Now they are giving up on furnishing a facsimile of the check. My last statement just has DDA Check number so and so and an amount. Unless I am supermeticulus at filling out the check book, when I write the check, balancing the check book is a totally lost effort. So much for "progress" by "financial service companies" aka banks.