I had the same thing happen on my 2004 Honda Civic years ago. The dealership replaced the voltage regulator but that did not fix the problem. Next, they replaced the alternator and that solved the problem. Have you had your battery tested? Does your Civic have the voltage regulator integrated in the alternator? I would also make sure you don’t have any loose connections.