Dimmesdale & Chillingworth: Whose Sin Was Worse?

Dimmesdale felt extreme regret for his mistake and he punished himself for it. Although Dimmesdale lied to his congregation, he in a sort taught the congregation from his mistake. Dimmesdale turns to his faith for salvation, and delivers the most inspiring and meaningful sermons of his life. Even though Dimmesdale didn't have to stand on a scaffold for three hours or wear an embroidered scarlet letter like Hester, he didn't get off easy. He punished himself for his sin: whipped himself, fasted, and he had nightmares that lead him to the scaffold at night. I believe his intense guilt eventually leads to his death (right after he confessed to being Pearl's father). Chillingworth also lied about being a doctor, which is very dangerous.
On the other hand, I could understand if a reader found Dimmesdale's sin to be much worse. After all, Dimmesdale was a minister and was supposed to set a good example for the society. Chillingworth wasn't always malicious and evil- he was once a kind man. Jealousy of Hester's anonymous lover turned him into the cold, cruel monster. This proves that he loved Hester a lot. Chillingworth realized Dimmesdale was the father of Hester's daughter Pearl about halfway through the novel. One could argue that he could have killed him on the spot, but he didn't.
Although i don't find either character completely justified in their sin, I believe Chillingworth's sin to be much worse. Dimmesdale didn't hurt anyone. Well, Chillingworth didn't really either but lying about being a doctor certainly has potential to be harmful for his patients. Dimmesdale channeled something good out of his ugly affair- he taught others from his mistake.