Oftentimes when I admit to someone something I regret either doing or not doing, they will respond, "Don't feel guilty."
What they don't understand is that for me guilt has a valuable purpose. It helps me realize when I have been off course. It helps me realize that I need to repent. It is the very thing that brings me to my Savior seeking redemption. It is the very thing that helps me change and want to do better.
So yes, guilt is good.