Firing in Haste or Anger

What should you do if you go against all the expert advice and fire an employee in haste or anger? You may need to do some damage control, depending on the circumstances that led to the impulsive firing.