No you don't lose it for that ... You did not act or had conduct that was insulting, belligerent, poor sportsmanship and so on ... You neglected your duties for somewhat justifiable reasons which were family and work related so no, you don't get that taken away from you ...
Now if you want to lose it or you want to give it back that is up to you lol ...