Stop letting the supervisors waste time while pushing the workers so hard. Too hypocritical.
Create more incentive for them to stay
Dont treat your department managers like replaceable cattle.
Get rid of some of your existing management staff. Make sure managements are not exceeding their weekly hours and if so, reward them their time back. Also, higher wages for managers who are killing themselves to work for you.