Likely there are insufficient active members to cover home teaching assignments. Adult male converts often move away or can’t be located. Prospective elders often outnumber the active elders. Faithful elders often travel or move for employment or educational reasons. Some are called as high priests or receive major assignments outside the quorum. - Elder Dale E MillerI love working in the Elders Quorum. Many of the men there have enormous potential that is waiting to be unlocked, men who "are only kept from the truth because they know not where to find it" (D&C 123:12). They want to be good but think it's hard or don't understand what to do next. These men just need someone to love them and show them the way.
Visit them. Teach them. Talk to them. Love them. Many of them will respond.
I have seen it happen. The men are usually quiet in church, if they are there. They have testimonies but the flames are small. I have seen them go to the temple; I have seen them turn into bishopric counselors; I have seen them become faithful home teachers; I have seen them become better fathers.
And if any man among you be strong in the Spirit, let him take with him him that is weak, that he may be edified in all meekness, that he may become strong also. - D&C 84:106