-는 거 turns an action into 'the doing of it' and 힘들다 says it is hard. When the difficulty belongs to someone else, Korean switches to 힘들어하다, 'finds it hard', which three of these lines do — about a homebody, about someone who struggles to meet people, about coping with work life. Hard here means draining or taxing, not difficult to understand.