-다 here is the short form of -다가, marking the turn, so 올라갔다 내려오다 is going up and coming straight back down. Most of these lines pair it with a rise: four people stepping onto something and off again, a lift going up and down in eleven minutes, an index that peaked and fell back. The longer spelling 다가 내려오다 means the same thing.