Need more information please!
Particularly:
Are the agents always pathfinding to the same location as one-another (does that location change over time)?
Do agents have significant differences in how they move?
Do the agents collide with one-another? If not, do you want to avoid them huddling up?
If they do collide, is the "two agents going down a very narrow corridor" situation liable to happen in your game?
If the agents share a common moving goal, I have had a positive experience performing the pathfinding in a shared space. I generated a heat map such that hotter areas are nearer the target (taking into account the movement constraints of the level geometry.) That is done just once, then each agent will just examine their local area of the heat map and simply move in whatever direction gives the greatest heat rise. For a single agent, it's the world's least efficient pathfinding algorithm but it shows significant performance gains once you have large numbers of agents. Some variety in agent movement can be produced by changing how they respond to the heat map.
I've some words and pictures about this from when I was implementing it. I think I call it a height map in that, just to be inconsistent.