You sometimes find additional Waylaid supplies from enemies.
Log in with Battle.net to track your character's progress here.