Participant based assignment in PR Workflow

I have set a participant based assignment in my Workflow. Role-based ="Project Manager", it's working fine but its retrieving all the project manager present on our instance rather I want that project manager of that particular project should only be retrieved and workflow item should be assigned to him for approval/rejection. Right now it's assigning the workflow to 10 people.