As the owner of your private Community, it's your responsibility to review pending members before they can join your private Community.

When you go to your Community Home page, you'll see this orange bar at the top where you can click Review to accept or deny the pending member.

You'll be prompted to your Manage Members page where you can decide the members' statuses by clicking either Approve Member or Deny Member