Can I add a user to the site without them showing up in the staff list

Yes, when you add them to the site you need to make sure they are not in the staff list role. This will have a name like "egressive staff". Only users in this role will be displayed on the staff list page.

To find what the name of the role is use the menu to navigate to the "Administer > Site Configuration > Role Contact" page.