It can be tricky to setup from an infrastructure perspective -- the way we do this is with Chef gatekeepers, you might also be able to pull it off with some form of sharding, or even a simple file being present on disk to indicate that someone has been identified as "trusted" could help, but essentially get to a state where you've got a group of engineers willing to help out with testing software, and push relatively continuously to those folks