Actually divide up the permissions