How do I know how tight to clamp the vice?

The vice should be tight enough that the part does not move and you cannot easily tighten the vice anymore. Unless the part is thin and liable to distortion, you should not have to worry about the vice being too tight.