My facial hair grows fast. I need to shave every day, and could probably shave twice a day without much trouble. I've noticed that my facial hair grows faster when I'm lazy, like just sitting at home in front of the computer or sleeping a lot. While when I'm expending a lot of energy it will grow slower, like when I was sailing for ten days in a row on a small boat.
My guess is that the body just conserves energy for other more vital functions when you're working hard, so hair grows slower. Though I've got no proof of this.
I'm not suggesting you become lazy though.