A tuning parameter is parameter used in statistics algorithm in order to control their behaviour. The algorithm creates normally for each value of the tuning parameter a different model.
Then it must be wisely chosen in order to get the best model. See Statistics - Model Selection