Okay after testing this with many of my castles I have came to a conclusion. The link they grow VARIES on many factors that take place when they train. These factors are:
If I find more factors I will be sure to let you in on the secret.
Source-Series of multiple castles test on my own game.