I tried many different ways to calibrate system parameters. In-sample performance is really nice but out-of-sample performance is always ****.

Which ratios do you guys use? Or many suggestions? Please!