Here are a few loose and simplified calculations for your enjoyment, based off a 165 lb individual.
m=meter, s=second, J=Joules
At 1m, individual reaches a velocity of 4.43 m/s.
At 2m, individual reaches a velocity of 6.26 m/s.
At 3m, individual reaches a velocity of 7.67 m/s.
At 5m, individual reaches a velocity of 9.9 m/s.
Velocity builds as distance increases, as does the force of impact, measured in Joules.
1m = 735J, or 136 lbs-force/square-foot (like standing with your kid brother on your back).
2m = 1470J, or 273 lbs
3m = 2205J, or 410 lbs
There are a few ways we can think about this:
A) The higher you drop from, the more force you will have to dissipate with your legs and a roll.
B) Higher drops equal faster landing velocities, meaning less time to perform landing maneuvers.
A+B=C) The decrease in reaction-time and higher forces results in a near-exponential increase in difficulty. Imagine squatting 100 lbs in a half-second. Not too bad. What about 400 lbs in a quarter-second? Perhaps, but only with proper training and coordination.