You end up with an effect like a wet sponge....very soggy and soft....which leads to poor ride due to no support for the sleepers.....
Here is an example:
Image (c)2014 SandTEngineerClassic example. The sort of issue that, if not dealt with properly, leads to incidents like the derailment at Gloucester
http://www.firstgreatwestern.info/coffeeshop/index.php?topic=13057.0 The clay subsoils around Berkshire (including North Berkshire now Oxfordshire) and Wiltshire are particularly susceptible to this. Our local highway authorities have similar problems.