Well, there is the whole 'going mad and losing track of what you yourself are feeling/thinking' if you're strong enough and completely without shields. Speaking as someone who had crappy shields and undeveloped telepathy for better than twenty years, it's not a particularly good way to live.