IMHO: Regardless the legal system has to honor the ownership of the patent, whether they are patent trolls or not.

Some owners of patent will never have the money to go after infringers, so they sell their patents to people who have deep pocket.

It is a business just like any other, you just cant take away people rights of ownership just because they bought the patents from someone who can not enforce them.