Get rental to leave my property

From your description, I'm assuming you are the sole owner of the home.  If he has been paying rent each month, even though no written lease, you may be able to get him out through an eviction process - first giving at least 15 days notice (assuming rent was paid month-to-month).  It would be easier with a written lease, but since he's paid rent, there's a chance you'll be successful through the eviction process (it is quicker and cheaper).  The other legal options would be an unlawful detainer (guest that's overstayed their welcome) or an ejectment.  In my experience, when it is a significant other that's the problem, either they'll leave once the process gets started or it will take a formal filing of an ejectment.  I would suggest first consulting with an attorney so that you are able to discuss the details in confidence and get the details of your best option(s).  Second, once you have the options, I'd suggest, if possible, retaining the attorney to take care of the issue for you (reasoning is that the attorney can generally operate in the courts more efficiently and to prevent the issue from growing into a bigger, more emotional, problem).