You can go to the regie du logement and ask for resiliation of the lease and to evict the tenant, according to art.
1971. of CCQ, the lessor may obtain the resiliation of the lease if the lessee is over three weeks late in paying the rent or, if he suffers serious prejudice as a result, where the lessee is frequently late in paying it.
I will feel guilty if the tenant is the one who is suffering some prejudice.