Would the law see it like that? I don't think so. I can find dozens of cases with a simple internet search showing that a landlord can't keep a security deposit if the lease is broken in accordance with the provisions in the lease. It can only be used for unpaid rent and damages caused by the tenant.
Is there no end to your whining and complaining? You broke your lease and now you want to gyp the landlord out of $50 per month because you are not honest enough to keep your word. You know, because it was verbal and you are not honest enough to man up. Hope you are not expecting a good referal from your landlord.