How to get off child support if the children stay with me now?

You have two options: 1. You can try to modify custody and thus child support; or 2. You can redirect the child support payments through OCSE to you, not mom. If the children have been with you longer than eight weeks, this is a fairly straightforward process. Given that you're behind, it sounds like modifying custody would be best because you can eliminate your obligations and thus stop the arrearages from piling up. Either way, you'll need a lawyer.

You may be able to find a petition or motion to be granted child support retroactive to the date you were granted custody.