Based on the information that you have given, here is what needs to happen:
First, you need a written Settlement Agreement.
Since you apparently have children and they are not yet emancipated, that Agreement needs to cover custody and parenting time, as well as child support and other child-related financial issues.
If neither your husband or you has been paying alimony (spousal support) under the "status quo," and you both agree that there will be no alimony, that should also be stated in the Settlement Agreement. (The Settlement Agreement should give the facts which form the basis for the mutual waiver of alimony.
You say that "there are no assets involved." The Settlement Agreement should also confirm that, and each of you should represent that you have provided full disclosure to the other party about any assets.
You also say that "each party will assume debt in their name from this point on" and that "there is no joint debt." Both of those things should also be stated in the Settlement Agreement.
Once the Settlement Agreement is signed by both of you, the next step is for one of you to have a Divorce Complaint properly prepared, filed and served on the other party. In that Divorce Complaint, there should be a request that the Settlement Agreement be Incorporated into the Judgment of Divorce.
You ought to be able to get a date to "put through" the divorce on an uncontested basis in fairly short order after that.
Although you are not legally required to have a lawyer involved at any point in the process, I recommend that you at least meet with a very experienced lawyer who devotes his/her entire practice to New Jersey Divorce and Family Law matters.
Go over your situation in detail with the attorney, get educated answers to your questions, and obtain expert guidance. In my opinion, it will be well worth the cost of the meeting.