Can I hold my neighbor accountable??

No; the tree is naturally growing. However, you have the right to cut the roots intruding onto your property. This should remedy your problem.

Jerry Blevins is right. You have the right to cut the roots off. If you go over the tell your neighbors what you are about to do but if they cooperate you can split the cost of cleaning up the tree without killing it you might come out better.