I filed child support on child’s father, what will happen if he gets angry and tries to keep my child?

Me and my young daughters father get along for the most part, but he holds her child support over my head. He only pays on his terms (which is normally a small amount every 2 or 3 months). It’s not that he doesn’t have the money he is very well off. He works off and normally has her for 3-5 days out of the month. After worrying for awhile I decided to file for child support. I feel he is going to be very upset when he gets served with papers. I’m scared that when he gets served may be when she is staying with him and he will try to keep her. Thing is, he works out of town so he will only leave her with his mother to raise. I’m just preparing myself in case but if this happens, is there anything I can do about it?