Do all new jersey zip codes start with 0

No, not all New Jersey zip codes start with 0. While many New Jersey zip codes do start with 0, some do not.

New Jersey has a total of 565 zip codes, and they are distributed across the state as follows:

So, while a significant majority of New Jersey zip codes do start with 0, about 36% of them do not.