Do all contractors have to be licensed in order to joint venture?

Yes. Please see Rule 0680-1.11. Contractors may contract as a joint venture and combine their monetary limit. The joint venture is not required to obtain a separate license; both license names should be on the contract.