Former Alberta premier Jason Kenney says the governing United Conservative Party caucus has "no business" signing a petition to force a vote on the province quitting Canada.