Four men are each given a unique number from $1$ to $4$, and four women are each given a unique number from $1$ to $4$. How many ways are there to arrange the men and women in a circle such that no two men are next to each other, no two women are next to each other, and no two people with the same number are next to each other? Note that two configurations are considered to be the same if one can be rotated to obtain the other one.