The epidemiological study further concludes that, "[a]s a precaution, hunters should avoid eating deer and elk tissues known to harbor the CWD agent (e.g., brain, spinal cord, eyes, spleen, tonsils, lymph nodes) from areas where CWD has been identified.
Even so, I don't know if I would take a chance. This was for human consumption and I'm assuming humans don't eat the antlers, so maybe they just didn't warn against antlers for that reason.