Os 304 não precisam incluir os cabeçalhos CORS. Os navegadores devem ver o 304 e usar o cache.
CORS doesn't require those headers on a 304, and indeed browsers work without them present on it. This is because many 304s are generated from intermediary caches that can't be updated to know about CORS.