É por design. Veja aqui:
EDITAR: o link original foi quebrado e não consigo encontrar uma versão atualizada dessa página. Aqui está outro que diz a mesma coisa:
If you're invited to someone else's meeting, you'll see options on how to respond, and you'll be able to look at the scheduling view to see who else is on the list, but you won't be able to see how they're responded to the invite (well not entirely). You may be able to see the details in the scheduling view (depending on whether the invited attendees have given you the permission to see their calendars).
If you didn't organise the meeting, you may be able to open the calendar of the organiser and still be able to see who responded and how.