All birds eat "grit" which will be found in their gizzards. It is how they grind food that needs processed before digestion since they can't chew.
Oyster shell is soluble and dissolves and does not act as grit. It's highly unlikely that your roosters were eating the oyster shell but your hens...