How long have the males been blooming for? Male blossoms will start blooming before the female flowers usually around 10 days to attract pollinators to the plant and then the females will slowly start to bloom after that. As for your squash starting to grow then shriveling while it's still small...