Yes, I would pull the eggs, one at a time, pull loose chips of shell, check viability, and moisturize the membrane, personally.
Warm water on the membrane isn’t going to be enough in my opinion/ experience.
The sponge pieces/ paper towel small rolls will help get the humidity in the bator back...
Do you have coconut oil?
Vaseline as a second choice, Neosporin / triple antibiotic ointment (no pain killer) third, olive oil as a far fourth (it needs to be applied much more often- you are going to need to be on membrane watch...)
I would not “assist” much, but I would grab some q tips and...