It depends on the situation.
If you use a light to keep the chicks warm, it needs to stay on 24/7 until they feather out enough to not need the heat.
If they are in an environment that allows the normal light/dark cycle without heat, they don't need a light at night.
What freaks the chicks...