They'll burn just fine. Make sure they're good and dry, though, that lichen can hold a bit of water.
If you have birch with those shelf-lump type mushrooms on it, they're valuable kindling, you can keep the mushrooms in a bag and use them for firestarters, they burn wet or dry!