I use wood shavings for horses. A big bag is about $6 now but should last you a year.
I'm worried about plastic floor tho. That's going to be frigid in coooold weather. Can you find a dog crate bottom that would fit? And cut a couple of pieces of cardboard to fit under it? That would insulate...