I figured out that I can use pandoc for .csv, .odt, .docx, and .rtf.
I can also use catdoc for .doc as you suggested.
Finally, I can use xlsx2csv and xls2csv, then pipe into pandoc for .xlsx or .xls respectively.
Still looking for a way to preview .pptx files, but probably none will be found.