There have been some speakers over the years in plain birch cabs and they were fine if you wish to tolerate end cut ply. Klipsch did some as basics and some Euro company probably from Sweden or Finland. It works fine as long as you have good grade ply and can keep the tolerances of your work.
No reason not to in my opinion.