I would generally go from front to back with regards to airflow. Also allow heat to do what it does best - rise. Front and side panel for intake, rear and top for exhaust.
What you described will work but it's not ideal in my opinion.
120mm fan filters are about $4 a piece and worth every penny!