I dunno, in my opinion there is still a large chasm between the 404LE and ESP950, HE-60, SR-0, and SR-007 (haven't heard the 4070). Granted, there is a price difference (and reliability difference in some cases), but it's a price-performance ratio that is well worth it.
FWIW, one of the best tweaks I found when I owned Maggies was placing a ficas tree roughly behind them. For example, if they sounded best 4-5' x 3-4' as you mentioned, stick the ficas in the corner.
you'll want a custom curve attenuator most likely. Nothing off the shelf will work. Also, get the gain as low as you can and have the amp still be stable.
That being said, I wouldn't do it.