The AE-2 will be just fine with the HD580s. Sure, it's a portable amp, and there are those limitations that come with it, but I'm positive that they'll do the job perfectly fine (and then some). Personally, I like the HD580's sound straight out of the iPod, but to each his own.