I¡m having the same segmentation fault issue compiling AM. Installing from experimental packages works, but there's no mmal hardware acceleration.
This is an issue for certain. It's been around for three weeks, since the compile was fixed for the Pi. I know that the AM build works and compiles. I don't think this is an AM issue.
I looked at the RetroPie Setup menu install script (which works) and I can see that they isolate the installs of AM and SFML and make a script to run AM in the /usr/bin folder where the "attract" executable is usually stored. I can see they use a different libjpeg than the AM docs use. I'll also mention that the SFML compile commands have recently changed (this is shown in the SFML docs) for newer firmware versions of the Pi.
I saw the issue a while ago and have made attempts to correct it. I figured someone else would have a solution by now but I guess most people are using a downloaded image or are installing via the RetroPie Setup menu. I don't use either of these and enjoy 2.3 on my Windows build but still use 2.2 on my Pi.
I think you could hack the RetroPie Setup script to get mmal. Install ffmpeg manually before hand and then edit the RetroPie Attract-Mode script to eliminate the pre-built AV modules (libavutil-dev libavcodec-dev libavformat-dev libavfilter-dev libswscale-dev libavresample-dev). This isn't a great solution and I haven't tried it but it should work. Personally I'll work on or wait for a better solution.
P.S. This should really be a new thread called something like Segmentation Fault... RetroPie Image