You apparently do. Mostly, cause AMP is somewhat restrictive in regards to loading certain HTML assets/scripts/css, just to provide that ‘feel of speed’.
Turns out some of the out-of-the-box scripts from Google Tag Manager won’t work in AMP. In fact, the very same code of the TagManager scriptlet won’t work smoothly either or create problems on certain actions.
Instead, Google Tag Manager allows you to create an AMP ready TagManager code, and in that implementation, you will only have available what’s possible in AMP, tags events and all.
^(Also, AMP is evil and should be banned from the face of the planet.)