Yes, that’s normal. The Air has no fan, so during long heavy work it gets warm and quietly slows itself down a bit to stay safe. It won’t damage the Mac.
To keep exports faster: - Use it on a hard, cool surface, not your lap or a bed. - Close other apps during the export. - Use your editor’s hardware-accelerated export (H.264 or HEVC), which is much lighter on the chip.
If you export long videos often, a MacBook Pro (which has a fan) will hold full speed for longer.