Although I haven't given the GMAT myself as yet, nearly everyone I have spoken to has said that you are given a pad & pen/marker for your rough work. Even the OG mentions it. You can visit this page for more information regarding the test: On Test Day
Hope this helps. Cheers!