It turns out that the grinding sound was missing teeth on the starter:
Here is the old starter housing:
Here is the new starter housing:
I believe that the new starter fits larger small block Chevy engines that are newer; however, I figured that I could just swap out the starter parts and it would be fine.