You actually weren’t subjected to literacy tests “if your grandfather was eligible to vote”, ie your grandfather was a white citizen.