You can remove it from your inventory before starting the Aftershocks quest, I had it stored in a chest in my house for a while beforehand, but you don't need it.
I think Tolfdir says something along the lines of "I hope you still have the staff, you may need it"- But you won't.

Kind of misleading, I know. I went and retrieved it and then didn't use it. ._.