Brainwash, no, but it's a power that shouldn't be held by normal humans. It's a piece of a larger whole, and the untold power the temporal crystal had isn't to be trifled with.

We haven't seen what a shard will do if in contact with a human, but we know it's dangerous to let it happen at all.