I've wondered this for a bit. Another major limitation is nerves. If we could move them around and/or repair them, then that is one step closer to being able to make any changes to a person's skull.
I heard that when touching a nerve lightly with even a micro-needle, it would damage it.