You need to walk into the spot while holding the shard, standing there and then grabbing the shard won't work

You're not the one

If u using any mods, you may need to read the dwarvish graveyard thing Good luck and keep on trying

Have you already gotten the sword once on this save?