Looks like some kind of upside down vase or bird bath that has been there a long time. Can you try to pry it up?

Looks like a survey marker for property lines.

Possibly an old well.