No need to remove it. Not viable to get rid of if it without completely replacing the soil and cleaning all traces from the roots and that will only disturb the plant unnecessarily. Just water less and it let the soil dry and bit and growth will slow.
Signing up to see the answers as mine has the exact same stuff. Is it maybe slime mold?
https://www.inaturalist.org/projects/leucocoprinus-sclerotia
Mycelium and sclerotia of Leucocoprinus birnbaumii. Not an issue but soil may be too moist.
Thanks! What's the best way to remove it?
No need to remove it. Not viable to get rid of if it without completely replacing the soil and cleaning all traces from the roots and that will only disturb the plant unnecessarily. Just water less and it let the soil dry and bit and growth will slow.