This is a male Steatoda grossa (AKA cupboard spider), despite being one of the false widow species, I wouldn't panic, nor assume there is a significant threat.
Certainly remove any that you find, if you are concerned. They are typically shy & reclusive, not aggressive, preferring darker, quieter areas. The males, like yours, are more likely to be seen as they wander in search of a mate.
It would probably be remiss of me to fail to mention that they may be capable of biting, but compared to the more infamous Steatoda nobilis, S grossa are somewhat more widespread & well established where I live, probably living in the majority of homes. I tend to find males fairly frequently in my bedroom & bathroom (I move them to other rooms, but I don't have a baby to be concerned about - if i did, I'd tip them outside), they're most concerned with just getting out of our way.