How to test if a string contains one of the substrings in a list?
Is there any function that would be the equivalent of a combination of
For example, say I have the series
s = pd.Series(['cat','hat','dog','fog','pet']), and I want to find all places where
s contains any of
['og', 'at'], I would want to get everything but pet.
I have a solution, but it's rather inelegant:
searchfor = ['og', 'at'] found = [s.str.contains(x) for x in searchfor] result = pd.DataFrame[found] result.any()
Is there a better way to do this?
One option is just to use the regex
| character to try to match each of the substrings in the words in your Series
s (still using
You can construct the regex by joining the words in
>>> searchfor = ['og', 'at'] >>> s[s.str.contains('|'.join(searchfor))] 0 cat 1 hat 2 dog 3 fog dtype: object
As @AndyHayden noted in the comments below, take care if your substrings have special characters such as
^ which you want to match literally. These characters have specific meanings in the context of regular expressions and will affect the matching.
You can make your list of substrings safer by escaping non-alphanumeric characters with
>>> import re >>> matches = ['$money', 'x^y'] >>> safe_matches = [re.escape(m) for m in matches] >>> safe_matches ['\\$money', 'x\\^y']
The strings with in this new list will match each character literally when used with