String searching algorithm

From Wikipedia, the free encyclopedia

String searching algorithms, sometimes called string matching algorithms, are an important class of string algorithms that try to find a place where one or several strings (also called patterns) are found within a larger string or text.

Let Σ be an alphabet (finite set). Formally, both the pattern and searched text are concatenation of elements of Σ. The Σ may be a usual human alphabet (for example, the letters A through Z in English). Other applications may use binary alphabet (Σ = {0,1}) or DNA alphabet (Σ = {A,C,G,T}) in bioinformatics.

In practice how the string is encoded can affect the feasible string search algorithms. In particular if a variable width encoding is in use then it is slow (time proportional to N) to find the Nth character. This will significantly slow down many of the more advanced search algorithms. A possible solution is to search for the sequence of code units instead but unless the encoding is specifically designed to avoid it doing so may produce false matches.

Contents

[edit] Basic classification

The various algorithms can be classified by the number of patterns each uses.

[edit] Single pattern algorithms

Let m be the length of the pattern and let n be the length of the searchable text.

Algorithm Preprocessing time Matching time
Naïve string search algorithm 0 (no preprocessing) Θ(n m)
Rabin-Karp string search algorithm Θ(m) average Θ(n+m),
worst Θ(n m)
Finite automaton Θ(m |Σ|) Θ(n)
Knuth-Morris-Pratt algorithm Θ(m) Θ(n)
Boyer-Moore string search algorithm Θ(m + |Σ|) Ω(n/m), O(n)
Bitap algorithm (shift-or, shift-and, Baeza-Yates-Gonnet) Θ(m + |Σ|) Θ(n)

[edit] Algorithms using finite set of patterns

[edit] Algorithms using infinite number of patterns

Naturally, the patterns can not be enumerated in this case. They are represented usually by a regular grammar or regular expression.

[edit] Other classification

Other classification approaches are possible. One of the most common uses preprocessing as main criteria.

Classes of string searching algorithms
Text not preprocessed Text preprocessed
Patterns not preprocessed Elementary algorithms Index methods
Patterns preprocessed Constructed search engines Signature methods

[edit] Naïve string search

The simplest and least efficient way to see where one string occurs inside another is to check each place it could be, one by one, to see if it's there. So first we see if there's a copy of the needle in the first few characters of the haystack; if not, we look to see if there's a copy of the needle starting at the second character of the haystack; if not, we look starting at the third character, and so forth. In the normal case, we only have to look at one or two characters for each wrong position to see that it is a wrong position, so in the average case, this takes O(n + m) steps, where n is the length of the haystack and m is the length of the needle; but in the worst case, searching for a string like "aaaab" in a string like "aaaaaaaaab", it takes O(nm) steps.

[edit] Stubs

KMP computes a deterministic finite automaton that recognizes inputs with the string to search for as a suffix, so it doesn't need to back up. Boyer-Moore starts searching from the end of the needle, so it can usually jump ahead a whole needle-length at each step. Baeza-Yates and Gonnet uses bits in a word to keep track of whether the previous j characters were a prefix of the search string, and is therefore adaptable to fuzzy string searching. The bitap algorithm is an application of Baeza-Yates' approach.

[edit] Index methods

Faster search algorithms are based on preprocessing of the text. After building an substring index, for example a suffix tree or suffix array, the occurrences of a pattern can be found quickly. As an example can a suffix tree be built in Θ(n) time, and all z occurrences of a pattern can be found in O(m + z) time (if the alphabet size is viewed as a constant).

[edit] Other variants

Some search methods, for instance trigram search, are intended to find a "closeness" score between the search string and the text rather than a "match/non-match". These are sometimes called "fuzzy" searches.

[edit] External links

[edit] References

[edit] See also