splunk
Levenshtein Command
This app has been archived. Learn more about app archiving.
This app is NOT supported by Splunk. Please read about what that means for you here.
Overview
Details
This add-on uses the github distribution of the Levenshtein command to find
the raio or distance between two strings. READ the README.txt for installation.
Usage:
|levenshtein (distance|ratio) field1 field2 | table field1 field2 ratio
Examples:
sourcetype=apache | levenshtein ratio client_domain src_domain | table client_domain src_domain ratio
sourcetype=apache | levenshtein distance client_domain src_domain | table client_domain src_domain distance
sourcetype=apache | levenshtein all client_domain src_domain | table client_domain src_domain ratio distance
Please note that I tested this using Python 2.7 on a MacOS. The script calls the Levenshtein "egg" module that installs OUTSIDE of Splunk Python. It appears that the github download for Levenshtein in Python is 32 bit, which may not work as is on a 64 bit Linux machine running Splunk 64 bit.
the raio or distance between two strings. READ the README.txt for installation.
Usage:
|levenshtein (distance|ratio) field1 field2 | table field1 field2 ratio
Examples:
sourcetype=apache | levenshtein ratio client_domain src_domain | table client_domain src_domain ratio
sourcetype=apache | levenshtein distance client_domain src_domain | table client_domain src_domain distance
sourcetype=apache | levenshtein all client_domain src_domain | table client_domain src_domain ratio distance
Please note that I tested this using Python 2.7 on a MacOS. The script calls the Levenshtein "egg" module that installs OUTSIDE of Splunk Python. It appears that the github download for Levenshtein in Python is 32 bit, which may not work as is on a 64 bit Linux machine running Splunk 64 bit.
In simple terms, distance is the number of characters that differ and ratio is the percentage of characters that differ. So, rocks and docks will have a distance of 1 and ratio of .8.
From Splunker Burch Simon:
"Ever wonder if it’s possible to search things that aren’t an exact match? What if you’re looking for “Google” in your data but still want to find matches for “Gogle” and “Googlle”? Well, you’re in luck because that’s exactly what the Levenshtein command does! Extend your SplunkFu by finding and filtering results based on how close of a match they are. Say goodbye to your binary world of equals and not equals. Say hello to Levenshtein!"
Release Notes
Version 0.6
Nov. 11, 2014
Added all option to get ratio and distance fields at the same time.
Version 0.5
Nov. 5, 2014