# BBLib BBLib (Brandon-Black-Lib) is a collection of various reusable methods and classes to extend the Ruby language. Currently the library is in an early state and is being written generally for education purposes. As such, large changes will likely occur and some functions may be incomplete or inaccurate until 1.0. One of my primary goals with the core BBLib code is to keep it as lightweight as possible. This means you will not find dependencies outside of the Ruby core libraries in this code. Further modules that do have larger dependencies will be released in separate gems. For a full breakdown of what is currently in this library, scroll down. ## Installation Add this line to your application's Gemfile: ```ruby gem 'bblib' ``` And then execute: $ bundle Or install it yourself as: $ gem install bblib ## Usage BBLib is currently broken up into the following categories: * File * Hash * Math * Net * String * Time ### File #### File Scanners Various simple file scan methods are available. All of these are toggleable-recursive and can be passed filters using any wildcarding supported by the Ruby Dir.glob() method. ```ruby # Scan for any files or folders in a path BBLib.scan_dir 'C:/path/to/files' #=> 'C:/path/to/files/readme.md' #=> 'C:/path/to/files/license.txt' #=> 'C:/path/to/files/folder/' ``` If you need only files or dirs but not both, the following two convenience methods are also available: ```ruby # Scan for files ONLY BBLib.scan_files 'C:/path/to/files' #=> 'C:/path/to/files/readme.md' #=> 'C:/path/to/files/license.txt' # Scan for folders ONLY BBLib.scan_dirs 'C:/path/to/files' #=> 'C:/path/to/files/folder/' ``` All of the scan methods also allow for the following named arguments: * **recursive**: Default is false. Set to true to recursively scan directories * **filter**: Default is nil. Can take either a String or Array of Strings. These strings will be used as filters so that only matching files or dirs are returned (Ex: '*.jpg', which would return all jpg files.) ```ruby # Scan for any 'txt' or 'jpg' files recursively in a dir BBLib.scan_dir 'C:/path/to/files', recursive: true, filter: ['*.jpg', '*.txt'] #=> 'C:/path/to/files/license.txt' #=> 'C:/path/to/files/folder/profile.jpg' #=> 'C:/path/to/files/folder/another_folder/text.txt' ``` In addition, both _scan_files_ and _scan_dirs_ also support a **mode** named argument. By default, this argument is set to :path. In _scan_files_ if :file is passed to :mode, a ruby File object will be returned rather than a String representation of the path. Similarily, if :dir is passed to _scan_dirs_ a ruby Dir object is returned. #### File Size Parsing A file size parser is available that analyzes known patterns in a string to construct a numeric file size. This is very useful for parsing the output from outside applications or from web scrapers. ```ruby # Turn a string into a file size (in bytes) BBLib.parse_file_size "1MB 100KB" #=> 1150976.0 ``` By default the output is in bytes, however, this can be modified using the named argument **output**. ```ruby # Turn a string into a file size (in bytes) BBLib.parse_file_size "1MB 100KB", output: :megabyte #=> 1.09765625 # The method can also be called directly on a string "1.5 Mb".parse_file_size output: :kilobyte #=> 1536.0 ``` All of the following are options for output: * :byte * :kilobyte * :megabyte * :gigabyte * :terabtye * :petabtye * :exabtye * :zettabtye * :yottabtye Additionally, ANY matching pattern in the string is added to the total, so a string such as "1MB 1megabyte" would yield the equivalent of "2MB". File sizes can also be intermingled with any other text, so "The file is 2 megabytes in size." would successfully parse the file size as 2 megabytes. #### Other Methods **string_to_file** This method is a convenient way to write a string to disk as file. It simply takes a path and a string. By default if the path does not exist it will attempt to create it. This can be controlled using the mkpath argument. ```ruby # Write a string to disk string = "This is my wonderful string." BBLib.string_to_file '/home/user/my_file', string # OR to avoid the creation of the path if it doesn't exist: BBLib.string_to_file '/home/user/my_file', string, false # OR call the method directly on the string string.to_file '/home/user/another_file', true ``` ### Hash #### Deep Merge A simple implementation of a deep merge algorithm that merges two hashes including nested hashes within them. It can also merge arrays (default) within the hashes and merge values into arrays (not default) rather than overwriting the values with the right side hash. Part of the code is based on information found @ http://stackoverflow.com/questions/9381553/ruby-merge-nested-hash ```ruby h1 = ({value: 1231, array: [1, 2], hash: {a: 1, b_hash: {c: 2, d:3}}}) h2 = ({value: 5, array: [6, 7], hash: {a: 1, z: nil, b_hash: {c: 9, d:10, y:10}}}) # Default behavior merges arrays and overwrites non-array/hash values h1.deep_merge h2 #=> {:value=>5, :array=>[1, 2, 6, 7], :hash=>{:a=>1, :b_hash=>{:c=>9, :d=>10, :y=>10}, :z=>nil}} # Don't overwrite colliding values, instead, place them into an array together h1.deep_merge h2, overwrite_vals: false #=> {:value=>[1231, 5], :array=>[1, 2, 6, 7], :hash=>{:a=>[1, 1], :b_hash=>{:c=>[2, 9], :d=>[3, 10], :y=>10}, :z=>nil}} # Don't merge arrays, instead, overwrite them. h1.deep_merge h2, merge_arrays: false #=> {:value=>5, :array=>[6, 7], :hash=>{:a=>1, :b_hash=>{:c=>9, :d=>10, :y=>10}, :z=>nil}} ``` A **!** version of _deep_merge_ is also available to modify the hash in place rather than returning a new hash. #### Keys To Sym Convert all keys within a hash (including nested keys) to symbols. This is useful after parsing json if you prefer to work with symbols rather than strings. An inplace (**!**) version of the method is also available. ```ruby h = {"author" => "Tom Clancy", "books" => ["Rainbow Six", "The Hunt for Red October"]} h.keys_to_sym #=> {:author=>"Tom Clancy", :books=>["Rainbow Six", "The Hunt for Red October"]} ``` #### Reverse Similar to reverse for Array. Calling this will reverse the current order of the Hash's keys. An in place version is also available. The code behind this is based on a method found @ http://stackoverflow.com/questions/800122/best-way-to-convert-strings-to-symbols-in-hash ```ruby h = {a:1, b:2, c:3, d:4} h.reverse #=> {:d=>4, :c=>3, :b=>2, :a=>1} ``` ### Math #### Keep Between Used to ensure a numeric value is kept within a set of bounds. The first argument is the number, the second is the minimum of the bounds and the second is the maximum. To specify no min or max simply pass nil as either of the bounds. ```ruby number = 17 BBLib.keep_between number, 0, 10 #=> 10 number = 0.145 BBLib.keep_between number, 0.5, 1 #=> 0.5 number = -250 BBLib.keep_betwee number, nil, 100 #=> -250 ``` ### Net Currently empty... ### String #### FuzzyMatcher FuzzyMatcher (BBLib::FuzzyMatcher) is a class for making fuzzy comparisons with strings. It implements a weighted algorithm system which uses the algorithms listed below to generate a percentage based match between two strings. There are various settings that can be toggled in addition. These settings are: * **Case Sensitive**: Toggles whether or not strings should be compared in a case sensitive manor. * **Remove Symbols**: Toggle to remove all symbols from the strings before comparing them. * **Move Articles**: Toggling this normalizes the position on preceding or trailing articles (the, an, a). * **Convert Roman**: When toggled to true, all roman numerals found in the strings are converted to integers. Current algorithms are: * Levenshtein * Composition * Phrase * Numeric ```ruby # Create a FuzzyMatcher and set it to be case insensitive fm = BBLib::FuzzyMatcher.new case_sensitive: false # Set the weight of two of the algorithms. A weight of zero effectively turns off that algorithm. fm.set_weight :levenshtein, 10 fm.set_weight :composition, 5 # Get similarity as a % fm.similarity 'Ruby', 'Rails' #=> 20.0 # Set the threshold match percent fm.threshold = 50 # Returns true if the match percent is greater than or equal to the threshold fm.match? 'Ruby', 'Rails' #=> false # Get the similarity of a string with an Array of strings. A hash is returned # with the key being the string compared and the value being its match % fm.similarities 'Ruby', ['Ruby', 'Rails', 'Java', 'C++'] #=> {"Ruby"=>100.0, "Rails"=>20.0, "Java"=>0.0, "C++"=>0.0} # Compare a string to an Array of strings but return only the match with the highest comparison result fm.best_match 'Ruby', ['Ruby', 'Rails', 'Java', 'C++'] #=> 'Ruby' ``` #### String Comparisons **ALGORITHIMS** Implementations of the following algorithms are currently available. All algorithms are for calculating similarity between strings. Most are useful for fuzzy matching. All algorithms are available statically in the BBLib module but are also available as extensions to the String class. Most of these algorithms are case sensitive by default. 1 - Levenshtein Distance A fairly simple rendition of the Levenshtein distance algorithm in Ruby. There are two functions available: **levenshtein_distance** and **levenshtein_similarity**. The former, calculates the number of additions, removals or substitutions needed to turn one string into another. The latter, uses the distance to calculate a percentage based match of two strings. ```ruby # Get the Levenshtein distance of two strings 'Ruby is great'.levenshtein_distance 'Rails is great' # OR BBLib.levenshtein_distance 'Ruby is great', 'Rails is great' #=> 4 # Or calculate the similarity as a percent 'Ruby is great'.levenshtein_similarity 'Rails is great' #=> 71.42857142857143 ``` 2 - String Composition Compares the character composition of two strings. The order of characters is not relevant, however, the number of occurrences is factored in. ```ruby 'Ruby is great'.composition_similarity 'Rails is great' #=> 71.42857142857143 ``` 3 - Phrase Similarity Checks to see how many words in a string match another. Words must match exactly, including case. The results is the percentage of words that have an exact pair. The number of occurrences is also a factor. ```ruby 'Learn Ruby, it is great'.phrase_similarity 'Learn Rails; it is awesome' #=> 60.0 'ruby, ruby, ruby'.phrase_similarity 'ruby ruby' #=> 66.66666666666666 ``` 4 - Numeric Similarity (In Progress) This algorithm is currently undergoing refactoring... 5 - QWERTY Similarity A basic method that compares two strings by measuring the physical difference from one char to another on a QWERTY keyboard (alpha-numeric only). May be useful for detecting typos in words, but becomes less useful depending on the length of the string. This method is still in development and not yet in a final state. Currently a total distance is returned. Eventually, a percentage based match will replace this. ```ruby 'q'.qwerty_distance 's' #=> 2 'qwerty'.qwerty_distance 'qsertp' #=> 5 ``` #### Roman Numeral **to_roman** Converts an integer into a roman numeral. Supports numbers up to 1000 ('M'). Anything greater will simply return a string version of the integer. Can be called directly on any Fixnum object as well as from the BBLib module. ```ruby BBLib.to_roman 20 #=> 'XX' 15.to_roman #=> 'XV' ``` **string_to_roman** Converts any integers found in a string into their roman numeral equivalent. Numbers will only be converted if they are surrounded by white space or by symbols. If the integer is embedded within alpha characters or contains a decimal, it is left untouched. The method is also extended to the String class to be called directly. ```ruby BBLib.string_to_roman "Toy Story 3" #= "Toy Story III" "Die Hard 2: Die Harder".to_roman #=> "Die Hard II: Die Harder" "Left4Dead".to_roman #=> "Left4Dead" "Ruby 2.2".to_roman #=> "Ruby 2.2" ``` **from_roman** The opposite of _string_to_roman_. Parses a string for roman numerals and converts them into integers. Also extended to the String class to call directly. Works similarly to _to_roman_ in that numerals are converted only if surrounded by white space or symbols. ```ruby BBLib.from_roman "Toy Story III" #=> 'Toy Story 3' "Super Mario Land II: Six Golden Coins".from_roman #=> 'Super Mario Land 2: Six Golden Coins' "Donkey Kong CountryIII".from_roman #=> 'Donkey Kong CountryIII' ``` #### Other **msplit** _aka multi split_ _msplit_ is similar to the String method split, except it can take an array of string delimiters rather than a single delim. The string is split be each delimiter in order and an Array is returned. ```ruby "This_is.a&&&&test".msplit ['_', '.', '&'] #=> ['This', 'is', 'a', 'test'] ``` By default any empty items from the return Array are removed. This behavior can be changed using the _:keep_empty_ named param. ```ruby "This_is.a&&&&test".msplit ['_', '.', '&'], keep_empty: true #=> ['This', 'is', 'a', '', '', '', 'test'] ``` _msplit is only available directly from an instantiated String object._ **move_articles** This method is used to normalize strings that contain titles. It parses a string and checks to see if _the_, _an_ or _a_ are in the title, either preceding or trailing. If they are found they are moved to the front, back or removed depending on the argument passed to _position_. The method is available via the BBLib module or any instance of String. ```ruby title = "The Simpsons" title.move_articles :back #=> "Simpons, The" title.move_articles :none #=> "Simpsons" title = "Day to Remember, A" title.move_articles :front #=> "A Day to Remember" ``` **drop_symbols** A simple method to remove all non-alpha, non-numeric and non-whitespace characters from a string. Extended to the String class. **extract_integers** Returns an array of all integers found within a string. The named param _:convert_ can be set to true to convert the extract numbers into Fixnums. If left false, strings are returned instead. **extract_floats** Performs the same action as _extract_integers_ except it can also pull floats from a string. The _:convert_ param is also available, but converts the strings into floats. **extract_numbers** See above. Is an alias for _extract_floats_. ### Time #### Duration parser **Parsing a duration from String** Similar to the file size parser under the files section, but instead can parse duration from know time patterns in a string. By default the result is returned in seconds, but this can be changed using the named param _:output_. The method is also extended to the String class directly. ```ruby "1hr 10 minutes 11s".parse_duration #=> 4211.0 "1hr 10 minutes 11s".parse_duration output: :hour #=> 1.1697222222222223 ``` Output options are: * :mili * :sec * :min * :hour * :day * :week * :month * :year **Create a duration String from Numeric** There is also a method to turn a Numeric object into a string representation of a duration. This method is extended to the Numeric class. An input may be specified to tell the method what the input number represents. The options for this are the same as the output options listed above. A stop can be added using any of those same options. This will prevent the string from containing anything below the specified time type. For instance, specifying _stop: :sec_ will prevent milliseconds from being included if there are any. There are also three options that can be passed to the _:style_ argument to change the output (options are _:full_, _:medium_ and _:short:). ```ruby 9645.to_duration #=> '2 hrs 40 mins 45 secs' 101.to_duration input: :hour #=> '4 days 5 hrs' 20.56.to_duration input: :hour, style: :full #=> '20 hours 33 minutes 36 seconds' 20.56123.to_duration input: :hour, style: :medium, stop: :min #=> '20 hrs 33 mins' 123124.to_duration( style: :short) #=> '34h 12m 4s' ``` ## Development After checking out the repo, run `bin/setup` to install dependencies. Then, run `rake spec` to run the tests. You can also run `bin/console` for an interactive prompt that will allow you to experiment. To install this gem onto your local machine, run `bundle exec rake install`. To release a new version, update the version number in `version.rb`, and then run `bundle exec rake release`, which will create a git tag for the version, push git commits and tags, and push the `.gem` file to [rubygems.org](https://rubygems.org). ## Contributing Bug reports and pull requests are welcome on GitHub at https://github.com/bblack16/bblib. This project is intended to be a safe, welcoming space for collaboration, and contributors are expected to adhere to the [Contributor Covenant](contributor-covenant.org) code of conduct. ## License The gem is available as open source under the terms of the [MIT License](http://opensource.org/licenses/MIT).