DEV Community: decentralizuj

Find linux process with bash

decentralizuj — Wed, 07 Apr 2021 17:27:40 +0000

If you ever found yourself googling how to find active processes in linux, or process with the highest CPU, save this post as a reference, and save code into the script.

COMMANDS:

ps aux
#=> list processes

grep 'firefox'
#=> show firefox processes

awk *opts
#=> choose what we want to print

We will use this simple commands, so let's make a script for this:

#!/usr/bin/env bash

#  Define 'help' banner
function print_help() {
  echo -e "--------------------------------------------------------------"
  echo -e " - procfind will print the highest CPU% processes"
  echo -e " - procfind firefox - will print firefox processes"
  echo -e "--------------------------------------------------------------"
}

  #  max number of processes to show
  processes="10"

  if [ "$1" == "-h" ] || [ "$1" == "--help" ]; then
    print_help
    exit

  else

    # If first argument is passed as string, search processes for that arg
    echo "CPU |PID |MEM |START |COMMAND"
    ps aux | grep "$1"| awk '{print $3,$2,$4,$9,$11}' | sort -rn | head -n "$processes"
  fi
  exit

Save script as you want (procfind) and give it executable permissions with sudo chmod +x procfind. No .sh at the end because we defined our environment #!/usr/bin/env bash.

Now if we run ./procfind -h, we will get:

------------------------------------------------------------
 - ./procfind will print the highest CPU% processes
 - ./procfind firefox - will print firefox processes
------------------------------------------------------------

If we run ./procfind firefox:

CPU |PID |MEM |START |COMMAND
20.2 24281 10.1 16:04 /home/USERNAME/PATH/tor-browser_en-USA/Browser/firefox.real
11.8 24209 12.5 16:03 ./firefox.real
1.9 24325 9.8 16:04 /home/USERNAME/PATH/tor-browser_en-USA/Browser/firefox.real
1.4 24361 5.2 16:04 /home/USERNAME/PATH/tor-browser_en-USA/Browser/firefox.real
0.7 31245 6.0 18:25 /home/USERNAME/PATH/tor-browser_en-USA/Browser/firefox.real
0.0 376 0.0 19:21 grep

Check your Ruby Developer Level with simple task

decentralizuj — Mon, 05 Apr 2021 21:51:40 +0000

I just found an old post from @evanilukhin showing interview task - Simple word calculator. I was reading it on my mobile, so first I read his post, and decided to not look at the answer code (anyway it's impossible to understand on small android display).

Ruby Interview Tasks - Simple word calculator

Ivan Ilyukhin ・ Dec 23 '19 ・ 1 min read

#ruby

Task is next: make this code work:

one.plus.two.equal    # =>  3
one.minus.three.equal # => -2

While you're on interview, it can be harder than it should be. Few minutes later electricity came back (some works during this morning... awful), so I decided to try to solve it (in his post I read it's good for every developer to check his skills... and it's true). You have a link to his post if you want to read it and see his results (probably better than mine, but hey, 10 minutes on android 5, and it works... :P).

So what do you think, are you able to make this code work without reading the rest? Here's my solution (first one, fast one):

My Answer

  class One
    def initialize
      @num = 1
    end

    def plus
      @opt = :add
      return self
    end

    def minus
      @opt = :rmw
      return self
    end

    def two
      case @opt
        when :add then @num += 2
        when :rmw then @num -= 2
      end
      return self
    end

    def three
      case @opt
        when :add then @num += 3
        when :rmw then @num -= 3
      end
      return self
    end

    def equal
      num  = @num
      @num = 1
      return num
    end
  end

  one = One.new
  one.plus.two.equal    =>  3
  one.minus.three.equal => -2

and about 10 minutes later I decided to make this more DRY, and to allow it to use 'one' chained more times (like original article code work)

  class One
    def initialize
      @num = 1
    end

    def one
      use_number 1
    end

    def two
      use_number 2
    end

    def three
      use_number 3
    end

    def plus;  set_opt(:add) end
    def minus; set_opt(:rmw) end

    def equal
      num  = @num and @num = 1
      return num
    end

    private

    def set_opt(opt)
      @opt = opt; return self
    end

    def use_number(number)
      case @opt
        when :add then @num += number.to_i
        when :rmw then @num -= number.to_i
        else @num
      end
      @opt = nil
      return self
    end
  end

one = One.new
one.plus.two.equal # => 3
one.plus.two.minus.three.plus.one.equal => 1

Get server stats with bash

decentralizuj — Mon, 05 Apr 2021 21:11:36 +0000

This is script to get server stats printed in terminal and saved as txt output (or not). I will not explain each command, but for total beginners I will say that commands are piped with I, so take each command and use with -h in terminal to get more info.

# example to get help for awk
awk -h

# commands are piped with |
# get free memory with 'free'
# output it to 'tail' to print last line
free -m | tail -n 1

So here's the full script, you can remove # at last 2 lines to save output and/or show notification on desktop.

#!/usr/bin/env bash

#  Define Output Log-File (or not)

OUTPUT_LOG=~/sys-log.txt

#  Define Colors

  R="\e[0m" #reset
  U="\e[4m" #underline
  Y="\e[33m" #yellow
  RED="\e[37m" #light red

#  Format Date and Time

DATE=$(date +%m/%d/%Y)
TIME=$(date +%k:%M:%S)
DAY=$(date +%A)

#  User Logged In

USER=$(whoami)

#  System Uptime

UPTIME_S=$(uptime -s)
UPTIME_P=$(uptime -p)
UPTIME=$(uptime -s && uptime -p)

#  Free Memory

FREE=$(free -m | head -n 2 | tail -n 1 | awk {'print $4'})

#  Free Swap Memory

SWAP=$(free -m | tail -n 1 | awk {'print $3'})

#  CPU Idle

CPU=$(vmstat 1 2 | sed -n '/[0-9]/p' | sed -n '2p' | awk '{print $15}')

#  Free Disk Space

SPACE=$(df -h / | awk '{ a = $4 } END { print a }')

#  Define banner to print

  banner() {

    echo ----------------------------------------------------------------------
    echo -e "$RED" DAY: "$R"$DAY "$RED"'\t'DATE: "$R"$DATE "$RED"'\t'TIME: "$R"$TIME"$R"
    echo ----------------------------------------------------------------------
}

#  Define nice-print stats

  print_stats() {

    echo -e "$R"WELCOME:"$R"'\t|\t'"$Y"$USER

    echo -e "$R"UPTIME: "$R"'\t|\t'"$Y"$UPTIME

    echo -e "$R"FREE MEMORY:"$R"'\t|\t'"$Y"$FREE MB

    echo -e "$R"FREE SWAP:"$R"'\t|\t'"$Y"$SWAP MB

    echo -e "$R"CPU IDLE:"$R"'\t|\t'"$Y"$CPU %

    echo -e "$R"DISK SPACE:"$R"'\t|\t'"$Y"$SPACE
}

#  Define One-Line output log

  output() {

    echo "$DATE | $TIME | $USER | $UPTIME_S | $UPTIME_P | $FREE MB | $SWAP MB | $CPU % | $SPACE"
}

### ### ###

#  Execute Defined Functions

  clear && banner           # Print Banner

  print_stats               # Print Stats

#  output >> $OUTPUT_LOG     # Save Output (or not)

#  Display Desktop Notification

#  ALERT=$(notify-send -u normal "Free Space :  $SPACE   |   CPU USAGE :  $CPU %  |   Free Mem :  $FREE MB") && echo -e $ALERT

Are You Lucky Bastard?

decentralizuj — Sun, 04 Apr 2021 15:52:03 +0000

decentralizuj / luckybastard

Introduction

This is a fun-only project, just to do something fun while drinking amazing cold Nescafe-Shake.

So how it works? SecureRandom create 32bits random hex string. This string is used by Money-Tree gem to make Master Node of Bip32 HD wallet. I could just let money-tree to create random seed, but where's my fun then?

Let's start!

You can add gems into Gemfile, then use it for luckybastard, but most of ruby devs have this gems installed. In case you don't have:

# install gems localy with:
gem install money-tree colorize

or

# create Gemfile and add gems
# run `bundle install` to install them
gem 'money-tree'
gem 'colorize'

Now create file called luckybastard.rb and open it. Write shebang (because I guess you're on linux, if you are on windows, go install linux), and require needed dependencies.

#!/usr/bin/env ruby

require 'securerandom'
require 'money-tree'
require 'open-uri'
require 'colorize'
require 'net/http'

MoneyTree and Colorize are gems we need to install, and other dependencies need to require.

Let's create our class LuckyBastard

  # class LuckyBastard - code is part of this

  # max-time to sleep if request fail
  SLEEP = 2

  # default type of checking address
  TYPE  = :sent


  def initialize( max_sleep = SLEEP, type = TYPE )

    # count all requests (generated seeds)
    @counter = 0

    # this counter reset on 10, to show in terminal
    @count = 0

    # type of address-check
    @type = type

    # is loop paused
    @work = false

    # max_sleep between fail requests
    @pause = max_sleep

    # start time
    @start = Time.now.to_i
  end

After initializing variables, it's time to make methods to get/set/use them.

  # set max_pause time
  def pause=(max_sleep)
    @pause = max_sleep
  end

  # get max_pause time
  def pause
    @pause
  end

  # check is paused or not
  def pause? 
    @work == true
  end

  # start or stop loop
  def pause!
    if pause? then start else stop end
  end

  # stop loop
  def stop
    @loop = false
  end

  # start loop if paused (or not)
  def start
    pause! if pause?
    until pause? do execute end      
  end

  # from check(address)
  def success?
    @balance > 0.0
  end

That's all for public methods. Now we need LuckyBastard#execute (used in #start). That method will use another to generate seed and check for address balance. This methods should be private.

Private methods you can't call directly. You put them inside public method to run.

# ... public code

  private

  # called from #start
  def execute

    # generate random keys
    random_private_key!

    # check address balance
    check @address 
    @count += 1

    # if balance is more then 0.0
    if success?
      @end = Time.now.to_i - @start

      # write valid data to file and print them
      write_to_file(@address, @balance, @hex_seed)
      puts "[*] Valid seed found in #{(@end / 60)} minutes".yellow
      puts "[!] Enter 'Q' to quit, or any key to continue (q/Q):".yellow

      # get answer from input, exit if include q/Q
      answer = STDIN.gets.chomp
      %w[q Q].include?(answer) ? exit(1) : start

    # when fail, print data if 10 seeds generated
    elsif @count >= 10

      # add previous seeds to total counter 
      @counter += @count

      # clean screen and print number of generated seeds
      system 'clear' or system 'cls'
      print "\n >> Looking for [".green + "#{@type.to_s.upcase}".yellow + "]".green
      puts " coins on random address".green
      puts "\n " +" #{@counter} ".black.on_yellow + " random seeds checked...".yellow
      puts ""

      # print fail address data, do not save
      write_to_file(@address, @balance, @hex_seed, save: false)

      # reset count, so we can count next 10 seeds
      @count = 0

      # sleep random time, we defined maximum
      sleep rand(pause)
    end
  end


  def random_private_key!

    # generate random 32bit hex string
    @hex_seed = SecureRandom.hex 32

    # make new master node, and get address
    @address = MoneyTree::Master.new(seed_hex: @hex_seed).to_address
  end


  def check(address)

    # define to check for `received/sent` by address
    type = @type.to_s 
    url  = "https://blockchain.info/q/get#{type}byaddress/#{address}"
    data = Net::HTTP.get URI url

    # get balance in float
    return @balance = data.to_f 

    # if request fail, sleep 1 min and repeat
    rescue
    puts 'request timeout, repeating process in 60 seconds...'
    sleep(60) and start
  end


  def write_to_file(address, balance, seed, opt = {})
    @data = " #{Time.now.to_s}" + "\n"
    @data += "\n Address: #{address}\n Balance: #{balance}\n HexSeed: #{seed}"

    # do not save if option save is true (for invalid seed)
    File.write("#{address}.txt", @data) unless opt[:save] == false

    # print red for fail, green for success (balance > 0)
    clr = success? ? :green : :red
    puts @data.colorize(clr)
  end

After you put this code inside LuckyBastard class, you can write one more method as a shortcut to run loop

class LuckyBastard

  # all previous code here

  def self.start!(max_sleep = 2, type = :sent)
    LuckyBastard.new(max_sleep, type).start
  end

end

You need a way to run it from terminal. Without arguments print help instructions, which tell us to run with --start, and to add --sent if we want.

  # check for received coins unless args include `--sent`
  type = ARGV.include?('--sent') ? :sent : :received

  # start if args include start, or print help
  if ARGV.include?('--start')
    system 'clear'
    puts "\n Starting random seed generation..."
    LuckyBastard.start! 2, type
  else
    puts "\n              Are You Lucky Bastard?".green.bold
    puts "      Generate random hex seed and find out!".green.bold
    print ' '
    50.times { print '='.green } and puts
    puts "  Get received by address:".white
    puts "   $ ruby luckybastard.rb --start".light_green
    puts "  Get sent by address:".white
    puts "   $ ruby luckybastard.rb --start --sent\n".light_green
  end

Create new ruby gem - Moriarty part-3

decentralizuj — Fri, 02 Apr 2021 11:27:10 +0000

decentralizuj / moriarty

Moriarty - Tool to check social networks for available username

In past series I created moriarti.rb (responsible for everything). I love to work with ruby scripts, because of ability to write powerful/useful code in short time. But this only works for "small projects". If we want to extend script after some time, It'll become pain in the ass. For this we have ruby-gems, which are easily extendible even for different developer.

Performance advice:

Each require make ruby slower. Do not create gem with a few lines of code and many requires. For that case, make a script file and use it until you want to extend it.

Create Ruby Gem

First thing is to create directory where you want your ruby gem. In root directory create bin and lib folders. That's same for every gem.

  # Moriarty directory tree

moriarty |
         | - bin/ 
         |
         | - lib/

Lib folder handle our scripts, and bin (binaries) handle executable files. Now let's go back to the root of our gem. We need few more files to add there.

  # Moriarty root files

Gemfile
Rakefile
README.md  # important!
moriarty.gemspec

Let's talk about README file first. It's important to create and to write few lines about gem. Even if you do not plan to opensource it, or share with others, after some time you'll forget what you did 6 month ago in which file. To avoid time and nerve lose, don't be lazy and create it. Same thing with comments in source code - it's not must to go in details, just something to help you remember those details.

Pro TIP:

Too many comments make source code unreadable. make comments short, write code to be readable. I wrote all this comments for purpose of learning. If you want to add comments in right way, learn RDoc. I will write another article about generating RDoc from gem's comments.

Gemfile handle our dependencies from .gemspec file, so bundler know what to install:

# Moriarty Gemfile

source 'https://rubygems.org'

# this line tell bundler where to look
gemspec

Gemspec file contain everything about our gem. Dependencies, name, description, version, site... but also all files that our gem use. Specification also have data about executable files, so when we install our gem locally, we can run it moriarty USERNAME instead of ruby bin/moriarty from root directory.

This is a reason why all objects should define path when work with files, because working directory is not always script directory.

# Gemspec file (moriarty.gemspec)

# frozen_string_literal: true
Gem::Specification.new do |s|
  s.name        = 'name'
  s.version     = '0.1.0'
  s.summary     = 'short description'
  s.description = <<~DESC
    # Write long description here.
  DESC
  s.authors  = ['...']
  s.homepage =  '...'
  s.license  =  '...'

  s.metadata['homepage_uri']    = '...'
  s.metadata['source_code_uri'] = '...'
  s.metadata['bug_tracker_uri'] = '...'

  # here you add all files from your gem
  s.files = ['README.md', 'LICENSE']

  # directory with executable
  s.bindir = 'bin'

  # one or more executable files
  s.executables   = ['...']

  # directory with our files
  s.require_paths = ['lib']

  # define gems needed to work
  s.add_runtime_dependency 'colorize', '~> 0.8.1'
  s.add_runtime_dependency 'rest-client', '~> 2.1.0'
  s.add_runtime_dependency 'nokogiri', '~> 1.11.2'

  # define gems needed for development
  s.add_development_dependency 'bundler', '~> 2.2.9'
  s.add_development_dependency 'rake', '~> 13.0.3'
end

With all of this, we're ready to create files that will handle our code. In lib/ we will create file moriarty.rb, and that file will require all other files. This way our executable (or other gem) need to require just one file for everything to work.

# lib/moriarty.rb

#!/usr/bin/env ruby
require 'rest-client'
require 'colorize'
require 'nokogiri'

require_relative 'moriarty/cli'

Here I required dependencies from gemspec. I explained in first article why I use rest-client. I also required relative file moriarti/cli, and we need to create it. Don't think about it too much for now.

From our script file I will copy almost all methods. I will not copy #find! and code we used to run script. Only code to construct username, url, send request and receive response.

#
# Main class to get data and execute request
#
# Methods: [ #new, #go, #success?, #make_url, #url=, #user= ]
#
# Attributes:
#  :user     = :moriarty     => 'moriarty'
#  :url      = 'example.com' => 'https://example.com/'
#  :response => [.code, .headers, .body]  -> restclient#get
#  :html     => scrapped HTML if success? -> nokogiri#html
#

class Moriarty

  attr_reader :url, :user, :response, :html

  # Set username and site for search request
  # exclude 'https', #make_url will add it for you
  # To use different protocol, set it as third parameter
  #
  # @jim = Moriarty.new( 'moriarty', 'example.com', :http )
  #  => @jim.user == 'moriarty'
  #  => @jim.url  == 'http://example.com/'

  def initialize( name = '', site = 'github.com', type = :https )
    @user = name.to_s
    @url  = make_url site, type
  end

  # execute request (args are optional)
  # @jim.go site: 'github.com', user: 'mynickname'
  #  => true/false
  #  -> @jim.response (.code, .headers, .body)
  #  -> @jim.html (page HTML if request success)

  def go( opt = {} )
    opt[:user] ||= @user
    url = opt[:site].nil? ? @url : make_url(opt[:site])
    uri = url + opt[:user]
    @response = RestClient.get uri
    @html     = Nokogiri::HTML @response
    return @success = true
    rescue
    return @success = false
  end

  alias search go

  # create URL from site name, add 'https' if needed
  # @jim.make_url 'instagram.com'
  #  => 'https://instagram.com/'

  def make_url( link, prot = :https )
    prot = nil if link.to_s.start_with? prot.to_s
    url  = prot.nil? ? link.to_s : prot.to_s + '://' + link.to_s
    url += '/' unless url.end_with?('/')
    return url
  end

  # Set URL from site name and protocol(optional)
  # @jim.url = 'github.com'
  #  => @jim.url == 'https://github.com'

  def url=( link, start = :https )
    @url = make_url link, start
  end

  # Set username from string or :symbol
  # @jim.user = :moriarty
  #  => @jim.user == 'moriarty'

  def user=( name )
    @user = name.to_s
  end

  # Check does request succeeded or not
  # @jim.success?
  #  => true/false

  def success?
    @success == true
  end
end

Now it's time to create lib/moriarty directory, and cli.rb inside. That file I will use for methods we need in CLI (in future versions, that will be removed).

class Moriarty

 class << self

  # Moriarty.find! 'smartuser'      
  #  => [FOUND!] if username 'smartuser' is free on github
  #
  # Moriarty.find! :stupiduser, 'facebook.com', :hunt
  #  => [FREE!] if user 'stupiduser' is registered on facebook

  def find!( username, web = 'github.com', type = :search )

    @jim = Moriarty.new username.to_s, web.to_s
    @jim.go

    name = print_name(username).to_s
    site = print_url(web).to_s

    case    
    when type.to_sym == :hunt && @jim.success?
      p1('+')
      p1('FOUND!')
      p2(" #{name}", :cyan, :bold)
      p2(" found on >> ") 
      puts p2(site, :cyan, :bold)
    when type.to_sym == :hunt && !@jim.success?
      p1('-', :red, :red)
      p2(" #{name} fail on ", :red)
      puts p2(site, :red)
   when @jim.success?
      p1('-', :red, :red)
      p2(" #{name} is taken on ", :red)
      puts p2(site, :red)
    else
      p1('+')
      p1('FREE!')
      p2(" #{name}", :cyan, :bold)
      p2(" is free on >> ")
      puts p2(site, :cyan, :bold)
    end
  end

  # #hunt! is alias for #find! with :hunt option
  # Check is user 'stupiduser' registered on instagram
  #  -> Moriarty.hunt! 'stupiduser', 'instagram.com'

  def hunt!( name, site = 'github.com', type = :hunt)
    find! name, site, type
  end

  # Remove extensions from domain name
  # Moriarty.print_url('https://www.github.com')
  #  => 'github'

  def print_url( site )
    site, name = site.to_s, ''
    if site.start_with?('http')
      site.gsub!("https://", '') or site.gsub!("http://", '')
    end
    site.gsub!("www.", '') if site.start_with?('www.')
    ext = site.to_s.split('.').last
    name = site.gsub(".#{ext}", '')
    name = name.split('/').first if ext.size < 5
    return name.capitalize
  end

  # Remove extensions from username
  # Moriarty.print_name('@moriarty')
  #  => 'moriarty'

  def print_name( name )
    name.gsub!('@','') if name.to_s.start_with?('@')
    name.gsub!('#','') if name.to_s.start_with?('#')
    name.gsub!('/u/','') if name.to_s.start_with?('/u/')
    return name
  end

  def p1( title, color1 = :'light_green', color2 = :cyan, type = :bold )
    str = ' ['.colorize(color2) + title.to_s.colorize(color1) + ']'.colorize(color2)
    str = str.bold if type == :bold
    print str
  end

  def p2( title, color = :cyan, type = :regular)
    str = title.colorize(color)
    str = str.bold if type == :bold
    print str
  end
 end
end

In cli.rb we again define class Moriarty, but this time accept only self methods. Note that you can create as many files as you want, just require them in main lib/moriarty.rb, and add in .gemspec.

Now we have our classes, but we need a way to execute it in terminal. For that we will create bin/moriarty:

#!/usr/bin/env ruby

# require 'lib/moriarty', which will require 'moriarti/cli'

require_relative '../lib/moriarty'

  # Simple way to try first version
  # accept '--hunt' as argument

  hunt = ARGV.include?('--hunt') ? :hunt : :search
  message = hunt == :hunt ? "Starting hunt on user -> " : "Starting search for free username -> "

  # If no args, or include '-h' or '--help', print banner
  # If use '--hunt', do not search for '--hunt' username

  if ARGV.empty? or ARGV.include? '-h' or ARGV.include? '--help'

    puts "\nSearch social networks for free username".cyan
    puts " $ ".white + "ruby bin/moriarty sherlock watson".green
    puts "\nRun with --hunt to search for registered users".cyan
    puts " $ ".white + "ruby bin/moriarty sherlock watson --hunt\n".green
    exit(1)

  else

    system 'clear' or system 'cls'
    start_time = Time.now.to_i

    ARGV.each do |user|
      next if user == '--hunt'

      puts
      Moriarty.p2(message, :cyan, :bold)
      Moriarty.p1(user)
      puts; puts

      Moriarty.find! user,         'github.com',            hunt
      Moriarty.find! user,         'rubygems.org/profiles', hunt
      Moriarty.find! "@#{user}",   'dev.to',                hunt
      Moriarty.find! "@#{user}",   'medium.com',            hunt
      Moriarty.find! "/u/#{user}", 'reddit.com',            hunt
      Moriarty.find! user,         'youtube.com',           hunt
      Moriarty.find! user,         'facebook.com',          hunt
      Moriarty.find! user,         'instagram.com',         hunt
      Moriarty.find! "@#{user}",   'tiktok.com',            hunt
    end

    end_time = Time.now.to_i
    counter  = end_time - start_time

    sec = ' second'
    sec += 's' unless counter.to_s.end_with?('1')

    puts
    Moriarty.p2('Finished in ->', :cyan, :bold)
    Moriarty.p1(counter)
    Moriarty.p2(sec, :cyan, :bold)
    puts; puts
  end

Don't forget to give this file executable permissions:

sudo chmod +x bin/moriarty

Almost done! We need to add all those files in .gemspec:

  s.files = ['bin/moriarty', 'lib/moriarty.rb', 'lib/moriarty/cli.rb', 'moriarty.gemspec',
             'README.md', 'LICENSE']
  s.bindir = 'bin'
  s.executables = ['moriarty']

I added license file here (MIT in my case), that's all up to you. The easiest way is to create repository on GitHub and choose license.

To be able to use rake tasks, open Rakefile and add:

require 'bundler/gem_tasks'

Now you can use your gem from terminal:

ruby bin/moriarti sherlock --hunt

Or compile into gem:

bundle exec rake build

To push into rubygems:

# register on rubygems

gem push pkg/moriarti-0.1.0.gem

Or upload to github and use from git:

# Gemfile of some app

require 'moriarty', '~> 0.1.0', git: 'https:github.com/....'

Next article will be about refactoring gem and terminal use (options, colors, output...)

Small code refactor - Moriarty part-2

decentralizuj — Fri, 02 Apr 2021 01:40:56 +0000

decentralizuj / moriarty

Moriarty - Tool to check social networks for available username

GIF preview v-0.2.0 - without latest changes'

Gem is still in alpha, many things will be added (like scrapping info from social networks) Breaking changes are highly possible, so I do not suggest use of this gem except for development and test That means, do not use it in production services, otherwise feel free to play with it.

Moriarty

Tool to check social networks for available username.
Idea from python tool - sherlock

What it do

Search multiple social networks for free username. It's reverse from Sherlock, so not-found username is success. Argument --hunt will run search like sherlock would, looking for valid users.

How to install

Clone repo and install dependencies:

# Moriarty use rest-client, nokogiri and colorize gems
 git clone https://github.com/decentralizuj/moriarty.git && cd moriarty && bundle install

Or install from rubygems:

DISCLAIMER GitHub repository is updated before Rubygems. Before v-1.0.0 is released, recommended way is to clone repo,…

View on GitHub

First code is never good enough, especially in Ruby, where everything could be done in many different ways. I'll start with initializer:

  # Set username and site for search request
  # exclude 'https', #make_url will add it for you
  # To use different protocol, set it as third parameter
  #
  # @jim = Moriarty.new( :moriarty, 'example.com', :http )
  #  => @jim.user == 'moriarty'
  #  => @jim.url  == 'http://example.com/'

  def initialize( name = '', site = 'github.com', prot = :https )
    @user = name.to_s
    @url  = make_url site, prot
  end

Here we added 'make_url(site_name, protocol)'. This method purpose is to construct URL from string, so we can use dev.to instead of https://dev.to.

  # create URL from site name, add 'https' if needed
  # @jim.make_url 'github.com'
  #  => 'https://github.com/'

  def make_url( link, prot = :https )
    prot = nil if link.to_s.start_with? prot.to_s
    url  = prot.nil? ? link.to_s : prot.to_s + '://' + link.to_s
    url += '/' unless url.end_with?('/')
    return url
  end

Here we can add parameter site: github.com in Moriarty#go, without https://. In first part I said that we'll create setters manually. Now we can use #make_url in setter to create link from string.

  # Set URL from site name and protocol(optional)
  # @jim.url = 'github.com'
  #  => @jim.url == 'https://github.com'

  def url=( link, prot = :https )
    @url = make_url link, prot
  end

  # Set username from string or :symbol
  # @jim.user = :moriarty
  #  => @jim.user == 'moriarty'

  def user=( name )
    @user = name.to_s
  end

It's time to edit Moriarty#go, method in charge to send request.

  # execute request (args are optional)
  # @jim.go site: 'github.com', user: 'mynickname'
  #  => true/false
  #  -> @jim.response (.code, .headers, .body)
  #  -> @jim.html (page HTML if request success)

  def go( opt = {} )

    # define username to search, or use default
    opt[:user] ||= @user

    # if option 'site:' is 'nil', use default
    # otherwise construct url with '#make_url'
    url = opt[:site].nil? ? @url : make_url(opt[:site])

    # create url for request, and send
    uri = url + opt[:user]
    @response = RestClient.get uri

    # try to scrap data from page
    @html     = Nokogiri::HTML @response

    # return true or false
    return @success = true
    rescue
    return @success = false
  end

  # add alias search, just because of convention
  alias search go

There's one more thing that we should add here, to check for response success:

  # Check does request succeeded or not
  # @jim.success?
  #  => true/false

  def success?
    @success == true
  end

Create method to execute search request, and output data in terminal. Default method is search for free username, in that case fail requests mean username is free. If we define :hunt as type parameter, we will search for registered user.

  # Find method is responsible to handle all other methods
  # and to tell use final results

  def find!( user = @user, web = @url, type = :search )

    @jim.go user: user, site: site

    name = print_name(user).to_s
    site = print_url(web).to_s

    case    
    when type.to_sym == :hunt && @jim.success?
      puts "#{name} found on #{site}"

    when type.to_sym == :hunt && !@jim.success?
      puts "#{name} not found #{site}"

   when @jim.success?
      puts "#{name} is taken on #{site}"

    else
      puts "#{name} is free on #{site}"
    end
  end

Methods #print_name and #print_url prepare strings for printing in cli. Names are cleaned from signs like @, #, /u/, and site is stripped of extensions and capitalized.

  # Remove extensions from domain name
  # Moriarty.print_url('https://www.github.com')
  #  => 'github'

  def print_url( site )

    # define site from string
    # make name empty string
    site, name = site.to_s, ''

    # if site start with 'http', try to remove 'https'
    # if not, then remove 'http'

    if site.start_with?('http')
      site.gsub!("https://", '') or site.gsub!("http://", '')
    end

    # remove 'www.' from sitename, if included

    site.gsub!("www.", '') if site.start_with?('www.')

    # split domain on '.' to get extension, and remove it

    ext  = site.to_s.split('.').last
    name = site.gsub(".#{ext}", '')

    # if ext is longer then 5, routes contain more data
    # example: 'rubygems.org/profiles/*'

    name = name.split('/').first if ext.size < 5

    # first letter uppercase

    return name.capitalize

  end

  # Remove extensions from username
  # @jim.print_name('@moriarty') 
  #  => 'moriarty'

  def print_name( name )
    name.gsub!('@','') if name.to_s.start_with?('@')
    name.gsub!('#','') if name.to_s.start_with?('#')
    name.gsub!('/u/','') if name.to_s.start_with?('/u/')
    return name
  end

Now we have class with all objects needed to do what we want it to do. For sites that need to check html for success (like twitter), there's variable @html ( getter Moriarty.html ).

Let's run search from terminal. How? We need to define sites to search, and usernames. We'll define sites as array, and accept usernames as arguments. If we add --hunt, it will run in hunt mode, otherwise in default (search for free name).

  # define sites to search

  SITES = [ 'github.com', 'dev.to' ].freeze

  # run hunt if arg --hunt included, otherwise search

  hunt = ARGV.include?('--hunt') ? :hunt : :search

  unless ARGV.empty?

    @jim = Moriarty.new :jim

    ARGV.each do |user|
      SITES.each do |site|

        next if user == '--hunt'
        @jim.find! user, site, hunt

      end
    end

  end

Thanks all for reading this post(s), don't forget to share content...somewhere :) In next article I'll pack and compile this into a gem.

Search Social Networks for free username - Moriarty part-1

decentralizuj — Thu, 01 Apr 2021 14:03:58 +0000

You can find this gem on GitHub and rubygems. Sharing is the best way to donate for my development. This is part of multiple series content about moriarty gem and it's creation, from script to gem. It's intended for beginners

decentralizuj / moriarty

Moriarty - Tool to check social networks for available username

GIF preview v-0.2.0 - without latest changes'

Moriarty

Tool to check social networks for available username.
Idea from python tool - sherlock

What it do

Search multiple social networks for free username. It's reverse from Sherlock, so not-found username is success. Argument --hunt will run search like sherlock would, looking for valid users.

How to install

Clone repo and install dependencies:

# Moriarty use rest-client, nokogiri and colorize gems
 git clone https://github.com/decentralizuj/moriarty.git && cd moriarty && bundle install

Or install from rubygems:

DISCLAIMER GitHub repository is updated before Rubygems. Before v-1.0.0 is released, recommended way is to clone repo,…

View on GitHub

After using Sherlock for a long time (like it!), I decided to create something similar in Ruby. This give me more power to extend software with new features easily, like scrapping info from website, comments from FB, tags from photos etc... For me, ruby is much over python (because of dev happiness, and many ways to do the same thing). When I say "over" python, I talk about personal experience, not about Ruby VS Python

Start Project

What script should do:

take username
take website url
submit request
receive response

For http request I'll go with gem rest-client, and here's why. RestClient response is used to scrap page html data with Nokogiri::HTML method. If we use Net::HTTP#get instead of RestClient#get we will get all positive results. But with rest-client in use, nokogiri fail if there's no page to scrap, even if response code is 200. So here I used rescue to set @success to false. This do not work for all sites, so I need to check scrapped data in future.

#!/usr/bin/env ruby

require 'rest-client'
require 'nokogiri'

class Moriarty

  # initialize new object, set user and url
  # add https and '/' to the end

  def initialize( name = '', site = 'github.com', type = :https )
    @user = name.to_s
    @url  = type.to_s + '://' + site.to_s
    @url += '/' unless @url.end_with?('/')
  end


  # make request to url
  # accept optional options hash

  def go( opt = {} )
    # use initialized data or enter new
    opt[:user] ||= @user
    opt[:site] ||= @url  

    # construct url from sitename and username
    uri = opt[:site].to_s + opt[:user].to_s

    # make request with rest-client
    @response = RestClient.get uri

    # get page html with nokogiri
    @html = Nokogiri::HTML @response

    # if everything is fine, set and return true
    # otherwise, set and return false
    return @success = true
    rescue
    return @success = false
  end
end

Part of job is done. But we must somehow access this variables, so we need to define attr_reader (we will create setter methods manually).

class Moriarty
  attr_reader :url, :user, :response, :html, :success?
  # ... ...
end

Now we can use Moriarty class like this:

# This way we can check GitHub, dev, instagram, but we can't
# check linkedin etc... This is because those pages return
# data to nokogiri to scrap, even if no user

  @jim = Moriarty.new( 'moriarty', 'github.com' )
  @jim.go 

  if @jim.success ?
    puts "#{@jim.user} is registered on #{@jim.url}"
  else
    puts "Username #{@jim.user} seems to be free on #{@jim.url}"
  end

This post is part of multiple series. In next part I will add all other methods from gem, and in third I will create ruby gem. Last, but not least will explain CLI interface use.

With next updates I will add methods to scrap from html and check is user registered or is false-positive. If registered, data will be saved in some kind of database (I like CSV for this kind of data, or just a .txt)

Next series will come soon, in next hours...

CLI - GIF recording with Ruby and SCROT

decentralizuj — Wed, 31 Mar 2021 20:14:14 +0000

Preview GIF created with ScreenScrot:

Take a look about Moriarty on GitHub:

decentralizuj / moriarty

Moriarty - Tool to check social networks for available username

Open-Source Development need donations, in my case that's link/repo sharing, instead of Bitcoin. Comments, discussions and opinions are highly appreciated (good or bad).

Introduction

GIF recording is great to show your friends how the script work. I was looking for an easy way to capture my script output into GIF, but somehow I couldn't find anything that suit my needs. I decided to write few lines of code, and to make it work just like I want.

First, I want to capture screenshots from my terminal, and to have it saved in PNG, so I can use those photos as background or something. I want to start it from terminal, and to record only active window, but with ability to record everything sometimes (or to select with mouse). At the end, I want to enter for how long to capture screenshots, before gif creation. Let's start!

Install SCROT and ImageMagick

On ubuntu-like linux:

sudo apt update -qq
sudo apt install scrot imagemagick -y

Now it's time to write some ruby code to do what we want. Create file called 'screenscrot.rb'.

Create class ScreenScrot

Create class, define constants and make initializer accept args or use those constants.

# capture screenshots on linux with ruby and scrot
# save photos as .png
# create gif with imagemagick

class ScreenScrot

  TITLE = 'screenscrot' # name of file and folder to create
  PATH  = Dir.pwd    # define path to root directory
  EXT   = :png  # screenshots extension

  attr_reader :title, :ext, :path, :directory, :c

  def initialize( title = TITLE, path = PATH, ext = EXT )

    @c = 0
    @path, @ext, @title = path.to_s, ext.to_s, title.to_s

    @path     +=  '/' unless @path.end_with?('/')
    @filename  =  @title + '_' + rand(999).to_s
    @directory =  @path + @filename + '/'

    system "mkdir -p #{@directory}" unless Dir.exist?(@directory)
    Dir.chdir(@directory)

  end
end

Here, TITLE is constant to use if parameter title is not defined. Path is path to the working directory, and extension is for captured screenshots. Our new object accept all those parameters, or will use this ones if not defined. After title I added random number, so I do not overwrite past screenshots if I want to record it again (so if I use 'recorder', it will become 'recorder_456'. That is saved in variable @filename. We add this filename to path, together with '/' at the end, and we get @directory variable, which is path where we will save our screenshots and gif at the end). If directory not exist, it will be created and entered.

Capture screenshots

This method is here to save .png screenshot that we will use later with imagemagick.

  # record active window
  # use :all to capture everything
  # use :select to capture select rec window
  # >> @screen.capture(:all)

  def capture( win = :active )

    case win.to_sym
      when :all      then scr = ''    # rec everything
      when :select   then scr = '-s'  # select with mouse
      else scr = '-u'                 # active window (default)
    end

    # without name scrot add timestamp, but that is too slow
    # if use .to_i we get 1 screenshot per second only
    # so we use .to_f and then remove '.' from name
    screenshot = @directory + Time.now.to_f.to_s.gsub!('.', '')

    # prepend command for scrot, add counter to the name
    # so we can save all frames without problems
    exec = "scrot #{scr} -q 10 #{screenshot + @c.to_s}.#{@ext}"

    `exec`

    @c += 1    # captured frames counter

  end

With this we have option to save screenshots into folder, with chosen quality, extension and part of screen to save. Default is active window, so part of screen that is active when recording start. If you change terminal, do it on same part of screen. Otherwise use :select, so you click with mouse on window you want to record. Last option is :all, that will record entire screen.

Convert into GIF

After getting screenshots, we will use ImageMagick's convert to create animated GIF.

  def to_gif( name = nil, opts = {} )

    # if name param is nil or '' use default title
    name  = @filename if name.empty?
    @gif = name.to_s

    # accept options hash or use default values
    opts[:dir]   ||= @directory
    opts[:ext]   ||= @ext
    opts[:delay] ||= 20
    opts[:loop]  ||= 2

    Dir.chdir(opts[:dir])

    # add .gif to the filename, if do not contain 
    @gif += '.gif' unless @gif.end_with? '.gif'

    # construct ImageMagick's convert command from parameters
    exec = "convert -delay #{opts[:delay]} -loop #{opts[:loop]} *.#{opts[:ext]} #{@gif}"

    # create GIF
    `exec`
  end

That's it! Method #to_gif accept filename and options hash as parameters, or will use default values. Default filename is @title, and delay is pause in microseconds between two frames. I will add some sleep between capturing screenshots because I do not need all those frames for terminal recording. Loop param define how many times to repeat animation. Zero is infinite loop, but all other values will be increased by one (if loop is 1, it's played once. If loop is 2, animation is played and repeated two more times, which is 3 times at all).

GIF created this way is high quality, even when png quality in scrot command is set to 10 (100 is max). This lead to pretty big file, but still it's ok for short videos. This can be fixed with more arguments in convert command.

Run script

To run everything, I just made it simple. Accept time to record, gif name and part of screen to record as arguments. First argument is time to record, default is 60. Second is name, default is screenscrot. Third arg is part of screen, default is active (that's why script count 5 seconds, so you can activate window to rec).

  # enter name as second argument or use hardcoded TITLE
  puts "Start Recording Screenshots..."
  name = ARGV[1] or ScreenScrot::TITLE

  # initialize new object with name
  @screen = ScreenScrot.new name

  # clean terminal and count 5 seconds before start
  system 'clear'

  cnt = 5
  cnt.times do
    puts "Starting in #{cnt -= 1}"
    sleep 1
    system 'clear'
  end

  puts "[Screenshot Recording Started]"  

  str_time = Time.now

  # add recording time as first argument, in seconds
  # default is 60
  max_time = ARGV.empty? ? 60 : ARGV[0].to_i

  # check args for window recording type
  # if contain --all or --select, use it, else use :active
  display = :active
  display = :select if desplay.include?('--select')
  display = :all    if display.include?('--all')

  # save screenshots untill time elapsed
  # add small sleep because we record terminal
  until (Time.now - str_time).to_i >= max_time do
    @screen.capture(display)
    # edit or remove sleep, per use-case
    sleep 0.2
  end

  # notify about end, print time in minutes and number of frames
  print "[Screenshot Recording Stopped] after "
  puts  "#{(Time.now - str_time).to_f.round(2)} seconds"

  # at the end, create GIF animation
  puts "\n [GIF!] - Start creating gif animation:"
  puts "   Name: #{@screen.gif}"
  puts "   Path: #{@screen.directory}\n"

  @screen.to_gif

  # notify user about end, print file name and directory
  print "[CREATED!] - #{@screen.c.to_s} frame"
  print "s" unless @screen.c.to_s.end_with?('1')
  puts  "collected into GIF animation."
  puts

With this you can make nice gif animation of terminal, for showcase or to record tests...

ruby screenscrot.rb 60 myfilename --all

DEV Community: decentralizuj

Find linux process with bash

Check your Ruby Developer Level with simple task

Ruby Interview Tasks - Simple word calculator

Ivan Ilyukhin ・ Dec 23 '19 ・ 1 min read

Get server stats with bash

Are You Lucky Bastard?

decentralizuj / luckybastard

Introduction

Let's start!

Create new ruby gem - Moriarty part-3

decentralizuj / moriarty

Moriarty - Tool to check social networks for available username

Create Ruby Gem

Small code refactor - Moriarty part-2

decentralizuj / moriarty

Moriarty - Tool to check social networks for available username

Moriarty

What it do

How to install

Search Social Networks for free username - Moriarty part-1

decentralizuj / moriarty

Moriarty - Tool to check social networks for available username

Moriarty

What it do

How to install

Start Project

CLI - GIF recording with Ruby and SCROT

decentralizuj / moriarty

Moriarty - Tool to check social networks for available username

Introduction

Install SCROT and ImageMagick

Create class ScreenScrot

Capture screenshots

Convert into GIF

Run script

Full Script