Archive

Archive for the ‘Programming’ Category

Installing RVM (Ruby Version Manager) in Xubuntu 12.04 or Slackware 14

2013-01-23 Leave a comment

When I first started learning Ruby I found out about RVM which was a great project as I could easily switch between ruby versions based on what I wanted. To get RVM installed in Xubuntu (Ubuntu) 12.04 took more work then I’m normally use to with Slackware. I’ve had to install it on multiple systems with a space between each install making my memory fuzzy about what is required to get everything working. So I decided to dump my information here for later reference and who knows the next time I do it and something changes I’ll update this page. With out delay the processes can be copied and pasted below.

All the required dependencies to get it working that don’t get installed with ubuntu. I’ll create a VM where I can test to see which packages aren’t required since I was installing a few other packages I needed at the time all in the same line.

$ sudo apt-get install build-essential openssl libreadline6 libreadline6-dev curl git git-core zlib1g zlib1g-dev libssl-dev libyaml-dev libsqlite3-dev sqlite3 libxml2-dev libxslt-dev autoconf libc6-dev ncurses-dev automake libtool bison subversion pkg-config

For Slackware you can skip the dependencies since everything we need is already installed. Since packages/libraries are managed the slack way the need to disable the autolibs functionality of rvm is required. More about autolibs can be found here

Installing RVM and ruby, taken from the RVM install documentation found here.
Slackware 14

$ \curl -L https://get.rvm.io | bash -s stable --ruby
$ ~/.rvm/bin/rvm autolibs 0
$ ~/.rvm/bin/rvm install ruby

*buntu 12.04

$ \curl -L https://get.rvm.io | bash -s stable --ruby
$ rvm install ruby
Advertisements
Categories: Computers, Linux, Programming, Ruby

SSH private/public keys with passphrase and agent manager

2012-12-04 Leave a comment

Managing multiple systems that you only have access to by ssh can be annoying when you have to keep typing in ssh <HOST/IP>; then typing your password on each system.

This article explains how to use ssh pub/priv key pairs with a passphrase and ssh-agent.
The goal is to make logging in remotely more secure by using key pairs along with a passphrase but only having to use the passphrase once in a given time period.

First you’ll need to generate your own private/public key pair on the system you’ll be sshing FROM using the following command.

$ ssh-keygen -t rsa -b 4096 -f ~/.ssh/<ROLE>_rsa -C "Comment goes here"
Enter file in which to save the key (/home//.ssh/id_rsa):
Enter passphrase (empty for no passphrase):

NOTES:
You should never give your private key file or it’s contents to anyone. Think of it like a key to your house anyone that has it can access your “house”(server).

  • The comment just helps to let you know what the key is used for. I normally put the server(s) I’m going to push the public key too in the comments. This could be considered a minor security risk labeling where the key is used.
  • Some systems default to DSA, I recommend RSA 2048 bits or higher for the keys hence the keygen options -t rsa -b 4096. Two short write ups about DSA vs RSA can be found and .
  • Do not leave the passphrase empty as the worst case someone gets hold of your private key or gains access to your account they at least have to know the passphrase (back to the previous way of using just a password for security) to use it. An empty passphrase means anyone with the key can enter the server if they know which server the key is used on (hence the comment security risk).
  • If you generate more than one key pair and use the same passphrase, entering the passphrase will make all the key pairs that use that passphrase active at the same time.

Now that we have the keys generated the next step is to copy the .pub key text to the remote servers .ssh/authorized_keys file. I wrote this little bash script as a wrapper for the command used to publish the key. It prompts for what user to ssh with and the server host/ip then the ssh-copy-id command will prompt for the users password. It will automatically create the .ssh directory and append the key to the authorized_keys file. If your system doesn’t have ssh-copy-id I have included a bash 1 liner below the script that will check if the .ssh directory exists and create it then append the public key to the authorized_keys file.

if [[ -z "$sshusername" ]] && [[ -z "$serverIPaddress" ]] ; then
## Prompt for the user name to use
echo -en "\nIs $USER the account you want to use? \n" ;
select yn in "Yes" "No"; do
case "$yn" in
Yes ) sshusername="$USER" ; break ;;
No ) read -p "Type the username you want to use: " sshusername ; break;;
esac
done ;
echo -en "\n" ;

## Prompt for the server name or IP
read -p "Type the Hostname or IP address of the server: " serverIPaddress ;
echo -en "\n" ;

## The actual command to copy the key over
ssh-copy-id "$sshusername"@"$serverIPaddress" ;

## Clean up of the vars we used
unset sshusername ;
unset serverIPaddress ;
else
## The system uses the variables?!?
echo -en "Your system currently has the following variables set.\n sshusername AS $sshusername\n serverIPaddress AS $serverIPaddress\n\n";
fi ;

One way to push the new pub key to the server is by using the ssh-copy-id binary command. If you are using some other port besides 22 you’ll need to include the username/host and port option all in quotes.

#ssh-copy-id -i <path to pub key> "username@host/ip -p <port>"
ssh-copy-id -i .ssh/id_rsa.pub lifeforce4@example.com
ssh-copy-id -i .ssh/id_rsa.pub "lifeforce4@example.com -p 9999"

Bash one liner for pushing public key to remote system if youre unable to use ssh-copy-id. Be sure to put the correct and <HOST/IP> settings for the ssh command.

cat ~/.ssh/id_rsa.pub | ssh @<HOST/IP> 'if [[ -z "$HOME/.ssh" ]] ; then mkdir $HOME/.ssh ; fi ; cat - >> ~/.ssh/authorized_keys'

Now we should have a priv/pub key par in our .ssh folder and on the remote system our public key should be in the authorized_keys file. To test if it’s working ssh to the system. You should be prompted with the following instead of the @<HOST/IP>’s password:

$ssh server
Enter passphrase for key '/home//.ssh/id_rsa':

Upon entering the correct passphrase you will now be logged in to the remote system. Exit out of the system and try sshing again you’ll notice you get prompted again for the passphrase. Great all this seemed to do was add an extra layer of security but didn’t stop the annoying issue of each time having to enter a password/passphrase.

Now it’s time to use a key manager such as ssh-agent which allows us to enter the passphrase once and after that anytime we try to ssh to any server that has our public key we’ll get direct access (for a given amount of time before we have to reenter the passphrase).

On my systems I create two alias commands some people want to have their system prompt for the password when they open a session the first time I prefer to start start it when I need too that way if a day I don’t need to ssh to a server (it happens some times…) my shell doesn’t have access.

The two aliases I use are below.

## type agent once on the machine your are using unless the time elapses or the system was rebooted
## Removes the old hostname agent file
## starts the agent with 28800 seconds (8hrs) to be active in memory
##   and story the environment variables to access the keys in memory in the .agent file
## run the .agent file as a Tlc script and then add the private key identities to the authentication agent
alias agent='rm -f "$HOME"/.ssh/`hostname`.agent ; ssh-agent -t 28800 | grep -v echo > "$HOME"/.ssh/`hostname`.agent ; source "$HOME"/.ssh/`hostname`.agent ; ssh-add'

## Any new shells you just need to run this alias to have them use the agent in memory
alias sshagent='if [ -e "$HOME"/.ssh/`hostname`.agent ]; then source "$HOME"/.ssh/`hostname`.agent ; fi'

Now you have the generated keys with the remote system(s) having the public key in the auth file and you are able to use an agent so you only have to enter your passphrase once allowing you to ssh to any systems with the public key with out any prompts.

A system is only as secure as it’s user.

Categories: Bash, Computers, Linux, Security

ddclient config for namecheap

2012-06-15 Leave a comment

Ok so I was hitting my head on the desk trying to figure this out even after chatting with namecheap. I’m guessing what they were trying to tell me to do was for a different version number of ddclient or they just didn’t know.

I have tested this on two systems with two different versions of ddclient both work.

Distro ddclient
Slackware 14 3.8.1
CentOS 6.2 3.7.3
Raspbian (wheezy) 3.8.0

Don’t add quotes around the password or add commas/backslashes after each line.

The only thing you really need to look at is the namecheap section at the bottom of my complete ddclient.config file below. I also give a full example to help with any confusion that might happen.

Due to a bug in ddclient any identical subdomains under different domains will be ignored and only the last one updated unless you patch it. You can find more information about the bug and how to patch it here.

ddclient.config

daemon=600                              # check every 600 seconds make sure
syslog=yes                              # log update msgs to syslog
mail=root                               # mail all msgs to root
mail-failure=root                       # mail failed update msgs to root
pid=/var/run/ddclient.pid               # record PID in file.
ssl=yes                                 # use ssl-support.

## To obtain an IP address from Web status page make sure daemon checks a minimum of 600 other wise dyndns might block your client from getting the ip.
use=web, web=checkip.dyndns.org/, web-skip='IP Address' # found after IP Address

##
## NameCheap (namecheap.com)
##
protocol=namecheap
server=dynamicdns.park-your-domain.com
login=yourdomain
password=DNSPASSWORD #Do not add single/double quotes
subdomain

Example for the site google.com with the host of dev (dev.google.com).

##
## NameCheap (namecheap.com)
##
protocol=namecheap
server=dynamicdns.park-your-domain.com
login=google.com
password=8cc67226fadff52f402d31505ee85d6b
dev
Categories: DNS, Linux, Perl

Bash Color Logs

2012-05-17 Leave a comment

Simple little function that will tail a log and color the lines accordingly. With the option to exclude any lines with a given regex, currently does not work on active tails using the -f option. Copy it into your .bashrc or .bash_profile.

#####
## Program:
##    Log tail with color and option to remove lines
## Author:
##    Kyle Rizzo
##    lifeforce0 {at} gmail {dot} com
##    https://lifeforce4.wordpress.com
## Summary:
##    Simple little function that will tail a log and color
##    the lines accordingly. With the option to exclude any
##    lines with a given regex.
#####
ctail()
{
   if  [ $# -eq "3" ] ; then
      tail $1 $2 | eval "perl -pe 's/.*$3.*\n//g'" | perl -pe 's/^.*SEVERE.*$/\e[0;31;40m$&\e[0m/g; s/^.*FATAL.*$/\e[0;31;40m$&\e[0m/g; s/^.*ERROR.*$/\e[0;31;40m$&\e[0m/g; s/^.*CRIT.*$/\e[1;31;40m$&\e[0m/g; s/^.*WARN.*$/\e[1;33;40m$&\e[0m/g; s/^.*DEBUG.*$/\e[1;36;40m$&\e[0m/g; s/^.*INFO.*$/\e[0;32;40m$&\e[0m/g; s/^.*VERB.*$/\e[1;37;40m$&\e[0m/g';
   elif [ $# -eq "2" ]; then
      tail $1 $2 | perl -pe 's/^.*SEVERE.*$/\e[0;31;40m$&\e[0m/g; s/^.*FATAL.*$/\e[0;31;40m$&\e[0m/g; s/^.*ERROR.*$/\e[0;31;40m$&\e[0m/g; s/^.*CRIT.*$/\e[1;31;40m$&\e[0m/g; s/^.*WARN.*$/\e[1;33;40m$&\e[0m/g; s/^.*DEBUG.*$/\e[1;36;40m$&\e[0m/g; s/^.*INFO.*$/\e[0;32;40m$&\e[0m/g; s/^.*VERB.*$/\e[1;37;40m$&\e[0m/g';
   elif [ $# -eq "1" ]; then
      tail $1 | perl -pe 's/^.*SEVERE.*$/\e[0;31;40m$&\e[0m/g; s/^.*FATAL.*$/\e[0;31;40m$&\e[0m/g; s/^.*ERROR.*$/\e[0;31;40m$&\e[0m/g; s/^.*CRIT.*$/\e[1;31;40m$&\e[0m/g; s/^.*WARN.*$/\e[1;33;40m$&\e[0m/g; s/^.*DEBUG.*$/\e[1;36;40m$&\e[0m/g; s/^.*INFO.*$/\e[0;32;40m$&\e[0m/g; s/^.*VERB.*$/\e[1;37;40m$&\e[0m/g';
   else
      echo -en "Usage: \e[1;36;40mctail -f /Path/to/log/file\e[0m\n       \e[1;36;40mctail -f /Path/to/log/file excludeText\e[0m\n       \e[1;36;40mctail -100 mylog.txt '(SEVERE|FATAL|ERROR)'\e[0m\n       \e[0mNote: Removing lines will only work if you're not actively tailing a file with the \e[1;36;40m-f\e[0m option.\e[0m\n";
   fi
}

Create a temp log file to test each level.

for level in VERBOSE DEBUG INFO WARN CRITICAL ERROR CRIT FATAL WARNING VERB SEVERE;do tempdate=`date`; echo $tempdate $level Random text that is about the msg >> mylog.txt; tempnum=$RANDOM;sleep $((tempnum %= 9)); done
Categories: Bash, Computers, Linux, Perl, Programming

Text file lines manipulation.

2012-04-24 Leave a comment

A few simple little ruby scripts that will do some text file manipulation. If you couldn’t tell I was working on a project that required all these.

Convert all lines in a text file to lowercase (downcase) and save them in a new file, I could have saved them to the same file (see remove line number below) but I wanted to preserve the original file as well.

def fileToLower(inFile, outFile)
    File.open(outFile, 'a') do |fout|
        File.open(inFile) do |fin|
            fin.each_line do |line|
                fout.puts line.downcase
            end
        end
    end
end

Remove a specific line number from a text file.

def removeLine(fileName, lineNum)
    lines = File.readlines(fileName)
    count = 1
    File.open(fileName, "w") do |fout|
        lines.each do |line|
            fout.puts(line) unless count == lineNum
            count += 1
        end
    end
end

Get a single line from a text file.

def getSingleLine(fileName, lineNum)
   File.open(fileName) do |file|
      curLine = 1
      file.each_line do |line|
         return line if lineNum == curLine
         curLine += 1
      end
   end
end
Categories: Programming, Ruby

Basename Changer from listed text file

2012-04-18 Leave a comment
#!/bin/bash
#####
## Program:
##    Basename Changer from List
## Author:
##    Kyle Rizzo
##    lifeforce0 {at} gmail {dot} com
##    https://lifeforce4.wordpress.com
## Summary:
##    
##    
##    
#####

## Coloring Schemes
NC='\033[0;37m'
RED='\033[1;31m'
YELLOW='\033[1;33m'
BLUE='\033[1;34m'
CYAN='\033[1;36m'
WHITE='\033[1;37m'

files=($(ls *.mp3))
i=0
## read the file namelist.txt which has on each line
## a different file in the order that the users wishes
## the files located 
cat namelist.txt | while read j

## A loop to cycle though the 
do
    echo mv "${files[ $i ]}" "$j"
    (( i = i + 1 ))
done
Categories: Bash, Linux, Programming

Read lines from a file and split by delimiter.

2012-04-18 Leave a comment

This reads a file line by line and then will split the lines based on the delimiter in this case a tab.

#!/usr/bin/perl
use strict;
use warnings;

## Open the file or exit with an error
open FILE, 'exampleFile.txt' or die $!;
## Make $line equal to one line in the file at a time until the end
foreach my $line (<FILE>)
{
    ## remove the newline from $line.
    chomp($line);
    
    ## Split the line with a regex (which is just the tab char)
    my @lineElements = split(/\t/, $line);
    
    ## Loop through the lineElements array and print each one
    foreach my $element (@lineElements)
    {
        print "$element\n";
    }
}
Categories: Perl, Programming