Long configuration files have a helpful/annoying amount of comments and explanations about directives. Put this function into your .bashrc to read config files without any comments or white space:
rconf(){ cat "$@" | egrep -v '(#|^\s#*$|^$)' ; }Then re-load .bashrc file and next time you need to read a config file just:
# rconf <config file>You can select from a table into an outfile, and change the field delimiter. This is interactive, and you must be logged in locally to the mysql server, with write permissions to wherever you want to write the file.
mysql> SELECT 'pid','email' UNION SELECT pid,email INTO OUTFILE '/tmp/test.csv' FIELDS TERMINATED BY ',' FROM table;
Query OK, 11837 rows affected (0.21 sec)
mysql> Bye
# head /tmp/test.csv
pid,email
1081603,user1@fordodone.com
888151,user2@fordodone.com
781,user3@fordodone.com
2307364,user4@fordodone.com
2286573,user5@fordodone.com
2212194,user6@fordodone.com
2137603,user7@fordodone.com
500492,user8@fordodone.com
1514582,user9@fordodone.com
This is non-interactive and can be done from remote host:
# echo "select pid,email from table;" | mysql -h dbhost -udbuser -p -Ddbname | awk '{for (i=1;i<NF;i++) printf "%s,",$i; printf $i"\n"}' > /tmp/test.csvHere’s just a few ways to skin this cat:
# tac /etc/fstab | grep -m 1 fs144
10.239.11.144:/vol/vol22 /mnt/fs144/vol22 nfs auto,rw,soft,mountvers=3 0 0
# grep fs144 /etc/fstab | tail -1
10.239.11.144:/vol/vol22 /mnt/fs144/vol22 nfs auto,rw,soft,mountvers=3 0 0
# awk '{ if ( /fs144/ ) j=$0;} END {print j}' /etc/fstab
10.239.11.144:/vol/vol22 /mnt/fs144/vol22 nfs auto,rw,soft,mountvers=3 0 0I was recently handed an old Windows laptop, and told “It is broken so I know you can put it to use, and if you get my music off of it that would be awesome.” Right away I knew I had a great chance of recovering everything from the hard drive.
I took the hard drive out of the laptop and plugged it into my workstation via a SATA to USB converter. It showed right up and I mounted the partition that I thought would be the windows partition:
# ls
autoexec.bat config.sys doctemp found.000 found.003 MSOCache pagefile.sys ProgramData Program Files Users
Boot DELL Documents and Settings found.001 hiberfil.sys newfile.enc pending.un ProgramData.LOG1 $Recycle.Bin Windows
bootmgr dell.sdr Drivers found.002 Intel newkey PerfLogs ProgramData.LOG2 System Volume Information
Well, that looks familiar. Then went into the person’s user directory and did this:
# find . -type f -name '*.m4a' -o -name '*.mp3' -ls > ~/music_file_listI could have been more thorough and looked for more file extensions (acc,m4u, etc.), but I figured iTunes would just put every music file in the same folder. The resultant file looked like this:
# tail music_file_list
82837 9632 -rw------- 2 fordodone fordodone 9861791 Sep 16 2008 ./Users/laptop/Music/iTunes/Alanis\ Morissette\ -\ Jagged\ Little\ Pi\ 12.mp3
307 27696 -rw------- 2 fordodone fordodone 28357414 Oct 22 2008 ./Users/laptop/Searches/Documents/3L\ First\ Semester/Energy/dem\ now.mp3
53814 4856 -rw------- 2 fordodone fordodone 4972361 Feb 17 2007 ./Users/laptop/Searches/Documents/Old\ Computer/My\ Music/01\ Bouncing\ Around\ The\ Room.mp3
53817 6116 -rw------- 2 fordodone fordodone 6259086 Feb 17 2007 ./Users/laptop/Searches/Documents/Old\ Computer/My\ Music/01\ Come\ Together.mp3
53834 8132 -rw------- 2 fordodone fordodone 8325962 Feb 17 2007 ./Users/laptop/Searches/Documents/Old\ Computer/My\ Music/01\ Funky\ Bitch.mp3
53962 31512 -rw------- 2 fordodone fordodone 32266213 Dec 21 2004 ./Users/laptop/Searches/Documents/Old\ Computer/My\ Music/01\ Inflate-_Barnacles.mp3
53975 4424 -rw------- 2 fordodone fordodone 4527885 Feb 17 2007 ./Users/laptop/Searches/Documents/Old\ Computer/My\ Music/01\ Julius.mp3
53979 12288 -rw------- 2 fordodone fordodone 12579091 Apr 1 2002 ./Users/laptop/Searches/Documents/Old\ Computer/My\ Music/01\ Mike's\ Song.mp3
54019 8476 -rw------- 2 fordodone fordodone 8677963 Mar 31 2002 ./Users/laptop/Searches/Documents/Old\ Computer/My\ Music/01\ Vultures.mp3
54028 6004 -rw------- 2 fordodone fordodone 6146289 Feb 17 2007 ./Users/laptop/Searches/Documents/Old\ Computer/My\ Music/01\ Wilson.mp3Now the goal was to get a list of unique directories in which music could be found. I would then take that list and rsync those directories to a local hard drive. Since the music files could be located at any unpredictable level in the tree, and I only wanted the directory listing I did this:
# cat music_file_list | cut -d / -f 2- | rev | cut -d / -f 2- | rev | sort | uniq -c
926 Users/laptop/Music/iTunes
27 Users/laptop/Music/iTunes/iTunes\ Music/Podcasts/GreenBiz\ Radio
10 Users/laptop/Music/iTunes/iTunes\ Music/Podcasts/NPR_\ Planet\ Money\ Podcast
51 Users/laptop/Music/iTunes/iTunes\ Music/Podcasts/This\ American\ Life
4 Users/laptop/Music/iTunes/iTunes\ Music/Podcasts/WNYC's\ Radiolab
2 Users/laptop/Music/iTunes/iTunes\ Music/Smeal\ College\ of\ Business/Wall\ Street\ Bootcamp\ Series
1 Users/laptop/Searches/Documents/3L\ First\ Semester/Energy
8 Users/laptop/Searches/Documents/Old\ Computer/My\ MusicThat gave me the list I was looking for and how many mp3 and m4a files were in each unique directory. I’ll probably skip the Podcasts, and just recover the rest. It looks like this will be about 30G of files, so I will probably use adrive.com to upload and share this amount of data.
TODO: revisit this exercise with awk.
# hdparm -I /dev/sda | grep Serial
Serial Number: WD-WCAL71856931
## smartctl -a /dev/sda | grep 'Serial Number'
Serial Number: WD-WCAL71856931
#These utilities are from the hdparm and smartmontools packages:
# dpkg -l | grep hdparm
ii hdparm 9.32-1 tune hard disk parameters for high performance
# dpkg -l | grep smart
ii smartmontools 5.39.1+svn3124-2 control and monitor storage systems using S.M.A.R.T.
# Use the shred utility to wipe an old hard drive. Shred is part of the coreutils package on Linux.
# dpkg -S /usr/bin/shred
coreutils: /usr/bin/shred
To wipe /dev/sdc use this:
shred -vfz -n 20 /dev/sdcThis will overwrite the drive 20 times (-n 20), show progress (-v), force if permissions needed (-f), and overwrite the last time with zeros (-z) making it look like a blank hard drive. 20 times is way overkill, but we have to be paranoid. The average person wouldn’t be able to get past the layers of RAID1, volume encryption, lvm, and ecryptfs home dir encryption, let alone a single pass of zeros, but we want to make it more difficult for people/agencies who know what they are doing.
This gets a list of tables in database ‘interesting’ and how many rows are in each table. The second query just sums them up for a grand total.
mysql> use mysql;
Database changed
mysql> SELECT table_name,table_rows FROM INFORMATION_SCHEMA.tables WHERE table_schema = 'interesting';
+------------+------------+
| table_name | table_rows |
+------------+------------+
| a | 29 |
| b | 4 |
| c | 1104 |
| d | 55378308 |
| e | 56925066 |
| f | 53479079 |
| g | 55963435 |
| h | 53966893 |
| i | 55839182 |
| j | 56854816 |
| k | 54613112 |
| l | 55454111 |
| m | 56133247 |
| n | 7 |
| o | 4 |
| p | 18 |
| q | 30 |
| r | 5 |
| s | 5 |
| t | 68 |
| u | 22 |
| v | 5 |
| w | 7 |
| x | 66046 |
| y | 69439 |
| z | 87361 |
| aa | 89519 |
| ab | 75892 |
| ac | 61785 |
| ad | 64964 |
| ae | 69905 |
| af | 65599 |
| ag | 69710 |
| ah | 381 |
| ai | 181 |
| aj | 2285397 |
| ak | 2272764 |
| al | 10 |
+---------+------------+
38 rows in set (0.04 sec)
mysql> SELECT sum(table_rows) FROM INFORMATION_SCHEMA.tables WHERE table_schema = 'interesting';
+-----------------+
| sum(table_rows) |
+-----------------+
| 559887795 |
+-----------------+
1 row in set (0.05 sec)
mysql>
find is an amazing command. With the proper manipulation it can be used to massage out the file data you need.
To find files modified in the last 24 hours is straight fowrard. Just look for files with a modified time of now() minus 1 day (24 hours):
find . -type f -mtime -1 -ls But if you just want files modified today it’s a bit more involved:
touch -t `date +%m%d0000` /tmp/$$
find . -type f -newer /tmp/$$ -ls
rm /tmp/$$touch a file with the timestamp of 12am today. The file can have any name, but we just use the bash pid here. Then find files newer than that file. It will return files modified some time since 12am. Then remove the touched file.
in /etc/fstab:
//ip.add.re.ss/c$ /mnt/windows_c_share smbfs username=username@ADdomain.com 0 0When you mount -a it will ask for password. You could put the password in fstab, but that’s not too secure. (neither is using a c$ share :)
Using ESXi 4.1:
vm705:~ # esxcfg-vswitch --add-pg=vlan301 vSwitch0
vm705:~ # esxcfg-vswitch --vlan=301 --pg=vlan301 vSwitch0
And this was to move a bunch of VLANs from one vSwitch to another:
vm705:~ # for i in `seq 221 235`; do esxcfg-vswitch -D vlan$i vSwitch0; done;
vm705:~ # for i in `seq 221 235`; do esxcfg-vswitch -A vlan$i vSwitch1; done;
vm705:~ # for i in `seq 221 235`; do esxcfg-vswitch -p vlan$i -v $i vSwitch1; done;