View source for Zip codes answers


Please note that in UNIX, there is more than one way to do things.

'''Q1:'''
<pre>
zcat /home/projects/22126_NGS/exercises/unix/ZIP_CODES.csv.gz  |awk 'BEGIN{FS=","}{if($5=="\"NY\""){print $0}}'|wc -l
</pre>
<ol>
<li><code>zcat</code>: Decompresses the ZIP_CODES.csv.gz file and outputs its content.</li>
<li><code>awk 'BEGIN{FS=","}</code>: Sets the field separator to a comma for the CSV file.</li>
<li><code>if($5=="\"NY\""){print $0}</code>: Checks if the 5th field (state) is "NY" and prints the entire line.</li>
<li><code>wc -l</code>: Counts the number of lines, which corresponds to the number of ZIP codes in NY.</li>
</ol>

'''Q2:'''
<pre>
zcat /home/projects/22126_NGS/exercises/unix/ZIP_CODES.csv.gz|awk 'BEGIN{FS=","}{if($5=="\"NY\""){print $4}}' |sort |uniq -c  |sort -nr  |head -n 3
</pre>
<ol>
<li><code>awk</code> and <code>if($5=="\"NY\""){print $4}</code>: Selects and prints the ZIP codes of NY.</li>
<li><code>sort</code>: Sorts the ZIP codes.</li>
<li><code>uniq -c</code>: Counts the unique occurrences of each ZIP code.</li>
<li><code>sort -nr</code>: Sorts the counts in descending order.</li>
<li><code>head -n 3</code>: Displays the top 3 most frequent ZIP codes.</li>
</ol>

'''Q3:'''
<pre>
zcat /home/projects/22126_NGS/exercises/unix/ZIP_CODES.csv.gz |awk 'BEGIN{FS=","}{if($5=="\"NY\""){print $4}}' |sort |uniq -c  |awk '{if($1==1){print $0}}'  |wc -l
</pre>
<ol>
<li>Processes similar to Q2 to get the count of each ZIP code in NY.</li>
<li><code>awk '{if($1==1){print $0}}'</code>: Filters out ZIP codes that appear only once.</li>
<li><code>wc -l</code>: Counts these unique ZIP codes.</li>
</ol>


'''Q4:'''


<pre>
zcat /home/projects/22126_NGS/exercises/unix/ZIP_CODES.csv.gz|awk 'BEGIN{FS=","}{if($5=="\"NY\""){print $4}}' |sort |uniq -c  |awk '{print $1}' |sort -n |uniq -c
</pre>
<ol>
<li>Initial steps similar to Q2 to count each ZIP code in NY.</li>
<li><code>awk '{print $1}'</code>: Extracts the count number.</li>
<li><code>sort -n | uniq -c</code>: Sorts and counts how often each frequency occurs.</li>
</ol>

'''Q5:'''

<pre>
zcat /home/projects/22126_NGS/exercises/unix/ZIP_CODES.csv.gz | awk 'BEGIN{FS=","}{print $2"\t"$4}' |sed "s/+//g" |sed "s/\"//g"   |awk '{if($1>=39.4){print $2}}' |sort |uniq |wc -l
</pre>
<ol>
<li><code>awk '{print $2"\t"$4}'</code>: Extracts latitude and ZIP code, separated by a tab.</li>
<li><code>sed "s/+//g"</code> and <code>sed "s/\"//g"</code>: Removes pluses and quotes.</li>
<li><code>awk '{if($1>=39.4){print $2}}'</code>: Filters ZIP codes with latitude >= 39.4.</li>
<li><code>sort | uniq | wc -l</code>: Counts unique ZIP codes that meet the criteria.</li>
</ol>

'''Q6:'''

<pre>
zcat /home/projects/22126_NGS/exercises/unix/ZIP_CODES.csv.gz| awk 'BEGIN{FS=","}{print $4"\t"$5}'   |sort |uniq -c |sed "s/\([0-9]\) /\1\t/g" | sort  -k 3,3 -k 1,1nr -t "`/bin/echo -e '\t'`"  | sort -u -k 3,3 -t "`/bin/echo -e '\t'`"
</pre>

<ol>
<li><code>zcat</code>: Decompresses the <code>ZIP_CODES.csv.gz</code> file and outputs its content.</li>
<li><code>awk 'BEGIN{FS=","}</code>: Sets the field separator to a comma. Prints the 4th (city) and 5th (state) fields separated by a tab.</li>
<li><code>sort</code>: Sorts the output alphabetically.</li>
<li><code>uniq -c</code>: Counts unique occurrences of each city-state pair.</li>
<li><code>sed "s/\([0-9]\) /\1\t/g"</code>: Replaces the space between the count and city-state pair with a tab for better formatting.</li>
<li><code>sort -k 3,3 -k 1,1nr -t "\`/bin/echo -e '\t'\`"</code>: Sorts the output first by state (3rd field), then by the count (1st field) in reverse numeric order, using a tab as the field separator.</li>
<li><code>sort -u -k 3,3 -t "\`/bin/echo -e '\t'\`"</code>: Uniquely sorts the list by state, keeping only the first occurrence of each state (which is the city with the highest count due to the previous sort).</li>
</ol>

'''Q7:'''

<pre>
zcat /home/projects/22126_NGS/exercises/unix/ZIP_CODES.csv.gz | awk 'BEGIN{FS=","}{print $4}' |sort |uniq  |awk '{print substr($1,0,2)}' |grep "\"M" |wc -l
</pre>
<ol>
<li><code>zcat</code>: Decompresses the <code>ZIP_CODES.csv.gz</code> file and outputs its content.</li>
<li><code>awk 'BEGIN{FS=","}</code>: Sets the field separator to a comma. Prints only the 4th field (ZIP code).</li>
<li><code>sort</code>: Sorts the ZIP codes alphabetically.</li>
<li><code>uniq</code>: Filters out duplicate ZIP codes.</li>
<li><code>awk '{print substr($1,0,2)}'</code>: Prints the first two characters of each ZIP code.</li>
<li><code>grep "\"M"</code>: Filters for lines where the first two characters start with "M" (accounting for any quotes).</li>
<li><code>wc -l</code>: Counts the number of lines, giving the total number of unique ZIP codes starting with "M".</li>
</ol>