For the last few years, the United Nations Sustainable Development Solutions Network has been publishing the World Happiness Report. The underlying data is a combination of data from specially commissioned surveys undertaken by the Gallup organisation, and statistical and economic data from other sources. The web site linked above also provides the methodology for how the different data have been combined to compute the final score, most dramatically called the Life Ladder.
The data shown above can be found in the CSV formated text file.
The actual method used to compute the Life Ladder score is quite complicated, so the the aim of this Project, in brief, is to test whether simpler methods can yield similar results. In particular, the Project aims to see whether any of a range of proposed methods yields a similar ranking, when countries are ranked by Life Ladder score in descending order i.e. from happiest on these measures, to least happy. (The Wikipedia article also discusses criticisms of the World Happiness Report process.)
Looking at the data sample above, you can see that the column headers occupy the first row, the countries are listed in the first column, while the Life Ladder scores that we are seeking to emulate are in the second column. The third and subsequent columns contain the data from which you will compute your own Life Ladder scores. However, for this exercise, please remember that the aim is not to replicate the precise Life Ladder scores, but rather to replicate the ranking of countries as a result of the Life Ladder scores.
Eye-balling the Data
In Data Science projects, it is always a good idea to "eyeball" the data before you attempt to analyse it. The aim is to spot any trends ("this looks interesting") or any issues. So, looking at the sample above (ignoring the first two columns), what do you notice?
• There is a difference in scale across the columns. Healthy Life Expectancy at Birth ranges from 52.3 to 72.8, but in general is valued in 10's, while Social Support is a value in the range 0.0 to 1.0, and Freedom to Make Life Choices has both negative and positive floating point numbers. (The problem of GDP per Capita being actually valued in the thousands, or tens of thousands, has already been solved by the data collectors taking logs.) The issue is that you don't want a particular attribute to appear significant just because it has much larger values than other attributes.
• The other thing you may have noticed is that sometimes the data is simply missing, e.g. the score for Confidence in National Government for Algeria. Any metric we propose will have to deal with such missing data (which is actually a very common problem).
Specification: What your program will need to do
Your program needs to call the Python function input three times to:
• get the name of the input data file
• get the name of the metric to be computed across the normalised data for each country. The allowed names are "min", "mean", "median" and "harmonic_mean".
• get the name of the action to be performed. The two options here are: "list", list the countries in descending order of the computed metric, or "correlation", use Spearman's rank correlation coefficient to compute the correlation between ranks according to the computed metric and the ranks according to the Life Ladder score.
The order of the 3 calls is clearly important.
The output, printed to standard output, will be either a listing of the countries in descending order based on the computed metric, or a statement containing the correlation value (a number between -1.0 and 1.0).
Tasks: A more detailed specification
• Use input to read in 3 strings, representing the input file name, the metric to be applied to the data from the file (excluding the first two columns) and the action to be taken to report to the user.
• Read in the CSV formated text file. That is, fields in each row are separated by commas, e.g.
Apart from the first field, all the other fields are either numbers (so converted using float(), or empty, which can be translated to the Python object None. Each line will be transformed into a row, represented as a list, so you end up with a list of lists.
• For each column apart from the first two, compute the largest and smallest values in the column (ignoring any None values).
• Given the maximum and minimum values for each column, normalise all the values in the respective columns. That is, each value should be normalised by transforming it to a value between 0.0 and 1.0, where 0.0 corresponds to the smallest value, and 1.0 to the largest, with other values falling somewhere between 0.0 and 1.0. For example, the minimum Life Expectancy years in the small dataset is 52.33952713. This is transformed to 0.0. The maximum value is 72.78334045, which is transformed to 1.0. So, working proportionally, 69.05165863 is transformed to 0.81746645. In general, the transformation is (score - min)/(max-min), where max and min are the respective maximum and minimum scores for a given column, and will, of course, differ from column to column.
• For each row, across all the columns except the first two, compute the nominated metric using the normalised values (excluding None). "min", "mean" and "median" are, respectively, the minimum value (on the basis that a nation's happiness is bounded by the thing the citizens are grumpiest about), "mean" and "median" are the arithmetic mean and median value (discussed in lectures). The harmonic mean of a list of numbers is defined here. For harmonic mean, apart from avoiding None values, you will also have to avoid any zeroes; the other metrics have no problem with 0. The output from this stage is a list of country,score pairs.
• The list of country,score pairs are either to be listed in order of descending score, or the Spearman's rank correlation coefficientshould be computed between the country,score list that you have computed and the Life Ladder list, when sorted by descending score. You can assume there are no tied ranks, which means that the simpler form of the Spearman calculation can be used. An example of how to compute Spearman's rank correlation can be found here.
Enter name of file containing World Happiness computation data: WHR2018Chapter2_reduced_sample.csv
Choose metric to be tested from: min, mean, median, harmonic_mean mean
Chose action to be performed on the data using the specified metric. Options are list, correlation correlation
The correlation coefficient between the study ranking and the ranking using the mean metric is 0.8286
Enter name of file containing World Happiness computation data: WHR2018Chapter2_reduced_sample.csv
Choose metric to be tested from: min, mean, median, harmonic_mean harmonic_mean
Chose action to be performed on the data using the specified metric. Options are list, correlation list
Ranked list of countries' happiness scores based the harmonic_mean metric
The complete table is in file (LISTE)
You will have noticed that you have not been asked to write specific functions. That has been left to you. However, it is important that your program defines the top-level function main(). The idea is that within main() the program calls the other functions, as described above. (Of course, these may call further functions.) The reason this is important is that when I test your program, my testing program will call your main() function. So, if you fail to define main(), my program will not be able to test your program.
Your program can assume a number of things:
• Anything is that meant to be a string (i.e. a name) will be a string, and anything that is meant to be a number (i.e. a score for a country) will be a number.
• The order of columns in each row will follow the order of the headings, though data in particular columns may be missing in some rows.
What being said, there are number of error conditions that your program should explicitly test for and respond to. One example is detecting whether the named input file exists; for example, the user may have mistyped the name. The way this test can be done is to first:
Then, assuming the file name is in variable input_filename, use the test:
if not os.path.isfile(input_filename) :
and test for None in the calling function (likely main()).
Things to avoid
There are a couple things for your program to avoid.
• Please do not import any Python module, other than os. While use of the many of these modules, e.g. csv or scipy is a perfectly sensible thing to do in a production setting, it takes away much of the point of different aspects of the project, which is about getting practice opening text files, processing text file data, and use of basic Python structures, in this case lists.
• Please do not assume that the input file names will end in .csv. File name suffixes such as .csv and .txt are not mandatory in systems other than Microsoft Windows.
• Please make sure your program has only 3 calls to the input() function. More than 3 will cause your program to hang, waiting for input that my automated testing system will not provide. In fact, what will happen is that the marking program detects the multiple calls, and will not test your code at all.
These solutions may offer step-by-step problem-solving explanations or good writing examples that include modern styles of formatting and construction of bibliographies out of text citations and references. Students may use these solutions for personal skill-building and practice. Unethical use is strictly forbidden.import os
"""happiness_report will call all other functions defined within its scope"""
# prompt user for file input
path_to_file = input(
"Enter name of file containing World Happiness computation data: ")
# if named file does not exits in a directory, return None
if not os.path.isfile(path_to_file):
# read the file
with open(path_to_file) as file:
file_content = file.readlines() # read lines so items of file_content list become strings
data = 
# iterate over all strings in file_content, but skip the first one (column headers)
for line in file_content[1:]:
# use komma to separate the line into a list of values
row = line.strip('\n').split(',')
row_list = 
# iterate over rows and corresponding indices
for ind, val in enumerate(row):
if ind == 0: # the first column is string, just append it to row_list
By purchasing this solution you'll be able to access the following files: