{
"cells": [
{
"cell_type": "markdown",
"metadata": {},
"source": [
"# Python Programming Final Term Project"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"#### (50 points) Part 1 - Movie Data\n",
"\n",
"Box Office Mojo (http://boxofficemojo.com) is a website that\n",
"tracks a variety of information on movies released each year (such as genre,\n",
"studio, box office revenues, etc.). You will write Python scripts that collect\n",
"data on all the movies for the year that the user specifies and that are listed on\n",
"the site. As an example, information on movies that were released in 2015 is\n",
"available at: http://www.boxofficemojo.com/yearly/chart/?yr=2015&p=.htm\n",
"Collect the following information for each movie and save in a comma separated\n",
"text file named movies.txt:\n",
"i. Movie Name.\n",
"ii. Movie ID. Note that this is not displayed on the webpage, but appears in\n",
"the source code for the page. For example, for movie â€œStar Wars: The\n",
"Force Awakensâ€, the Movie ID is â€œstarwars7â€.\n",
"iii. Studio that produced the movie.\n",
"iv. Total Gross Earnings\n",
"v. Total number of Theaters that the movie was shown\n",
"vi. Opening Gross Earnings\n",
"vii. Opening number of Theaters that the movie was shown\n",
"In addition answer the following questions:\n",
"i. What is the average Total Gross Earnings in the specified year\n",
"ii. Name the movie(s) that had the maximum number of theaters that they\n",
"were shown in"
]
},
{
"cell_type": "code",
"execution_count": 1,
"metadata": {},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
   "This is a program to scrape data from the http://boxofficemojo.com for a class project.\n",
   "\n",
   "What is the year that you are interested in getting data: 2015\n",
   "The data is stored in file movies.txt\n",
   "The average Total Gross Earnings for 2015 is: $15,720,616.04\n",
   "The movie(s) that were shown in the maximum number of theaters for 2015 are: Minions\n"
]
}
],
"source": [
"import requests\n",
"import re\n",
"\n",
"def scrapeMovieData(year):\n",
" movieData = []\n",
" page = 1\n",
" while True:\n",
"    url = \"https://www.boxofficemojo.com/yearly/chart/?yr=\" + str(year) + \"&page=\" + str(page)\n",
"    r = requests.get(url)\n",
"    html = str(r.content)\n",
"    html = html.replace(\"f4f4ff\", \"ffffff\")\n",
"    START_TAG = \"<tr bgcolor=\\\"#ffffff\\\"><td align=\\\"center\\\">\"\n",
"    END_TAG = \"</td></tr>\"\n",
"    if START_TAG not in html:\n",
"          break\n",
"    while START_TAG in html:\n",
"          i = html.index(START_TAG)\n",
"          html = html[i+len(START_TAG):]\n",
"          j = html.index(END_TAG)\n",
"          current = html[:j].replace(\"\\\\'\", \"\")\n",
"          tags = re.sub('<[^<]+?>', '|', current)\n",
"          while '||' in tags:\n",
"             tags = tags.replace('||', '|')\n

The scale of the final project must be larger in scope than the hom...