ML0101EN-Reg-Mulitple-Linear-Regression-Co2-py-v1.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {
    "button": false,
    "new_sheet": false,
    "run_control": {
     "read_only": false
    }
   },
   "source": [
    "<center>\n",
    "    <img src=\"https://cf-courses-data.s3.us.cloud-object-storage.appdomain.cloud/IBMDeveloperSkillsNetwork-ML0101EN-SkillsNetwork/labs/Module%202/images/IDSNlogo.png\" width=\"300\" alt=\"cognitiveclass.ai logo\"  />\n",
    "</center>\n",
    "\n",
    "# Multiple Linear Regression\n",
    "\n",
    "Estimated time needed: **15** minutes\n",
    "\n",
    "## Objectives\n",
    "\n",
    "After completing this lab you will be able to:\n",
    "\n",
    "*   Use scikit-learn to implement Multiple Linear Regression\n",
    "*   Create a model, train it, test it and use the model\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<h1>Table of contents</h1>\n",
    "\n",
    "<div class=\"alert alert-block alert-info\" style=\"margin-top: 20px\">\n",
    "    <ol>\n",
    "        <li><a href=\"#understanding-data\">Understanding the Data</a></li>\n",
    "        <li><a href=\"#reading_data\">Reading the Data in</a></li>\n",
    "        <li><a href=\"#multiple_regression_model\">Multiple Regression Model</a></li>\n",
    "        <li><a href=\"#prediction\">Prediction</a></li>\n",
    "        <li><a href=\"#practice\">Practice</a></li>\n",
    "    </ol>\n",
    "</div>\n",
    "<br>\n",
    "<hr>\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "button": false,
    "new_sheet": false,
    "run_control": {
     "read_only": false
    }
   },
   "source": [
    "### Importing Needed packages\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {
    "button": false,
    "new_sheet": false,
    "run_control": {
     "read_only": false
    }
   },
   "outputs": [],
   "source": [
    "import matplotlib.pyplot as plt\n",
    "import pandas as pd\n",
    "import pylab as pl\n",
    "import numpy as np\n",
    "%matplotlib inline"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "button": false,
    "new_sheet": false,
    "run_control": {
     "read_only": false
    }
   },
   "source": [
    "### Downloading Data\n",
    "\n",
    "To download the data, we will use !wget to download it from IBM Object Storage.\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {
    "button": false,
    "new_sheet": false,
    "run_control": {
     "read_only": false
    }
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "--2021-08-07 08:37:09--  https://cf-courses-data.s3.us.cloud-object-storage.appdomain.cloud/IBMDeveloperSkillsNetwork-ML0101EN-SkillsNetwork/labs/Module%202/data/FuelConsumptionCo2.csv\n",
      "Resolving cf-courses-data.s3.us.cloud-object-storage.appdomain.cloud (cf-courses-data.s3.us.cloud-object-storage.appdomain.cloud)... 169.63.118.104\n",
      "Connecting to cf-courses-data.s3.us.cloud-object-storage.appdomain.cloud (cf-courses-data.s3.us.cloud-object-storage.appdomain.cloud)|169.63.118.104|:443... connected.\n",
      "HTTP request sent, awaiting response... 200 OK\n",
      "Length: 72629 (71K) [text/csv]\n",
      "Saving to: ‘FuelConsumption.csv’\n",
      "\n",
      "FuelConsumption.csv 100%[===================>]  70.93K  --.-KB/s    in 0.002s  \n",
      "\n",
      "2021-08-07 08:37:09 (44.7 MB/s) - ‘FuelConsumption.csv’ saved [72629/72629]\n",
      "\n"
     ]
    }
   ],
   "source": [
    "!wget -O FuelConsumption.csv https://cf-courses-data.s3.us.cloud-object-storage.appdomain.cloud/IBMDeveloperSkillsNetwork-ML0101EN-SkillsNetwork/labs/Module%202/data/FuelConsumptionCo2.csv"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**Did you know?** When it comes to Machine Learning, you will likely be working with large datasets. As a business, where can you host your data? IBM is offering a unique opportunity for businesses, with 10 Tb of IBM Cloud Object Storage: [Sign up now for free](http://cocl.us/ML0101EN-IBM-Offer-CC)\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "button": false,
    "new_sheet": false,
    "run_control": {
     "read_only": false
    }
   },
   "source": [
    "<h2 id=\"understanding_data\">Understanding the Data</h2>\n",
    "\n",
    "### `FuelConsumption.csv`:\n",
    "\n",
    "We have downloaded a fuel consumption dataset, **`FuelConsumption.csv`**, which contains model-specific fuel consumption ratings and estimated carbon dioxide emissions for new light-duty vehicles for retail sale in Canada. [Dataset source](http://open.canada.ca/data/en/dataset/98f1a129-f628-4ce4-b24d-6f16bf24dd64?utm_medium=Exinfluencer\\&utm_source=Exinfluencer\\&utm_content=000026UJ\\&utm_term=10006555\\&utm_id=NA-SkillsNetwork-Channel-SkillsNetworkCoursesIBMDeveloperSkillsNetworkML0101ENSkillsNetwork20718538-2021-01-01)\n",
    "\n",
    "*   **MODELYEAR** e.g. 2014\n",
    "*   **MAKE** e.g. Acura\n",
    "*   **MODEL** e.g. ILX\n",
    "*   **VEHICLE CLASS** e.g. SUV\n",
    "*   **ENGINE SIZE** e.g. 4.7\n",
    "*   **CYLINDERS** e.g 6\n",
    "*   **TRANSMISSION** e.g. A6\n",
    "*   **FUELTYPE** e.g. z\n",
    "*   **FUEL CONSUMPTION in CITY(L/100 km)** e.g. 9.9\n",
    "*   **FUEL CONSUMPTION in HWY (L/100 km)** e.g. 8.9\n",
    "*   **FUEL CONSUMPTION COMB (L/100 km)** e.g. 9.2\n",
    "*   **CO2 EMISSIONS (g/km)** e.g. 182   --> low --> 0\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "button": false,
    "new_sheet": false,
    "run_control": {
     "read_only": false
    }
   },
   "source": [
    "<h2 id=\"reading_data\">Reading the data in</h2>\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {
    "button": false,
    "new_sheet": false,
    "run_control": {
     "read_only": false
    }
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>MODELYEAR</th>\n",
       "      <th>MAKE</th>\n",
       "      <th>MODEL</th>\n",
       "      <th>VEHICLECLASS</th>\n",
       "      <th>ENGINESIZE</th>\n",
       "      <th>CYLINDERS</th>\n",
       "      <th>TRANSMISSION</th>\n",
       "      <th>FUELTYPE</th>\n",
       "      <th>FUELCONSUMPTION_CITY</th>\n",
       "      <th>FUELCONSUMPTION_HWY</th>\n",
       "      <th>FUELCONSUMPTION_COMB</th>\n",
       "      <th>FUELCONSUMPTION_COMB_MPG</th>\n",
       "      <th>CO2EMISSIONS</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>2014</td>\n",
       "      <td>ACURA</td>\n",
       "      <td>ILX</td>\n",
       "      <td>COMPACT</td>\n",
       "      <td>2.0</td>\n",
       "      <td>4</td>\n",
       "      <td>AS5</td>\n",
       "      <td>Z</td>\n",
       "      <td>9.9</td>\n",
       "      <td>6.7</td>\n",
       "      <td>8.5</td>\n",
       "      <td>33</td>\n",
       "      <td>196</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>2014</td>\n",
       "      <td>ACURA</td>\n",
       "      <td>ILX</td>\n",
       "      <td>COMPACT</td>\n",
       "      <td>2.4</td>\n",
       "      <td>4</td>\n",
       "      <td>M6</td>\n",
       "      <td>Z</td>\n",
       "      <td>11.2</td>\n",
       "      <td>7.7</td>\n",
       "      <td>9.6</td>\n",
       "      <td>29</td>\n",
       "      <td>221</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>2014</td>\n",
       "      <td>ACURA</td>\n",
       "      <td>ILX HYBRID</td>\n",
       "      <td>COMPACT</td>\n",
       "      <td>1.5</td>\n",
       "      <td>4</td>\n",
       "      <td>AV7</td>\n",
       "      <td>Z</td>\n",
       "      <td>6.0</td>\n",
       "      <td>5.8</td>\n",
       "      <td>5.9</td>\n",
       "      <td>48</td>\n",
       "      <td>136</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>2014</td>\n",
       "      <td>ACURA</td>\n",
       "      <td>MDX 4WD</td>\n",
       "      <td>SUV - SMALL</td>\n",
       "      <td>3.5</td>\n",
       "      <td>6</td>\n",
       "      <td>AS6</td>\n",
       "      <td>Z</td>\n",
       "      <td>12.7</td>\n",
       "      <td>9.1</td>\n",
       "      <td>11.1</td>\n",
       "      <td>25</td>\n",
       "      <td>255</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>2014</td>\n",
       "      <td>ACURA</td>\n",
       "      <td>RDX AWD</td>\n",
       "      <td>SUV - SMALL</td>\n",
       "      <td>3.5</td>\n",
       "      <td>6</td>\n",
       "      <td>AS6</td>\n",
       "      <td>Z</td>\n",
       "      <td>12.1</td>\n",
       "      <td>8.7</td>\n",
       "      <td>10.6</td>\n",
       "      <td>27</td>\n",
       "      <td>244</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "   MODELYEAR   MAKE       MODEL VEHICLECLASS  ENGINESIZE  CYLINDERS  \\\n",
       "0       2014  ACURA         ILX      COMPACT         2.0          4   \n",
       "1       2014  ACURA         ILX      COMPACT         2.4          4   \n",
       "2       2014  ACURA  ILX HYBRID      COMPACT         1.5          4   \n",
       "3       2014  ACURA     MDX 4WD  SUV - SMALL         3.5          6   \n",
       "4       2014  ACURA     RDX AWD  SUV - SMALL         3.5          6   \n",
       "\n",
       "  TRANSMISSION FUELTYPE  FUELCONSUMPTION_CITY  FUELCONSUMPTION_HWY  \\\n",
       "0          AS5        Z                   9.9                  6.7   \n",
       "1           M6        Z                  11.2                  7.7   \n",
       "2          AV7        Z                   6.0                  5.8   \n",
       "3          AS6        Z                  12.7                  9.1   \n",
       "4          AS6        Z                  12.1                  8.7   \n",
       "\n",
       "   FUELCONSUMPTION_COMB  FUELCONSUMPTION_COMB_MPG  CO2EMISSIONS  \n",
       "0                   8.5                        33           196  \n",
       "1                   9.6                        29           221  \n",
       "2                   5.9                        48           136  \n",
       "3                  11.1                        25           255  \n",
       "4                  10.6                        27           244  "
      ]
     },
     "execution_count": 3,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df = pd.read_csv(\"FuelConsumption.csv\")\n",
    "\n",
    "# take a look at the dataset\n",
    "df.head()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Let's select some features that we want to use for regression.\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {
    "button": false,
    "new_sheet": false,
    "run_control": {
     "read_only": false
    }
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>ENGINESIZE</th>\n",
       "      <th>CYLINDERS</th>\n",
       "      <th>FUELCONSUMPTION_CITY</th>\n",
       "      <th>FUELCONSUMPTION_HWY</th>\n",
       "      <th>FUELCONSUMPTION_COMB</th>\n",
       "      <th>CO2EMISSIONS</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>2.0</td>\n",
       "      <td>4</td>\n",
       "      <td>9.9</td>\n",
       "      <td>6.7</td>\n",
       "      <td>8.5</td>\n",
       "      <td>196</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>2.4</td>\n",
       "      <td>4</td>\n",
       "      <td>11.2</td>\n",
       "      <td>7.7</td>\n",
       "      <td>9.6</td>\n",
       "      <td>221</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>1.5</td>\n",
       "      <td>4</td>\n",
       "      <td>6.0</td>\n",
       "      <td>5.8</td>\n",
       "      <td>5.9</td>\n",
       "      <td>136</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>3.5</td>\n",
       "      <td>6</td>\n",
       "      <td>12.7</td>\n",
       "      <td>9.1</td>\n",
       "      <td>11.1</td>\n",
       "      <td>255</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>3.5</td>\n",
       "      <td>6</td>\n",
       "      <td>12.1</td>\n",
       "      <td>8.7</td>\n",
       "      <td>10.6</td>\n",
       "      <td>244</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>3.5</td>\n",
       "      <td>6</td>\n",
       "      <td>11.9</td>\n",
       "      <td>7.7</td>\n",
       "      <td>10.0</td>\n",
       "      <td>230</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>3.5</td>\n",
       "      <td>6</td>\n",
       "      <td>11.8</td>\n",
       "      <td>8.1</td>\n",
       "      <td>10.1</td>\n",
       "      <td>232</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>3.7</td>\n",
       "      <td>6</td>\n",
       "      <td>12.8</td>\n",
       "      <td>9.0</td>\n",
       "      <td>11.1</td>\n",
       "      <td>255</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>3.7</td>\n",
       "      <td>6</td>\n",
       "      <td>13.4</td>\n",
       "      <td>9.5</td>\n",
       "      <td>11.6</td>\n",
       "      <td>267</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "   ENGINESIZE  CYLINDERS  FUELCONSUMPTION_CITY  FUELCONSUMPTION_HWY  \\\n",
       "0         2.0          4                   9.9                  6.7   \n",
       "1         2.4          4                  11.2                  7.7   \n",
       "2         1.5          4                   6.0                  5.8   \n",
       "3         3.5          6                  12.7                  9.1   \n",
       "4         3.5          6                  12.1                  8.7   \n",
       "5         3.5          6                  11.9                  7.7   \n",
       "6         3.5          6                  11.8                  8.1   \n",
       "7         3.7          6                  12.8                  9.0   \n",
       "8         3.7          6                  13.4                  9.5   \n",
       "\n",
       "   FUELCONSUMPTION_COMB  CO2EMISSIONS  \n",
       "0                   8.5           196  \n",
       "1                   9.6           221  \n",
       "2                   5.9           136  \n",
       "3                  11.1           255  \n",
       "4                  10.6           244  \n",
       "5                  10.0           230  \n",
       "6                  10.1           232  \n",
       "7                  11.1           255  \n",
       "8                  11.6           267  "
      ]
     },
     "execution_count": 4,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "cdf = df[['ENGINESIZE','CYLINDERS','FUELCONSUMPTION_CITY','FUELCONSUMPTION_HWY','FUELCONSUMPTION_COMB','CO2EMISSIONS']]\n",
    "cdf.head(9)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Let's plot Emission values with respect to Engine size:\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {
    "button": false,
    "new_sheet": false,
    "run_control": {
     "read_only": false
    },
    "scrolled": true
   },
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAYUAAAEHCAYAAABBW1qbAAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjMuNCwgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy8QVMy6AAAACXBIWXMAAAsTAAALEwEAmpwYAAAwDElEQVR4nO2df5xddXnn389MJiGTqMAksoGQGUqBdmItypTWTX+gAbHRF2i3unFHzUt9NZjQFu36smazW7XddNnWttLdJjYVJJqpLFvtyotSlERtV0ulAQFJkCUuCQSykIA/QBBI8uwf59yZM3fOuefHPeeeO3c+79fr+7r3fs/5nvPcm8z3Od/neb7PY+6OEEIIAdBXtwBCCCG6BykFIYQQk0gpCCGEmERKQQghxCRSCkIIISaRUhBCCDHJvCovbmYHgKeB48Axdx8zs1OB/wGMAAeAt7n798LzNwHvDc//bXf/UqvrL1myxEdGRqoSXwghepI777zzqLsvjTtWqVIIea27H418/jCw292vNrMPh59/18xGgbXASuB0YJeZnevux5MuPDIywp49e6qUXQgheg4zO5h0rA7z0eXAjvD9DuDNkf4b3P15d38I2A9c2HnxhBBi7lK1UnDgy2Z2p5mtD/tOc/fDAOHry8P+M4BHImMPhX1CCCE6RNXmo1Xu/piZvRy4zcy+0+Jci+mbkYMjVC7rAVasWFGOlEIIIYCKVwru/lj4+gTwtwTmoMfNbBlA+PpEePoh4MzI8OXAYzHX3O7uY+4+tnRprJ9ECCFEQSpTCma2yMxe0ngPvB64D7gJWBeetg74Yvj+JmCtmS0ws7OAc4A7qpJPCCHETKpcKZwGfN3M7iGY3P/O3W8FrgYuMbMHgUvCz7j7XuBGYB9wK3Blq8gjIcTcYmICRkagry94nZioW6LexGZz6uyxsTFXSKoQvc/EBKxfD88+O9U3OAjbt8P4eH1yzVbM7E53H4s7ph3NQoiuZ/Pm6QoBgs+bN9cjTy8jpSCE6HoefjhfvyiOlIIQoutJij5XVHr5SCkIIbqeLVsCH0KUwcGgX5SLlIIQousZHw+cysPDYBa8yslcDZ1IiCeEEG0zPi4l0Am0UhBCCDGJlIIQQohJpBSEEEJMIqUghBBiEikFIYQQk0gpCCGEmERKQQghxCRSCkIIISaRUhBCCDGJlIIQQohJpBSEEEJMUrlSMLN+M/uWmd0cfv6omT1qZneHbU3k3E1mtt/MHjCzS6uWTQghxHQ6kRDvKuB+4KWRvj9z949HTzKzUWAtsBI4HdhlZueqTrMQQnSOSlcKZrYceCPwqQynXw7c4O7Pu/tDwH7gwirlE0IIMZ2qzUefAD4EnGjq/00zu9fMrjOzU8K+M4BHIuccCvuEEEJ0iMqUgpm9CXjC3e9sOrQNOBs4HzgM/EljSMxlPOa6681sj5ntOXLkSIkSCyGEqHKlsAq4zMwOADcArzOzne7+uLsfd/cTwF8xZSI6BJwZGb8ceKz5ou6+3d3H3H1s6dKlFYovhBBzj8qUgrtvcvfl7j5C4ED+iru/w8yWRU57C3Bf+P4mYK2ZLTCzs4BzgDuqkk8IIcRM6ijH+Udmdj6BaegAcAWAu+81sxuBfcAx4EpFHgkhRGfpyOY1d/+au78pfP9Od/8Zd3+lu1/m7ocj521x97Pd/Tx3//tOyCaEmB1MTMDICPT1Ba8TE3VL1JtoR7MQIpWNG2HePDALXjdu7Oz9JyZg/Xo4eBDcg9f166UYqkBKQQjRko0bYds2OB4ac48fDz53UjFs3gzPPju979lng35RLuY+I+pz1jA2NuZ79uypWwwhepq+vuDpvBkzONG8A6mHZeglzOxOdx+LO6aVghCiJUnPjZ18nlyxIl+/KI6UghCi69myBQYHp/cNDgb9olykFIQQXc/4OGzfDsPDgcloeDj4PD5et2S9h5SCEKIlGzbk66+K8XE4cCDwIRw4IIVQFVIKQvQAVcbwb90aKID+/uBzf3/weevW9q6rfQfdiZSCEBVTdYx/XAz/u98NS5aUN+Fu3QrHjgXXP3asHIWgfQfdiUJShaiQRox/M2U8aTcYGQkm1VYMDnaXDT5J5uHhwDQkqqVVSKqUghAVMm/e1KavKP39wRN3GSTF8DfTTROu9h3Ui/YpCFETcQqhVX8RssbqP/xw8XukmcDy+ge076B7kVIQokIsrnRUi/4ixMXwx1F0wk1Lc1HEP6B9B92LlIIQFVLGbuC0p/TmGP6hIZg/f/o57Uy4n/xk6/4ieYm076B7kVIQc5q6s3+mkTUZXTSG/+hReO97p4eQrltXfMJNU2xJZqk0c5X2HXQnUgpiztKJ7J+NiTlrfzPbt+frh8Bss2PH9O+1Y0d14Z7yD/QWUgpizlJkws3L+vX5+psp4qjudJpp+Qd6i8qVgpn1m9m3zOzm8POpZnabmT0Yvp4SOXeTme03swfM7NKqZRNzm05EBrW7G7jISqOoOSeJtDQX4+OBeaosc5Wol06sFK4C7o98/jCw293PAXaHnzGzUWAtsBJ4A7DVzDIusoXIT7umnay0sxu4yEqjbHNOmmLrtLlKVEulSsHMlgNvBD4V6b4c2BG+3wG8OdJ/g7s/7+4PAfuBC6uUT8xt2jXtdIJVqwIHeJR584L+JOLMOQMD8MwzxdNetFJsqorWW1S9UvgE8CEgukfxNHc/DBC+vjzsPwN4JHLeobBPiEqoKtFbmWzePHPn87FjMyfc6OaxzZsD8000RNUMnnyymjxDZZurRL1UphTM7E3AE+5+Z9YhMX0zguHMbL2Z7TGzPUeOHGlLRiHKTvRWNlkm3LjNYzt2BCuGEydg8WJ44YXp48t8klf0UW9R5UphFXCZmR0AbgBeZ2Y7gcfNbBlA+PpEeP4h4MzI+OXAY80Xdfft7j7m7mNLly6tUHwh6ifLhJtmvqn6Sb6q6KOVK4MVTqOtXNne9UQ2KlMK7r7J3Ze7+wiBA/kr7v4O4CZgXXjaOuCL4fubgLVmtsDMzgLOAe6oSj4hZgNZJty0Sb/qJ/kqdievXAn79k3v27dPiqET1LFP4WrgEjN7ELgk/Iy77wVuBPYBtwJXunuJwYFCzD6yTLhpk34n9hGUvTu5WSGk9c8lKt+F7+6ztl1wwQUuRN3s3Ok+POxuFrzu3Nn5+w8OugcehaANDk6Xo24Z8xL9Ls1tLrNhQ/xvsmFDvusAezxhXtWOZiHaoBsqiGVZTTQ/yYNKYc5GOrELX0pBiDaYjTH6VSiysp3Co6P5+ucKndiFL6UgRBvUEaMfnXwbLW2Sj+5jWLcuvyK7+OLp97v44qljVTiF9+6dqQBGR4P+uUwnduFLKQjRBp2O0U8qztNqkm9eGSQ9VSbVeb74Yti9e3rf7t1TiqEqp/DevdMt53NdIUBnduFLKQjRBt2cIbSxWokzccWR9LTZrBDS+kV1dGIXvpSCEG3QzRXEGquVrKasMu3Sojqq3oUvpSBEDxJdrWQ1ZQ0PVyePmD1IKQjRBt0QktogabUSZ+KKY82a+P7Vq/P1i9mNlIIQLYhG7cTF83c6JLVVveSkHcXNJq4k38Ett8T379o1UwGsXh30Q+fqUojOIKUgRAJZVgF1hKTG7WlNS30Q3bx24kTsZVvKvGvX9Ps1FAKUFxFTefoGkY2krc6zoSnNhaiS4eH4lALDw1PnDA3FnzM0VJ1cGza49/cH9+nvdx8dzZf6IMv3ysvq1dOvtXp1/u9URvoGkQ2U5kKI/HRj8ZiNG2HbtumlL5P2A2zbFm/2KjuMdmICbr99et/tt880tbUyxXUifYPISJK2mA1NKwVRJVmeqM3izzErT45oMrtWieJatSoT5CX9TkNDU/cYGnKfPz9ZJiXA6yxopSBEfrI8USeFe/b1lZNsrtmvUZRnnw3SWzRkgtaprlultWgmaSf0k09Oyf3kk62rv8lZ3T1IKQiRQJaNaUnhnsePlxOimnU3chayypSW1qJMGqa4iy6KP57UL6rDvJ3Hj5oZGxvzPXv21C2GmONMTAST98MPB0/icTuDh4enUlbnoa+vvRVCK/r7g5XCihWBcmsou6T8StFx69dP7aRNO78Vjd9lZCR+xVH0dxOtMbM73X0s7phWCkK0Sbvhnq1CMatKrAfTVw7veU/21czx44ETuyFnURNP1BTXjU79uUplSsHMTjKzO8zsHjPba2YfC/s/amaPmtndYVsTGbPJzPab2QNmdmlVsglRFYsW5euPiyaKTrg/+ZPlyxjHCy/AVVflG9OIDDrvvGznDwzA0FC8Ka7T2WZFC5I80O02wIDF4fsB4JvALwAfBT4Yc/4ocA+wADgL+C7Q3+oeij4S3UDW6KA4GvsNmlt/f+vj0Xb66TPLcRZt7jP3HKSd3+p7Z41wylJSVJQHdUQfhfd+Jvw4ELZW1tHLgRvc/Xl3fwjYD1xYlXxClEG70UFplbRaZS5tTJ+PPpotjUV/fzb7f1xai6TrNeRIolWEU5RuzjY716jUp2Bm/WZ2N/AEcJu7fzM89Jtmdq+ZXWdmp4R9ZwCPRIYfCvuE6Bh5Uy20Gx2UFoqZNVTzG9+AQ4eCCfrEiUD2KIODsGNHcGxoKP6a0f5oWosNG+LPL7OwC8ysIy2FUA+VKgV3P+7u5wPLgQvN7BXANuBs4HzgMPAn4elxzzAznkHMbL2Z7TGzPUeOHKlEbjE3SbPvx5EUo5+VJHt8oz9p4j1+fGoPwfz50+V2D/LsL1489dS9bl2gwPrCv/hmpTIwANdcE3+vtMIuJ50UPy6pX3Q3HQtJNbOPAD9y949H+kaAm939FWa2CcDd/0t47EvAR9399rjrgUJSRbnMmxdvrunvDybZPGOaSQpVbYSFtjp/48bAlJK3CE5D7oaJK7qiGRiAl74UnnpqZkhqXpYsCTanNTM0BEePFrumqJZaQlLNbKmZnRy+XwhcDHzHzJZFTnsLcF/4/iZgrZktMLOzgHOAO6qST4hm0uz7eY9FSQpVzdIfrbSVh4ZscSauF18MJnL3wOz0jW/ku3aUp57K1y+6m3nppxRmGbDDzPoJlM+N7n6zmX3WzM4nMA0dAK4AcPe9ZnYjsA84Blzp7ioQKDpGf3/yJN9w0I6OTi8gPzyczYRUR1WzhrknLda/YSaDYqUdk1ZSSlExO6ky+uhed3+Vu7/S3V/h7r8f9r/T3X8m7L/M3Q9Hxmxx97Pd/Tx3//uqZBOiQdSxnOWpf98+WLly6nPWqmad2m8QpeGPyBrrXzQjaZJpLalfdDfa0SwKk1aVrNtlaHYsN0gL24ymqm4OpUzia1/LLlcrTj45vn9gINkRnFVx5fVZiB4laQPDbGjavFYf3bDZqF0Z0jaOFUnnnHdM3vOLFqPJssGu8b3zUuR3EvVCi81rSognCtENCczalaHVk717+vE48kYw5b1HkQipZhorpGaiq4s8FPmdRL20HX0URhL9BzPbHm44u87MritXTDGb6IYEZu3KkLYxbHQ0/nhzf9SEtXBh/JiyNnoViZBqZtWqqf0KDfr6gv4iJG1uS+oX3U1Wn8IXgZcBu4C/izQxR+mGBGZZZGjlc0grOL9370wF0Bx91Jzm4plnZk64q1cnP4EnPWUn9ZdRjGbz5pmhsCdOTBW8iaMb/EeiQyTZlaINuDvLeZ1u8inUx2zwKWSRccOGKd9Cf3/+QvFJpSiz/i6d8ilEyVtCNO13TPPNiO6DFj6FrErhPwNrspzbySalUC/tTqhl0KrWcJYay+1c3z173eSkexaRsSpFVlRGOZpnH62UQlbz0VXAzWb2YzN7Omw/rGTpImYFExNBgrVonqAdO7rLrNCuz6HZNBRXxjKruSzpnlnqQDcT3eF87Fh+5/CaNfn6037HvCYw0eUkaYvZ0LRSqI8ynsLbJc2ssWhRvIyLFmW7fpbvuHOn+/z56SuF/v7k1UanV1x1rRTSVl2ic9Cu+Si4BpcBHw/bm7KOq7JJKdRHXrt0FvJOGlWbNbKM37nTfWAgXSkkKa648QMDrb973Pl5KNunkPV3ar6vmRRDXbStFICrgd3Ae8J2G3B1lrFVNimF+ih7pVDEcZ02uXVCKST9Do2VQZITtvE7DQ3FHx8aipcpSQHlUQxF/u1aKewsv1PSamr+/Oxyi/IoQyncC/RFPvcD92YZW2WTUqiPsqOP0ibXuJVDN6wU2lVMeWVs9zu5x5u85s8v/m+XZeVRhtyiPFophTy5j06OvH9ZYSeG6AnKLp+Y5Mw8fjyYOuKcvEWctGWTtleijH0FVRA82yV/zsP73pevX3Q5Sdoi2oC3AweB64EdwEPA2ixjq2xaKfQOWeL940wc7Zo1WpFlfLv29qpWCq2c11UECaQ5y7VS6C4oydG8jMDZfDnwr7KOq7JJKfQOO3e69/VlUwxZI3WymDVaKZXR0fjxo6MzZS+6VyLvZJnFp5C2wa2KIIE0Vq+Ov+fq1dXdUyRTWCkAPxW+vjqutRrbiSal0DskTWRZWpJiWLw4/vzFi4PjWWzrzYqhWSGkUUbkTjNp0UdJyrWvL9vvUhXNikEKoT7aUQrbw9evxrSvtBrbiSalUC9lxp0nRelkXTnEkTbh5o38yUrz77JhQ3UmrjjSrtlqF7b2EMwNSjEf5W3ASQQ1lu8B9gIfC/tPJQhpfTB8PSUyZhOwH3gAuDTtHlIK9VF29FFRhdBqAq2iXkIaeX+XOpRClt+z03msRGdppRQy1VMws7cCt7r702b2H0Pz0R+4+7dajDFgkbs/Y2YDwNcJ0mX8GvCUu19tZh8OlcLvmtko8DngQuB0goys53qLOs2qp1AfZddTSKoTkIWitQqqqAOQ93epQoa+vvixZkE21Ky/dSdrY4jO0nY9BeA/hQrhF4FLCSKQPtlqQKiQngk/DoTNCRzVO8L+HcCbw/eXAze4+/Pu/hDBiuHCjPKJDpNUrD5LEfs42qk3kDR28eLW/UND8ceT+rOQFFp78GB5aaejdaXnzQs+R0lSJo3+iy7Kdp9O1sYQ3UNWpdB4rngjsM3dvwjMTxtkZv1mdjfwBHCbu38TOM3dDwOEry8PTz8DeCQy/FDYJ7qQsuPv4wq/xLF48fRaxKtXwy23xE+4P/pR/DUa/ddcE9Q2jjIwEPTnITpJt3q6dw+Uw7vfXVwxNNeVPn48+NysGFqxf3+28zpZG0N0EUl2pWgDbgb+EvguwSa2BcA9WcaG408mcE6/Avh+07Hvha9/Abwj0n8t8G9irrUe2APsWbFiRXlGNpGLLLbwPI7orPsUYOqaQ0Mzo4eK5ORpx1leNGqq4cwu20+Sds2sqb7z+hSU7G52QQlpLgYJfAHnhJ+XAa/PMjZyjY8AHyRwIi+LXOeB8P0mYFPk/C8Br2l1TTma6yMtcqdMh2veVmae/4ULp49buHD68VZRU2kTcJbfMc/vVMZvWWRSL5LUT9RLK6WQ1dF8NnDI3Z83s4uAVwKfcffvtxizFHjR3b9vZguBLwP/FfgV4EmfcjSf6u4fMrOVwF8z5WjeHSohOZq7kLQC8mU6XPPScKgWceJu3Bik62jliF24EJ59dupere6Rdnzx4ngz16JFQWnPZrJ8p3Z+ywzTwQyWLIEnn5zZPzQER48Wl0VURxmO5s8Dx83sJwnMOmcRTOCtWAZ81czuBf6FwKdwM0HG1UvM7EHgkvAz7r4XuBHYB9wKXNlKIfQ6ZdfETXNO5iWtgHy7BW7aoagtvNlen8Rzz029b9e3kub3mA3EKYRW/aLLSVpCRBtwV/j6IeC3wvffyjK2ytar5qOy9wCUUde3mTQzRt78OmWZjtrZLZxnA13W3zbtGnllrNp8VISyryeqhxJ8Ct8kSIp3H3BW2HdflrFVtl5VCmUnLKuisHraRNBpn0IZu4WLTp6tksGl+QyqUAp5nPbRVjTtRFU7w0V1tFIKWc1H7wZeA2xx94fM7CxgZ3nrFRGlbNNLmqmnCspOrZ3GiROBr6Kq60dZuHD651WrYPny4HsuXx58blBW2GuDDRvS++NSijdMhxCYtk4/ffrx1ath165iMl1zDcxvClCfP7/4dxQ1k6QtZkPr1ZVC2U9eaQnSilC2yaCd3EdJ98z7O2YJ12z+zbKsiFqFaxbJHpqlpnP0nkNDM6ODyk5joZDU2QVFVwpmdmP4+m0zuzfSvh06kMUsoPnJNq2/DqpYtZx/fr5+9/Rrnjgx3Um/efNUJFKDZ5+FdeumggQgWMXErWbOPTf+Pkn9AFu3BhFe7sHr1q0zzxkfn7rn4sXw4oszZdy8OfkeeYner1MrNlENLUNSzWyZux82s+G44+5eMKlBOfRqSGpa7pq6r9cYm0SWybWZl7wkPgQzK3H3TAubzXp+q/FJv22UwcFk01leGWF62Gx/f5DmI04xNKji31/MbgqHpPpUOoqDoQL4HvB0pIkKSCvxWPf1qqCKEMy8vpSs+Zei47P8hq2eyvPKWCTNRSf+/csOoRY1kmRXijbgCuBx4ABBKc6HgP+bZWyVrVd9CmUXVm/X7h1H2T6FdvwJ0RYtglMk6ipqr09q0fFxv22e3yWvjEW+U9khzp2+vigfSghJfRBYkuXcTrZeVgplpw1oNekXuV8RpVC0nnJRxVBkf0ZUKSQ5npvHR79XFkXSfL88MhZVxlU6gquo+SyqpQylcCswmOXcTrZeVQqd/iMrEu2Ud3JqpyxlkdYgS6RO9NxW10wbX+R3yStjFXtO2qWOms+iPVophay5j14FfJpgE9vzEdPTb5dmxyqAHM3lUMRpnGXMxERgS3/44eA7xdnJG7mQysx9FJUhD2U4z/PmMsrLypWwb9/M/tFR2Lu3/esXoeyCS6J6ysh99JfAV4B/Bu6MNFEBzRuP0vq7kYmJwHF78GAwoSY5TosW5elWmsNT0/rz8sAD+fo7QdxmucHBoF/MPrIqhWPu/jvu/ml339FolUo2h4kmXMvS3y5VVCCLi9+Po2hRnlaMjpZ/zawkrSharTTyRO7UsTs9jU7vXhfVklUpfNXM1pvZMjM7tdEqlWwOk2QiqiqmvIo0BVlXAGVPZu2YUZLMR2WbtqJMTASV2BorqrTKbGVXvCsLbV7rHbIqhX9HUATnn5gyHfWeMb+HaH763Lgx+Wl0fByuu276k95117X3h511kmpnNRKl4d5sVgh5nsLf9758/WVw1VUzdxu/+GLQH0fSXop2alwLMY0kD/RsaL0afVQ07LBBltj5vr72whLTZMwaJZQlW2iWlhRqmzd+Pk8kUJHfpd3zy5CxCpT7aHZB0ZBU4EOR929tOvaHrcZ2okkpxJM1dfKiRdXJmJSEr10lktaim/zqiJ/vhFLoNrR5bfbRSimkmY/WRt5vajr2hpIWK6KJdh2/We35VVb3yuP/6MtqxMzACy9MmV7qqP6W99+uCid/p0lKClhmwj3ROdL+HC3hfdzn6QfNzjSzr5rZ/Wa218yuCvs/amaPmtndYVsTGbPJzPab2QNmdmmub9JDzLX89MHCszwaZSDryPmU99+uF/6t6yy9KiogaQkRrDCCMpzN7+M+x4xdBrw6fP8S4P8Ao8BHgQ/GnD8K3AMsIKgB/V2gv9U9etV85N6ejTarqSVaG6Ds3EdZahNU2RrfqQ6zRt7fcrbb45XmYvZBC/PRvBSd8bNm9kOCVcHC8D3h55NSlM1hoJFl9Wkzux84o8WQy4Eb3P154CEz2w9cCNyeIqMoyBVXBK+NjWYNE8DBg1PRLEUjkMp++i9CQ/bGruoVK4INVVWHS46P57tH3vO7jS1bpv//AW1em9UkaYsyGzACPAy8lGClcAC4F7gOOCU8578D74iMuRb49VbX7dWVws6dM5+0zbI/QaY9RTdHrBR50kt7Sk/Kp9TJlcJcptOrj9m+2plr0G7uo3Yws8XAPxDUd/6CmZ0GHAUc+ANgmbu/x8z+Arjd3XeG464FbnH3zzddbz2wHmDFihUXHOy1PAnAggWBw7SZ+fPh+edn9jeTN4dPkVxLafdYsmTKtl8H3bBSqYvmlR+0LvQj5h5l5D4qeuMB4PPAhLt/AcDdH3f34+5+AvgrAhMRwCHgzMjw5cBjzdd09+3uPubuY0uXLq1S/NqIUwit+tulCofsU08VHyvaQ9FAoh0qUwpmZgQmoPvd/U8j/csip70FuC98fxOw1swWmNlZwDnAHVXJJ6aoIqHZqUqCUhuKBhLtUOVKYRXwTuB1TeGnf2Rm3zaze4HXAh8AcPe9wI3APoL6DVe6e41pvnoTs6AucLR8YycTmvX1VZtLSMyO8quie0mLPiqMu3+d+L0Mt7QYswVQzELFNOr6QuuC76046ST48Y/j+yHZfOQe+CmqVAyzaeNXFSgaSLRDpT4FUQ9ZU0dv3x68TkzAu941PVPnu97VOnncT/xE6/66nlYHBmbXxq8qUCpr0Q5SChWQJzNnFcRV5oqjkbb6iitmRhmdODG1jyHPPRr9a9bEH0/qb4fFi6cmv09/WpMfKJW1KE5l5qO5ShUbwaL09ZW/CSspB1I7uZFuSTASJvW3w3PPVVdrQoi5hlYKJVN1OGDDvLN+ffsrkCrt+p2MgKmz6pgQvYaUQsl0ajIsQ9FUucGrkz6FuquOCdFLSCmUTCcnw26OO0/b+1DmRK6qY0KUh5RCyXTSwdrNcedpETDnnVf82g2F0t8PGzYUD6sVQsyk8txHVTI2NuZ79nRXqeiknD9DQ3D0aLZrZLH1t8plk8dX4F5N7qM05s0r5gvImv9JCJFMbbmP5iJJSeDKSg5XRdx5HQXrizqHf+mXypVDCDEdhaTOMqoIvWyYX7ZvDybr/v7ATl+lWaa/v5hi+NrXShdFCBFBK4Ua2LgxMJ/E5SGqi61b4dixwPRz7Fj1dvqizmGFnwpRLVoplIxZsn0eAgXQyDsE5eQhqoO075lG8+okKwo/FaJatFIoQKs0FklO1kZ/I99QM0n9nSLv6uWnfzpffxzR1cnpp2cbo/BTIapFK4WctJvGIumpuE6zSJHVy/335+tPY2Cg9fFO+DmEEApJzc3ISKAImhkeDhKPpYVqJoVi9vcHT83Qfrhn3pDULDLluUeR/1JlX08IkYxCUkskqSR01lLRF12Ur79KFi4MXrth9ZLkK5APQYjOIqWQk3Ynr7vvztdfJc89F7wW+U6LF+frT6MbFJMQotoazWea2VfN7H4z22tmV4X9p5rZbWb2YPh6SmTMJjPbb2YPmNmlVcnWDu1OXlVvbitCkvO2lVP3k58MzE5R5s0L+oswPJyvXwhRDVWuFI4B/97dfxr4BeBKMxsFPgzsdvdzgN3hZ8Jja4GVwBuArWbWdcaD2TB5nXxyvvO3bg1yCOXJKTQ+DtdfPz230fXXF99l3cmcUUKIZCpTCu5+2N3vCt8/DdwPnAFcDuwIT9sBvDl8fzlwg7s/7+4PAfuBC6uSryizYfL6/vfzjymyea3M6l6dLMojhEimIz4FMxsBXgV8EzjN3Q9DoDiAl4ennQE8Ehl2KOzrKpImqe3bg30LohidLMojhEim8mnMzBYDnwfe7+4/bHVqTN+MYEQzW29me8xsz5EjR8oSMzNJUUbHj3cmdLKuus9V08k6FEKIZCpVCmY2QKAQJtz9C2H342a2LDy+DHgi7D8EnBkZvhx4rPma7r7d3cfcfWzp0qXVCZ9A3SGSZZbj7CbSivIIITpDldFHBlwL3O/ufxo5dBOwLny/DvhipH+tmS0ws7OAc4A7qpKvKN0SIllm3eeitEr3kZfxcVi3brqze9268tKDCyGyUeVKYRXwTuB1ZnZ32NYAVwOXmNmDwCXhZ9x9L3AjsA+4FbjS3btkCu5OkuztixZlG59n53MzjXQfBw+Ws3qZmAjCWRtK9/jx4HMvrYaEmA0ozUVO2plI3bOlc8h6j0ZqjWYuvhh2704fv2gRPPNMtns1k5buIy8nnRRfUW3BAvjxj/NfTwiRjNJc9CCt7O1f+Uq2a/zoR8XvX3a0UFKJTZXeFKKzSCnMMrKU4+zE4k/RQkL0JkqdPcuoohxnEbZsmZ5CHBQtJEQvoJVCD9KO3yMr4+PBaiWa5qLV6iWN1avz9QshqkGO5pzU7Wgus57C0BAcPZrt3E7Q7CBfvRp27apPHiF6FTma5xhZk/O97W3VypGXc8+dvk/h3HPrlUeIuYiUQg8Stzs4js98pnpZstIoCRrdp7BtW3qtaCFEuUgp9CDN9v4k2glJLZvt2/P1CyGqQUqhR4mmtZ4NqPKaEN2BlEKHSUpBEe0vOxInabXQiSglIcTsQkqhQzSqoWWZoPfvjz8nqV8IIcpCSqFDvOxlwWtSrqFof1LNhqT+NJLCWLspGnk2lDkVYi4gpdAhVEGsNaqnIER3IKUQw8aNMG9eYNKZN6+csMhTT23/Gr1M2TukhRDFUO6jJhrx8g0a8fKQrZh9N7J6dXwq7W5LITE+LiUgRN1opdBEWrz80FCx6z71VLFxZbBr10wFoBQSQog4pBSaSIuXL5oaou6U0rt2BY7lRpNCEELEUWWN5uvM7Akzuy/S91Eze7SpPGfj2CYz229mD5jZpVXJBa1rCzdy7zTT6L/llvz3GxiYcphmCUmdPz/+nKR+IYQoiypXCtcDb4jp/zN3Pz9stwCY2SiwFlgZjtlqZgnTc3uk1RZevz5+XKO/SBRRdMLPEh563XUzlYdZ0C+EEFVSmVJw938EslrSLwducPfn3f0hYD9wYRVybd48vTAMBJ83bw7eb90KGzZMz9a5YcOUkznJDNTfH0zccSuNF16Yun6WePzxcfjsZ6dH4nz2s3LCCiGqpw6fwm+a2b2heemUsO8M4JHIOYfCvtLJUlt41SpYvjyYkJcvDz43SIqn37EjyDOUlGuocf2s8fjR3EUHDkghCCE6Q6eVwjbgbOB84DDwJ2F/nKU91tBiZuvNbI+Z7Tly5EhuAZJSSjf608xLcfH069YFK4G+vqDF0VhhZI3Hb+X3yEK744UQcxR3r6wBI8B9aceATcCmyLEvAa9Ju/4FF1zgeenri8bgTLW+vuD48HD88f5+d7Pg+M6dU9fbudN9cDB+TKMNDk4fk0bcNfNcY+dO9/nzp4+fPz+fDEKI3gXY4wnzaqXlOM1sBLjZ3V8Rfl7m7ofD9x8Aft7d15rZSuCvCfwIpwO7gXPcvWXi5CLlONNKXfb1pecEGhycerofGYnPSdTfH5h+VqwITEN5zD9J1xweDkxJaSxZAk8+ObO/28pvCiHqoZZynGb2OeB24DwzO2Rm7wX+yMy+bWb3Aq8FPgDg7nuBG4F9wK3AlWkKoShpIadZ9hNEHdNJPoqGf6GIPyCL36MVcQqh0V9m6g4hRO9RZfTR2919mbsPuPtyd7/W3d/p7j/j7q9098saq4bw/C3ufra7n+fuf1+VXGkhp2vWxB9vpjFBJymRdjarJeVJKit/kkpdCiGSmHM7mtNCTrNuTmtM+klKJKtyqYKsqThU6lII0cycUwoQKIBjxwLfwbFj0xPdZTHRRENIk5RIkZ3PDZLyJGXNn3TNNcEu6jRU6lII0cycVAqtSNuc1hxC2q79P48MWU1S4+Pw6U9Phb0mkeRfEULMXaQUmkjbnNbsOC4ygaftISij4Ex081tSiuyLLsp+PSHE3EBKoYm8xV7yTuBpm+OKyJCGaj4LIbIipRBDnhQTeSfwtNxLVVCFiUsI0ZtIKRSg2fwD2ZVI3Ka05v4sq4k8VBE2K4ToTaQUctLuhJ22eQ7KX02U4aMQQswNpBRy0u6EnVbZDco395TtoxBC9C7z6hZgttHuhD08nJzXqMGKFfHntGPuGR+XEhBCpKOVQk7atc9nMeXI3COEqAsphZy0O2FnMeXI3COEqItKU2dXTZHU2WUwMRH4EB5+uFhqbCGEqJNaUmf3Mu2WysxSFU2V04QQdSClUAJ5JvAsIa1l71MQQoisyHzUJo0JPBqmGq3M1kyWqmrtVl4TQohWtDIfSSm0Sd4JPKncp1lgjsp6jhBCFKWucpzXmdkTZnZfpO9UM7vNzB4MX0+JHNtkZvvN7AEzu7Qqucom776FLCGtSkshhKiLKn0K1wNvaOr7MLDb3c8BdoefMbNRYC2wMhyz1cxmRbb/vBO49ikIIbqZKms0/yPQXCvscmBH+H4H8OZI/w3u/ry7PwTsBy6sSrYyyTuBa5+CEKKb6XSai9Pc/TCAux82s5eH/WcA/xw571DY1/U0Juo8+xaypJxQWgohRB10S+6juKKRsR5wM1sPrAdY0SVGdk3gQoheodP7FB43s2UA4esTYf8h4MzIecuBx+Iu4O7b3X3M3ceWLl1aqbBCCDHX6LRSuAlYF75fB3wx0r/WzBaY2VnAOcAdHZZNCCHmPJWZj8zsc8BFwBIzOwR8BLgauNHM3gs8DLwVwN33mtmNwD7gGHCluydUHhBCCFEVlSkFd397wqHVCedvARR0KYQQNaLcR0IIISaZ1WkuzOwIEJNkIjNLgKMliVMVkrEcJGM5SMZyqFvGYXePjdSZ1UqhXcxsT1L+j25BMpaDZCwHyVgO3SyjzEdCCCEmkVIQQggxyVxXCtvrFiADkrEcJGM5SMZy6FoZ57RPQQghxHTm+kpBCCFEhDmnFOKK/3QbZnammX3VzO43s71mdlXdMjVjZieZ2R1mdk8o48fqlikJM+s3s2+Z2c11y5KEmR0ws2+b2d1mVm85wQTM7GQz+xsz+074f/M1dcsUxczOC3+/Rvuhmb2/brmaMbMPhH8z95nZ58zspLplijLnzEdm9svAM8Bn3P0VdcsTR5gscJm732VmLwHuBN7s7vtqFm0SMzNgkbs/Y2YDwNeBq9z9n1OGdhwz+x1gDHipu7+pbnniMLMDwJi7d218vZntAP63u3/KzOYDg+7+/ZrFiiUs0vUo8PPu3s5eplIxszMI/lZG3f25ML3PLe5+fb2STTHnVgoJxX+6Cnc/7O53he+fBu6ny+pLeMAz4ceBsHXdE4aZLQfeCHyqbllmM2b2UuCXgWsB3P2FblUIIauB73aTQogwD1hoZvOAQRIyQtfFnFMKsw0zGwFeBXyzZlFmEJpl7iZIgX6bu3edjMAngA8BJ2qWIw0Hvmxmd4Y1Q7qNnwCOAJ8OTXGfMrNFdQvVgrXA5+oWohl3fxT4OEFC0MPAD9z9y/VKNR0phS7GzBYDnwfe7+4/rFueZtz9uLufT1D/4kIz6ypznJm9CXjC3e+sW5YMrHL3VwO/ClwZmjm7iXnAq4Ft7v4q4EeENda7jdC0dRnwP+uWpRkzO4Wg/PBZwOnAIjN7R71STUdKoUsJ7fSfBybc/Qt1y9OK0IzwNeAN9Uoyg1XAZaG9/gbgdWa2s16R4nH3x8LXJ4C/pftqlB8CDkVWg39DoCS6kV8F7nL3x+sWJIaLgYfc/Yi7vwh8AfjXNcs0DSmFLiR04l4L3O/uf1q3PHGY2VIzOzl8v5DgP/t3ahWqCXff5O7L3X2EwJzwFXfvqqcyADNbFAYUEJpkXg90VXScu/8/4BEzOy/sWk1Q/6QbeTtdaDoKeRj4BTMbDP/OVxP4DLuGOacUwuI/twPnmdmhsOBPt7EKeCfBk20jvG5N3UI1sQz4qpndC/wLgU+ha0M+u5zTgK+b2T0EFQf/zt1vrVmmOH4LmAj/zc8H/rBecWZiZoPAJQRP4F1HuNL6G+Au4NsEc3BX7W6ecyGpQgghkplzKwUhhBDJSCkIIYSYREpBCCHEJFIKQgghJpFSEEIIMYmUgpgzmNnxpiyahXfkmtk/lSlb07XHzOzPq7q+EK1QSKqYM5jZM+6+uG45hOhmtFIQc56wlsHHzOyusKbBT4X9S83strD/L83soJktCY89E75eZGZfi9QZmAh3qmJmF5jZP4RJ7r4UpkRvvvdbw7z695jZP0aueXP4/pbIyuYHZrYuTET4x2b2L2Z2r5ld0anfSvQ+UgpiLrGwyXz0byPHjoYJ6bYBHwz7PkKQGuPVBPmIViRc91XA+4FRgmyiq8LcVf8N+HV3vwC4DtgSM/b3gEvd/WcJkrhNw93XhEkH3wscBP5X+P4H7v5zwM8Bv2FmZ2X8DYRoyby6BRCigzwXTrBxNNIi3An8Wvj+F4G3ALj7rWb2vYSxd7j7IYAwlfgI8H3gFcBt4cKhnyBVcjPfAK4Pi63EpmYIVyefBd7m7j8ws9cDrzSzXw9PeRlwDvBQgnxCZEZKQYiA58PX40z9XVjOsdHxBux195YlK939fWb28wSFgO42s/Ojx8MKYjcAv+/ujSR5BvyWu38po3xCZEbmIyGS+TrwNoDw6fyUHGMfAJZaWMfYzAbMbGXzSWZ2trt/091/DzgKnNl0ytXAve5+Q6TvS8CG0ESFmZ3b5QVvxCxCKwUxl1gYmnca3OrurcJSPwZ8LvQ9/AOB+efpLDdy9xdC886fm9nLCP7WPgHsbTr1j83sHIKn/93APcCvRI5/ENgbkfv3CEqLjgB3hU7tI8Cbs8glRBoKSRUiATNbABx392PhE/+2Fj4JIXoCrRSESGYFcKOZ9QEvAL9RszxCVI5WCkIIISaRo1kIIcQkUgpCCCEmkVIQQggxiZSCEEKISaQUhBBCTCKlIIQQYpL/D/ZoRF15citXAAAAAElFTkSuQmCC\n",
      "text/plain": [
       "<Figure size 432x288 with 1 Axes>"
      ]
     },
     "metadata": {
      "needs_background": "light"
     },
     "output_type": "display_data"
    }
   ],
   "source": [
    "plt.scatter(cdf.ENGINESIZE, cdf.CO2EMISSIONS,  color='blue')\n",
    "plt.xlabel(\"Engine size\")\n",
    "plt.ylabel(\"Emission\")\n",
    "plt.show()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "button": false,
    "new_sheet": false,
    "run_control": {
     "read_only": false
    }
   },
   "source": [
    "#### Creating train and test dataset\n",
    "\n",
    "Train/Test Split involves splitting the dataset into training and testing sets respectively, which are mutually exclusive. After which, you train with the training set and test with the testing set.\n",
    "This will provide a more accurate evaluation on out-of-sample accuracy because the testing dataset is not part of the dataset that have been used to train the model. Therefore, it gives us a better understanding of how well our model generalizes on new data.\n",
    "\n",
    "We know the outcome of each data point in the testing dataset, making it great to test with! Since this data has not been used to train the model, the model has no knowledge of the outcome of these data points. So, in essence, it is truly an out-of-sample testing.\n",
    "\n",
    "Let's split our dataset into train and test sets. Around 80% of the entire dataset will be used for training and 20% for testing. We create a mask to select random rows using the  **np.random.rand()** function:\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {
    "button": false,
    "new_sheet": false,
    "run_control": {
     "read_only": false
    }
   },
   "outputs": [],
   "source": [
    "msk = np.random.rand(len(df)) < 0.8\n",
    "train = cdf[msk]\n",
    "test = cdf[~msk]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "button": false,
    "new_sheet": false,
    "run_control": {
     "read_only": false
    }
   },
   "source": [
    "#### Train data distribution\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {
    "button": false,
    "new_sheet": false,
    "run_control": {
     "read_only": false
    }
   },
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAYUAAAEHCAYAAABBW1qbAAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjMuNCwgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy8QVMy6AAAACXBIWXMAAAsTAAALEwEAmpwYAAAuu0lEQVR4nO3df/QddX3n8ef7+80P801UIEQ2EJKwGm2D20X5FnXT00UDYtEj2q1u3GBziqfRhLZo67Fk2a24bboc+0u7bVKj/Ijmu7JstQsHWSgBbNfWigkCEpBDeiAhwEL4pQRYMF/e+8fM/Wa+k5k7M3dm7sy939fjnDn33s+dmfv5Xsi873x+vD/m7oiIiACMNF0BERFpDwUFERGZoqAgIiJTFBRERGSKgoKIiExRUBARkSmz6jy5mT0EPAdMAofdfdzMjgP+B7AceAj4sLs/E+6/CfhYuP9vuftN3c5//PHH+/Lly+uqvojIUNq9e/eT7r4o6b1ag0Lone7+ZOT1xcAt7n6ZmV0cvv5dM1sJrAFOBU4EdprZG919Mu3Ey5cvZ9euXXXWXURk6JjZvrT3mmg+Og/YHj7fDnwgUn61u7/k7g8Ce4Ez+l89EZGZq+6g4MDfmtluM1sflp3g7o8BhI+vC8tPAh6OHHsgLBMRkT6pu/lolbs/amavA242sx912dcSyo7KwREGl/UAS5curaaWIiIC1Hyn4O6Pho9PAH9D0Bz0uJktBggfnwh3PwCcHDl8CfBowjm3ufu4u48vWpTYTyIiIj2qLSiY2Xwze3XnOfBu4B7gOmBduNs64Nrw+XXAGjOba2anACuA2+uqn4iIHK3OO4UTgO+Y2V0EF/dvufuNwGXA2Wb2AHB2+Bp33wNcA9wL3Ahc2G3kkYjMLBMTsHw5jIwEjxMTTddoONkgp84eHx93DUkVGX4TE7B+PbzwwpGysTHYtg3Wrm2uXoPKzHa7+3jSe5rRLCKtd8kl0wMCBK8vuaSZ+gwzBQURab39+4uVS+8UFESk9dJGn2tUevUUFESk9TZvDvoQosbGgnKploKCiLTe2rVBp/KyZWAWPKqTuR79SIgnIlLa2rUKAv2gOwUREZmioCAiIlMUFEREZIqCgoiITFFQEBGRKQoKIiIyRUFBRESmKCiIiMgUBQUREZmioCAiIlMUFEREZErtQcHMRs3sB2Z2ffj6UjN7xMzuDLdzI/tuMrO9Zna/mZ1Td91ERGS6fiTEuwi4D3hNpOzP3P2PozuZ2UpgDXAqcCKw08zeqHWaRUT6p9Y7BTNbArwX+EqO3c8Drnb3l9z9QWAvcEad9RMRkenqbj76AvAZ4JVY+W+Y2d1mdoWZHRuWnQQ8HNnnQFgmIiJ9UltQMLP3AU+4++7YW1uB1wOnAY8Bf9I5JOE0nnDe9Wa2y8x2HTx4sMIai4hInXcKq4D3m9lDwNXAu8xsh7s/7u6T7v4K8GWONBEdAE6OHL8EeDR+Unff5u7j7j6+aNGiGqsvIjLz1BYU3H2Tuy9x9+UEHci3uvv5ZrY4stsHgXvC59cBa8xsrpmdAqwAbq+rfiIicrQmluP8vJmdRtA09BDwcQB332Nm1wD3AoeBCzXySESkv/oyec3dv+3u7wuff9Td/5W7/5y7v9/dH4vst9ndX+/ub3L3/92PuonIYJiYgOXLYWQkeJyYaLpGw0kzmkUkU9MX5IkJWL8e9u0D9+Bx/XoFhjooKIhIVxMTsG7d9AvyunX9vSBfcgm88ML0shdeCMqlWuZ+1KjPgTE+Pu67du1quhoiQ23BAnj++aPL58+HQ4f6U4eRkSAgxZnBK/FZUJLJzHa7+3jSe7pTEJGukgJCt/I6LF1arFx6p6AgIq23eTOMjU0vGxsLyqVaCgoi0tVIylUirbwOa9fCtm2wbFnQZLRsWfB67dr+1WGmUFAQka4+/vFi5XVZuxYeeijoQ3joIQWEuigoiAyBOoeMbtkCGzbA6GjwenQ0eL1lS7nzNj3MVZIpKIjUrO6LXz/G8G/ZAocPB+c/fLiagKB5B+2kIakiNepc/KJj7MfGqm0PX748uKjGLVsWNLO00SDWeZh0G5KqoCBSo35c/AZxDP8g1nmYaJ6CSEP27y9W3ot+jOHfuBFmzQou2rNmBa+jijaRad5BeykoiNQoPrY+q7wXdY/h37gRtm6FyTBn8eRk8LoTGHrpH9C8gxZz94HdTj/9dBdps5ER9+BSOX0bGcl/jg0b3EdHg+NGR4PXcTt2uC9b5m4WPO7YUdVfEJwz6W8wC95ftiz5/WXLup+3zjpLd8AuT7mu6k5BZrSsZpGy0trH87abZ/1K74iP4YfqRjyldTt2ynttItO8g3ZSUJAZK+8Ft4zO2P685XHbthUrh/4P91T/wHBRUJAZq5cLblHr1xcrj5tMWXswrRz6n2Za/QPDpfagYGajZvYDM7s+fH2cmd1sZg+Ej8dG9t1kZnvN7H4zO6fuusnM1ssFt6iys4F7udOoesTThg3dy9euDdZXiP6N69apOWhQ9eNO4SLgvsjri4Fb3H0FcEv4GjNbCawBTgXeA2wxs5w32SLFlW3ayavMbOBe7jSqbs7JCmwTE7B9+/RmuO3bNTt5UNUaFMxsCfBe4CuR4vOA7eHz7cAHIuVXu/tL7v4gsBc4o876ycxWtmmnH1atCjrAo2bNCsrT1NGc0y2waVW04VL3ncIXgM8A0bEWJ7j7YwDh4+vC8pOAhyP7HQjLRGpRV6K3Kl1ySXARjjp8+OgLbnTy2CWXBM03/Uoz3Y8JetI/s7J36Y2ZvQ94wt13m9mZeQ5JKDtqMJyZrQfWAyzV8AYpacuWdgWBuDwX3Hh+pX37guabfq03sHRpcioP/fMcTHXeKawC3m9mDwFXA+8ysx3A42a2GCB8fCLc/wBwcuT4JcCj8ZO6+zZ3H3f38UWLFtVYfZHm5ekfaLr5pq7RR3XPIZFktQUFd9/k7kvcfTlBB/Kt7n4+cB2wLtxtHXBt+Pw6YI2ZzTWzU4AVwO111U9kEOS54DbdfFPHqmj9mEMiyZqYp3AZcLaZPQCcHb7G3fcA1wD3AjcCF7p7hYMDRQZPngtuGyaPVT07uR9zSAZV7XdQafkvBmFT7iNpg6Zz+OzY4T42Nj3v0NjYYOcSSsql1Nlmsg0bkr+TpHxY3aDcRyL1aMMKYr0037R9Kcx+zSEZNP24g1JQECmh6U7eXtQRyM46KwhIne2ss8rVcRDmkDShH7PwG28CKrOp+UialpVWug7HHDP9s+bNy24+ijZxddJwF0l1vXr19H1Xr05/L2mfXuRJGT7TpP23Gx0tdh7UfCRSj3538h57LDz77PSyF1/sfrcSvzNI+1WZNlrprLPglluml91yy5G7gfh70X3KKJMeZFj14w5KQUGkhH5nCI0HhG46F/mkJq4kaYGsrou+FNePWfgKCiIl1DFGvyqdi3ye+QpKdT046r6DUlAQGULRi3xWU5ZSXUuUgoJICf0eknrMMcnl8+al360kNXFFZaW6Xr26WLkMNgUFkS6yxvP3e0jqM88cHRiOOSb4zLQZxfEmrqSx/t3qvHPn0QFg9eqgHILzJkkrl3ZTUBBJkecuoIm8Q888M31A4jPPZKc+iKaheOWVxNN2rfPOndM/sxMQoLrOdiXAawcFBZEUee4Cjjsu+di08irEL56nnloseVzVw2irWI5TCfDaQ0FBJEXT2UeTJF087703ed+tW5ObvaoeRpt3Oc5uTXFKgNciabPaBmHTjGap07Jl2TN/+zGjOTobuVuiuG5btxnOZZP4pX1PCxce+YyFC93nzEmvkxLg9Rea0SxSXJ5f1HXPaI73a/TqhReCJp3Or3Tonuq6SC6jpFXXAJ566ki9n3oKXn756Dp1muKUAK89FBREUuSZmFb3jOa8s5HzmJzMN2w2K61FlTpNcWeemfx+WrnUx7zMz4+GjY+P+65du5quhsxwExPBxXv//uAOYfPm6iaCjYzkv0MYHS2WLXPZsuAuIc6SVkuPfc769Udm0mbtn6cOy5cn33Gk1VHKMbPd7j6e9J7uFERKiq869g//UGxoZbehmEWaoTqpDzZsyLd/rx3m8ZFBvTbxRO+o2tipP1PVFhTM7FVmdruZ3WVme8zsc2H5pWb2iJndGW7nRo7ZZGZ7zex+MzunrrqJ1KXo0Mqs/d/whnyfG51cdsMN+Y4p2+/RGRmUt4ln9mxYuDC5Ka4NS4pKKK0HuuwGGLAgfD4b+B7wduBS4NMJ+68E7gLmAqcA/wyMdvsMjT6SNsgzOihtNFJWfvy097utW5BnlFK35TrT1kdIGxm0cGHye/Pn5x/hNIxLirYZXUYfzaox2DhwKHw5O9y6tY6eB1zt7i8BD5rZXuAM4Lt11VGkrM7ooKzO4LR+gayVtLr1EaSdc+nS5Pb50dGgiSur32PnzuTO5qTzQTCyKMnzz8OhQ8nvxXXqUlffjORXa5+CmY2a2Z3AE8DN7v698K3fMLO7zewKMzs2LDsJeDhy+IGwTKRviq5dXHZ0UNZQzLxDNaP9Evv3B8+jxsaCCWVpQ1Djomkt0vooql4aM943o4DQjFqDgrtPuvtpwBLgDDN7M7AVeD1wGvAY8Cfh7kljGI76LWRm681sl5ntOnjwYC31lpmpl4ynZTtCs4Zipl14JyePzCGYM2d6v4R70Om8YMGR9vt164IAljfYRWUt7LJgQfJxaeXScmntSlVvwGeJ9SUAy4F7wuebgE2R924C3tHtnOpTkCrlmcGc95j4NjKSfHxae/zChUf2ia5VXGTr9EvU3V6f52+QdqGJGc1mtsjMjgmfzwPOAn5kZosju30QuCd8fh2wxszmmtkpwArg9rrqJxLXy7DIrLUKOtIyk6a1x0fLoyttFdG5c0hL7Hf++dVkJH366WLl0m51Nh8tBm4zs7uB7xP0KVwPfN7MfhiWvxP4FIC77wGuAe4FbgQudPcCU3FEykkb/uienu4hz1oF0MzaAp26ZDVxlc1IqhQVw0UzmmVG27gxuKh32uhHR4Nf5d1EF5hJOt/WrUeXpy2u3m02cNI/zSKzhzufmTZbOC7P356k6N8gzdOMZqlF0ZE6batDfOJYvIM2TbehmmkTx/JOKMuSthzn7NnpHcF5m7iKpMiQIZbW2TAImzqam9OGyUZl65A1cayXdM5FU2kX/YwdO5L3zfqb80yw6/zdRfXyPUmz6NLRrOYj6UkbEpiVrUNWs0cvzSJF61T0M6r43os2cWVR89HgKd18FI4k+o9mti2ccHaFmV1RbTVlkLQhgVnZOmR1kMYXq++Il0ebsA4dCppyoqpMpV3F975qVVDXqJGRoLwXaZPb8ibmk3bJ26dwLfBaYCfwrcgmM1QbEpiVrUPaxLBO+c6dRweAeCdzfMLbU09Nv8vIWq847Vd2WnkV3/sllxw9RPaVV6avPS0zWFq7UnQD7syzX7839Sk0Zxj6FNynTwwbHQ1eF5Fn8lq3OvXSp1D2b656CdGsvhlpH7r0KeQNCn8AnJtn335uCgrNKntBrUKVaw33cv686yanzYruZRZ12b+5l8/sRh3Ng6eKoPAc8Arw/8LnzwE/yXNsnZuCQnPacKeQR5nAledvzJvmIu1XeBPfY9WfWfWdh9SvdFBo66ag0Jyqf23WYcOG5DrmDQx5/sYdO9znzMkOCqOj6b/s677bSVLlZ+a9U2ji75Rk3YJC7slrZvZ+M/vjcHtflf0aMnjaMPooy5e+VKw8Lm0WcLzcPftck5PBfnkyr2Y56aQjaTfMgtdF9TtN9cQEXHDB9Ay0F1zQzIRH6S7XPAUzuwz4eaDzn/AjwG53v7jGumXSPIXmtGGeQpay4+fzHJ/2PXQWtBkZSZ4p3PmeJibgox+dXh8z+NrXki/UJ50Ejz56dPmJJ8Ijj3T7a+qT53s6/vjk5H8LF8KTT9ZTL0lXRZqLc4Gz3f0Kd78CeE9YJjNUUuqEKsfjQzvSaGRJuzN65ZVgS0sd0QkkF1xwdIByD8qTJAWEbuVpqvxu8wyrzZMNVtqhSO6jYyLPX1txPWTAxLODxhdiL6uXBW+akDVvIGuC3MsvJ7+fVl6Fqr/bT3yiWLm0XFpnQ3QjaC7aB1wFbAceBNbkObbOTR3Nw6uKjuyyQyXzHJ81kifrHEXrmHf/bqOu6hgkkDXKSwvxtAtVjD4iWB/h/cB5wL/Ie1ydm4LCcMm7wljeIaZ5Rw+ljYhZuTL5+JUrp39Ot3Nk1aFoUDjxxOR9Tzxx+veYtE/nu2piCOmOHe6zZ0//vNmzNQKpKT0HBeBnwse3Jm3dju3HpqAwPNIuZHm2tMCQdSFKGk46Z073wBAPCFmy7iTmzk3+m+bOTT9nPDBEA4J7sPRn0jk7S4IuWJD8/oIFxf62ojQktT3KBIVt4eNtCdut3Y7tx6ag0Kwq/5H3sgZx9M4hrX7dLvp1NWnEv5cNG9K/p6J3CnlknbPbLGxdsGeGSpqPim7AqwjWWL4L2AN8Liw/DrgZeCB8PDZyzCZgL3A/cE7WZygoNKfqWbG9BoRuF9Cqm27yKPq9NBEU8nyfbZydLtXpFhTyzlP4EHCjuz9nZv8pbD76fXf/QZdjDJjv7ofMbDbwHeAi4JeBp939MjO7OAwKv2tmK4GvA2cAJxJkZH2jd1mnWfMUmlP1PIVZs3pf+SttGcmRkeASF2cWDBetYx2AutdTyCPr7877XbdpzolUq4p5Cv85DAi/AJxDMALpr7odEAakQ+HL2eHmBB3V28Py7cAHwufnAVe7+0vu/iDBHcMZOesnfZZ3tm9eaWmsyxw7f3738oULk99PK88jbd7Cvn3VzbfYuDG4sJsFjxs3Tn8/LZh0ys88M9/ntGl2uvRP3qDQ+V3xXmCru18LzMk6yMxGzexO4AngZnf/HnCCuz8GED6+Ltz9JODhyOEHwjJpoazx90UlLfySZMGC6WsRr14drH+cdMF9/vnkc3TKv/jFoxfEmT07KC8iepHu9uvePQgOv/ZrR+pZdD2F+LrSk5PB63hg6Gbv3nz79XNtDGmRtHal6AZcD3wJ+GeCSWxzgbvyHBsefwxB5/SbgWdj7z0TPv4lcH6k/HLg3yWcaz2wC9i1dOnS6hrZpJA8beFFOqLzZhvt9AmYBR3C8Y7kInMEitYxSa+jpjqd2UWHh+ZZu6Db5+ZN9V20T0EjiwYLFaTOHiPoC1gRvl4MvDvPsZFzfBb4NEEn8uLIee4Pn28CNkX2vwl4R7dzqqO5OVkjd6rscC26VdmRPG/e9OPmzZv+frdRU1kXYPfiE8ny/E1lvrteLuqagzB4ugWFvM1Hi4FvufsDZnYm8CGCkUWpwnWdjwmfzwPOAn4EXAesC3dbR7DUJ2H5GjOba2anACuyPkOa8+yz3csvuQReeGH6ey+80J8lH8u0hUebgszgxRenv//ii9NzPnXrsI0veZnk3JQMYmnldesla+pFF8FPfzq97Kc/Dcpl8OQNCt8AJs3sDQTNOqcA/z3jmMXAbWZ2N/B9gj6F64HLgLPN7AHg7PA17r4HuAa4F7gRuNC7jDwadlUng8vqnCwq7WLYKW8ytXavbeHx9vo00UBRtm/l8suLlefRa79Or5Tsbsik3UJEN+CO8PEzwG+Gz3+Q59g6t2FtPqp6DkDZxWaS9LNZpMhWtE8hqsgEurzfbVYzW9E61t181Iuqzyf1o4I+he8RJMW7BzglLLsnz7F1bsMaFKpOWFbHwupZF4KigS3P6mXdtqS28KJ/d68Xz27J4LLa2+sICkU67aPb6tVp/7W7U7K7wdMtKORtPvo14B3AZnd/MGzz31Hd/YpEVd30ktXUU4eiqbXLpopOaguv6++eN2/661WrYMmS4O9csiR43bF2LVx55fTv4core08xviPlX120PGmti07TIQTNSyeeOP391ath587e6vTFL8Kc2AD1OXOKD+2VlkiLFoOwDeudQtW/vLISpPWi6iaDMrmP0j6z6B1XnuGa8e+sbFPf6tXFf7XnGf4Z3WfhwqPvVqpOY6EhqYOFXu8UzOya8PGHZnZ3ZPth2IEsAyD+yzarvAl13LW84Q3Fyt2zz/nKK9M76dNGWa1bl2+QwBvfWKwc8q2vHN1nwYKjRwdVPRKs32s+S3265j4ys8Xu/piZLUt63917TGpQjWHNfZSVu6bp83WOTZPn4hr36lfDoUPZ+xX5zLQcP2m5kvLmBIoen/bdRo2NpTedFa1jL+r47y+DrefcR34kHcW+MAA8AzwX2aQGWUs8Nn2+OqSlpCijaJ9C3vxL0ePzfIfdfpX3o7+nH//9B2E9bcknV0ezmX3czB4H7gZ2h9vw/URvic2bkzvuNm/u/Xzxjsexsenna/ofdS93F1FJ9S46h2DLFtiwIXucf/T9pO82SVqiwKpzSCXJ89+/jEFZT1tySutsiG4Eax8cn2fffm7D2tFcR9qAbh2BvXxeLx3N3epQppM5rQO1l/kZ0eGlaR3P8eOjf1davdKGwdYxhyRJnR3Bdaz5LPWignkKNwJjefbt5zasQaHf/8h6Ge1UNCiUWeC+6Bb9nrIWlI/KSm6XdXwv30vROvayf92aWPNZyukWFPIusvMW4EqCSWwvRe4yfqv6e5f81NFcjV46jfMcMzERtKXv3x/8TUnt5J2FXLqdr6hev6cqOs+PPz45vcPChfDkk8XrFNdJxRG3YUPQ/NWEqhdckvpVscjOl4BbgX/iSJ/C7mqqJ3FpbdR52q7bIt7OnNZx2uuiPN002YH+0kvFyovatq1YeT/U3Wch/ZU3KBx299929yvdfXtnq7VmM1g8M2dWeVl1rECWNH4/SdXJ25q+GKUNq+023LZIJ38Ts9OzFJ29Lu2WNyjcZmbrzWyxmR3X2Wqt2QyW1vRR15jyOtIU5L0DqOpiVsXFqOgqaFWYmAhWYouO3ImuzBbXj9FKvdDkteGRNyj8B4JFcP4RDUmtXRX/8OO/PjduTP81unYtXHHF9F96V1xR7h923rqWuRuJSrsYFfkV/olPFCuvQtG1CNLmUpRZ41pkmrQe6EHYhnX0UdlhikkjfeLbyEi5YYlZo2zyjhTKk0I6z5b3e8jK+VN2ZE/ROvZjtFI/KPfRYKHXIanAZyLPPxR77w+7HduPbViDgnu5f/h5UyfPn997/bIuZkXXJigbFJIuRk2Mn+9HUGibqtf/kPp1CwpZuY/ucPe3xp8nvW7CsA5JLatIG3iX//w9f4Z7sTqY9V6PuJER+OpXg2akJnL+FB2SWvcQ1n7QkNTBU2ZIqqU8T3od/9CTzew2M7vPzPaY2UVh+aVm9oiZ3Rlu50aO2WRme83sfjM7J6Nu0mJF+gqqCggQXOw//vHgeRM5n4p22g/DWgRNLr0q1csKCp7yPOl13GHgd9z9Z4G3Axea2crwvT9z99PC7QaA8L01wKnAe4AtZtbwmIrhNhL5r9907qMqdZLrNTF+vminfR2d/P02CAkXpYC0dqWwWWkS+AlBRtTD4fPO6592OzbhXNcCZwOXAp9OeH8TsCny+ibgHd3OOcx9CmU67vK2w3f6KXppE85qC8+zYE2dWxXfo+SjPoXBQ9ncR2U3YDmwH3hNGBQeIsi4egVwbLjPXwDnR465HPiVbucd1qCwY8fRF1Wz/P/Isi6Y8Y7rXjpksy7IafmU+h0UZqp+B0MF38HSLSjkyn1UhpktAP6OYH3nb5rZCcCTBM1Pvw8sdvcLzOwvge+6+47wuMuBG9z9G7HzrQfWAyxduvT0fXXkSWjY3LnJaxbPmZMvXULRHD69dMhmfUZaB2q/1Py/dat1UoxEZ5R3W+hHZp4qch/1+sGzgW8AE+7+TQB3f9zdJ939FeDLwBnh7geAkyOHLwEejZ/T3be5+7i7jy9atKjO6jcmbRH7sovbp6mjTfjpp3s/VspJWyK0yuU3ZXjVFhTMzAiagO5z9z+NlC+O7PZB4J7w+XXAGjOba2anACuA2+uqnxxRR4fscUqC0hiNBpIy6rxTWAV8FHhXbPjp583sh2Z2N/BO4FMA7r4HuAa4l2D9hgvdvcE0X8PJLFgXOLr4fD8Tmo2M1JtLSDQaSMqZVdeJ3f07JM9luKHLMZsBJdwtaf787mseT04eycnfaw7+BQuSM38uWBA8pjUfuQf9FHUGhqryKQ2qzZuT+xSUylryqLVPQZrxq7+ab79ODv6imToB3va27uVN/VqdPXuwJn7VQamspQwFhRo0PRHsa1/Lt18nbXXRTJ0At97avfzcc5PfTysvY8GCIxe/K6/UxQ+Uylp6V1vz0UwVHw64b9+RtMZV/MMcGQl+bW/enH6+bgu6JEkbOtptSGnakM9O+Q0pjYRp5WW8+GJ9uYxEZhrdKVSs7uGAnead9evL34HU2a7fzxEwTa46JjJsFBQq1q+LYRWBpvOr/lWvSn4/rTyPfvYpNL3qmMgwUVCoWD8vhlUFmjoWm8+a+7BsWe/njtOqYyLVUVCoWD87WKsKNFn9A73IGgFT5vvo3BmMjsKGDb0PqxWRo9We+6hObVxkp4pFU/K09XfLZVN0kZ1Zs5Lb5UdH4fDh4nXM879U2sIsWQZp8RmRtmos99FM1MtIniLqGHfexGLwvTZ9nXZapdUQkRgNSR0wdQy97DS/bNsW3DGMjgYBoc5mmaVLe7tT+Pa3K6+KiEToTqEBGzcGTTZJeYiasmVL0FTkHjzW3U6f1BGdh4afitRLQaFiaW3tnfKNG4O8Q52LWycPURsCQxGdHEd5y+PiHdF5afipSL0UFCqWNZKnk28oLq28X4revWTlPsojmorhxBPzHaPhpyL1Up9Cn6U1fzTZLNK5e4nWJSuLalbuo6Jmz+7+fj/6OUREdwo9KZPwLq35o4lmkZHwv34vdy9Vz21IG41k1r9+DhFRUCisk/Aumma6SB6iM88sVl6n17wmeGzD3YsWhhFpBwWFgsomvLvzzmLldXr22eCxl7uXsh3NcXUsCSoixdW5RvPJZnabmd1nZnvM7KKw/Dgzu9nMHggfj40cs8nM9prZ/WZ2Tl11K6Nswru6J7f1opfJa3/1V0GHdNSsWUF5L9auhXXrpqewWLdO6wCI9FuddwqHgd9x958F3g5caGYrgYuBW9x9BXBL+JrwvTXAqcB7gC1m1roBiIPQzJF3JE/Hli1BDqEiOYXWroWrrpqe2+iqq3q/iE9MwPbt04fqbt/e/wWKRGa6vuU+MrNrgb8ItzPd/TEzWwx8293fZGabANz9v4b73wRc6u7fTTtnE7mP4iN1OjoX0aycQHlyBpXNK5R33H+33Eb9lpYLadmyYNiqiFSn8dxHZrYceAvwPeAEd38MIHx8XbjbScDDkcMOhGWtkrZy2LZtR0bzDIo2zQ7u56I8IpKu9suYmS0AvgF80t1/0m3XhLKjfheb2Xoz22Vmuw4ePFhVNXNLy9czOVku1XReTa37XLdBaJYTmQlqDQpmNpsgIEy4+zfD4sfDZiPCxyfC8gPAyZHDlwCPxs/p7tvcfdzdxxctWlRf5VM0nWahyuU420Sjj0Taoc7RRwZcDtzn7n8aees6YF34fB1wbaR8jZnNNbNTgBXA7XXVr1dtaXKpct3nXpWZxBen0Uci7VDnncIq4KPAu8zsznA7F7gMONvMHgDODl/j7nuAa4B7gRuBC929JZfgI+pc7L6otPb2DRvyHV/mbyk7iS/pfF/+8vTRR1/+8nDdDYkMAq28VlCZC2kVo4+i0kbmpI2Qips/Hw4dyvdZcVWPFnr1q5PrsmABPPdc8fOJSLrGRx/NFP28i+jW3p53Atnzz/f++VWPFkoLTr0GLRHpjYJChepYFS0uz3Kc/bj502ghkeGk1NkDph+BJ4/Nm4M+hGgeqDKjhTrZUJPKRaR/dKcwhPpxIY2vnJZ195LlE58oVi4i9dCdQoXa8qs2b/PRwoXlPmft2uqGjHbyLG3bFow80qI6Is3QnUKfZa3hXIVly/Lt9+EPV/eZVVi1CpYsCb6LJUuC1yLSXwoKfVb1imVJkmYHJ/nqV6v7zLKqnvcgIr1RUOizfizHGW/vT1NmSGrVyi5eJCLVUFDoszxLX1YRONauDSaRtWW0Upa0RINp5SJSDwWFPkvr3I2W97ISWjf96Mcoqx93UCKSTUGhT445Jnh86aXk96PlaWs2pJUPgzx3UCJSPwWFPnnta4PHPOkcqm5K6UfndllpI6byjqQSkWooKPSJVhDrTuspiLSDgkKCKtcJ6DjuuPLnGGZVz5AWkd5oRnNMZ7x8Z3hkZ7w8DO4FavVquOWW5PI2qXKGtIj0RncKMVnj5Xtt43766XL1KmPnzqMDwOrVQbmISJSCQkzWOgHnntvbeYuklK5jCOnOnUHHcmdTQBCRJHWu0XyFmT1hZvdEyi41s0diy3N23ttkZnvN7H4zO6euekH3PoOsdQJ6GRY6e/aRDtM8F3xlDBWRptR5p3AV8J6E8j9z99PC7QYAM1sJrAFODY/ZYma1TFvKyrGTNQqml1FE0Qt+nuGhW7YE6yxHF7HfsEEZQ0WkfrUFBXf/eyBvS/p5wNXu/pK7PwjsBc6oo15ZfQZZo2DS7iRGR4P9k2bgvvxydp9EvHzLFjh8OAgWhw8rIIhIfzTRp/AbZnZ32Lx0bFh2EvBwZJ8DYVnl8qwtHM0b9NBD00fEpN1JbN8e7J+Wa6hzfo3HF5E263dQ2Aq8HjgNeAz4k7A8qaU9saHFzNab2S4z23Xw4MHCFUibL5B3HkHSncS6dcGdwMhIsCXp3GHkHY9fdq5EHXMtRGQGcPfaNmA5cE/We8AmYFPkvZuAd2Sd//TTT/eiFi6MjsE5si1cWPhU7u6+Y4f72FjyOTvb2FiwX5lzFjlH2eNFZLgBuzzlutrXOwUzWxx5+UGgMzLpOmCNmc01s1OAFcDtddQhbb5Ar/MIkvoo4EgfQy8zc8uuLaC1CUSkV3UOSf068F3gTWZ2wMw+BnzezH5oZncD7wQ+BeDue4BrgHuBG4EL3b2W/JhZQ06hWNNLWh9Fp38h3ieRR55+j16O37cvCFSzZsHGjcXqJCIzQ21pLtz9IwnFl3fZfzNQe3fr5s3T01jA9I7eomkuli5Nzl5aZLJa3HHHwVNPJZfnkVanjslJ2Lo1eK5RTSISNeNmNGd19BZtekmb4dzrzOcq5F2jedu2+usiIoPFvE1J9QsaHx/3Xbt2VXrOkZHkCWZmycNNly9P/lW+bFnQdNSPOiSZmAgC2f793ddNGOD//CLSIzPb7e7jSe/NuDuFLHn6HKLKtv9XUYck0bkWWupSRPJSUIgpOrmsigt42TpkOfPMYuUiMnMpKMQUXeyljhnKVS84s3dvsXIRmbkUFBJ0S3ORtG/RC3i/ZxvX0cQlIsNJQaEH8Ys65A8iWVla8+5TRB1NXCIynBQUCip7wc4z5LXqGclKwicieSkoFFT2gp2nKafq5p6q+yhEZHjVNqN5WJW9YOeZAV3HLOm1axUERCSb7hQKKts+n6cpR809ItIUBYWCyl6w8zTlqLlHRJqiNBc9iKaQWLo0CAi6YIvIoOiW5kJ9Cj1Q+7yIDCs1H1VAS1+KyLDQnUJJRddfEBFpM90plKSlL0VkmNS5HOcVZvaEmd0TKTvOzG42swfCx2Mj720ys71mdr+ZnVNXvaqmvEIiMkzqvFO4CnhPrOxi4BZ3XwHcEr7GzFYCa4BTw2O2mNlAZPtXXiERGSa1BQV3/3vg6VjxecD28Pl24AOR8qvd/SV3fxDYC5xRV92qpIlmIjJM+t2ncIK7PwYQPr4uLD8JeDiy34GwrPU00UxEhklbRh9ZQlnirDozWw+sB1jakjYazVsQkWHR7zuFx81sMUD4+ERYfgA4ObLfEuDRpBO4+zZ3H3f38UWLFtVaWRGRmabfQeE6YF34fB1wbaR8jZnNNbNTgBXA7X2um4jIjFdb85GZfR04EzjezA4AnwUuA64xs48B+4EPAbj7HjO7BrgXOAxc6O6TddVNRESS1RYU3P0jKW+tTtl/M6AxOyIiDdKMZhERmTLQqbPN7CCQsEZZbscDT1ZUnbqojtVQHauhOlaj6Touc/fEkToDHRTKMrNdaTnF20J1rIbqWA3VsRptrqOaj0REZIqCgoiITJnpQWFb0xXIQXWshupYDdWxGq2t44zuUxARkelm+p2CiIhEzLigkLT4T9uY2clmdpuZ3Wdme8zsoqbrFGdmrzKz283srrCOn2u6TmnMbNTMfmBm1zddlzRm9pCZ/dDM7jSzXU3XJ4mZHWNmf21mPwr/33xH03WKMrM3hd9fZ/uJmX2y6XrFmdmnwn8z95jZ183sVU3XKWrGNR+Z2S8Ch4Cvuvubm65PkjBZ4GJ3v8PMXg3sBj7g7vc2XLUpZmbAfHc/ZGazge8AF7n7PzVctaOY2W8D48Br3P19TdcniZk9BIy7e2vH15vZduD/uPtXzGwOMObuzzZcrUThIl2PAG9z9zJzmSplZicR/FtZ6e4vhul9bnD3q5qt2REz7k4hZfGfVnH3x9z9jvD5c8B9tGx9CQ8cCl/ODrfW/cIwsyXAe4GvNF2XQWZmrwF+EbgcwN1fbmtACK0G/rlNASFiFjDPzGYBY6RkhG7KjAsKg8bMlgNvAb7XcFWOEjbL3EmQAv1md29dHYEvAJ8BXmm4Hlkc+Fsz2x2uGdI2/xI4CFwZNsV9xczmN12pLtYAX2+6EnHu/gjwxwQJQR8Dfuzuf9tsraZTUGgxM1sAfAP4pLv/pOn6xLn7pLufRrD+xRlm1qrmODN7H/CEu+9uui45rHL3twK/BFwYNnO2ySzgrcBWd38L8DzhGuttEzZtvR/4n03XJc7MjiVYfvgU4ERgvpmd32ytplNQaKmwnf4bwIS7f7Pp+nQTNiN8G3hPszU5yirg/WF7/dXAu8xsR7NVSubuj4aPTwB/Q/vWKD8AHIjcDf41QZBoo18C7nD3x5uuSIKzgAfd/aC7/xT4JvBvGq7TNAoKLRR24l4O3Ofuf9p0fZKY2SIzOyZ8Po/gf/YfNVqpGHff5O5L3H05QXPCre7eql9lAGY2PxxQQNgk826gVaPj3P3/Ag+b2ZvCotUE65+00UdoYdNRaD/wdjMbC/+dryboM2yNGRcUwsV/vgu8ycwOhAv+tM0q4KMEv2w7w+vObbpSMYuB28zsbuD7BH0KrR3y2XInAN8xs7sIVhz8lrvf2HCdkvwmMBH+Nz8N+MNmq3M0MxsDzib4Bd464Z3WXwN3AD8kuAa3anbzjBuSKiIi6WbcnYKIiKRTUBARkSkKCiIiMkVBQUREpigoiIjIFAUFmTHMbDKWRbPnGblm9o9V1i127nEz+/O6zi/SjYakyoxhZofcfUHT9RBpM90pyIwXrmXwOTO7I1zT4GfC8kVmdnNY/iUz22dmx4fvHQofzzSzb0fWGZgIZ6piZqeb2d+FSe5uClOixz/7Q2Fe/bvM7O8j57w+fH5D5M7mx2a2LkxE+Edm9n0zu9vMPt6v70qGn4KCzCTzYs1H/z7y3pNhQrqtwKfDss8SpMZ4K0E+oqUp530L8ElgJUE20VVh7qr/BvyKu58OXAFsTjj294Bz3P1fEyRxm8bdzw2TDn4M2Af8r/D5j93954GfB37dzE7J+R2IdDWr6QqI9NGL4QU2SSctwm7gl8PnvwB8EMDdbzSzZ1KOvd3dDwCEqcSXA88CbwZuDm8cRglSJcf9A3BVuNhKYmqG8O7ka8CH3f3HZvZu4OfM7FfCXV4LrAAeTKmfSG4KCiKBl8LHSY78u7CCx0aPN2CPu3ddstLdP2FmbyNYCOhOMzst+n64gtjVwH9x906SPAN+091vylk/kdzUfCSS7jvAhwHCX+fHFjj2fmCRhesYm9lsMzs1vpOZvd7dv+fuvwc8CZwc2+Uy4G53vzpSdhOwIWyiwsze2PIFb2SA6E5BZpJ5YfNOx43u3m1Y6ueAr4d9D39H0PzzXJ4PcveXw+adPzez1xL8W/sCsCe26x+Z2QqCX/+3AHcB/zby/qeBPZF6/x7B0qLLgTvCTu2DwAfy1Eski4akiqQws7nApLsfDn/xb+3SJyEyFHSnIJJuKXCNmY0ALwO/3nB9RGqnOwUREZmijmYREZmioCAiIlMUFEREZIqCgoiITFFQEBGRKQoKIiIy5f8DFrhw4voZLFYAAAAASUVORK5CYII=\n",
      "text/plain": [
       "<Figure size 432x288 with 1 Axes>"
      ]
     },
     "metadata": {
      "needs_background": "light"
     },
     "output_type": "display_data"
    }
   ],
   "source": [
    "plt.scatter(train.ENGINESIZE, train.CO2EMISSIONS,  color='blue')\n",
    "plt.xlabel(\"Engine size\")\n",
    "plt.ylabel(\"Emission\")\n",
    "plt.show()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "button": false,
    "new_sheet": false,
    "run_control": {
     "read_only": false
    }
   },
   "source": [
    "<h2 id=\"multiple_regression_model\">Multiple Regression Model</h2>\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "In reality, there are multiple variables that impact the Co2emission. When more than one independent variable is present, the process is called multiple linear regression. An example of multiple linear regression is predicting co2emission using the features FUELCONSUMPTION_COMB, EngineSize and Cylinders of cars. The good thing here is that multiple linear regression model is the extension of the simple linear regression model.\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {
    "button": false,
    "new_sheet": false,
    "run_control": {
     "read_only": false
    }
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Coefficients:  [[9.73617439 8.18051358 9.6509734 ]]\n"
     ]
    }
   ],
   "source": [
    "from sklearn import linear_model\n",
    "regr = linear_model.LinearRegression()\n",
    "x = np.asanyarray(train[['ENGINESIZE','CYLINDERS','FUELCONSUMPTION_COMB']])\n",
    "y = np.asanyarray(train[['CO2EMISSIONS']])\n",
    "regr.fit (x, y)\n",
    "# The coefficients\n",
    "print ('Coefficients: ', regr.coef_)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "As mentioned before, **Coefficient** and **Intercept**  are the parameters of the fitted line.\n",
    "Given that it is a multiple linear regression model with 3 parameters and that the parameters are the intercept and coefficients of the hyperplane, sklearn can estimate them from our data. Scikit-learn uses plain Ordinary Least Squares method to solve this problem.\n",
    "\n",
    "#### Ordinary Least Squares (OLS)\n",
    "\n",
    "OLS is a method for estimating the unknown parameters in a linear regression model. OLS chooses the parameters of a linear function of a set of explanatory variables by minimizing the sum of the squares of the differences between the target dependent variable and those predicted by the linear function. In other words, it tries to minimizes the sum of squared errors (SSE) or mean squared error (MSE) between the target variable (y) and our predicted output ($\\hat{y}$) over all samples in the dataset.\n",
    "\n",
    "OLS can find the best parameters using of the following methods:\n",
    "\n",
    "*   Solving the model parameters analytically using closed-form equations\n",
    "*   Using an optimization algorithm (Gradient Descent, Stochastic Gradient Descent, Newton’s Method, etc.)\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<h2 id=\"prediction\">Prediction</h2>\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {
    "button": false,
    "new_sheet": false,
    "run_control": {
     "read_only": false
    }
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Residual sum of squares: 616.12\n",
      "Variance score: 0.86\n"
     ]
    }
   ],
   "source": [
    "y_hat= regr.predict(test[['ENGINESIZE','CYLINDERS','FUELCONSUMPTION_COMB']])\n",
    "x = np.asanyarray(test[['ENGINESIZE','CYLINDERS','FUELCONSUMPTION_COMB']])\n",
    "y = np.asanyarray(test[['CO2EMISSIONS']])\n",
    "print(\"Residual sum of squares: %.2f\"\n",
    "      % np.mean((y_hat - y) ** 2))\n",
    "\n",
    "# Explained variance score: 1 is perfect prediction\n",
    "print('Variance score: %.2f' % regr.score(x, y))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**Explained variance regression score:**\\\n",
    "Let $\\hat{y}$ be the estimated target output, y the corresponding (correct) target output, and Var be the Variance (the square of the standard deviation). Then the explained variance is estimated as follows:\n",
    "\n",
    "$\\texttt{explainedVariance}(y, \\hat{y}) = 1 - \\frac{Var{ y - \\hat{y}}}{Var{y}}$\\\n",
    "The best possible score is 1.0, the lower values are worse.\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<h2 id=\"practice\">Practice</h2>\n",
    "Try to use a multiple linear regression with the same dataset, but this time use __FUEL CONSUMPTION in CITY__ and \n",
    "__FUEL CONSUMPTION in HWY__ instead of FUELCONSUMPTION_COMB. Does it result in better accuracy?\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Coefficients: [[9.79813736 7.86601151 6.10940945 3.28796401]]\n",
      "Residual sum of squares: 618.05\n",
      "Variance score: 0.86\n"
     ]
    }
   ],
   "source": [
    "# write your code here\n",
    "regr = linear_model.LinearRegression()\n",
    "x=np.asanyarray(train[['ENGINESIZE','CYLINDERS','FUELCONSUMPTION_CITY','FUELCONSUMPTION_HWY']])\n",
    "y=np.asanyarray(train[['CO2EMISSIONS']])\n",
    "regr.fit(x,y)\n",
    "print('Coefficients:',regr.coef_)\n",
    "y_=regr.predict(test[['ENGINESIZE','CYLINDERS','FUELCONSUMPTION_CITY','FUELCONSUMPTION_HWY']])\n",
    "x=np.asanyarray(test[['ENGINESIZE','CYLINDERS','FUELCONSUMPTION_CITY','FUELCONSUMPTION_HWY']])\n",
    "y=np.asanyarray(test[['CO2EMISSIONS']])\n",
    "print(\"Residual sum of squares: %.2f\"% np.mean((y_ - y) ** 2))\n",
    "print('Variance score: %.2f' % regr.score(x, y))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<details><summary>Click here for the solution</summary>\n",
    "\n",
    "```python\n",
    "regr = linear_model.LinearRegression()\n",
    "x = np.asanyarray(train[['ENGINESIZE','CYLINDERS','FUELCONSUMPTION_CITY','FUELCONSUMPTION_HWY']])\n",
    "y = np.asanyarray(train[['CO2EMISSIONS']])\n",
    "regr.fit (x, y)\n",
    "print ('Coefficients: ', regr.coef_)\n",
    "y_= regr.predict(test[['ENGINESIZE','CYLINDERS','FUELCONSUMPTION_CITY','FUELCONSUMPTION_HWY']])\n",
    "x = np.asanyarray(test[['ENGINESIZE','CYLINDERS','FUELCONSUMPTION_CITY','FUELCONSUMPTION_HWY']])\n",
    "y = np.asanyarray(test[['CO2EMISSIONS']])\n",
    "print(\"Residual sum of squares: %.2f\"% np.mean((y_ - y) ** 2))\n",
    "print('Variance score: %.2f' % regr.score(x, y))\n",
    "\n",
    "```\n",
    "\n",
    "</details>\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "button": false,
    "new_sheet": false,
    "run_control": {
     "read_only": false
    }
   },
   "source": [
    "<h2>Want to learn more?</h2>\n",
    "\n",
    "IBM SPSS Modeler is a comprehensive analytics platform that has many machine learning algorithms. It has been designed to bring predictive intelligence to decisions made by individuals, by groups, by systems – by your enterprise as a whole. A free trial is available through this course, available here: <a href=\"https://www.ibm.com/analytics/spss-statistics-software?utm_medium=Exinfluencer&utm_source=Exinfluencer&utm_content=000026UJ&utm_term=10006555&utm_id=NA-SkillsNetwork-Channel-SkillsNetworkCoursesIBMDeveloperSkillsNetworkML0101ENSkillsNetwork20718538-2021-01-01\">SPSS Modeler</a>\n",
    "\n",
    "Also, you can use Watson Studio to run these notebooks faster with bigger datasets. Watson Studio is IBM's leading cloud solution for data scientists, built by data scientists. With Jupyter notebooks, RStudio, Apache Spark and popular libraries pre-packaged in the cloud, Watson Studio enables data scientists to collaborate on their projects without having to install anything. Join the fast-growing community of Watson Studio users today with a free account at <a href=\"https://www.ibm.com/cloud/watson-studio?utm_medium=Exinfluencer&utm_source=Exinfluencer&utm_content=000026UJ&utm_term=10006555&utm_id=NA-SkillsNetwork-Channel-SkillsNetworkCoursesIBMDeveloperSkillsNetworkML0101ENSkillsNetwork20718538-2021-01-01\">Watson Studio</a>\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Thank you for completing this lab!\n",
    "\n",
    "## Author\n",
    "\n",
    "Saeed Aghabozorgi\n",
    "\n",
    "### Other Contributors\n",
    "\n",
    "<a href=\"https://www.linkedin.com/in/joseph-s-50398b136/?utm_medium=Exinfluencer&utm_source=Exinfluencer&utm_content=000026UJ&utm_term=10006555&utm_id=NA-SkillsNetwork-Channel-SkillsNetworkCoursesIBMDeveloperSkillsNetworkML0101ENSkillsNetwork20718538-2021-01-01\" target=\"_blank\">Joseph Santarcangelo</a>\n",
    "\n",
    "## Change Log\n",
    "\n",
    "|  Date (YYYY-MM-DD) |  Version | Changed By  |  Change Description |\n",
    "|---|---|---|---|\n",
    "| 2020-11-03  | 2.1  | Lakshmi  | Made changes in URL |\n",
    "| 2020-08-27  | 2.0  | Lavanya  |  Moved lab to course repo in GitLab |\n",
    "|   |   |   |   |\n",
    "|   |   |   |   |\n",
    "\n",
    "## <h3 align=\"center\"> © IBM Corporation 2020. All rights reserved. <h3/>\n"
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python",
   "language": "python",
   "name": "conda-env-python-py"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.6.13"
  },
  "widgets": {
   "state": {},
   "version": "1.1.2"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 4
}