Forecasting_Stock_Price

ANALYZING ROAD SAFETY & TRAFFIC DEMOGRAPHICS IN THE UK (Multi-class Classification) SUMMARY Here, I am aim to analyze the Road Safety and Traffic Demographics dataset (UK), containing accidents reported by the police between the years of 2004 - 2017. PROJECT GOALS: Identify factors responsible for most of the reported accidents. Build a machine learning model that is capable of accurately predicting the severity of an accident. Provide recommendations to the Department of Transport (UK Government), to improve road safety policies and prevent recurrences of severe accidents where possible. PACKAGES USED: Scikit-learn, numpy, pandas, imblearn (imbalanced-learn), seaborn, Matplotlib MOTIVATION World Health Organization (WHO) reported that more than 1.25 million people die each year while 50 million are injured as a result of road accidents worldwide. Road accidents are the 10th leading cause of death globally. On current trends, road traffic accidents are to become the 7th leading cause of death by 2030 making it a major public health concern. Between the years 2005 and 2016, there were roughly 2 million road accidents reported in the United Kingdom (UK) alone of which 16,000 were fatal. As a big data project, I wanted to explore the traffic demographics data in greater detail using machine learning! CONTEXT The UK government amassed traffic data from 2004 to 2017, recording over 2 million accidents in the process and making this one of the most comprehensive traffic data sets out there. It's a huge picture of a country undergoing change. Note that all the contained accident data comes from police reports, so this data does not include minor incidents. For steps undertaken to pre-process and clean the data, please view the "Data Cleansing & Descriptive Analysis_UK Traffic Demographics.ipynb" file DESCRIPTIVE ANALYTICS (EDA) Tools used include Python, Tableau, MS PowerBI Percent (%) distribution of target classes Percent dist of Accident Severity As seen above, the data is highly imbalanced. For detailed steps undertaken to deal with the imbalanced data, please view the "Modelling_Predictive Analytics_UK Traffic Demographics.ipynb" file. This article provides some great tips on utilizing the correct performance metrics when analyzing a models performance trained on an imbalanced dataset. This article describes several strategies that can help combat the case of a severly imbalanced dataset. Methods include: Resampling strategies (under - Tomek Links, Cluster Centroids, over sampling - SMOTE) Using Decision Tree based models Using Cost-Sensitive training (Penalize algorithms) Number of accidents by Year and Accident Severity Total accidents by year and severity It can be seen above that the trend seems to be increasing as the years go. In addition, the spike between 2008 - 2009 was because of a enhancement in the reporting system introduced in the UK in 2009, where all accident including minor accidents needed to be reported by the police so as to match the counts represented by hospitals, insurance claims etc. Accidents density by Location geomap Most accidents took place in major cities - Birmingham, London, leeds, Newcastle Accidents by Gender and Age Accidents by gender and age Accidents by Day of the week and Year Accidents by year and weekday Most accidents take place on a Friday Vehicle Manoever at time of accident Vehicle Manoever at time of accident Most accidents take place as a result of overtaking For more findings, please go to the "Images" folder. For steps undertaken to carry out some predictive modeling and hyper-parameter tuning, please view the "Modelling_Predictive Analytics_UK Traffic Demographics.ipynb" file. RECOMMENDATIONS TO THE DEPARTMENT OF TRANSPORT (UK) Decrease emergency response times during afternoon rush-hours (15-19) especially on Fridays. Allocate resources to investigate high density traffic points and identify new infrastructure needs to divert traffic from dual-carriage ways. Explore conditions of vehicles and casualties such as vehicle type, age of vehicles registered, pedestrian movements, etc. for policy makers. Adopt comprehensive distracted driving laws that increase penalties for drivers who commit traffic violations like aggressive overtaking. ACKNOWLEDGEMENTS The license for this dataset is the Open Givernment Licence used by all data on data.gov.uk. The raw datasets are available from the UK Department of Transport website. I had a lot of fun working on this dataset and learned a lot in the process. I plan to further my research in the area of predictive modeling using imabalanced data and how to effectively build a highly robust model for future projects. About Here, I analyze the Road Safety and Traffic Demographics dataset (UK), containing accidents reported by the police between the years of 2004 - 2017. Topics accident-rate accident-severity imbalanced-data imbalanced-learning road-accident reported-accidents road-safety uk-government transport traffic-demographics severe-accidents pca classification Resources Readme Releases No releases published Packages No packages published Languages Jupyter Notebook 100.0% © 2020 GitHub, Inc.

To showcase my new skills in Python, Spark, PySpark, and Kafka I created a jupyter notebook that utilized a huge dataset on Youtube Trending data to predict when youtube videos would land on the Trending Page. I implemented data cleaning and processing to build a data pipeline and machine learning model to predict how long it would take

Updated 15 seconds ago It is a hypothetical startup, where a user registers, sends free digital trees to people in their contacts and also paid supertrees,$1 each(the first supertree is free). A super can come to know and register for Send A Tree through source: google, invite_a_friend, paid promo, and article. A daily of the file is created for each day (filename: day_xx), containing event_type: registration, free_tree_send or super_tree_send, date, location, phone_type, birth_year, and source. In this project: I have set up Jupyter Notebook, PgAdmin, Rstudio, and Python3 on remote LINUX server, using DigitalOcean. Set up automation for data load, automated categorization based on event type and storing daily logs in respective folders, through CRONTAB Created SQL tables, for the categorized daily logs for REGISTRATIONS, FREE TREE SEND, and SUPER TREE SEND and automated SQL load. Performed broad market segmentation tasks through SQL and Python. Segments: Registrations, Free Trees, Super Trees 5.Performed micro-market segmentation tasks: Segments through SQL and Python: Location, phone type, Source, Birth Year Questions Answered: a. Which is the most important source of registrations? Are there any changes in the trends? b.Which Phone_type based segment has more/least registrants, the free tree sends, supertree sends? Who is more active? c.Which Location-based segment has more/least registrants, the free tree sends, supertree sends? Who is more active? d.Which Source-based segment has more/least registrants, the free tree sends, supertree sends? Who is more active? e.Which Birth Year-based segment has more/least registrants, the free tree sends, supertree sends? Who is more active? Calculate daily Active users on the app in total and through segmentation perspective. Automated the daily active users' calculations. Performed revenue calculation task in SQL and Python: Calculating the total revenue and also revenue through each segment possible and Automated the daily revenue calculation. Performed Funnel Analysis and Cohort Analysis( first and last 30 days) in SQL and Python. Performed Prediction Analysis to predict, Send-a-Tree possibly reaching the 25,000 free-tree sends per day, 10,000 super tree sends per day, 35,000 registrants per day? Perform Ramdon Forest Classification for classifying the error phone type records into iOS or Android-based on free_tree_sends, super_tree_sends, and source types as features. © 2020 GitHub, Inc.

The project was aimed to predict a most likely future stock trend based on 17320 daily trading records historical data on S&P 500 from January 1950 to October 2018, this project mainly used Jupyter Notebook.