ALY 6110 : You Will Download And Process, With Spark, Two Of The Following Datasets Or Two Datasets- Data Management & Big Data Spring Assignment

Published: 25 Jan, 2025
Category Assignment Subject Computer Science
University Northeastern University Module Title ALY 6110 Data Management & Big Data Spring

Overview and Rationale

Spark’s intended use is for data lakes which were discussed previously. It is important to be able to process these large data sets effectively with Spark. This assignment will provide you with experience and practice in using Spark to analyze a large data set.

Course Outcomes

This assignment is directly linked to the following key learning outcomes from the course syllabus:

Use methodologies to analyze big data sets and determine insights, including the use of Spark

Assignment Summary

For this assignment, you will download and process, with Spark, two of the following datasets OR two datasets your team selected for the final project. Note however, this is an individual assignment. If you choose your project dataset, your group may choose to incorporate your work into their assignment, but that is not required.

Government Sourced

Annual House Price Indexes
(see Working Papers
https://www.fhfa.gov/research/papers/wp1601?redirect=

https://www.fhfa.gov/research/papers/wp1602?redirect=

https://www.fhfa.gov/research/papers/wp1604?redirect=

Annual House Price Indexes
(see Working Papers

https://www.fhfa.gov/research/papers/wp1601?redirect=

https://www.fhfa.gov/research/papers/wp1602?redirect=

https://www.fhfa.gov/research/papers/wp1604?redirect=

Three-Digit ZIP Codes (Developmental Index; Not Seasonally Adjusted) )

CSV download (for Spark)

Instructions

Select 2 datasets, use SparklyR library in R to load them into Spark, and use a combination of SparklyR and traditional R commands to find insight of the details using different types of graphs and charts.

Write a 3-5 page report (excluding Appendix) that includes a section for each data set you choose to analyze. (Note: this is a short analysis, so keep your business problem focused and your analysis brief.)

For each data set include:

A description of the steps you took to perform the analysis (with code snippets as needed)
Secondary appendix file that is either the commented R code used (recommended) or commented screenshots of your analysis steps Results of your analysis

Your insights based on your analysis Format & Guidelines

The paper should follow the following format:

Introduction

Provide a short description of the dataset you analyzed and purpose for the analysis. Identify questions you are attempting to answer with or insights you want to gain from the analysis.

Analysis and results Outline your steps and provide the results of your analysis. Connect the results and your analysis to the purpose described in the introduction. Be specific.

Insights
Provide your insights based on your analysis. Connect your insights to the purpose of the analysis.

References Cited
Likely brief, but at least include citations to your data sources.

Appendix

Provide commented R code (recommended) or commented screenshots outlining the complete analysis; you will hit on the key analysis steps in the Analysis and Results section while referencing this Appendix for the complete process.

For your reference, please see the SparklyR Getting Started Guide (https://therinspark.com/starting) for how to install Spark via the SparklyR library in RStudio and a general introduction to the SparklyR commands.

Windows users! When installing the Java JDK, be sure to choose the option to install in a different location (eg. c:/java8) rather than the standard Program Files directory.

Are you a Student at Northeastern University And Facing challenges with your ALY 6110 Spark Installation Assignment? Look no further! At Workingment, provide plagiarism-free online assignment help services for UK students, offering expert guidance with your computer science assignments. Whether you're short on time or need someone reliable to handle the technical details, Are you thinking can i pay someone to do your assignment? The answer is yes.   Our professional writers ensure accurate, timely, and AI-free solutions according to your requirements. Don’t let your assignments stress you out—get the best help with computer science assignments today and achieve A+ Grades in your assignments. Visit Workingment.com and let us take care of the hard work!

HNN120 Quality and Safety in Healthcare Assignment 01 Brief | Deakin

This assessment will help you to demonstrate Unit Learning Outcome 1: Outline the Evolution of Nursing as a Profession. Undertaking this task will also help you to develop skills in locating and utilising evidence, and in writing for an academic audience.

PRJ5001 Project Management Profession Assessment 2 Brief | APIC

The purpose of this assessment is to analyse a real-life project, either completed (within the last five years) or ongoing to evaluate and discuss its business case, project charter, and stakeholder register.

PRJ5001 Project Management Profession Assessment 4 Brief | APIC

The purpose of this assessment is to create a single-page A3 size poster with important findings and conclusions from Assessment 3: Project Case Analysis. Students are also required to present the same as an oral presentation. The presentation will be conducted live.

PRJ5001 Project Management Profession Assessment 3 Brief | APIC

The purpose of this assessment is to analyse a given project case study and to demonstrate a critical understanding of the project case. For successful completion of the assessment, students are required to research and read the case study and analyse it to provide an evaluation of reasons for the controversy of this project.

PUBH6206 Health Promotion and Community Health Assessment 2 Brief | Torrens University Australia

Students are required to write a health promotion program plan of 2000 words (+/- 10%) in length. Students are required to follow the instructions on how to develop their plan. You will be provided with a list of communities/population groups and health issues by your Learning Facilitator. You are required to choose one of the health issues and community/population groups to develop a specific health promotion plan.

7LEAD027W Learning and Managing in a Global Context SEM 2 Assessment Brief | University of Westminster

Reflective journals are a tool used in leadership development.  They enable the developing leader to pause and take stock; review achievements, and reflect on the progress made towards goals.  Writing in a journal creates a safe space to reflect dispassionately on personal experiences and observations, which in turn leads to the identification of both personal strengths and derailing behaviours.

BM4106 Critical Issues in Business and Management Research SEM2 Assignment 2 Brief |UCLan

This assessment is worth 60% of the overall module mark. This Assessment Pack consists of a detailed assignment brief, guidance on what you must prepare, and information on how class sessions support your ability to complete successfully.

FINA1163 Financial Resource Management Assignment Brief | University of Greenwich

This module aims to equip students with a Financial Management toolkit, to engage in International Business Finance matters which postgraduates in International Business should be able to address. The goal is to analyse how small, medium and large firms finance their economic activities in the global economy.

CCMT10416 Earth Systems Assessment Brief | NTU University

This assessment aims to facilitate a deeper understanding of the Carboniferous geology of Derbyshire and the Permo-Triassic geology of Nottinghamshire. You will do this by exploring the geological features of several field sites during the field course and relating this to published academic literature.

5025CMD Data Science for Business Assignment Brief | CU

Create a report that examines how Data Science contributes to IT management decision-making by analysing and visualising real datasets and building a predictive model. Your report should explore how Big Data analytics support business strategy, business processes, and decision-making in an organisation through various tasks.

Online Assignment Help in UK