Description | Possible Marks / Wtg(%) | Word Count | Due date |
Assignment 2 Written Practical Report | 100 marks 15% Weighting | 1500 | 15/04/19 |
Modules 1–5 are particularly relevant for this assignment. Assignment 2 relates to the course objectives 1, 2 and 4:
1. demonstrate applied knowledge of people, markets, finances, technology and management in a global context of business intelligence practice (data warehouse design, data mining process, data visualisation and performance management) and resulting organisational change and how these apply to implementation of business intelligence in organisation systems and business processes
2. identify and solve complex organisational problems creatively and practically through the use of business intelligence and critically reflect on how evidence based decision making and sustainable business performance management can effectively address real world problems
4. demonstrate the ability to communicate effectively in a clear and concise manner in written report style for senior management with correct and appropriate acknowledgment of main ideas presented and discussed.
Note you must use RapidMiner Studio for Task 2 and you must use Tableau Desktop for Task 3 in this Assignment 2. Failure to do so may result in Task 2 and/or Task 3 not being marked and zero marks awarded. Note carefully University policy on Academic Misconduct such as plagiarism, collusion and cheating. Your Assignment 2 submission is automatically submitted to and checked in Turnitin for academic integrity when you submit your Assignment 2 via the course study Assignment 2 submission link. If any of these occur they will be found and dealt with by the USQ Academic Integrity Procedures. If proven, Academic Misconduct may result in failure of an individual assessment, the entire course or exclusion from a University program or programs.
Assignment 2 consists of three main tasks and a number of sub tasks
Task 1 Data Lakes and Data Warehousing (Worth 40 Marks)
Conduct a desktop research by critically reviewing relevant literature on data lakes in context of a more traditional approach to data management including data warehousing. Drawing on the relevant and current literature, write a short essay on data lakes that addresses two sub tasks:
Task1.1), provide a concise definition of a data lake in context of an organisational approach to data management (about 250 words) and
Task 1.2) explain what are two advantages of deploying a data lake and what are two disadvantages of deploying a data lake as part of an organisational data management strategy (about 500 words)
Task 2 Exploratory Data Analysis and Linear Regression Analysis (Worth 35 Marks)
Carefully study the Data Dictionary for Salary Data Set (See Table 1) and accompanying description of each variable in the salary.csv data set. It is important you understand this data set as it is used for Task 2 and Task 3 in Assignment 2.
Note: You should conduct some desktop research on determinates/drivers of a person’s salary level in order to fully understand and interpret the key findings of the exploratory data analysis (EDA) and Linear Regression Models for the salary.csv data set for Task 2 and visual presentation of the salary.csv data set in Task 3.
Table 1 Data Dictionary for the salary.csv Data Set
Variable | Description – Note NA denotes a missing value for a variable | Unit |
salary | Weekly Earnings (dollars) | Integer |
hours | Average Hours Worked Per Week | Integer |
IQ | IQ Score | Integer |
kww | Knowledge of World of Work Score | integer |
education | Number of Years of Education | Integer |
wexperience | Years of Work Experience | Integer |
tenure | Number of Years with Employer | Integer |
age | Age in Years | Integer |
married | = 1 If Married | Integer |
black | = 1 If Black | Integer |
south | = 1 If Live in South | Integer |
urban | = 1 If Live in a Standard Metropolitan Statistical Area | Integer |
sibs | Number of siblings | Integer |
birthorder | Birth Order | Integer |
meducation | Mother’s Education (Years) | Integer |
feducation | Father’s Education (Years) | Integer |
Task 2.1) Conduct an exploratory data analysis (EDA) of the salary.csv data set using the RapidMiner Studio data mining tool. Note this will require use of a number of RapidMiner operators
Provide the following for Task 2.1:
(i) a screen capture of your final EDA process, briefly describe your EDA process
(ii) summarise key results of your exploratory data analysis in Table 2.1 Results of Exploratory Data Analysis for salary.csv.
(iii) Discuss the key results of exploratory data analysis presented in Table 2.1 and provide a rationale for selecting top 5 variables for predicting salary of a person and in particular their relationship with dependent/target variable salary drawing on the results of EDA analysis and relevant literature (About 300 words).
Table 2.1 should include the key characteristics of each variable in the salary.csv data set such as maximum, minimum values, average, standard deviation, most frequent values (mode), missing values and invalid values etc.
Hint: The Statistics Tab and the Chart Tab in RapidMiner Studio provide a lot of descriptive statistical information and the ability to create useful charts like Barcharts, Scatterplots etc for the EDA analysis. You might also like to look at running some correlations and/or chi square tests as appropriate for the salary.csv data set to determine which variables contribute most to predicting house values.
Task 2.2) Build a Linear Regression model for predicting salary of a person using a RapidMiner data mining process and an appropriate set of data mining operators and a reduced set of variables from the salary.csv data set as determined by your exploratory data analysis in Task 2.1. Provide the following for Task 2.2:
(i) A screen capture of Final Linear Regression Model process and briefly describe your Final Linear Regression Model process
(ii) A table named Table 2.2 named Results of Final Linear Regression Model for Task 2.2 for salary.csv data set.
(iii) Discuss the results of the Final Linear Regression Model for salary.csv data set drawing on the key outputs (coefficients, standardised coefficients, t-statistics values, p-values and significance levels etc) for predicting house values and relevant supporting literature on the interpretation of a Linear Regression Model (About 300 words).
Include all appropriate outputs such as RapidMiner Processes, Graphs and Tables that support key aspects of exploratory data analysis and linear regression model analysis of the salary.csv data set in your Assignment 2 report.
Note you need export Processes and Graphs from RapidMiner using File/Print/Export Image option and include in Task 2 section where relevant or in Appendix 2 of Assignment 2 report.
Task 3 Tableau Desktop View of salary data set (Worth 15 marks)
Task 3.1) Create a Tableau Text Table or Graph view that displays salary values, average hours worked per week and other relevant data using the data set salary.csv. Comment on the (1) process of preparing a Text Table or Graph view using Tableau Desktop and (2) key trends and patterns that are apparent (about 75 words).
Task 3.2) Create a Tableau Text Table or Graph view that displays salary values, education level and other relevant data using salary.csv. Comment on the (1) process of preparing a Text Table or Graph view using Tableau Desktop and (2) key trends and patterns that are apparent (about 75 words).
Note: you need copy the two Text Table / Graph views you have created in Tableau using the Worksheet Menu Copy or Export Image option and include in the Task 3 section where relevant or in Appendix 3 of Assignment 2 report.
Report presentation, writing style and referencing (Worth 10 marks) Your Assignment 2 must be presented in report format, written in an appropriate style and supported where required with appropriate in text references using Harvard Referencing Style
Your assignment 2 report must be structured in report format as follows:
Cover/Title Page for Assignment 2 Table of Contents
Body of report – Task 1 main heading with appropriate sub headings Task 1.1, Task 1.2 etc..
Body of report – Task 1 main heading with appropriate sub headings Task 1.1, Task 1.2 etc..
Task 2 …
Task 3….
List of References List of Appendices
You must submit two files for Assignment 2:
1. Assignment 2 Report for Tasks 1, 2 and 3 in Word document format with extension .docx
2. Tableau packaged workbook with extension .twbx contains required two Text Table / Graph views for Task 3
You must use the following file naming convention:
1. Student_no_Student_name_CIS8008_Ass2.docx
2. Student_no_Student_name_CIS8008_Ass2.twbx
You must use Harvard referencing style – Harvard referencing resources
Install a bibliography referencing tool – Endnote which integrates with your word processor. http://www.usq.edu.au/library/referencing/endnote-bibliographic-software or alternatively use an online citation tool such as Zetoro or You Cite This For Me
USQ Library - how to reference correctly using Harvard referencing system https://www.usq.edu.au/library/referencing/harvard-agps-referencing-guide