Data Management for the Big Data Age
Duration
- One Semester or equivalent
Contact hours
- 36 hours
2021 teaching periods
Hawthorn
Higher Ed. Semester 1 | Higher Ed. Semester 2 | |
---|---|---|
Dates: Results: Last self enrolment: Census: Last withdraw without fail: |
Dates: Results: Last self enrolment: Census: Last withdraw without fail: |
Corequisites
Aims and objectives
This unit is designed to deliver a variety of technologies and techniques used in managing different types of data in the big data age. Database technologies including data modelling and database design at conceptual level, logical level and physical level, query language and processing, transaction management will be introduced. Two types of database systems – SQL and NoSQL will be presented and their differences will be discussed.
Unit Learning Outcomes | |
---|---|
On successful completion of this unit students will be able to: | |
# | Unit Learning Outcome Description |
ULO1 | Explain features of big data and the roles of different types of data |
ULO2 | Critically review the concepts and principles of databases and database management systems including relational data model for handling structured data |
ULO3 | Use SQL to create, query and manipulate databases |
ULO4 | Design databases using ER modelling techniques and functional dependencies using normalization |
ULO5 | Select technologies for data storage and physical database design, query processing and transaction management |
ULO6 | Use XML and JSON to design, query and manipulate semi-structured data and explain unstructured/text data processing and information retrieval techniques |
ULO7 | Evaluate different types of NoSQL databases, their differences from SQL databases and big data technologies on MapReduce and Hadoop |
Unit information in detail
- Teaching methods, assessment and content.
Teaching methods
All Applicable Locations | |||||
---|---|---|---|---|---|
Activity Type | Activity | Total Hours | Number of Weeks | Hours Per Week | Optional - Activity Details |
Face to Face Contact | Lecture | 24 | 12 weeks | 2 | No Description |
Face to Face Contact | Tutorial Labs | 12 | 12 weeks | 1 | Tutorials in Computer Labs |
Unspecified Learning Activities | Independent Learning | 114 | 12 weeks | 9.5 | No Description |
Total Hours: | 150 | Total Hours (per week): | 12.5 |
Assessment
All Applicable Locations | |||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| |||||||||||||||||||||||||
| |||||||||||||||||||||||||
| |||||||||||||||||||||||||
|
Content
- 3Vs features of Big data and different types of data: structured, semi-structured and unstructured data
- Introduction to all database concepts
- Relational data model
- Entity Relationship (ER) models for database design
- SQL and SQL Programming Techniques
- Functional dependencies and normalization for relational databases
- Physical database design and query processing
- Transaction management - concurrency control and recovery
- XML related technologies and JSON
- Different types of NoSQL databases and their differences from SQL databases
- Big data technologies on MapReduce and Hadoop
- Unstructured/text data processing and information retrieval
Study resources
- References.