CS7DS2 Optimisation For Machine Learning Assignment Report  Mini-Batch SGD, Overfitting Analysis & Gradient Algorithms

Published: 23 Jul, 2025
Category Assignment Subject Computer Science
University Trinity College Dublin (TCD) Module Title CS7DS2 Optimisation for Machine Learning
Assessment Title Report

CS7DS2 Supplemental Assignment 

You must do this assignment entirely yourself – you must not discuss or collaborate on the assignment with other students in any way, you must write answers in your own words and write code entirely yourself. If you use any online or other external content in your report you should take care to cite the source. It is mandatory to complete the declaration that the work is entirely your own and you have not collaborated with anyone – the declaration form is available on Blackboard. All submissions will be checked for plagiarism.

Reports must be typed and submitted as a separate pdf on Blackboard (not as part of a zip file).

Include the source of code written for the assignment as an appendix in your submitted pdf report (the code itself, not a screenshot, so the plagiarism checker can run on it). Also include a separate zip file containing the executable code and any data files needed. Programs should be running code written in Python. Keep code brief and clean with meaningful variable names etc.

Important: Your primary aim is to articulate that you understand what you’re doing – not just running a program and quoting numbers it outputs. Generally most of the credit is given for the explanation/analysis as opposed to the code/numerical answer.

CS7DS2 Assignment

It is thought that the “noise” added to the gradient when using mini-batch SGD acts as a regulariser and so helps prevent overfitting. Your task is to write a short report critically evaluating the use of mini-batch SGD to reduce overfitting and improve generalisation performance.The choice of model and dataset to use is up to you, but you need to justify why your choice is appropriate – in particular you should take care to make sure that overfitting takes place when using gradient descent (or SGD with a large batch size). Its also probably a good idea to look at two models/datasets so that you can compare/contrast them. You should investigate the role of mini-batch size on overfitting (remember that SGD becomes gradient descent the batch size equals the full dataset), and also the interplay between step size and mini-batch size. You should also investigate the use of constant-step size vs adaptive approaches such as adam.

Be sure to split the data into training, test and validation sets (cross-validation does not measure generalisation behaviour adequately). Also bear in mind the random nature of SGD, which means that you will probably need to do multiple runs and look at both the average behaviour and the fluctuations about the average from run to run.

Remember that most of the marks are for critical analysis/discussion.

  • 85 marks: indicative breakdown (i) methodology 30 marks, (ii) evaluation and critical discussion 45 marks, (iii) report organisation and presentation 10 marks.
  • Give short code for mini-batch SGD and explain its operation. [5 marks]
  • Explain how a projected gradient descent can be used to enforce a constraint on the decision variables. Illustrate with a brief example. [5 marks]
  • Briefly describe the RMSProp algorithm. Discuss how it differs from Adagrad (and why), and how it can change both the magnitude and direction of the step taken. [5 marks]

Achieve Higher Grades CS7DS2 Report Assignment

Order Non Plagiarized Assignment

Do you need help with your CS7DS2 Optimisation for Machine Learning Report Assignment? Our assignment help Ireland is here for you! Whether you need someone to do my assignment for me or require report writing, our Ireland experts are ready to help you in your Assignments. Ireland students can easily pay our experts for professional guidance with their coursework. Contact us today and get the best computer science assignment help from experienced writers.

See the solutions related of computer science then click here: Computer Science Assignment Sample

Workingment Unique Features

Hire Assignment Helper Today!


Latest Free Samples for University Students

LAA127/LAA127C Contract Law Assignment Coursework Sample 2025

Category: Coursework Example

Subject: Law

University: Swansea University

Module Title: LAA127/LAA127C Contract Law

View Free Samples

MGT4541 Strategy, Leadership and Management of Organisations Assignment 3 Example

Category: Assignment

Subject: Management

University: Middlesex University

Module Title: MGT4541 Strategy, Leadership and Management of Organisations

View Free Samples

DGM22702 Digital Consumer Journey Project Example 2025-26 | RUL

Category: Assignment

Subject: Computer Science

University: Ravensbourne University London

Module Title: DGM22702 Digital Consumer Journey

View Free Samples

LD7201 Academic and Employability Skills and Research Methods and Masters Dissertation Example

Category: Assignment

Subject: Education

University: Northumbria University

Module Title: LD7201 Academic and Employability Skills and Research Methods and Masters Dissertation

View Free Samples

COS7051-B Cyber Physical Systems Security Assignment Sample | UOB

Category: Assignment

Subject: Computer Science

University: University of Bradford

Module Title: COS7051-B Cyber Physical Systems Security

View Free Samples
Online Assignment Help in UK