On Gradient Descent and Coordinate Descent Methods and Its Variants

Authors

  • Sajjadul Bari
  • Md. Rajib Arefin
  • Sohana Jahan

Abstract

This research is focused on Unconstrained Opti
mization problems. Among a number of methods that can be
used to solve Unconstrained Optimization problems we have
worked on Gradient and Coordinate Descent methods. Step
size plays an important role for optimization. Here we have
performed numerical experiment with Gradient and Coordinate
Descent method for several step size choices. Comparison between
different variants of Gradient and Coordinate Descent methods
and their efficiency are demonstrated by implementing in loss
functions minimization problem.

Downloads

Published

2021-03-31

How to Cite

Bari, S., Arefin, M. R., & Jahan, S. (2021). On Gradient Descent and Coordinate Descent Methods and Its Variants. AIUB Journal of Science and Engineering (AJSE), 19(3), 9. Retrieved from https://ajse.aiub.edu/index.php/ajse/article/view/136

Issue

Vol. 19 No. 3 (2020): AJSE Volume:19 Issue:3 (2020)

Section

Articles

License

Copyright (c) 2026 AIUB Journal of Science and Engineering (AJSE)

Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

AJSE contents are under the terms of the Creative Commons Attribution License. This permits anyone to copy, distribute, transmit and adapt the work non-commercially provided the original work and source is appropriately cited.