Professor Fred Roosta
Professor
School of Mathematics and Physics
+61 7 336 53259
| Featured projects | Duration |
|---|---|
| Novel optimisation algorithms |
Publications
Book Chapters
Kylasa, Sudhir, Fang, Chih-Hao, Roosta, Fred and Grama, Ananth (2020). Parallel optimization techniques for machine learning. Parallel algorithms in computational science and engineering. (pp. 381-417) edited by Ananth Grama and Ahmed H. Sameh. Cham, Switzerland: Birkhauser. doi: 10.1007/978-3-030-43736-7_13
Ye, Nan, Roosta-Khorasani, Farbod and Cui, Tiangang (2019). Optimization methods for inverse problems. 2017 MATRIX annals. (pp. 121-140) edited by David R. Wood, Jan de Gier, Cheryl E. Praeger and Terence Tao. Cham, Switzerland: Springer. doi: 10.1007/978-3-030-04161-8_9
Journal Articles
Berahas, Albert S., Roberts, Lindon and Roosta, Fred (2024). Non-uniform smoothness for gradient descent. Transactions on Machine Learning Research.
MacDonald, Samual, Foley, Helena, Yap, Melvyn, Johnston, Rebecca L., Steven, Kaiah, Koufariotis, Lambros T., Sharma, Sowmya, Wood, Scott, Addala, Venkateswar, Pearson, John V., Roosta, Fred, Waddell, Nicola, Kondrashova, Olga and Trzaskowski, Maciej (2023). Generalising uncertainty improves accuracy and safety of deep learning analytics applied to oncology. Scientific Reports, 13 (1) 7395, 1-14. doi: 10.1038/s41598-023-31126-5
Yao, Zhewei, Xu, Peng, Roosta, Fred, Wright, Stephen J. and Mahoney, Michael W. (2023). Inexact Newton-CG algorithms with complexity guarantees. IMA Journal of Numerical Analysis, 43 (3), 1855-1897. doi: 10.1093/imanum/drac043
Liu, Yang and Roosta, Fred (2022). MINRES: From negative curvature detection to monotonicity properties. SIAM Journal on Optimization, 32 (4), 2636-2661. doi: 10.1137/21m143666x
Rijsdijk, Timothy, Nehring, Micah, Kizil, Mehmet and Roosta, Fred (2022). Confirming the Lassonde Curve through life cycle analysis and its effect on share price: A case study of three ASX listed gold companies. Resources Policy, 77 102704, 1-12. doi: 10.1016/j.resourpol.2022.102704
Roosta, Fred, Liu, Yang, Xu, Peng and Mahoney, Michael W. (2022). Newton-MR: inexact Newton Method with minimum residual sub-problem solver. EURO Journal on Computational Optimization, 10 100035, 1-44. doi: 10.1016/j.ejco.2022.100035
Eshragh, Ali, Roosta, Fred, Nazari, Asef and Mahoney, Michael W. (2022). LSAR: efficient leverage score sampling algorithm for the analysis of big time series data. Journal of Machine Learning Research, 23, 1-36.
Hodgkinson, Liam, Salomone, Robert and Roosta, Fred (2021). Implicit Langevin algorithms for sampling from log-concave densities. Journal of Machine Learning Research, 22 136, 1-30.
Potgieter, A. B., Zhao, Yan, Zarco-Tejada, Pablo J, Chenu, Karine, Zhang, Yifan, Porker, Kenton, Biddulph, Ben, Dang, Yash P., Neale, Tim, Roosta, Fred and Chapman, Scott (2021). Evolution and application of digital technologies to predict crop type and crop phenology in agriculture. In Silico Plants, 3 (1) diab017, 1-23. doi: 10.1093/insilicoplants/diab017
Yao, Zhewei, Xu, Peng, Roosta, Fred and Mahoney, Michael W. (2021). Inexact nonconvex Newton-type methods. INFORMS Journal on Optimization, 3 (2), 154-182. doi: 10.1287/ijoo.2019.0043
Liu, Yang and Roosta, Fred (2021). Convergence of Newton-mr under inexact hessian information. SIAM Journal on Optimization, 31 (1), 59-90. doi: 10.1137/19M1302211
Levin, Keith D., Roosta, Fred, Tang, Minh, Mahoney, Michael W. and Priebe, Carey E. (2021). Limit theorems for out-of-sample extensions of the adjacency and Laplacian spectral embeddings. Journal of Machine Learning Research, 22 194, 1-59.
Xu, Peng, Roosta, Fred and Mahoney, Michael W. (2020). Newton-type methods for non-convex optimization under inexact Hessian information. Mathematical Programming, 184 (1-2), 35-70. doi: 10.1007/s10107-019-01405-z
Roosta-Khorasani, Farbod and Mahoney, Michael W. (2018). Sub-sampled Newton methods. Mathematical Programming, 174 (1-2), 293-326. doi: 10.1007/s10107-018-1346-5
Fountoulakis, Kimon, Roosta-Khorasani, Farbod, Shun, Julian, Cheng, Xiang and Mahoney, Michael W. (2017). Variational perspective on local graph clustering. Mathematical Programming, 174 (1-2), 553-573. doi: 10.1007/s10107-017-1214-8
Ascher, Uri and Roosta-Khorasani, Farbod (2016). Algorithms that satisfy a stopping criterion, probably. Vietnam Journal of Mathematics, 44 (1), 49-69. doi: 10.1007/s10013-015-0167-6
Roosta-Khorasani, Farbod and Szekely, Gábor J. (2015). Schur properties of convolutions of gamma random variables. Metrika, 78 (8), 997-1014. doi: 10.1007/s00184-015-0537-9
Roosta-Khorasani, Farbod and Ascher, Uri (2015). Improved bounds on sample size for implicit matrix trace estimators. Foundations of Computational Mathematics, 15 (5), 1187-1212. doi: 10.1007/s10208-014-9220-1
Roosta-Khorasani, Farbod, Székely, Gábor J. and Ascher, Uri M. (2015). Assessing stochastic algorithms for large scale nonlinear least squares problems using extremal probabilities of linear combinations of gamma random variables. SIAM/ASA Journal on Uncertainty Quantification, 3 (1), 61-90. doi: 10.1137/14096311X
Roosta-Khorasani, Farbod, Van Den Doel, Kees and Ascher, Uri (2014). Stochastic algorithms for inverse problems involving pdes and many measurements. SIAM Journal on Scientific Computing, 36 (5), S3-S22. doi: 10.1137/130922756
Roosta-Khorasani, Farbod, van den Doel, Kees and Ascher, Uri (2014). Data completion and stochastic algorithms for PDE inversion problems with many measurements. Electronic Transactions on Numerical Analysis, 42, 177-196.
Conference Papers
Smee, Oscar and Roosta, Fred (2024). Inexact Newton-type methods for optimisation with nonnegativity constraints. International Conference on Machine Learning, Vienna, Austria, 21-27 July 2024. Proceedings of Machine Learning Research.
Zaher, Eslam, Trzaskowski, Maciej, Nguyen, Quan and Roosta, Fred (2024). Manifold integrated gradients: Riemannian geometry for feature attribution. International Conference on Machine Learning, Vienna, Austria, 21-27 July 2024. Proceedings of Machine Learning Research.
Hodgkinson, Liam, Van Der Heide, Chris, Roosta, Fred and Mahoney, Michael W. (2023). Monotonicity and double descent in uncertainty estimation with gaussian processes. International Conference on Machine Learning, Honolulu, HI United States, 23 - 29 July 2023. San Diego, CA United States: International Conference on Machine Learning.
Nguyen, Dung, Zhao, Yan, Zhang, Yifan, Huynh, Anh Ngoc-Lan, Roosta, Fred, Hammer, Graeme, Chapman, Scott and Potgieter, Andries (2022). Crop type prediction utilising a long short-term memory with a self-attention for winter crops in Australia. IGARSS 2022 - 2022 IEEE International Geoscience and Remote Sensing Symposium, Kuala Lumpur, Malaysia, 17-22 July 2022. Piscataway, NJ, United States: Institute of Electrical and Electronics Engineers. doi: 10.1109/IGARSS46834.2022.9883737
van der Heide, Chris, Hodgkinson, Liam, Roosta, Fred and Kroese, Dirk (2021). Shadow Manifold Hamiltonian Monte Carlo. International Conference on Artificial Intelligence and Statistics, Online, 27-30- July 2021. Tempe, AZ, United States: ML Research Press.
Tsuchida, Russell, Pearce, Tim, van der Heide, Chris, Roosta, Fred and Gallagher, Marcus (2021). Avoiding kernel fixed points: Computing with ELU and GELU infinite networks. 35th AAAI Conference on Artificial Intelligence, AAAI 2021, Online, 2 - 9 February 2021. Menlo Park, CA United States: Association for the Advancement of Artificial Intelligence.
Tsuchida, Russell, Pearce, Tim, van der Heide, Chris, Roosta, Fred and Gallagher, Marcus (2021). Avoiding kernel fixed points: computing with ELU and GELU infinite networks. 35th AAAI Conference on Artificial Intelligence / 33rd Conference on Innovative Applications of Artificial Intelligence / 11th Symposium on Educational Advances in Artificial Intelligence, Electr Network, 2-9 February 2021. Washington, DC, United States: Association for the Advancement of Artificial Intelligence.
Hodgkinson, Liam, van der Heide, Chris, Roosta, Fred and Mahoney, Michael W. (2021). Stochastic continuous normalizing flows: training SDEs as ODEs. Conference on Uncertainty in Artificial Intelligence, Online, 27-29 July 2021. San Diego, CA, United States: Association For Uncertainty in Artificial Intelligence (AUAI).
Feng, Zhili, Roosta, Fred and Woodruff, David P. (2021). Non-PSD matrix sketching with applications to regression and optimization. Conference on Uncertainty in Artificial Intelligence, Online, 27-29 July 2021. San Diego, CA, United States: Association For Uncertainty in Artificial Intelligence (AUAI).
Fang, Chih-Hao, Kylasa, Sudhir B., Roosta, Fred, Mahoney, Michael W. and Grama, Ananth (2020). Newton-admm: a distributed GPU-accelerated optimizer for multiclass classification problems. International Conference on High Performance Computing, Networking, Storage and Analysis (SC), Atlanta, GA, United States, 9-19 November 2020. Piscataway, NJ, United States: IEEE Computer Society. doi: 10.1109/SC41405.2020.00061
Crane, Rixon and Roosta, Fred (2020). DINO: Distributed Newton-type optimization method. International Conference on Machine Learning, Virtual, 12-18 July 2020. San Diego, CA, United States: International Conference on Machine Learning.
Xu, Peng, Roosta, Fred and Mahoney, Michael W. (2020). Second-order optimization for non-convex machine learning: an empirical study. SIAM International Conference on Data Mining, Cincinnati, OH, United States, 7-9 May 2020. Philadelphia, PA, United States: Society for Industrial and Applied Mathematics. doi: 10.1137/1.9781611976236.23
Kylasa, Sudhir, Roosta, Fred (Farbod), Mahoney, Michael W. and Grama, Ananth (2019). GPU accelerated sub-sampled Newton's method for convex classification problems. SIAM International Conference on Data Mining, Calgary, Canada, 2-4 May 2019. Philadelphia, PA, United States: Society for Industrial and Applied Mathematics. doi: 10.1137/1.9781611975673.79
Tsuchida, Russell, Roosta, Fred and Gallagher, Marcus (2019). Exchangeability and kernel invariance in trained MLPs. Twenty-Eighth International Joint Conference on Artificial Intelligence (IJCAI-19, Macao, China, 10-16 August 2019. Marina del Rey, CA USA: International Joint Conferences on Artificial Intelligence. doi: 10.24963/ijcai.2019/498
Crane, Rixon and Roosta, Fred (2019). DINGO: Distributed Newton-type method for gradient-norm optimization. Advances in Neural Information Processing Systems, Vancouver, BC, Canada, 8-14 December 2019. Maryland Heights, MO United States: Morgan Kaufmann Publishers.
Wang, Shusen, Roosta-Khorasani, Farbod, Xu, Peng and Mahoney, Michael W. (2018). GIANT: Globally improved approximate Newton method for distributed optimization. 32nd Conference on Neural Information Processing Systems, NeurIPS 2018, Montreal, QC, Canada, 2 - 8 December, 2018. Maryland Heights, MO, United States: Neural information processing systems foundation.
Cheng, Xiang, Roosta-Khorasani, Farbod, Palombo, Stefan, Bartlett, Peter L. and Mahoney, Michael W. (2018). FLAG n’ FLARE: fast linearly-coupled adaptive gradient methods. Twenty-First International Conference on Artificial Intelligence and Statistics, Lanzarote, Canary Islands, 9-11 April 2018. Cambridge, MA, United States: M I T Press.
Tsuchida, Russell, Roosta-Khorasani, Farbod and Gallagher, Marcus (2018). Invariance of weight distributions in rectified MLPs. 35th International Conference on Machine Learning, Stockholm, Sweden, 10-15 July 2018. Cambridge, MA, United States: M I T Press.
Levin, Keith, Roosta-Khorasani, Farbod, Mahoney, Michael W. and Priebe, Carey E. (2018). Out-of-sample extension of graph adjacency spectral embedding. 35th International Conference on Machine Learning, Stockholm, Sweden, 10-15 July 2018. Cambridge, MA, United States: M I T Press.
Bouchard, Kristofer E, Bujan, Alejandro F, Roosta-Khorasani, Farbod, Prabhat, Snijders, Jian-Hua Mao, Chang, Edward F, Mahoney, Michael W and Bhattacharyya, Sharmodeep (2017). The Union of Intersections (UoI) method for interpretable data driven discovery and prediction. 31st Annual Conference on Neural Information Processing Systems (NIPS), Long Beach, CA United States, 4-9 December 2017. Maryland Heights, MO, United States: Morgan Kaufmann Publishers.
Shun, Julian, Roosta-Khorasani, Farbod, Fountoulakis, Kimon and Mahoney, Michael W. (2016). Parallel local graph clustering. International Conferenceon Very Large Data Bases, New Delhi, India, 5-9 September 2016. New York, United States: Association for Computing Machinery. doi: 10.14778/2994509.2994522
Xu, Peng, Yang, Jiyan, Roosta-Khorasani, Farbod, Re, Christopher and Mahoney, Michael (2016). Sub-sampled Newton methods with non-uniform sampling. Neural Information Processing Systems 2016, Barcelona Spain, 5 - 10 December 2016 . La Jolla, CA United States: Neural Information Processing Systems Foundation.
Department Technical Reports
Xu, Peng , Roosta-Khorasani, Farbod and Mahoney, Michael W. (2017). Newton-type methods for non-convex optimization under inexact Hessian information. Cornell University Library, Cornell University.
Xu, Peng, Roosta-Khorasani, Farbod and Mahoney, Michael W. (2017). Second order optimization for non-convex machine learning: an empirical study. Cornell University Library, Cornell University.
Cheng, Xiang , Roosta-Khorasani, Farbod , Bartlett, Peter L. and Mahoney, Michael W. (2016). FLAG: Fast Linearly-Coupled Adaptive Gradient method. Cornell University Library, Cornell University.