To make optimization more efficient and effective!
OptEx: Expediting First-Order Optimization with Approximately Parallelized Iterations. Yao Shu, Jiongfeng Fang, Ying Tiffany He, Fei Richard Yu Key Words: First-Order Optimization, Parallelization In The 38th Conference on Neural Information Processing Systems (NeurIPS), 2024 [arXiv, pdf]
Heterogeneous Federated Zeroth-Order Optimization using Gradient Surrogates. Yao Shu, Xiaoqiang Lin, Zhongxiang Dai, Bryan Kian Hsiang Low Key Words: Zeroth-Order Optimization, Federated Optimization, Heterogeneity In Differentiable Almost Everything Workshop @ ICML, 2024 [arXiv, pdf, code]
Zeroth-Order Optimization with Trajectory-Informed Derivative Estimation. Yao Shu*, Zhongxiang Dai*, Weicong Sng, Arun Verma, Patrick Jaillet and Bryan Kian Hsiang Low Key Words: Zeroth-Order Optimization, Derived Gaussian Process In The 11th International Conference on Learning Representations (ICLR), 2023 [pdf, code]
Federated Neural Bandit. Zhongxiang Dai, Yao Shu#, Arun Verma, Flint Xiaofeng Fan, Bryan Kian Hsiang Low and Patrick Jaillet Key Words: Neural Bandit, Neural Tangent Kernel In The 11th International Conference on Learning Representations (ICLR), 2023 [arXiv, pdf, code]
Sample-Then-Optimize Batch Neural Thompson Sampling. Zhongxiang Dai, Yao Shu#, Bryan Kian Hsiang Low, Patrick Jaillet Key Words: Bayesian Optimization, Neural Tangent Kernel In The 36th Conference on Neural Information Processing Systems (NeurIPS), 2022 [arXiv, pdf, code]
Quantum Bayesian Optimization. Zhongxiang Dai*, Gregory Kang Ruey Lau*, Arun Verma, Yao Shu, Kian Hsiang Low, Patrick Jaillet Key Words: Bayesian Optimization In The 37th Conference on Neural Information Processing Systems (NeurIPS), 2023 [arXiv, pdf, code]
Exploiting Correlated Auxiliary Feedback in Parameterized Bandits. Arun Verma, Zhongxiang Dai, Yao Shu, ****Kian Hsiang Low Key Words: Parameterized Bandit In The 37th Conference on Neural Information Processing Systems (NeurIPS), 2023 [arXiv, pdf]
To make learning more efficient, effective and easier to deploy!
Localized Zeroth-Order Prompt Optimization. Wenyang Hu*, Yao Shu*, Zongmin Yu, Zhaoxuan Wu, Xiangqiang Lin, Zhongxiang Dai, See-Kiong Ng, Bryan Kian Hsiang Low Key Words: Prompt Optimization, Zeroth-Order Optimization, Neural Tangent Kernel, Large Language Models In In-Context Learning Workshop @ ICML, 2024 In The 38th Conference on Neural Information Processing Systems (NeurIPS Spotlight), 2024 [arXiv, pdf]
Prompt Optimization with EASE? Efficient Ordering-aware Automated Selection of Exemplars. Zhaoxuan Wu, Xiaoqiang Lin, Zhongxiang Dai, Wenyang Hu, Yao Shu, See-Kiong Ng, Patrick Jaillet, Bryan Kian Hsiang Low Key Words: Prompt Optimization, Neural Bandit, Large Language Models In In-Context Learning Workshop @ ICML, 2024 In The 38th Conference on Neural Information Processing Systems (NeurIPS), 2024 [arXiv, pdf, code]
Data-Centric AI in the Age of Large Language Models. Xinyi Xu, Zhaoxuan Wu, Rui Qiao, Arun Verma, Yao Shu, Jingtan Wang, Xinyuan Niu, Zhenfeng He, Jiangwei Chen, Zijian Zhou, Gregory Kang Ruey Lau, Hieu Dao, Lucas Agussurja, Rachael Hwee Ling Sim, Xiaoqiang Lin, Wenyang Hu, Zhongxiang Dai, Pang Wei Koh, Bryan Kian Hsiang Low Key Words: Data-Centric AI, Large Language Models In The 2024 Conference on Empirical Methods in Natural Language Processing (EMNLP Findings), 2024 [arXiv]
Use Your INSTINCT: INSTruction optimization usIng Neural bandits Coupled with Transformers. Xiaoqiang Lin*, Zhaoxuan Wu*, Zhongxiang Dai, Wenyang Hu, Yao Shu, See-Kiong Ng, Patrick Jaillet, Kian Hsiang Low Key Words: Prompt Optimization, Neural Bandit, Large Language Models In Instruction Workshop @ NeurIPS, 2023 In The 41st International Conference on Machine Learning (ICML), 2024 [arXiv, pdf, code]