RESEARCH & PUBLICATIONS
Advancing the State of the Art in AI
Shaping the future with publications in the world’s leading machine learning journals and conferences.
2025
Simultaneous Fine-Tuning and Pruning of LLMs
F Reinicke, J Franke, F Hutter, M Hefenbrock - OPT2025 Annual Workshop on Optimization of Machine Learning, 2025
Learning in Compact Spaces with Approximately Normalized Transformers (preprint)
J Franke, U Spiegelhalter, M Nezhurina, J Jitsev, F Hutter, M Hefenbrock - Advances in Neural Information Processing Systems, 2025
2024
Improving deep learning optimization through constrained parameter regularization
J Franke, M Hefenbrock, G Koehler, F Hutter - Advances in Neural Information Processing Systems, 2024
Preserving principal subspaces to reduce catastrophic forgetting in fine-tuning
J Franke, M Hefenbrock, F Hutter - ICLR 2024 Workshop on Mathematical and Empirical Understanding of Foundation Models, 2024