About Me

Hello! I’m SHEN Jiyuan (沈纪元), a Data Scientist at SAP AI Lab. My work focuses on developing automated evaluation pipelines for model performance assessment and providing model and method discovery for performance optimization. Prior to joining SAP, I earned my Master of Engineering (M.Eng) degree at Nanyang Technological University with the SCRIPTS scholarship. I am fortunate to be supervised by Prof. LAM, Kwok Yan during my studies, where I primarily focused on privacy-preserving federated learning and data-efficient learning techniques. I obtained my B.Eng. degree with a major in Intelligent Science and Technology (Department of Computer Science and Engineering) from Shanghai University in 2022, under the supervison of Prof. Xing Wu. During my undergraduate studies, I had the opportunity to intern at Bosch Corporate Research, where I was mentored by Dr. Dong Chen and mainly conduct an individual research project on long-video action recognition.

My primary research interest lies in following directions:

  1. Agent Evaluation Service: Design, build and maintain an end-to-end agent evaluation platform—spanning synthetic data pipelines (in collaboration), static/dynamic user proxies, metric specification and validation, automated error handling, and stability/consistency analysis.
  2. LLM-Related Technique Benchmarking: Develop a holistic evaluation framework for large language models, encompassing multi-modal LLM assessment, application-level AI performance evaluation, prompt optimization algorithms, and safety and security evaluation.
  3. Dataset Compression: Data-efficient Learning, Dataset Distillation, One-shot FL
  4. Federated Learning: Secure Aggregation, Fast Recovery from Poison Attacks, Model Inversion Attacks
  5. Computer Vision: Object Detection, Semantic Segmentation, Data Generation, Portrait Beautification

Recent News