InfoQ

Meta Details GEM Ads Model Using LLM-Scale Training, Hybrid Parallelism, and Knowledge Transfer

Meta released details about its Generative Ads Model (GEM), a foundation model designed to improve ads recommendation across ...
Microsoft

Towards Efficient Optimizer Design for LLM via Structured Fisher Approximation with a Low-Rank Extension

Designing efficient optimizers for large language models (LLMs) with low-memory requirements and fast convergence is an important and challenging problem. This paper makes a step towards the ...
Microsoft

Mechanism Design for LLM Fine-tuning with Multiple Reward Models

Recent research on fine-tuning large language models (LLMs) through the aggregation of multiple preferences has attracted considerable attention. However, the existing literature predominantly focuses ...
IEEE

From Causal Graphs to Problem Diagrams: Enhancing Safety Requirement Modeling with LLM

Abstract: Safety requirements play a crucial role in ensuring the reliability of Cyber-Physical Systems. Causal graphs provide structured support for the generation and validation of safety ...