Catalogue Search | MBRL
Search Results Heading
Explore the vast range of titles available.
MBRLSearchResults
-
DisciplineDiscipline
-
Is Peer ReviewedIs Peer Reviewed
-
Item TypeItem Type
-
SubjectSubject
-
YearFrom:-To:
-
More FiltersMore FiltersSourceLanguage
Done
Filters
Reset
6
result(s) for
"Roed, Marcel"
Sort by:
Real-time semantic segmentation on FPGAs for autonomous vehicles with hls4ml
by
Ghielmetti, Nicolò
,
Aarrestad, Thea
,
Summers, Sioni
in
Artificial neural networks
,
autonomous vehicles
,
Computer architecture
2022
In this paper, we investigate how field programmable gate arrays can serve as hardware accelerators for real-time semantic segmentation tasks relevant for autonomous driving. Considering compressed versions of the ENet convolutional neural network architecture, we demonstrate a fully-on-chip deployment with a latency of 4.9 ms per image, using less than 30% of the available resources on a Xilinx ZCU102 evaluation board. The latency is reduced to 3 ms per image when increasing the batch size to ten, corresponding to the use case where the autonomous vehicle receives inputs from multiple cameras simultaneously. We show, through aggressive filter reduction and heterogeneous quantization-aware training, and an optimized implementation of convolutional layers, that the power consumption and resource utilization can be significantly reduced while maintaining accuracy on the Cityscapes dataset.
Journal Article
Synthetic Data for any Differentiable Target
2026
What are the limits of controlling language models via synthetic training data? We develop a reinforcement learning (RL) primitive, the Dataset Policy Gradient (DPG), which can precisely optimize synthetic data generators to produce a dataset of targeted examples. When used for supervised fine-tuning (SFT) of a target model, these examples cause the target model to do well on a differentiable metric of our choice. Our approach achieves this by taking exact data attribution via higher-order gradients and using those scores as policy gradient rewards. We prove that this procedure closely approximates the true, intractable gradient for the synthetic data generator. To illustrate the potential of DPG, we show that, using only SFT on generated examples, we can cause the target model's LM head weights to (1) embed a QR code, (2) embed the pattern \\(67\\), and (3) have lower \\(^2\\) norm. We additionally show that we can cause the generator to (4) rephrase inputs in a new language and (5) produce a specific UUID, even though neither of these objectives is conveyed in the generator's input prompts. These findings suggest that DPG is a powerful and flexible technique for shaping model properties using only synthetic training examples.
How to Build the Virtual Cell with Artificial Intelligence: Priorities and Opportunities
2024
The cell is arguably the most fundamental unit of life and is central to understanding biology. Accurate modeling of cells is important for this understanding as well as for determining the root causes of disease. Recent advances in artificial intelligence (AI), combined with the ability to generate large-scale experimental data, present novel opportunities to model cells. Here we propose a vision of leveraging advances in AI to construct virtual cells, high-fidelity simulations of cells and cellular systems under different conditions that are directly learned from biological data across measurements and scales. We discuss desired capabilities of such AI Virtual Cells, including generating universal representations of biological entities across scales, and facilitating interpretable
experiments to predict and understand their behavior using Virtual Instruments. We further address the challenges, opportunities and requirements to realize this vision including data needs, evaluation strategies, and community standards and engagement to ensure biological accuracy and broad utility. We envision a future where AI Virtual Cells help identify new drug targets, predict cellular responses to perturbations, as well as scale hypothesis exploration. With open science collaborations across the biomedical ecosystem that includes academia, philanthropy, and the biopharma and AI industries, a comprehensive predictive understanding of cell mechanisms and interactions has come into reach.
Journal Article
Real-time semantic segmentation on FPGAs for autonomous vehicles with hls4ml
by
Ghielmetti, Nicolò
,
Aarrestad, Thea
,
Summers, Sioni
in
Artificial neural networks
,
Computer architecture
,
Field programmable gate arrays
2022
In this paper, we investigate how field programmable gate arrays can serve as hardware accelerators for real-time semantic segmentation tasks relevant for autonomous driving. Considering compressed versions of the ENet convolutional neural network architecture, we demonstrate a fully-on-chip deployment with a latency of 4.9 ms per image, using less than 30% of the available resources on a Xilinx ZCU102 evaluation board. The latency is reduced to 3 ms per image when increasing the batch size to ten, corresponding to the use case where the autonomous vehicle receives inputs from multiple cameras simultaneously. We show, through aggressive filter reduction and heterogeneous quantization-aware training, and an optimized implementation of convolutional layers, that the power consumption and resource utilization can be significantly reduced while maintaining accuracy on the Cityscapes dataset.
How to Build the Virtual Cell with Artificial Intelligence: Priorities and Opportunities
2024
The cell is arguably the most fundamental unit of life and is central to understanding biology. Accurate modeling of cells is important for this understanding as well as for determining the root causes of disease. Recent advances in artificial intelligence (AI), combined with the ability to generate large-scale experimental data, present novel opportunities to model cells. Here we propose a vision of leveraging advances in AI to construct virtual cells, high-fidelity simulations of cells and cellular systems under different conditions that are directly learned from biological data across measurements and scales. We discuss desired capabilities of such AI Virtual Cells, including generating universal representations of biological entities across scales, and facilitating interpretable in silico experiments to predict and understand their behavior using virtual instruments. We further address the challenges, opportunities and requirements to realize this vision including data needs, evaluation strategies, and community standards and engagement to ensure biological accuracy and broad utility. We envision a future where AI Virtual Cells help identify new drug targets, predict cellular responses to perturbations, as well as scale hypothesis exploration. With open science collaborations across the biomedical ecosystem that includes academia, philanthropy, and the biopharma and AI industries, a comprehensive predictive understanding of cell mechanisms and interactions has come into reach.
Red Deer Resequencing Reveals the Importance of Sex Chromosomes for Reconstructing Late Quaternary Events
by
del Pozo, Alberto Membrillo
,
Janke, Axel
,
Pfenninger, Markus
in
Analysis
,
Animals
,
Cervus elaphus
2025
Abstract
Sex chromosomes differ in their inheritance properties from autosomes and hence may encode complementary information about past demographic events. We compiled and analyzed a range-wide resequencing data set of the red deer (Cervus elaphus), one of the few Eurasian herbivores of the Late Pleistocene megafauna still found throughout much of its historic range. Our analyses of 144 whole genomes reveal striking discrepancies between the population clusters suggested by autosomal and X-chromosomal data. We postulate that the genetic legacy of Late Glacial population structure is better captured and preserved by the X chromosome than by autosomes, for two reasons. First, X chromosomes have a lower Ne and hence lose genetic variation faster during isolation in glacial refugia, causing increased population differentiation. Second, following postglacial recolonization and secondary contact, immigrant males pass on their X chromosomes to female offspring only, which effectively halves the migration rate when gene flow is male mediated. Our study illustrates how a comparison between autosomal and sex chromosomal phylogeographic signals unravels past demographic processes that otherwise would remain hidden.
Journal Article