DOE Joint Genome Institute

  • COVID-19
  • About Us
  • Contact Us
  • Our Science
    • DOE Mission Areas
    • Science Programs
    • Science Highlights
    • Scientists
    A vertical tree stump outdoors with about a dozen shiitake mushrooms sprouting from its surface.
    Tracing the Evolution of Shiitake Mushrooms
    Understanding Lentinula genomes and their evolution could provide strategies for converting plant waste into sugars for biofuel production. Additionally, these fungi play a role in the global carbon cycle.

    More

    Soil Virus Offers Insight into Maintaining Microorganisms
    Through a collaborative effort, researchers have identified a protein in soil viruses that may promote soil health.

    More

    Data yielded from RIViT-seq increased the number of sigma factor-gene pairs confirmed in Streptomyces coelicolor from 209 to 399. Here, grey arrows denote previously known regulation and red arrows are regulation identified by RIViT-seq; orange nodes mark sigma factors while gray nodes mark other genes. (Otani, H., Mouncey, N.J. Nat Commun 13, 3502 (2022). https://doi.org/10.1038/s41467-022-31191-w)
    Streamlining Regulon Identification in Bacteria
    Regulons are a group of genes that can be turned on or off by the same regulatory protein. RIViT-seq technology could speed up associating transcription factors with their target genes.

    More

  • Our Projects
    • Search JGI Projects
    • DOE Metrics/Statistics
    • Approved User Proposals
    • Legacy Projects
    The switchgrass diversity panel growing at the Kellogg Biological Station in Michigan. (David Lowry)
    Mapping Switchgrass Traits with Common Gardens
    The combination of field data and genetic information has allowed researchers to associate climate adaptations with switchgrass biology.

    More

    Artist rendering of genome standards being applied to deciphering the extensive diversity of viruses. (Illustration by Leah Pantea)
    Expanding Metagenomics to Capture Viral Diversity
    Along with highlighting the viruses in a given sample, metagenomics shed light on another key aspect of viruses in the environment — their sheer genetic diversity.

    More

    Photograph of a stream of diatoms beneath Arctic sea ice.
    Polar Phytoplankton Need Zinc to Cope with the Cold
    As part of a long-term collaboration with the JGI Algal Program, researchers studying function and activity of phytoplankton genes in polar waters have found that these algae rely on dissolved zinc to photosynthesize.

    More

  • Data & Tools
    • IMG
    • Data Portal
    • MycoCosm
    • PhycoCosm
    • Phytozome
    • GOLD
    Abstract image of gold lights and squares against a black backdrop
    Silver Age of GOLD Introduces New Features
    The Genomes OnLine Database makes curated microbiome metadata that follows community standards freely available and enables large-scale comparative genomics analysis initiatives.

    More

    Graphical overview of the RNA Virus MetaTranscriptomes Project. (Courtesy of Simon Roux)
    A Better Way to Find RNA Virus Needles in the Proverbial Database Haystacks
    Researchers combed through more than 5,000 data sets of RNA sequences generated from diverse environmental samples around the world, resulting in a five-fold increase of RNA virus diversity.

    More

    HPCwire Editor's Choice Award (logo crop) for Best Use of HPC in the Life Sciences
    JGI Part of Berkeley Lab Team Awarded Best Use of HPC in Life Sciences
    The HPCwire Editors Choice Award for Best Use of HPC in Life Sciences went to the Berkeley Lab team comprised of JGI and ExaBiome Project team, supported by the DOE Exascale Computing Project for MetaHipMer, an end-to-end genome assembler that supports “an unprecedented assembly of environmental microbiomes.”

    More

  • User Programs
    • Calls for Proposals
    • Special Initiatives & Programs
    • Product Offerings
    • User Support
    • Policies
    • Submit a Proposal
    Digital ID card with six headshots reads: Congratulations to our 2022 Function Genomics recipients!
    Final Round of 2022 CSP Functional Genomics Awardees
    Meet the final six researchers whose proposals were selected for the 2022 Community Science Program Functional Genomics call.

    More

    CSP New Investigators FY23 R1
    JGI Announces First Round of 2023 New Investigator Awardees
    Twice each year we look for novel research projects aligned with DOE missions and from PIs who have not led any previously-accepted proposals through the CSP New Investigator call.

    More

    screencap from Amundson and Wilkins subsurface microbiome video
    Digging into Microbial Ecosystems Deep Underground
    JGI users and microbiome researchers at Colorado State University have many questions about the microbial communities deep underground, including the role viral infection may play in other natural ecosystems.

    Read more

  • News & Publications
    • News
    • Blog
    • Podcasts
    • Webinars
    • Publications
    • Newsletter
    • Logos and Templates
    • Photos
    2022 JGI-UC Merced interns (Thor Swift/Berkeley Lab)
    Exploring Possibilities: 2022 JGI-UC Merced Interns
    The 2022 UC Merced intern cohort share how their summer internship experiences have influenced their careers in science.

    More

    Using Team Science to Build Communities Around Data
    As the data portals grow and evolve, the research communities further expand around them. But with two projects, communities are forming to generate high quality genomes to benefit researchers.

    More

    Cow Rumen and the Early Days of Metagenomics
    Tracing a cow rumen dataset from the lab to material for a hands-on undergraduate research course at CSU-San Marcos that has since expanded into three other universities.

    More

Past Events
Home › Past Events › Application of High Performance Computing to the DOE Joint Genomic Institute’s Data Challenges

Application of High Performance Computing to the DOE Joint Genomic Institute’s Data Challenges

January 25-26, 2010
DOE Joint Genome Institute, Walnut Creek, CA USA
—by invitation only—

Download the Meeting Schedule

Meeting Motivation

The generation of sequence is no longer the bottleneck in the widespread application of genomic science to the understanding of fundamental biological processes. However, as running time and cost cease to be the limiting factors in sequence generation, the volume of sequence data that can be routinely generated raises a plethora of analysis and data management challenges.

The Department of Energy’s National Laboratories are at the cutting edge of high-performance scientific computing, with computational platforms, network infrastructure and personnel focused on enabling computationally intensive projects in DOE-relevant science. To date this capability has been predominately directed towards modeling and simulation in the physical and engineering sciences including such complex problems as climate modeling. However, biological systems research in general, and sequence-enabled research at the JGI in particular, have reached a scale and computational complexity that requires support from the largest available computational facilities if computational analysis and data management are not to become the new bottlenecks in the translation of sequence data to biological information.

This workshop will bring together producers, managers, and users of next generation sequencing data from the Joint Genome Institute with computational scientists from the National Labs, providing a venue for the discussion of significant computational challenges. These will include analysis, data integration and management challenges faced by the JGI, and the identification of appropriate infrastructure and methodologies for addressing these challenges in partnership with the National Labs HPC resources.

Recognizing that in the present age of “commodity supercomputing” there is significant expertise and experience with large-scale computation on massive datasets outside the National Labs, and that other genome sequencing centers are gearing up to face similar challenges (Broad, Sanger, Wash U) the workshop will also provide a venue to hear about best practices and novel algorithms being developed and deployed outside DOE facilities.

Workshop Goals

The essential goals of this meeting are to accelerate the translation of sequence data to biological information. Towards this end, the workshop will:

Identify and define challenges faced by the JGI and the genomic science community related to next-gen-sequencing driven exponential data growth coupled with the identification of potential computational solutions to these challenges.

Educate members of the HPC community on the types of algorithmic, scaling, performance and data management and analysis problems encountered in the genomic domain, empowering them to map frameworks and solutions from the HPC domain to the genomic domain

Lay the groundwork for establishing collaborations focused on 4 to 6 central problems that individuals or institutions might be able to help the JGI in solving.

Intended Participants (by invitation only)

  • Computational researchers and managers from DOE high performance computing organizations at the national laboratories
  • Computational researchers from outside the DOE system who bring relevant experiences and expertise
  • Researchers, biologists and informatics management from the Joint Genome Institute involved in the production, management and analysis of next-generation sequencing data.
  • Researchers who may have developed computational solutions to the issues outlined below

Introductory Presentations

Eddy Rubin: Overview of the DOE JGI and Genomics now and in the next decade

Rick Stevens: Overview of the path for DOE HPC to intersect with genomics

Presentations followed by Discussion groups:

The goal of the presentations will be for individuals close to the data and associated science to educate the HPC community in the computational challenges faced. The discussion groups will be lead by the HPC participants in deciphering the issues and possible approaches to solutions

Topics Include

I.   Short Read Sequence Assembly and Integration of Reads from Multiple Sequencing Platforms
II.  Development of Information from the Data: Annotation and Large-Scale Data Integration
III  Evolutionary Analysis and Genome Feature Detection
VI.  Data Handling and Computational Infrastructure

Output

The output of the workshop will be a short document that articulates the key computational challenges faced by the JGI in the next 5 years and a discussion of the possible HPC solutions to these challenges (that are offered by DOE National Laboratory computational facilities?).

  • 2017 Microbial and Plant Systems Modulated by Secondary Metabolites Meeting
  • 2016 Microbial and Plant Systems Modulated by Secondary Metabolites Meeting
  • NeLLi 2017: From New Lineages of Life To New Functions
  • Program Meetings and Workshops
  • CSP 2012 PI Workshop
  • Bay Area Plant Microbe Interaction Symposium II
  • Microbial Genome Reannotation Workshop
  • Application of High Performance Computing to the DOE Joint Genomic Institute’s Data Challenges

More topics:

  • COVID-19 Status
  • News
  • Science Highlights
  • Blog
  • Webinars
  • CSP Plans
  • Featured Profiles
  • Careers
  • Contact Us
  • Events
  • User Meeting
  • MGM Workshops
  • Internal
  • Disclaimer
  • Credits
  • Policies
  • Emergency Info
  • Accessibility / Section 508 Statement
  • Flickr
  • LinkedIn
  • RSS
  • Twitter
  • YouTube
Lawrence Berkeley National Lab Biosciences Area
A project of the US Department of Energy, Office of Science

JGI is a DOE Office of Science User Facility managed by Lawrence Berkeley National Laboratory

© 1997-2023 The Regents of the University of California