DOE Joint Genome Institute

  • COVID-19
  • About Us
  • Contact Us
  • Our Science
    • DOE Mission Areas
    • Science Programs
    • Science Highlights
    • Scientists
    A vertical tree stump outdoors with about a dozen shiitake mushrooms sprouting from its surface.
    Tracing the Evolution of Shiitake Mushrooms
    Understanding Lentinula genomes and their evolution could provide strategies for converting plant waste into sugars for biofuel production. Additionally, these fungi play a role in the global carbon cycle.

    More

    Soil Virus Offers Insight into Maintaining Microorganisms
    Through a collaborative effort, researchers have identified a protein in soil viruses that may promote soil health.

    More

    Data yielded from RIViT-seq increased the number of sigma factor-gene pairs confirmed in Streptomyces coelicolor from 209 to 399. Here, grey arrows denote previously known regulation and red arrows are regulation identified by RIViT-seq; orange nodes mark sigma factors while gray nodes mark other genes. (Otani, H., Mouncey, N.J. Nat Commun 13, 3502 (2022). https://doi.org/10.1038/s41467-022-31191-w)
    Streamlining Regulon Identification in Bacteria
    Regulons are a group of genes that can be turned on or off by the same regulatory protein. RIViT-seq technology could speed up associating transcription factors with their target genes.

    More

  • Our Projects
    • Search JGI Projects
    • DOE Metrics/Statistics
    • Approved User Proposals
    • Legacy Projects
    A panoramic view of a lake reflecting a granite mountain.
    Genome Insider: Methane Makers in Yosemite’s Lakes
    Meet researchers who sampled the microbial communities living in the mountaintop lakes of the Sierra Nevada mountains to see how climate change affects freshwater ecosystems, and how those ecosystems work.

    Listen

    A light green shrub with spiny leaves, up close.
    Genome Insider: A Shrubbier Version of Rubber
    Hear from the consortium working on understanding the guayule plant's genome, which could lead to an improved natural rubber plant.

    Listen

    The switchgrass diversity panel growing at the Kellogg Biological Station in Michigan. (David Lowry)
    Mapping Switchgrass Traits with Common Gardens
    The combination of field data and genetic information has allowed researchers to associate climate adaptations with switchgrass biology.

    More

  • Data & Tools
    • IMG
    • Data Portal
    • MycoCosm
    • PhycoCosm
    • Phytozome
    • GOLD
    iPHoP image (Simon Roux)
    iPHoP: A Matchmaker for Phages and their Hosts
    Building on existing virus-host prediction approaches, a new tool combines and evaluates multiple predictions to reliably match viruses with their archaea and bacteria hosts.

    More

    Abstract image of gold lights and squares against a black backdrop
    Silver Age of GOLD Introduces New Features
    The Genomes OnLine Database makes curated microbiome metadata that follows community standards freely available and enables large-scale comparative genomics analysis initiatives.

    More

    Graphical overview of the RNA Virus MetaTranscriptomes Project. (Courtesy of Simon Roux)
    A Better Way to Find RNA Virus Needles in the Proverbial Database Haystacks
    Researchers combed through more than 5,000 data sets of RNA sequences generated from diverse environmental samples around the world, resulting in a five-fold increase of RNA virus diversity.

    More

  • User Programs
    • Calls for Proposals
    • Special Initiatives & Programs
    • Product Offerings
    • User Support
    • Policies
    • Submit a Proposal
    Green plant matter grows from the top, with the area just beneath the surface also visible as soil, root systems and a fuzzy white substance surrounding them.
    Supercharging SIP in the Fungal Hyphosphere
    Applying high-throughput stable isotope probing to the study of a particular fungi, researchers identified novel interactions between bacteria and the fungi.

    More

    Digital ID card with six headshots reads: Congratulations to our 2022 Function Genomics recipients!
    Final Round of 2022 CSP Functional Genomics Awardees
    Meet the final six researchers whose proposals were selected for the 2022 Community Science Program Functional Genomics call.

    More

    croppe image of the JGI helix sculpture
    Tips for a Winning Community Science Program Proposal
    In the Genome Insider podcast, tips to successfully avail of the JGI's proposal calls, many through the Community Science Program.

    Listen

  • News & Publications
    • News
    • Blog
    • Podcasts
    • Webinars
    • Publications
    • Newsletter
    • Logos and Templates
    • Photos
    2022 JGI-UC Merced interns (Thor Swift/Berkeley Lab)
    Exploring Possibilities: 2022 JGI-UC Merced Interns
    The 2022 UC Merced intern cohort share how their summer internship experiences have influenced their careers in science.

    More

    image from gif that shows where in the globe JGI fungal collaborators are located.
    Using Team Science to Build Communities Around Data
    As the data portals grow and evolve, the research communities further expand around them. But with two projects, communities are forming to generate high quality genomes to benefit researchers.

    More

    Cow Rumen and the Early Days of Metagenomics
    Tracing a cow rumen dataset from the lab to material for a hands-on undergraduate research course at CSU-San Marcos that has since expanded into three other universities.

    More

News & Publications
Home › News Releases › DOE JGI Sets ‘Gold Standard’ for Metagenomic Data Analysis

May 14, 2007

DOE JGI Sets ‘Gold Standard’ for Metagenomic Data Analysis

WALNUT CREEK, CA–With the advent of more powerful and economical DNA sequencing technologies, gene discovery and characterization is transitioning from single-organism studies to revealing the potential biotechnology applications embedded in communities of microbial genomes, or metagenomes. The field of metagenomics is still in its infancy–the equivalent of the early days of the California Gold Rush, with labs vying to stake their claim.

Amidst the prospecting, the call has been issued for methods to separate fool’s gold from the real nuggets. Such a gold standard has now been provided through work led by the U.S. Department of Energy Joint Genome Institute (DOE JGI) with colleagues from Oak Ridge National Laboratory and IBM’s T.J. Watson Research Center. Their results are published in the May edition of Nature Methods.

“DOE JGI and our collaborators have pioneered the use of DNA sequencing-based technologies to understand microbial communities through a combination of computational and experimental methods,” said Konstantinos Mavrommatis, lead author of the paper and a post-doctoral fellow in DOE JGI’s Genome Biology Program. “We are now exploring ways to analyze metagenomic data to enable accurate classification of sequence fragments into their corresponding species populations. The goal is to reconstruct metabolic pathways by comparing with reference isolate genomes, so that we can model ecosystem dynamics using metabolic reconstructions of metagenomic data. “However, so far all the methods that have been developed were aimed toward analyzing data coming from single, isolate genomes. In this instance, the situation is simple; we know what gene belongs to which organism. In metagenomes, it’s much more challenging, because you have sequences from many different organisms all mixed up, and moreover, you don’t have enough sequence from each to capture an accurate picture of the entire community, so you only get a glimpse of the identities of multiple genomes. All the publications to date have made the assumption that these tools will work as efficiently for metagenomes–but we really didn’t know.”

Nikos Kyrpides, DOE JGI Genome Biology Program Head, said that, to evaluate the magnitude of this problem and identify the inherent pitfalls, “we have constructed three simulated metagenomic datasets of varying complexity by mixing pieces of over one hundred already sequenced isolate organisms. This approach allowed us to quantify the fidelity of several data processing methods, since we could identify the correct answer by comparing the synthetic datasets to the corresponding isolate genomes.”

“This paper provides an extremely useful survey of tools and existing approaches for metagenome analysis and points out their weaknesses,” said Natalia Maltsev, of the Bioinformatics Group, Mathematics and Computer Science Division at Argonne National Laboratory. “The simulated datasets constructed by the authors provide a much-needed test bed for evaluation and comparisons of these tools. Their findings will no doubt have a very significant impact on the field of metagenomics in general. It will help groups like mine to choose efficient strategies for the development of automated methods for high-throughput metagenome analysis. And last, but not least, it will stimulate the development of new computational tools and approaches for studies of microbial communities.”

In a shotgun sequencing process, the DNA from the microbial genomes is first sheared into millions of small fragments to enable the amplification, labeling, and ultimately sequencing. Genome assembly is the process of putting the sequenced fragments back in order, in effect, putting Humpty Dumpty back together again–to recreate the identity of an organism from the scattered puzzle pieces of DNA.

“One of the problems in assembling metagenomes,” said Mavrommatis, “is that you end up with large fragments of unknown accuracy and a substantial number of sequences that fail to fit onto those larger fragments. On many occasions, this information is not taken into account–depriving the analysis of valuable information embedded in that sequence.

The solution proposed by Mavrommatis and his colleagues was to evaluate and compare the existing methods to see which performs best for the particular environmental samples being analyzed. “What we did was to take known sample genomes, shuffle them, create simulated metagenomes, and use those tools on them, and then we went back and compared the results to the isolate genomes. Essentially, we applied the gold standard–the truth–and found there were tools that shouldn’t have been used because their predictive accuracy was very low. But it also validated some of our assumptions.”

Mavrommatis said that, for example, when using the widely used sequence assembly tool Phrap, they actually saw artifacts created by the program caused by mixing sequences that should not have been mixed.

“It’s like when you’re in the market for a digital camera, you can go to web sites like CNET to see the reviews, make the comparisons, and get some guidance for choosing the right product for your particular needs.”

Another major problem with metagenomes is binning. Binning is the process of identifying from what organism a particular sequence has originated. There are several methods employed to bin sequences. BLAST (Basic Local Alignment Search Tool) is a method used to rapidly search for similar sequences in existing public databases.

Mavrommatis said that a popular approach is to take the sequence, BLAST it against the database, and find the best hit and assume that the sequence queried belongs to the same group of organisms. Other methods use intrinsic features of the sequence, such as oligonucleotide frequencies. Patterns of these features help to discriminate between the possible groups of organisms that contributed the sequence.

Several more methods have been proposed for binning, but none of these on their own have proven satisfactory, Mavrommatis said. “What we propose in the paper is a way to evaluate the appropriateness and accuracy of the binning methods using the same datasets in order to set a gold standard–we have designed the reference-simulated metagenome.”

Through the Nature Methods publication, Mavrommatis has invited others to contribute new methods as they arise to continue to update the server and sustain the value of the system. This is also facilitated through a server called “Fames” available at the DOE JGI (http://fames.jgi-psf.org/) where the community of researchers can check the most recent results, compare their dataset from their metagenome of interest against the simulated metagenome, and receive guidance as to which are the optimal tools for analysis.

“Having such a tool at hand for the first time now, the community can not only compare the methods, but can also ask the question, why is this method better, or why does this one fail? Over all, we hope that it will help to improve the process and lead to further development of new methods for evaluating metagenomes, particularly since this gold rush is not going away any time soon.”

The other DOE JGI authors on the study are Natalia Ivanova, Kerrie Barry, Harris Shapiro, Eugene Goltsman, Asaf Salamov, Frank Korzeniewski, Miriam Land, Alla Lapidus, Igor Grigoriev, Paul Richardson, Philip Hugenholtz and Nikos Kyrpides.

The DOE Joint Genome Institute, supported by the DOE Office of Science, unites the expertise of five national laboratories, Lawrence Berkeley, Lawrence Livermore, Los Alamos, Oak Ridge, and Pacific Northwest, along with the Stanford Human Genome Center to advance genomics in support of the DOE mission related to clean energy generation and environmental characterization and clean-up. DOE JGI’s Walnut Creek, Calif. Production Genomics Facility provides integrated high-throughput sequencing and computational analysis that enable systems-based scientific approaches to these challenges.

Share this:

  • Click to share on Facebook (Opens in new window)
  • Click to share on LinkedIn (Opens in new window)
  • Click to share on Pinterest (Opens in new window)
  • Click to share on Twitter (Opens in new window)
  • Click to print (Opens in new window)

The U.S. Department of Energy Joint Genome Institute, a DOE Office of Science User Facility at Lawrence Berkeley National Laboratory, is committed to advancing genomics in support of DOE missions related to clean energy generation and environmental characterization and cleanup. JGI provides integrated high-throughput sequencing and computational analysis that enable systems-based scientific approaches to these challenges. Follow @jgi on Twitter.

DOE’s Office of Science is the largest supporter of basic research in the physical sciences in the United States, and is working to address some of the most pressing challenges of our time. For more information, please visit science.energy.gov.

Filed Under: News Releases

More topics:

  • COVID-19 Status
  • News
  • Science Highlights
  • Blog
  • Webinars
  • CSP Plans
  • Featured Profiles

Related Content:

You can move, but you can’t hide

Illustration of a magnifying glass identifying viruses and plasmids.

JGI announces second round of 2023 New Investigator awardees

From left to right: [above] Emma Bell, Mallory Choudoir, Sneha Couvillion, Tobin Hammer, Christina Hazard, Rachel Mackelprang, Brook Moyers, Mei, Ran,; [below] Benjamin Peterson, Dacheng Ren, Allison Rober, Neal Scott, Chikae Tatsumi, Vojtech Tlaskal, Fernando Torralbo, Luis Felipe Valdez-Nuñez

A Collaboration to Improve Plant Genome Annotations Across Species

A tiled collage of square photos of different plants - soybeans, and sorghum, for example.

From Berkeley to Binghamton: Tracking Strawberry Evolution

iPHoP: A Matchmaker for Phages and their Hosts

iPHoP image (Simon Roux)

Supercharging SIP in the Fungal Hyphosphere

Green plant matter grows from the top, with the area just beneath the surface also visible as soil, root systems and a fuzzy white substance surrounding them.
  • Careers
  • Contact Us
  • Events
  • User Meeting
  • MGM Workshops
  • Internal
  • Disclaimer
  • Credits
  • Policies
  • Emergency Info
  • Accessibility / Section 508 Statement
  • Flickr
  • LinkedIn
  • RSS
  • Twitter
  • YouTube
Lawrence Berkeley National Lab Biosciences Area
A project of the US Department of Energy, Office of Science

JGI is a DOE Office of Science User Facility managed by Lawrence Berkeley National Laboratory

© 1997-2023 The Regents of the University of California