DOE Joint Genome Institute

  • COVID-19
  • About Us
  • Contact Us
  • Our Science
    • DOE Mission Areas
    • Science Programs
    • Science Highlights
    • Scientists
    A vertical tree stump outdoors with about a dozen shiitake mushrooms sprouting from its surface.
    Tracing the Evolution of Shiitake Mushrooms
    Understanding Lentinula genomes and their evolution could provide strategies for converting plant waste into sugars for biofuel production. Additionally, these fungi play a role in the global carbon cycle.

    More

    Soil Virus Offers Insight into Maintaining Microorganisms
    Through a collaborative effort, researchers have identified a protein in soil viruses that may promote soil health.

    More

    Data yielded from RIViT-seq increased the number of sigma factor-gene pairs confirmed in Streptomyces coelicolor from 209 to 399. Here, grey arrows denote previously known regulation and red arrows are regulation identified by RIViT-seq; orange nodes mark sigma factors while gray nodes mark other genes. (Otani, H., Mouncey, N.J. Nat Commun 13, 3502 (2022). https://doi.org/10.1038/s41467-022-31191-w)
    Streamlining Regulon Identification in Bacteria
    Regulons are a group of genes that can be turned on or off by the same regulatory protein. RIViT-seq technology could speed up associating transcription factors with their target genes.

    More

  • Our Projects
    • Search JGI Projects
    • DOE Metrics/Statistics
    • Approved User Proposals
    • Legacy Projects
    The switchgrass diversity panel growing at the Kellogg Biological Station in Michigan. (David Lowry)
    Mapping Switchgrass Traits with Common Gardens
    The combination of field data and genetic information has allowed researchers to associate climate adaptations with switchgrass biology.

    More

    Artist rendering of genome standards being applied to deciphering the extensive diversity of viruses. (Illustration by Leah Pantea)
    Expanding Metagenomics to Capture Viral Diversity
    Along with highlighting the viruses in a given sample, metagenomics shed light on another key aspect of viruses in the environment — their sheer genetic diversity.

    More

    Photograph of a stream of diatoms beneath Arctic sea ice.
    Polar Phytoplankton Need Zinc to Cope with the Cold
    As part of a long-term collaboration with the JGI Algal Program, researchers studying function and activity of phytoplankton genes in polar waters have found that these algae rely on dissolved zinc to photosynthesize.

    More

  • Data & Tools
    • IMG
    • Data Portal
    • MycoCosm
    • PhycoCosm
    • Phytozome
    • GOLD
    Abstract image of gold lights and squares against a black backdrop
    Silver Age of GOLD Introduces New Features
    The Genomes OnLine Database makes curated microbiome metadata that follows community standards freely available and enables large-scale comparative genomics analysis initiatives.

    More

    Graphical overview of the RNA Virus MetaTranscriptomes Project. (Courtesy of Simon Roux)
    A Better Way to Find RNA Virus Needles in the Proverbial Database Haystacks
    Researchers combed through more than 5,000 data sets of RNA sequences generated from diverse environmental samples around the world, resulting in a five-fold increase of RNA virus diversity.

    More

    HPCwire Editor's Choice Award (logo crop) for Best Use of HPC in the Life Sciences
    JGI Part of Berkeley Lab Team Awarded Best Use of HPC in Life Sciences
    The HPCwire Editors Choice Award for Best Use of HPC in Life Sciences went to the Berkeley Lab team comprised of JGI and ExaBiome Project team, supported by the DOE Exascale Computing Project for MetaHipMer, an end-to-end genome assembler that supports “an unprecedented assembly of environmental microbiomes.”

    More

  • User Programs
    • Calls for Proposals
    • Special Initiatives & Programs
    • Product Offerings
    • User Support
    • Policies
    • Submit a Proposal
    Digital ID card with six headshots reads: Congratulations to our 2022 Function Genomics recipients!
    Final Round of 2022 CSP Functional Genomics Awardees
    Meet the final six researchers whose proposals were selected for the 2022 Community Science Program Functional Genomics call.

    More

    CSP New Investigators FY23 R1
    JGI Announces First Round of 2023 New Investigator Awardees
    Twice each year we look for novel research projects aligned with DOE missions and from PIs who have not led any previously-accepted proposals through the CSP New Investigator call.

    More

    screencap from Amundson and Wilkins subsurface microbiome video
    Digging into Microbial Ecosystems Deep Underground
    JGI users and microbiome researchers at Colorado State University have many questions about the microbial communities deep underground, including the role viral infection may play in other natural ecosystems.

    Read more

  • News & Publications
    • News
    • Blog
    • Podcasts
    • Webinars
    • Publications
    • Newsletter
    • Logos and Templates
    • Photos
    2022 JGI-UC Merced interns (Thor Swift/Berkeley Lab)
    Exploring Possibilities: 2022 JGI-UC Merced Interns
    The 2022 UC Merced intern cohort share how their summer internship experiences have influenced their careers in science.

    More

    Using Team Science to Build Communities Around Data
    As the data portals grow and evolve, the research communities further expand around them. But with two projects, communities are forming to generate high quality genomes to benefit researchers.

    More

    Cow Rumen and the Early Days of Metagenomics
    Tracing a cow rumen dataset from the lab to material for a hands-on undergraduate research course at CSU-San Marcos that has since expanded into three other universities.

    More

News & Publications
Home › Blog › A User-Centered Approach to Accessing JGI Data

August 9, 2021

A User-Centered Approach to Accessing JGI Data

With a common set of "baseline metadata," JGI users can more easily access public data sets. (Steve Wilson)

With a common set of “baseline metadata,” JGI users can more easily access public data sets. (Steve Wilson)

When the JGI Data Portal (https://data.jgi.doe.gov/) launched last year, it was only accessible through the plant portal Phytozome. Now the portal offers a way for users to more easily access public data sets through a common set of metadata.

For Steve Wilson, JGI’s Systems Engineering group lead, the Data Portal reflects a structural shift in data access. Users were previously limited to accessing data sets within groups, such as plants (via Phytozome) or fungi (MycoCosm). “We have made a concerted effort to create a common set of ‘baseline metadata’ across the files that are submitted by each scientific program,” he said. “If each kingdom submits the same category of data (key) for their files as a baseline, we can allow a user to collect all of the ‘protein FASTA files’ more easily.” He also elaborated on the following topics.

Q(uestion): What is the Data Portal’s scope?
A(nswer): The JGI Data Portal currently allows users to find files by searching file metadata (info describing the files)

We are currently limited to:

    • Public data: datasets associated with completed projects that are eligible for public release, have completed their embargos, and numerous other requirements.
    • Data that passes through a kingdom portal (assemblies + annotations)
    • For IMG & Mycocosm: Data that is associated with an ITS project ID (AP or SP)

Q: What JGI Data Policy considerations do users accessing need to be mindful of?
A: The JGI Data Portal currently only presents public data (both restricted and unrestricted).

The Data Portal presents the users with the standard JGI Data Release Policy information when they request a download.  When we have a calculation for automatically determining which datasets are unrestricted and which are not, we will be able to display that on JDP and allow users to filter on that parameter.

The current Data Restriction Policy requires that users know about the FY Funding Year, and the publication status in addition to the public/private status.

Q: Does Data Portal work well with KBase and NMDC?
A: We have reached out to KBase regarding use of our search API. They have expressed an interest in using this to find files based on file metadata criteria.

Wilson said that the Data Portal and Genome Portal will continue to run in parallel for now. Eventually, he added, the Genome Portal will be retired once the same features are available on Data Portal.

Share this:

  • Click to share on Facebook (Opens in new window)
  • Click to share on LinkedIn (Opens in new window)
  • Click to share on Pinterest (Opens in new window)
  • Click to share on Twitter (Opens in new window)
  • Click to print (Opens in new window)

Filed Under: Blog

More topics:

  • COVID-19 Status
  • News
  • Science Highlights
  • Blog
  • Webinars
  • CSP Plans
  • Featured Profiles

Related Content:

Request for Information: BERAC Unified Data Framework

Image of network data cables courtesy of Berkeley Lab

New Research Sheds Light on Diversity in the Deep Sea

A photo taken in the deep sea. Black clouds billow out of hydrothermal vents.

An Earth Month Look at Sustainability Efforts at the JGI

Three people standing outside, holding garden pots where succulents are growing.

JGIota: A biofuel breakthrough in anaerobic fungi with Michelle O’Malley and Tom Lankiewicz

A Genome Insider Logo Image

JGIota: Sequencing Shiitakes with David Hibbett

A Genome Insider Logo Image

JGI at 25: Mapping Switchgrass Traits with Common Gardens

Aerial photo of the switchgrass diversity panel late in the 2020 season at the Kellogg Biological Station in Michigan. (Robert Goodwin)
  • Careers
  • Contact Us
  • Events
  • User Meeting
  • MGM Workshops
  • Internal
  • Disclaimer
  • Credits
  • Policies
  • Emergency Info
  • Accessibility / Section 508 Statement
  • Flickr
  • LinkedIn
  • RSS
  • Twitter
  • YouTube
Lawrence Berkeley National Lab Biosciences Area
A project of the US Department of Energy, Office of Science

JGI is a DOE Office of Science User Facility managed by Lawrence Berkeley National Laboratory

© 1997-2023 The Regents of the University of California