Lawrence Berkeley National Lab


The Data Science and Technology (DST) Department - a part of the Computational Research Division (CRD) at Berkeley Lab - delivers leading-edge, innovative methods for solving data-intensive science problems. DST activities range from basic and applied research to deployment of software tools. Our projects span a diverse set of activities, including: data management; data movement; cybersecurity; statistical, topological, and geometric analysis/analytics; computer vision; visualization; user-interface design; usability; end-to-end data-intensive system architecture and deployment. We focus on conceiving, developing, and applying leading-edge, innovative methods for solving data-intensive science problems. Our multidisciplinary teams are engaged on projects in five primary mission areas:
  • Scientific workflows and data analysis algorithms and frameworks
  • Data synthesis, management, movement, and curation of large and complex datasets
  • User-centered design of interfaces and software
  • Exascale data analytics and visualization capabilities
  • Cybersecurity for science and energy
Our collaborators are from across the science disciplines, ranging from theoretical astrophysicists to computational and experimental bioscientists. The capabilities we build are driven by the needs of contemporary computational, observational, and experimental science projects central to the mission of the DOE Office of Science. Our portfolio includes projects in basic and applied research, advanced software development, and deployment to the scientific community. The science challenges we are helping to understand include: understanding carbon interactions between the atmosphere and the biome, interpreting results from trillion-particle space weather simulations, detecting extreme weather events in climate models, locating halo particles in accelerator models, understanding organism function, and detecting blobs in fusion experiments while the data is in transit.

Latest News

Lab Researchers Awarded Funds for Climate Science, Cybersecurity Research

The UC National Laboratory Fees Program targets funding toward strategic areas of research to address key challenges faced by both the state of California and the nation. For 2018, the program invested more than $25 million to seven research teams focused on climate science, cybersecurity, and national security through the social sciences.

Berkeley Lab is a co-recipient of four awards, including one for a cybersecurity project in Berkeley Lab's Data Science and Technology Department — from the University of California National Laboratory Fees Research Program — called, "UC-Lab Center for Electricity Distribution Cybersecurity," which is a partnership between UC Riverside, UC Irvine, UCLA, UC Santa Barbara, Lawrence Livermore, and the Berkeley Lab.

Read more in Today at Berkeley Lab.

Combination of Old and New Yields Novel Power Grid Cybersecurity Tool

An innovative R&D project led by Berkeley Lab researchers that combines cybersecurity, machine learning algorithms and commercially available power system sensor technology to better protect the electric power grid has sparked interest from U.S. utilities, power companies and government officials.

Launched in 2015, the three-year project is now moving into the tech transfer stage, according to project lead Sean Peisert, a computer scientist in Berkeley Lab’s Computational Research Division and a cybersecurity expert. In addition to receiving funding support from the Department of Energy’s Cybersecurity for Energy Delivery Systems (CEDS) program in the Office of Electricity Delivery and Energy Reliability, the team has been working closely with key industry partners, including EnerNex, EPRI, Riverside Public Utilities and Southern Company.

Read more in Today at Berkeley Lab.

Researchers Discuss Challenges of Storing and Retrieving Exascale Data

The DST Scientific Data Management group has been working with NERSC personnel on advancements in HDF5. In particular, many of these advancements are designed to enable scientific data management in the exascale era. In this podcast, Suren Byna and Quincey Koziol discuss prepping HDF5 – one of the most parallel I/O libraries for high-end supercomputing systems – for exascale use.

Read more in Today at Berkeley Lab.

Berkeley Lab Researchers Contribute to Making Blockchains Even More Robust - Hyperledger Iroha project notes that this work heavily inspired their protocol

Blockchain—a technology used for verifying and recording digital transactions—blasted into public consciousness with the rise of Bitcoin. But this tool could also transform the way governments, global industries and even science research operate. In fact, several banks, corporations, governments and scientists have already implemented some form of blockchain to inexpensively, securely and expediently store and share information.

In the last few years, researchers at Lawrence Berkeley National Laboratory (Berkeley Lab), University of California at Davis (UC Davis) and University of Stavanger in Norway have developed a new protocol, called BChain, which makes blockchain even more robust. A paper describing BChain was published in the Proceedings of the 18th International Conference on Principles of Distributed Systems. The researchers are also working with colleagues at Berkeley Lab and beyond to adapt this tool to support applications that are of strategic importance to the Department of Energy’s (DOE) Office of Science.

Read the paper

Read more in the Berkeley Lab Newscenter.

DST's Peisert named Chair of the IEEE Technical Committee on Security and Privacy

DST's Sean Peisert assumed the role as Chair of the IEEE Technical Committee on Security and Privacy (TCSP), on January 1, 2018. The TCSP has more than 2,000 members worldwide and oversees the IEEE Symposium on Security and Privacy, the flagship academic computer security conference with over 600 attendees annually; the IEEE European Symposium on Security and Privacy, the IEEE Computer Security Foundations Symposium, and the IEEE Secure Development Conference. Dr. Peisert's term as chair runs January 1, 2018–December 31, 2019, and follows a two-year term as vice chair and chair-elect. Previously, he was general chair of the 36th IEEE Symposium on Security and Privacy, in May 2015.

Improved Neurodata Sharing Software Released

Neurodata Without Borders is a consortium of researchers and foundations with a shared interest in breaking down obstacles to data use and sharing. The group ultimately aims to standardize neurophysiology data on an international scale to ensure the success of brain research worldwide and accelerate the pace of discovery. It was initiated by the Kavli Institute in mid-2014 in the wake of the Brain Initiative announcement.

The 2.0 software version was developed by Oliver Ruebel (Data Science and Technology Department) and Andrew Tritt(Computer Science Department), in close collaboration with Kristofer Bouchard, also of Berkeley Lab, Loren Frank and Eddie Chang (UCSF), and the broader Neurodata Without Borders (NWB) community. The beta update was announced earlier this year and the team presented a poster of their work at the 2017 Society for Neuroscience meeting in Washington D.C. last month.

Read more at the CS web site.

DST Projects Improve Scientific Workflow Capabilities on HPC Systems

A common staple of scientific work on HPC systems is a workflow (series of steps and programs). These workflows can be complex and achieving efficiency is often ellusive. Lavanya Ramakrishnan and Gonzalo Rodrigo of the Data Science and Technology Department have released new software that allows HPC scheduling systems to automatically address these issues. The software is the result of a two-year collaboration between staff in the lab’s Data Science and Technology Department. and the Distributed Systems Group at Umeå University in Sweden.

Read more at the CRD web site.

Ushizima recognized for outreach with lab director's award

Diversity and Outreach have been a passion for Dani Ushizima of the DST Department. She has been involved in a broad range of activities including Black Girls Code, Tech Women, Grace Hopper Conference, and many more. She was recognized with the Directors Outreach award “For her selfless and tireless efforts as an exemplary ambassador of science and goodwill, engaging new and emerging scientists around the globe, and sharing knowledge that improves others’ lives.”

Read more at the LBL Director's Awards web site.

ESnet’s Science DMZ Design Could Help Transfer, Protect Medical Research Data

Like other sciences, medical research is generating increasingly large datasets as doctors track health trends, the spread of diseases, genetic causes of illness and the like. Effectively using this data for efforts ranging from stopping the spread of deadly viruses to creating precision medicine treatments for individuals will be greatly accelerated by the secure sharing of the data, while also protecting individual privacy.

In a paper published Friday, Oct. 6 by the Journal of the American Medical Informatics Association, a group of researchers led by Sean Peisert of the Department of Energy’s (DOE) Lawrence Berkeley National Laboratory (Berkeley Lab) wrote that the Science DMZ architecture developed for moving large data sets quick and securely could be adapted to meet the needs of the medical research community.

Read the paper

Read more in Today at Berkeley Lab.

DOE 40th Anniversary Milestone: Berkeley Lab's FastBit

As part of its 40th anniversary celebration DOE highlighted DST's FastBit technology developed in the Scientific Data Management group. The 40 Years of Research Milestones included FastBit and cited John Wu's paper from 2005.

Read more in the Berkeley Lab Today.

Berkeley Lab Aims to Strengthen the Cybersecurity of the Grid

As part of the Department of Energy's (DOE's) commitment to building cyber-resilient energy delivery systems, a new project led by Lawrence Berkeley National Laboratory (Berkeley Lab) will develop tools to detect and counter certain types of cyber attacks on the grid. The project has been awarded up to $2.5 million in funding over three years by DOE, one of 20 projects for cybersecurity on the grid announced recently.

Read more in the Berkeley Lab Newscenter.

DST's Peisert Discusses Challenges and Opportunities of Securing HPC

How is computer security different in a high-performance computing (HPC) context from a typical IT context? ... This article focuses on four key themes surrounding this issue.

HPC security article in Communications of the ACM.

Video accompanying HPC security article on Vimeo

DST has Three Papers on First Day at ACM HPDC 2017

Three DST members Bin Dong, Devarshi Goshal, and Gonzalo Rodrigo presented their work on scientific data processing, workflow management and scheduling at the ACM International Symposium on High-Performance Parallel and Distributed Computing (HPDC) in Washington D.C.. on June 28 2017.

The ACM HPDC is the premier annual conference for presenting the latest research on the design, implementation, evaluation, and the use of parallel and distributed systems for high-end computing. This was a competitive year, with a paper acceptance rate of 19%.

Follow the links to download the papers:

Dong, B., Wu, K., Byna, S., Liu, J., Zhao, W. and Rusu, F., 2017. ArrayUDF: User-Defined Scientific Data Analysis on Arrays.

Ghoshal, D. and Ramakrishnan, L., 2017, June. MaDaTS: Managing Data on Tiered Storage for Scientific Workflows.

Rodrigo, G.P., Elmroth, E., Östberg, P.O. and Ramakrishnan, L., 2017, June. Enabling Workflow-Aware Scheduling on HPC Systems.

DST’s Weber Co-Authors EuroVis 2017 Best Paper

Gunther Weber of the Data Science and Technology Department (DST) was among the authors of “Nested Tracking Graphs,” which won the Best Paper award at EuroVis 2017. EuroVis is an annual international visualization symposium which was held June 12 - 16 in Barcelona, Spain this year.

Read the paper: Nested Tracking Graphs EuroVis 2017 Paper

FLUXNET2015 Dataset Highlighted in EOS

FLUXNET2015 — a new data set to keep a sharper eye on land-air exchanges. The latest update of the longest global record of ecosystem carbon, water, and energy fluxes, features improved data quality, new data products, and more open data sharing policies. DST's own Gilberto Pastorello was the lead author on the article.

Follow the link to read the rest: EOS FLUXNET2015 Article

Supercharging the computers that will save the world

Data Science and Technology postdoc Gonzalo Rodrigo while at Umeå University in Sweden developed new techniques and tools to manage high performance computing systems more efficiently. This in an effort to comply with the increasing demand to handle large amounts of data within research and allowing for advance simulations.

Follow the link to read the rest:

Lab Scientists Visit Kenya With International TechWomen Delegation

In February Lab scientists Daniela Ushizima, of the DST Department, and Teresa Williams took their first trip to Africa as part of a delegation organized by TechWomen, a unique mentoring and exchange program funded by the U.S. Department of State and administered by the Institute of International Education. The trip was eye opening and hugely inspirational for the women, both personally and professionally.

Follow the link to read the rest: TaBL Article

Mind the gap: Speaking like a cybersecurity pro

"The Open Science Cyber Risk Profile is a bridge between the language of the domain scientist and the language of the information security professional."

Follow the link to read the rest: ScienceNode news story

FLUXNET2015 Dataset: New and Last Update Released

The Fluxdata Team (including Gilberto Pastorello, You-Wei Cheah, Megha Sandesh, and Deb Agarwal from DST) has released the final update of the FLUXNET2015 dataset. To learn more about the dataset, visit

Follow the link to read the rest: FLUXNET2015 news story

The Value of Failed Experiments

"The 'Learning from Authoritative Security Experiment Results (LASER)' workshop series was established in 2012 with the purpose of publishing results for 'properly conducted experimental (cyber) security research, including both successful as well as unsuccessful experiments.' [This article] discusses the importance of failed experiments and evidence-based approaches in cybersecurity.'"

Follow the link to read the rest: IEEE Cybersecurity Initiative news story

Working Group on Open Science Cybersecurity Risks Releases First Document Draft for Public Comment

Over the past several months, ESnet and the NSF Cybersecurity Center of Excellence collaborated with research and education community leaders to develop a risk profile for open science to formally capture and benchmark this expertise, allowing other organizations to apply these best practices more broadly.

Today, the group is releasing its draft Open Science Cyber Risk Profile (OSCRP) and inviting comment from the research community. The OSCRP is designed to help principal investigators and their supporting information technology professionals assess cybersecurity risks related to open science projects.

Follow the link to read the rest: ESnet news story

DST's Sean Peisert to lead project developing new data analysis methods for power grid

The project jointly led by LBNL and LLNL, Threat Detection and Response with Data Analytics, is part of a $220 million, three-year Grid Modernization Initiative launched in January 2016 by the Department of Energy to support research and development in power grid modernization. The goal of this project is to develop technologies and methodologies to protect the grid from advanced cyber and threats through the collection of data from a range of sources and then use advanced analytics to identify threats and how best to respond to them. Specifically, the project team hopes to be able to distinguish between power grid failures caused by cyber attacks and failures caused by other means, including natural disasters, normal equipment failures and even physical attacks.

Follow the link to read the rest: CRD news story

DST's Deb Agarwal profiled in honor of Lesbian, Gay, Bisexual, and Transgender Pride Month in June

When Deb Agarwal [the head of the DST department] first joined Berkeley Lab 22 years ago, she loved seeing the rainbow flag fly every June. But a number of years back, she noticed that it hadn't flown for a couple of years. No one seemed to think it was a big deal, but Agarwal felt otherwise, so she took it upon herself to make sure it was up every June....

Follow the link to read the rest: Profile

DST's Oliver Ruebel developer on Berkeley Lab's OpenMSI, which has been licensed to ImaBiotech

Two years ago, Lawrence Berkeley National Laboratory researchers developed OpenMSI - the most advanced computational tool for analyzing and visualizing mass spectrometry imaging (MSI) data. Last year, this web-available tool was selected as one of the 100 most technologically significant new products of the year by R&D Magazine. Now, OpenMSI has been licensed to support ImaBiotech's Multimaging technology in the field of pharmaceutical and cosmetic research and development. The Multimaging platform essentially allows researchers to combine and overlay different image files that have been acquired from different imaging techniques - like qualitative MALDI imaging, staining and immune staining—to increase confidence in data sets.

With cutting-edge MSI technology, scientists can study tissues, cell cultures and bacterial colonies in unprecedented detail at the molecular level. This information can lead to the discovery of new drug targets, diagnostic tests and more effective drugs. Beyond healthcare, MSI can be applied to industrial biotechnology, plant agriculture, veterinary medicine, forensic investigation, environmental toxicology, combatting terrorism, even exploring the universe. However as MSI datasets have grown from gigabytes to terabytes, basic tasks like opening a file or plotting spectra and ion images became insurmountable challenges for the average scientist.

To help researchers overcome these challenges, two Berkeley Lab researchers - Oliver Ruebel of the Computational Research Division (CRD) and Ben Bowen of the Environmental Genomics and Systems Biology (EGSB) Division with support from the National Energy Research Scientific Computing Center (NERSC), conceptualized and developed OpenMSI. This work was part of a larger effort at Berkeley Lab to extend advanced computational techniques to science areas (and scientists) that haven’t benefited from them in the past. The tool, which makes highly optimized computing technologies available to researchers via a user-friendly interface, was born from the Lab's Integrated Bio-imaging Initiative, and initially developed with funds from NERSC and the Laboratory Directed Research and Development (LDRD) Program at Berkeley Lab. NERSC is a DOE Office of Science User Facility.

Because OpenMSI leverages NERSC's resources to process, analyze, store, and serve massive MSI datasets, users can work on their data at full-resolution and in real-time without any special hardware or software. They can also access their data on any device with an Internet connection.

"OpenMSI has really been a grassroots effort. We always believed that OpenMSI would be a transformational technology, so we worked with Berkeley Lab's Innovation and Partnerships Office early on to protect the Lab's intellectual property," says Ruebel.

"This licensing agreement is certainly a great achievement towards achieving our vision of transforming mass spectrometry imaging research and applications through computing, but we still have a ways to go to fulfill our vision and to fully develop OpenMSI and achieve broad adoption," adds Bowen.

ImaBiotech is a contract research organization that offers services in mass spectrometry imaging. Headquartered in Lille, France, the company also develops and implements new imaging technologies.

Open Positions in DST

DST has a a number of open positions right now - Scientific Data Management Postdoctoral Researcher

The Scientific Data Management Research Group has an immediate opening for a post-doctoral researcher to analyze storage systems and parallel I/O performance and to develop novel object-based storage technologies for upcoming exascale era. Apply here

Usable Software Systems Group - User Research Postdoctoral Researcher

The Usable Software Systems Groups is looking for a postdoc in user research with experience in ethnography, user studies, user analytics. Apply here

Computer Security and Systems Data Analysis Postdoctoral Researcher

Looking for a post-doctoral researcher to perform data engineering and analysis of security and systems-behavior data, including use of machine learning and/or graph-theoretic approaches, in multiple domains. The position will analyze systems behavior in scientific computing environments, as well as security-related issues in cyber-physical system environments. Apply here

Data Analysis and Visualization Open Positions

Openings for a research scientist, a CSE and a postdoc with expertise on scientific imaging, computer vision and machine learning algorithm development to perform pattern recognition applied to problems in material sciences, such as characterization of new composites and films for microelectronics.

Apply for Research scientist

Apply for CSE

Apply for Postdoc

Dani Ushizima Participated in Black Girls CODE Robot Expo

Last month, Dani Ushizima from the DST department (left) and Laleh Cote (Workforce Development & Education) joined forces with Black Girls CODE to support 214 girls of color (ages 7-17) at the Robot Expo. The girls participated in hands-on activities on robotics, heard from from STEM professionals, and learned about applications and uses for robots.

ESnet, CENIC Announce Joint Cybersecurity Initiative; DST's Sean Peisert to Direct

ESnet and the Corporation for Education Network Initiatives in California (CENIC) recently announced a partnership in developing cybersecurity strategy and research. CENIC is a nonprofit organization that operates the California Research & Education Network (CalREN), a high-capacity network with over 20 million users. Sean Peisert of the Computational Research Division will be director of the new CENIC/ESnet Joint Cybersecurity Initiative. Peisert, who was also recently named as the chief cybersecurity strategist for CENIC, has worked extensively in computer security research and development. He will continue his work at Berkeley Lab and as an adjunct faculty member of the University of California at Davis.

FLUXNET2015 Global Carbon Flux Dataset Released

Today, eddy covariance measurements of carbon dioxide and water vapor exchange are being made routinely on all continents. The flux measurement sites are linked across a confederation of regional networks in North, Central and South America, Europe, Asia, Africa, and Australia, in a global network, called FLUXNET. This global network includes more than eight hundred active and historic flux measurement sites, dispersed across most of the world’s climate space and representative biomes. the FLUXNET-Fluxdata website (, hosted at the Lawrence Berkeley National Laboratory (USA). Here the data that have been shared by the Regional Networks and processed and harmonized to share with the FLUXNET communities. Fluxdata website offers a number of tools in addition to the data access such communication and ideas sharing platforms, documentation, and support to the FLUXNET data users. The FLUXNET2015 dataset is the first new global FLUXNET dataset since the LaThuile dataset in 2007. The team involved in preparing the data are spread across the towers and regional networks that contributed data as well as UC Berkeley (Housen Chu and Dennis Baldocchi), University of Tuscia (Dario Papale and Carlo Trotta), University of Virginia (Marty Humphrey and Norm Beekwilder), and Berkeley Lab. The DST personnel on the team are Gilberto Pastorello (data processing and preparation), Megha Sandesh (FLUXNET data portal), You-Wei Cheah (metadata and data preparation), and Deb Agarwal (data lead). Image credit - Housen Chu, UC Berkeley.

OpenMSI wins R & D 100 Award

OpenMSI is the most advanced tool for analyzing and visualizing mass spectrometry instruments (MSI) data that is available via web-browser. MSI technology enables scientists to study tissues, cell cultures, and bacterial colonies in unprecedented detail at the molecular level. Nowadays, MSI datasets range from tens of gigabytes to several terabytes. Thus, basic tasks like opening a file or plotting spectra and ion images become insurmountable challenges. OpenMSI overcomes these obstacles by making highly optimized computing technologies available via a user-friendly interface. Because OpenMSI leverages NERSC resources to process, analyze, store, and serve massive MSI datasets, users can now work on their data at full-resolution and in real-time without any special hardware or software. They can also access their data on any device with an internet connection. Ben Bowen of the Environmental Genomics and Systems Biology Division and Oliver Ruebel of the Computational Research Division led the development of the technology. Several other DST and NERSC personnel were involved in the development of this technology.

Sean Peisert Chairs Second ASCR Cybersecurity Workshop and Edits Subsequent Report

Sean Peisert chaired a second ASCR-sponsored workshop on the subject of cybersecurity research for scientific computing integrity in June 2015. The goal of this workshop was to define a long-term 10 to 20 year fundamental basic research and development strategy and roadmap regarding scientific computing integrity facing future high performance computing (HPC) and scientific user facilitates. This report builds on the findings of a previous ASCR Cybersecurity workshop, to examine computer security research gaps and approaches for assuring scientific computing integrity specific to the mission of the DOE Office of Science. Subsequently, Peisert also compiled and edited the resulting workshop report.

Shreyas Cholia: Systems Engineer by Day, KALX DJ by Night

Shreyas Cholia is not just another software engineer. If you've tuned into KALX lately, UC Berkeley's radio station, you may just have been enjoying the DJ sensibilities of DST's own Shreyas Cholia, a computational systems engineer who works jointly for CRD and NERSC. Cholia started as a volunteer at KALX in 2003, a year after joining the Lab, looking for a way to channel his love of music into an interesting extracurricular activity. Twelve years later, he's hosting his own KALX show every other Tuesday night. Read more in the recent article in Today at Berkeley Lab.

Dani Ushizima Receives DOE Early Career Research Award

Dani Ushizima of the Data Science and Technology Department has received a 2015 Early Career Research Program award from the Department of Energy's Office of Science. The award will fund research into developing new methods to help scientists extract more information from digital images produced by experiments studying materials such as ceramics and geological samples at the Department of Energy (DOE) facilities. The work is important as facilities are deploying instruments that can produce digital images at much greater resolution and much more frequently than just a few years ago. Images are being generated so quickly that scientists are struggling to keep up and extract information contained in this data modality.. . Read more in the recent article on The Computational Research Division website.

Sean Peisert Chairs IEEE Symposium on Security and Privacy

Sean Peisert is serving as general chair of the 36th IEEE Symposium on Security and Privacy, May 18–20, 2015 in San Jose, California. Since 1980, the IEEE Symposium on Security and Privacy has been the premier forum for presenting developments in computer security and electronic privacy, and for bringing together researchers and practitioners in the field. This year's program committee has selected 55 research papers covering a wide range of topics. An estimated 500 attendees from around the world are expected. As in past years, there will be a poster session, a short talks session, and several workshops that will take place alongside the symposium, including workshops on privacy engineering, genomic security and privacy, language theoretic security, mobile security, and Web 2.0 security and privacy. Also at the symposium is a NITRD panel, featuring panelists from NSF, DHS S&T and other government agencies involved in creating the 2015 Federal Cybersecurity R&D Strategic Plan, as well as several "Birds of a Feather" sessions including discussions on network integrity, the Federal Cybersecurity plan and privacy in affective computing.

Sean Peisert Chairs ASCR Cybersecurity Workshop and Edits Report

Sean Peisert chaired an ASCR-sponsored workshop on the subject of cybersecurity research for scientific computing integrity, a key interest of the DOE Office of Science, ASCR in particular. Subsequently, He also compiled and edited the resulting workshop report.

IPython Featured in Nature News

IPython was recently featured in Nature News. The IPython team is led by Fernando Perez, who joined DST earlier this month. IPython notebook makes data analysis easier to record, understand and reproduce. The article is available here and a live, interactive demo is available here

Best Paper Award at the IEEE Visualization Large Data Analysis and Visualization Symposium

Alexy Agronovsky of UCD was the lead author on the paper "Improved Post Hoc Flow Analysis Via Lagrangian Representations" which won Best Paper Award at the IEEE Visualization Large Data Analysis and Visualization Symposium. The basic idea is that flow field analysis can be done more accurately using a Lagrangian basis rather than an Eulerian basis, and that the work needed to produce the Lagrangian analysis can be done in situ, which results in not only better (more accurate) analysis but also at much less I/O cost. Hank Childs of DST led the team. Additional contributors to the paper are David Camp, Christoph Garth, E. Wes Bethel, and Kenneth I. Joy.

More information about the symposium can be found here.

Agarwal Named as Inria International Chair

The Inria Research Center in Rennes, France has awarded Deb Agarwal an International Chair position. This position is a part of the DALHIS Associated Team which is a collaboration between Dr. Christine Morin’s Inria Myriads team and the Data Science and Technology Department.

CRD Reorganization creates Data Science and Technology Department

The Data Science and Technology Department was announced today. This department brings together groups working across the span of data science problems. The new department is made up of the iintegrated Data Frameworks group led by Dan Gunter, the Scientific Data Management group led by John Wu, the Data Analytics and Visualization group led by Wes Bethel, the Usable Software systems group led by Lavanya Ramakrishnan. These groups have a long history of research and development in data science. This reorganization better aligns the groups to work together to address problems holistically. The Computational Science Department, formed at the same time, is composed of the groups focused more on a particular science and includes Craig Tull's Science Software Systems group. More details about the reorganization can be found here.

Inspiring Women in Computing

Women from Berkeley Lab's Computing Sciences area and DST delivered talks, volunteered as mentors and helped organize and energize this year's Grace Hopper Celebration of Women in Computing. More details available here.

SPOT Suite noted in NPR's Science Friday

NPR's Science Friday notes NERSC, ESnet, CRD, SLAC collaboration that uses the SPOT Suite developed by DST researchers. This was based on observations of interesting science that was submitted by listeners. More details available here.

Craig Tull Leading Multi-Disciplinary Team Enabling the SPOT Suite Transformation at ALS Beamlines

Earlier this year, the ALS became the first and only facility worldwide to fully automate GISAXS/GIWAXS measurements. This tool is primarily used to characterize the assembly and shape of nanoscopic objects at surfaces or buried interfaces in thin films—including materials like organic photovoltaics, fuel cell membranes or batteries. Combine this capability with SPOT Suite, and researchers can run experiments at this beamline from anywhere in the world, provided they have Internet access. Users can mount their samples onto barcoded sample holders at home and ship them to the ALS. At the facility, a robot arm transfers each new sample to the measurement stage, where it is automatically aligned into grazing incidence using the X-ray beam. A barcode reader informs the computer system which sample is mounted and how to run the sample. Data acquisition software then moves the sample to all angles pre-specified by the researcher and chooses the appropriate exposure time automatically for each image. As images are collected, SPOT Suite sends the data to NERSC via ESnet for scientists to access and view any time. “This automated system represents a significant leap forward in terms of labor saving, ease of use and throughput,” says Alexander Hexemer, who manages the GISAXS/GIWAXS beamline at the ALS. Read more

Daniela Ushizima, Deb Agarwal, and Wes Bethel Named to the Berkeley Institute for Data Science

The Berkeley Institute for Data Science has introduced its senior fellows, including Lab researchers Deborah Agarwal, E. Wes Bethel, Peter Nugent, Saul Perlmutter, David Schlegel, James Sethian, Kimmen Sjolander, Kyle Barbary, Beth Reid, and David Culler. The funded science fellows were also named with Daniela Ushizima receiving the only award to an LBL researcher (congratulations Dani!). Go here to view the complete list.

Berkeley Lab Hosts Week long Discovery Workshop covering Big Data analytics

Today, the tools available to the scientific community are undergoing a major revolution with a wide range of innovations that are enabling powerful new capabilities for knowledge discovery and analytics. The majority of these innovations are being motivated by major large scale science research initiatives. The foundation for these innovations consists of multiple new information technology architectures, tools, techniques and platforms. Berkeley Lab's Computational Research Division (CRD) and Univ. of California's AMPLab hosted a weeklong workshop on big data analytics from June 2-6.

This year, the workshop covered a wide range of topics including machine learning, graph processing, data security, tools for big data analytics. "The workshop was very successful and allowed the participants to both understand the general landscape but also dive-in deep with hands-on tutorials. The key to success of the workshop was the expertise at Berkeley Lab in these areas," said organizer Lavanya Ramakrishnan of CRD's Advanced Computing for Science Department.

In addition to Berkeley Lab and UC Berkeley, the speakers were from Cloudera, Apple, Cisco, Yahoo!, UC Davis, Nebula Inc, Microsoft, Google, HP Labs, Adatao, Databricks, Hortonworks and Amazon.

Eugen Feller Completes Inria Postdoc Visit

Eugen Feller has spent the last year visiting LBNL as an Inria@SiliconValley Post-doc as part of the DST Department/Inria Associated Team DALHIS. During his time at LBNL Eugen contributed to several research projects including Frieda and AmeriFlux. To read more about Eugen's experiences, see the interview he did once back at Inria.

Taghrid Samak Highlighted in Scientific Computing

Taghrid Samak of Berkeley Lab's Computational Research Division admits with a laugh that she wasn't one of those kids who started programming on the home computer at age 10. And if she hadn't followed her father's advice, she might have ended up looking for political solutions to pressing problems, rather than working on computational approaches to scientific challenges. Read more.

DST Intern Amy Nesky Presents Poster at the SULI Poster Session

DST intern Amy Nesky presented a poster on the work she did for the Baryon Oscillation Spectroscopic Survery (BOSS) at the Fall SULI poster session. Amy's work involved designing and developing an interactive, visual analytics website to help track and analyze the progress of the survey. See the poster for more details.

DST Team Helping Usher in a New Era of Light Source Computational Science

DST's Craig Tull was recently featured in an article for DEIXIS Magazine. The project is an LDRD involving CRD, NERSC, ALS, and ESnet personnel. DST personnel involved in the project include Craig Tull (project lead), Abdelilah Essiari, and Lavanya Ramakrishnan.

DST Team Helping Materials Science

LBNL's Kristin Persson recently co-authored an article for Scientific American about the Materials Project. The project here at LBNL involves personnel from many divisions across the lab. DST personnel involved in the project include Dan Gunter and Miriam Brafman.

TechWomen Participants visit LBNL

On October 18, participants and mentors from the TechWomen program visited LBNL for a tour of its facilities, including the Advanced Light Source. After the tour, DST department head Deb Agarwal gave a presentation on how to be an exceptional leader. The visit was organized by DST's Taghrid Samak.

Craig Tull and Team Reimagining ALS Data Environment with SPOT Suite

DEIXIS Magazine Annual 2013 featured Craig Tull, DST, Dula Parkinson, ALS, Jack Deslippe, NERSC, and others in an article about the growing flow of data from light sources. The team is working to move beamline data in real time via ESnet to some of the nation's most powerful open-science computers at NERSC, where it is processed, analyzed and visualized on the fly. Tull and team are working with the Advanced Light Source (ALS) at the Lab, but it can be extended to work with other light sources. "We're trying to move the typical data-intensive beamline into a world where they can take advantage of leadership-class, high-performance computing abilities," says Tull, who leads the project. "In the final analysis what we're trying to do is drive a quantum leap in science productivity. Read more

Deb Agarwal Among Lab Women Honored for Contributions to Science, Education

Deborah Agarwal, head of CRD's Advanced Computing for Science Department, was among 15 women honored October 18 during the first annual Women@The Lab event. Sponsored by the lab's Diversity and Inclusion Office and the Women Scientists and Engineers Council, the event highlighted the women's contributions to science and technology as well as the lab's commitment to diversity and its support for the Science, Technology, Engineering and Mathematics (STEM) workforce.

DST members participated in the LBNL 2013 Runaround

DST Summer Students contributing on projects

As the summer starts to wind toward a new school year, we want to acknowledge the excellent work of our summer students. Here is a list of this year's summer's students and a brief title for what they worked on while they were here.

  • Tonglin Li, from Illinois Institute of Technology, Chicago. FRIEDA state management in cloud environments.
  • Zhao Zhang, University of Chicago. Next-generation infrastructure support for mixed workloads.
  • Morgan Hargrove, Louisiana State University - Materials Project workflow interface.
  • Ryan Rodriguez, University of California Santa Cruz. Tigres visual representation of workflows.
  • Ahmed el Hassany, Indiana University. Interoperability between ESnet lookup service and IU's lookup/topology service (UNIS) to avoid fragmentation of perfSONAR landscape going forward (Joint with Esnet).
  • Karlyn Harrod, University of St. Thomas. Energy consumption models for distributed systems.
  • Jin Huang, University of Texas at Arlington. Machine learning for modeling network utilization.

Sarah Poon Organizes Talks and Tour for East Bay Consortium High School Students

Sarah Poon of DST along with Boun Khamnouane of the East Bay Consortium of Educational Institutions organized a visit of about 50 high school students from the East Bay to learn about careers in science, technology, engineering and mathematics. Read more

Taghrid Samak Works to Impact Social Development in Egypt

Since the Egyptian uprising that ultimately toppled the 30-year reign of Hosni Mubarak began on Jan. 25, 2011, Taghrid Samak of Berkeley Lab’s Computational Research Division has watched as the initial hope for her homeland has unraveled into a “messy” situation, as she puts it. But last month, Samak was at MIT, meeting with other Egyptian professionals to take concrete steps to address at least some of the pressing issues in the country that launched the Arab Spring. She chaired the 2013 EgyptNEGMA (Networking, Entrepreneurship, Growth, Mobilization, and Action) conference to review 10 finalist proposals for advancing social development in Egypt and choosing the top three. Read more

DST Team Contributes to Developing Tools to Reduce Greenhouse Gases at the Source

Despite advances in alternative energy sources, the United States will continue to rely on coal-fired power plants to generate much of the nation's electricity for the next 20 years or more. While coal is an economically viable fuel, its environmental cost is high-in 2011, coal accounted for 34 percent of the energy-related carbon dioxide (CO2) emissions in the United States. This is why a U.S. Department of Energy project, called the Carbon Capture Simulation Initiative (CCSI), is bringing together America's national laboratories, industry and academic institutions, to develop and deploy state-of-the-art computational modeling and simulation tools to accelerate the commercialization of carbon capture technologies in power plants. As part of this collaboration, computational researchers at Lawrence Berkeley National Laboratory (Berkeley Lab) are playing key roles in the development of the computational tools. on its industry advisory board. Read more

In the context of CCSI, Joshua Boverhof of CRD's Advanced Computing for Science Department developed the Turbine Science Gateway (TSG), a code for running the AspenTech process simulation applications in parallel on cloud computing systems, clusters, or on standalone machines. He recently won honorable mention for TSG in a competition sponsored by Amazon. Read more

view archived news